2024-11-10 20:03:00 INFO juju unit_agent.go:289 Starting unit workers for "containerd/0" 2024-11-10 20:03:00 INFO juju.worker.apicaller connect.go:163 [030efc] "unit-containerd-0" successfully connected to "10.0.0.27:17070" 2024-11-10 20:03:00 INFO juju.worker.apicaller connect.go:260 [030efc] password changed for "unit-containerd-0" 2024-11-10 20:03:00 INFO juju.worker.apicaller connect.go:163 [030efc] "unit-containerd-0" successfully connected to "10.0.0.27:17070" 2024-11-10 20:03:01 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-11-10 20:03:01 INFO juju.worker.logger logger.go:120 logger worker started 2024-11-10 20:03:01 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-11-10 20:03:01.01753911 +0000 UTC 2024-11-10 20:03:01 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-11-10 20:03:01.025394763 +0000 UTC 2024-11-10 20:03:01 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-11-10 20:03:01 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-11-10 20:03:01 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.27:17070 252.27.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-11-10 20:03:01 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-11-10 20:03:01.031737854 +0000 UTC 2024-11-10 20:03:01 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-11-10 20:03:01 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-11-10 20:03:01 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-containerd-0/run.socket } 2024-11-10 20:03:01 INFO juju.worker.uniter uniter.go:335 unit "containerd/0" started 2024-11-10 20:03:01 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-11-10 20:03:01 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-11-10 20:03:01 DEBUG juju.worker.uniter.operation executor.go:85 running operation install cs:~containers/containerd-146 for containerd/0 2024-11-10 20:03:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install cs:~containers/containerd-146" for containerd/0 2024-11-10 20:03:01 INFO juju.worker.uniter.charm bundles.go:81 downloading cs:~containers/containerd-146 from API server 2024-11-10 20:03:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install cs:~containers/containerd-146" for containerd/0 2024-11-10 20:03:01 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "cs:~containers/containerd-146" 2024-11-10 20:03:01 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "cs:~containers/containerd-146" 2024-11-10 20:03:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-11-10 20:03:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:03:01 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2024-11-10 20:03:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:03:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-11-10 20:03:01 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "cs:~containers/containerd-146" 2024-11-10 20:03:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install cs:~containers/containerd-146" for containerd/0 2024-11-10 20:03:02 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for containerd/0: ok=true 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for containerd/0: [] ok=true 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for containerd/0 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for containerd/0: ok=true 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for containerd/0: ok=true, hashes=[b37fd87fc50fe3559fb75340eda764704a239898380d4ccf6bd560e2cae9d72c] 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for containerd/0 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for containerd/0: ok=true, hashes=[038f12e9a041abf4c5c6210614ad1d900bde866e4b926a377bb2cb30237b52d4] 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for containerd/0: ok=true, hashes=[cf69cceac072fc1a45838fd7d472afdd6752342bc620f8a8e4373fd6ee414642] 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for containerd/0: [] ok=true 2024-11-10 20:03:02 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for containerd/0: ok=true 2024-11-10 20:03:02 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-11-10 20:03:02 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-11-10 20:03:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for containerd/0 2024-11-10 20:03:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run install hook) 2024-11-10 20:03:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run install hook) 2024-11-10 20:03:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for containerd/0 2024-11-10 20:03:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for containerd/0 2024-11-10 20:03:04 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-11-10 20:03:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 Reading package lists... 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 Building dependency tree... 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 Reading state information... 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 python3-dev is already the newest version (3.8.2-0ubuntu2). 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.1). 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 python3-pip is already the newest version (20.0.2-5ubuntu1.10). 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 python3-wheel is already the newest version (0.34.2-1ubuntu0.1). 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 build-essential is already the newest version (12.8ubuntu1.1). 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-10 20:03:04 DEBUG unit.containerd/0.install logger.go:60 Reading package lists... 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 Building dependency tree... 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 Reading state information... 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 Reading package lists... 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 Building dependency tree... 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 Reading state information... 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 virtualenv is already the newest version (20.0.17-1ubuntu0.4). 2024-11-10 20:03:05 DEBUG unit.containerd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-10 20:03:06 DEBUG unit.containerd/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 89ms 2024-11-10 20:03:06 DEBUG unit.containerd/0.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-containerd-0/.venv, clear=False, global=False) 2024-11-10 20:03:06 DEBUG unit.containerd/0.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2024-11-10 20:03:06 DEBUG unit.containerd/0.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2024-11-10 20:03:08 DEBUG unit.containerd/0.install logger.go:60 Looking in links: wheelhouse 2024-11-10 20:03:08 DEBUG unit.containerd/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-containerd-0/.venv/lib/python3.8/site-packages (20.0.2) 2024-11-10 20:03:09 DEBUG unit.containerd/0.install logger.go:60 Looking in links: wheelhouse 2024-11-10 20:03:09 DEBUG unit.containerd/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-containerd-0/.venv/lib/python3.8/site-packages (44.0.0) 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Looking in links: wheelhouse 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Building wheels for collected packages: setuptools-scm 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=06d277d9c4abf76fd5ef085e7583cc541c1bafa4c8ae0a49b3594355192bab00 2024-11-10 20:03:10 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/f2/9b/2f/2a2777292d81d492690a1341e5ba167216acbaea3793ca82c3 2024-11-10 20:03:11 DEBUG unit.containerd/0.install logger.go:60 Successfully built setuptools-scm 2024-11-10 20:03:11 DEBUG unit.containerd/0.install logger.go:60 Installing collected packages: setuptools-scm 2024-11-10 20:03:11 DEBUG unit.containerd/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2024-11-10 20:03:12 DEBUG unit.containerd/0.install logger.go:60 Looking in links: wheelhouse 2024-11-10 20:03:12 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.4.1.tar.gz 2024-11-10 20:03:12 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/certifi-2021.5.30.tar.gz 2024-11-10 20:03:12 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/requests-2.26.0.tar.gz 2024-11-10 20:03:13 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/pbr-5.6.0.tar.gz 2024-11-10 20:03:13 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/charset-normalizer-2.0.3.tar.gz 2024-11-10 20:03:13 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/Jinja2-2.10.1.tar.gz 2024-11-10 20:03:14 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2024-11-10 20:03:14 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/pyaml-20.4.0.tar.gz 2024-11-10 20:03:14 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2024-11-10 20:03:14 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-0.20.22.tar.gz 2024-11-10 20:03:17 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2024-11-10 20:03:17 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/urllib3-1.26.6.tar.gz 2024-11-10 20:03:17 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/Tempita-0.5.2.tar.gz 2024-11-10 20:03:18 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-1.1.1.tar.gz 2024-11-10 20:03:18 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/idna-3.2.tar.gz 2024-11-10 20:03:18 DEBUG unit.containerd/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.2.tar.gz 2024-11-10 20:03:18 DEBUG unit.containerd/0.install logger.go:60 Building wheels for collected packages: charms.reactive, certifi, requests, pbr, charset-normalizer, Jinja2, netaddr, pyaml, six, charmhelpers, wheel, urllib3, Tempita, MarkupSafe, idna, PyYAML 2024-11-10 20:03:18 DEBUG unit.containerd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.4.1-py3-none-any.whl size=43697 sha256=70eea600c66a54fb3f443eeefd431020db8879c5415c991a2004368ee7f0d93c 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/46/be/7f/513413018f53da78dd8b9c16d7825993dc0e130ddfef6c582c 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for certifi (setup.py): started 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for certifi (setup.py): finished with status 'done' 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Created wheel for certifi: filename=certifi-2021.5.30-py2.py3-none-any.whl size=145531 sha256=456c45004a6c764a5b3f6a1e4a5cfc249e5caa5189751e5a4e7abeb9a762db6a 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/8b/2a/aa/7a0a4d105725c596a84492beb8136ecf38df7f86c2f494114d 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for requests (setup.py): started 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for requests (setup.py): finished with status 'done' 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Created wheel for requests: filename=requests-2.26.0-py2.py3-none-any.whl size=62251 sha256=ccf289dff9162fbdba91402ab8e31c1390d680996d7c56e71707483660a6a118 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/36/46/85/fe7c2de7a2eb6ee187e308d55561949163851a593da85e2e66 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for pbr (setup.py): started 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Created wheel for pbr: filename=pbr-5.6.0-py2.py3-none-any.whl size=111309 sha256=55b808a90d606d7663f2396e7096fbd0ed99da0d1ce0513b0c1ebb5859a83802 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/81/aa/ad/5235171dcee4f3752fc3b9602a4d019177dcf3c1caa0343bb1 2024-11-10 20:03:19 DEBUG unit.containerd/0.install logger.go:60 Building wheel for charset-normalizer (setup.py): started 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Building wheel for charset-normalizer (setup.py): finished with status 'done' 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Created wheel for charset-normalizer: filename=charset_normalizer-2.0.3-py3-none-any.whl size=35859 sha256=045fe7bdca941c468d5b0b82a080ebfa68c1dc65ab5385f42fa7ac3f95158983 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/8f/5e/81/f06aab5561eba767a0018c53a235dc92d145b898fa86e4f2f0 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-2.10.1-py2.py3-none-any.whl size=124884 sha256=349ac145f0583f49224058f7c7a398de250bf16a7a92e2086783f043008573c5 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/78/64/91/eb44727a06809ab64b0d4ba9a558b3ac183dd0824ef1050a11 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Building wheel for netaddr (setup.py): started 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=e2376ba3570d310f3a9b43bcdd5a512c0a3580da91dc29589a7b6ce9426d65e3 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/5c/cb/3c/2d9d5d7edd338160f55d5e82634b0636dd6f79d3d60a97a761 2024-11-10 20:03:20 DEBUG unit.containerd/0.install logger.go:60 Building wheel for pyaml (setup.py): started 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Created wheel for pyaml: filename=pyaml-20.4.0-py2.py3-none-any.whl size=17405 sha256=88ade68f3989a04efbe30769b314a10370ee71728202bed6433c32e41768e4d6 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/b4/ac/a7/7409d675873640d1cd584e9c9074db9d86890dbc751674291f 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for six (setup.py): started 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=a77361d5ccf0391c303c0ab9c0b5d46b10211d35796627790b39ebc6b4a75ba1 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/a5/93/6f/7d550db90d8bcd8e927253377a8276dd4d76b0126257f0693b 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-0.20.22-py3-none-any.whl size=432838 sha256=199cd75f18ca74800283a6ac9ea8f0cf5f9859c26129dba82489094a1ebb308f 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/b7/d5/bd/0c9b87110cc5f68fa738860239d7a78dfb527652f8eebc5b11 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for wheel (setup.py): started 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=f8b131ecdf2a5fc39c812e92f0a9f03474b5673c52c13d1f8e5bd9dd961c96c3 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/72/45/25/63aba4bbb465b70bb2ee79ab0ec8779878be6b7dc83694e43c 2024-11-10 20:03:21 DEBUG unit.containerd/0.install logger.go:60 Building wheel for urllib3 (setup.py): started 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Building wheel for urllib3 (setup.py): finished with status 'done' 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Created wheel for urllib3: filename=urllib3-1.26.6-py2.py3-none-any.whl size=138477 sha256=620eb033cb4a433e5ac60e3667097b6ee44fb35518655716f574f4678a33b3db 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/6f/97/a8/f7693e645a98d8343af8133ed1c494f98c989e58fc7b7dee16 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Building wheel for Tempita (setup.py): started 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.5.2-py3-none-any.whl size=12880 sha256=c5944b9f50cbe12c731a0dc1e45829626d0a7308d560ccc035f88db8a6c9835c 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/30/b6/e5/a90ce1e7d786db554fe9bee324dccdc57be412dcbeb67eadd3 2024-11-10 20:03:22 DEBUG unit.containerd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-1.1.1-cp38-cp38-linux_x86_64.whl size=32952 sha256=f2a28fe7be9af087cca6f6697b02387874f8f97a3a97d001d2db11237ce91321 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/f7/76/40/dba6cb7c4ed5b16a516e982827763e519d89c78826f69b23b6 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Building wheel for idna (setup.py): started 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Building wheel for idna (setup.py): finished with status 'done' 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Created wheel for idna: filename=idna-3.2-py3-none-any.whl size=59634 sha256=e6990b51e79343ff2ad86f1a3a08876861677fdad089227676b7ababbe7ff9ce 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/04/78/86/e5bbcb366aada11d0544a6112c3633fe30e11e74bae3dbf927 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Building wheel for PyYAML (setup.py): started 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.2-cp38-cp38-linux_x86_64.whl size=44208 sha256=c67d583372f921cc6c3e82db931bca9347f8eeedd464848279a51d258ab8e4da 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-k4p7ykea/wheels/9d/fc/eb/31a011ae461ea3199cc1068db9279826ea1db10eec531d18ba 2024-11-10 20:03:23 DEBUG unit.containerd/0.install logger.go:60 Successfully built charms.reactive certifi requests pbr charset-normalizer Jinja2 netaddr pyaml six charmhelpers wheel urllib3 Tempita MarkupSafe idna PyYAML 2024-11-10 20:03:24 DEBUG unit.containerd/0.install logger.go:60 Installing collected packages: MarkupSafe, Jinja2, PyYAML, Tempita, netaddr, pbr, six, charmhelpers, pyaml, charms.reactive, certifi, urllib3, charset-normalizer, idna, requests, wheel 2024-11-10 20:03:24 DEBUG unit.containerd/0.install logger.go:60 Attempting uninstall: wheel 2024-11-10 20:03:24 DEBUG unit.containerd/0.install logger.go:60 Found existing installation: wheel 0.34.2 2024-11-10 20:03:24 DEBUG unit.containerd/0.install logger.go:60 Uninstalling wheel-0.34.2: 2024-11-10 20:03:24 DEBUG unit.containerd/0.install logger.go:60 Successfully uninstalled wheel-0.34.2 2024-11-10 20:03:24 DEBUG unit.containerd/0.install logger.go:60 Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 PyYAML-5.2 Tempita-0.5.2 certifi-2021.5.30 charmhelpers-0.20.22 charms.reactive-1.4.1 charset-normalizer-2.0.3 idna-3.2 netaddr-0.7.19 pbr-5.6.0 pyaml-20.4.0 requests-2.26.0 six-1.16.0 urllib3-1.26.6 wheel-0.33.6 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook install 2024-11-10 20:03:25 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.changed tracer: set flag config.changed.custom-registry-ca tracer: set flag config.changed.custom_registries tracer: set flag config.changed.disable-juju-proxy tracer: set flag config.changed.enable-cgroups tracer: set flag config.changed.gpu_driver tracer: set flag config.changed.http_proxy tracer: set flag config.changed.https_proxy tracer: set flag config.changed.no_proxy tracer: set flag config.changed.runtime tracer: set flag config.changed.shim tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim 2024-11-10 20:03:25 DEBUG unit.containerd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-10 20:03:25 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/container_runtime_common.py:31:install_custom_ca tracer: ++ queue handler reactive/containerd.py:250:enable_br_netfilter_module tracer: ++ queue handler reactive/containerd.py:269:install_containerd tracer: ++ queue handler reactive/containerd.py:304:check_for_gpu tracer: ++ queue handler reactive/containerd.py:430:gpu_config_changed tracer: ++ queue handler reactive/containerd.py:440:config_changed 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:31:install_custom_ca 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:250:enable_br_netfilter_module 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 Loading kernel module br_netfilter 2024-11-10 20:03:25 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.br_netfilter.enabled tracer: -- dequeue handler reactive/containerd.py:250:enable_br_netfilter_module 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:269:install_containerd 2024-11-10 20:03:25 INFO unit.containerd/0.juju-log server.go:316 status-set: maintenance: Installing containerd via apt 2024-11-10 20:03:25 DEBUG unit.containerd/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease 2024-11-10 20:03:25 DEBUG unit.containerd/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease 2024-11-10 20:03:25 DEBUG unit.containerd/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease 2024-11-10 20:03:25 DEBUG unit.containerd/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease 2024-11-10 20:03:25 DEBUG unit.containerd/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease 2024-11-10 20:03:27 DEBUG unit.containerd/0.install logger.go:60 Reading package lists... 2024-11-10 20:03:27 INFO unit.containerd/0.juju-log server.go:316 Installing containerd with options: ['--option=Dpkg::Options::=--force-confold'] 2024-11-10 20:03:27 DEBUG unit.containerd/0.install logger.go:60 Reading package lists... 2024-11-10 20:03:27 DEBUG unit.containerd/0.install logger.go:60 Building dependency tree... 2024-11-10 20:03:27 DEBUG unit.containerd/0.install logger.go:60 Reading state information... 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 The following additional packages will be installed: 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 runc 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 The following NEW packages will be installed: 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 containerd runc 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 0 upgraded, 2 newly installed, 0 to remove and 7 not upgraded. 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 Need to get 36.3 MB of archives. 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 After this operation, 152 MB of additional disk space will be used. 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 runc amd64 1.1.7-0ubuntu1~20.04.2 [3836 kB] 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates/main amd64 containerd amd64 1.7.2-0ubuntu1~20.04.1 [32.5 MB] 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 Fetched 36.3 MB in 0s (84.3 MB/s) 2024-11-10 20:03:28 DEBUG unit.containerd/0.install logger.go:60 Selecting previously unselected package runc. 2024-11-10 20:03:29 DEBUG unit.containerd/0.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 71405 files and directories currently installed.) 2024-11-10 20:03:29 DEBUG unit.containerd/0.install logger.go:60 Preparing to unpack .../runc_1.1.7-0ubuntu1~20.04.2_amd64.deb ... 2024-11-10 20:03:29 DEBUG unit.containerd/0.install logger.go:60 Unpacking runc (1.1.7-0ubuntu1~20.04.2) ... 2024-11-10 20:03:29 DEBUG unit.containerd/0.install logger.go:60 Selecting previously unselected package containerd. 2024-11-10 20:03:29 DEBUG unit.containerd/0.install logger.go:60 Preparing to unpack .../containerd_1.7.2-0ubuntu1~20.04.1_amd64.deb ... 2024-11-10 20:03:29 DEBUG unit.containerd/0.install logger.go:60 Unpacking containerd (1.7.2-0ubuntu1~20.04.1) ... 2024-11-10 20:03:32 DEBUG unit.containerd/0.install logger.go:60 Setting up runc (1.1.7-0ubuntu1~20.04.2) ... 2024-11-10 20:03:32 DEBUG unit.containerd/0.install logger.go:60 Setting up containerd (1.7.2-0ubuntu1~20.04.1) ... 2024-11-10 20:03:32 DEBUG unit.containerd/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /lib/systemd/system/containerd.service. 2024-11-10 20:03:33 DEBUG unit.containerd/0.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Marking containerd as hold 2024-11-10 20:03:36 DEBUG unit.containerd/0.install logger.go:60 containerd set on hold. 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.installed tracer: ++ queue handler reactive/containerd.py:287:publish_version_to_juju tracer: -- dequeue handler reactive/containerd.py:269:install_containerd 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.juju-proxy.changed tracer: ++ queue handler reactive/containerd.py:508:proxy_changed 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 Writing file /etc/containerd/config.toml root:root 444 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.restart tracer: ++ queue handler reactive/containerd.py:551:restart_containerd 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:304:check_for_gpu 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.nvidia.checked tracer: -- dequeue handler reactive/containerd.py:304:check_for_gpu 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:430:gpu_config_changed 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: cleared flag containerd.nvidia.checked tracer: ++ queue handler reactive/containerd.py:304:check_for_gpu 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:440:config_changed 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:287:publish_version_to_juju 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.version-published tracer: -- dequeue handler reactive/containerd.py:287:publish_version_to_juju 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:304:check_for_gpu 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: set flag containerd.nvidia.checked tracer: -- dequeue handler reactive/containerd.py:304:check_for_gpu 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:508:proxy_changed 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Proxy changed, writing new file to /etc/systemd/system/containerd.service.d/proxy.conf 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 Writing file /etc/systemd/system/containerd.service.d/proxy.conf root:root 444 2024-11-10 20:03:36 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: cleared flag containerd.juju-proxy.changed tracer: -- dequeue handler reactive/containerd.py:508:proxy_changed 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:551:restart_containerd 2024-11-10 20:03:36 INFO unit.containerd/0.juju-log server.go:316 status-set: maintenance: Restarting containerd 2024-11-10 20:03:37 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: cleared flag containerd.restart tracer: -- dequeue handler reactive/containerd.py:551:restart_containerd 2024-11-10 20:03:37 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:03:37 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-11-10 20:03:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for containerd/0 2024-11-10 20:03:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:03:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run install hook) 2024-11-10 20:03:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:03:37 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "containerd/0" (leader=true) entered scope for relation "containerd:containerd kubernetes-worker:container-runtime" 2024-11-10 20:03:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (12; app: kubernetes-worker) hook for containerd/0 2024-11-10 20:03:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run relation-created (12; app: kubernetes-worker) hook) 2024-11-10 20:04:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run relation-created (12; app: kubernetes-worker) hook) 2024-11-10 20:04:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (12; app: kubernetes-worker) hook" for containerd/0 2024-11-10 20:04:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (12; app: kubernetes-worker) hook" for containerd/0 2024-11-10 20:04:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running containerd-relation-created hook 2024-11-10 20:04:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:04:19 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Reactive main running for hook containerd-relation-created 2024-11-10 20:04:19 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: starting handler dispatch, 19 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published 2024-11-10 20:04:19 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: hooks phase, 0 handlers queued 2024-11-10 20:04:19 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:19 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:19 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:04:19 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:04:19 INFO unit.containerd/0.juju-log server.go:316 containerd:12: status-set: active: Container runtime available 2024-11-10 20:04:20 INFO juju.worker.uniter.operation runhook.go:159 ran "containerd-relation-created" hook (via explicit, bespoke hook script) 2024-11-10 20:04:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (12; app: kubernetes-worker) hook" for containerd/0 2024-11-10 20:04:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:04:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run relation-created (12; app: kubernetes-worker) hook) 2024-11-10 20:04:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:04:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for containerd/0 2024-11-10 20:04:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for containerd/0 2024-11-10 20:04:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for containerd/0 2024-11-10 20:04:20 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-11-10 20:04:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for containerd/0 2024-11-10 20:04:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run leader-elected hook) 2024-11-10 20:04:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run leader-elected hook) 2024-11-10 20:04:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for containerd/0 2024-11-10 20:04:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for containerd/0 2024-11-10 20:04:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-11-10 20:04:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:04:23 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook leader-elected 2024-11-10 20:04:23 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 19 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published 2024-11-10 20:04:23 DEBUG unit.containerd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-10 20:04:23 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:23 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:23 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:04:23 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:04:23 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:04:24 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-11-10 20:04:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for containerd/0 2024-11-10 20:04:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:04:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run leader-elected hook) 2024-11-10 20:04:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:04:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:04:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for containerd/0 2024-11-10 20:04:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run config-changed hook) 2024-11-10 20:04:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run config-changed hook) 2024-11-10 20:04:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for containerd/0 2024-11-10 20:04:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for containerd/0 2024-11-10 20:04:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-11-10 20:04:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:04:26 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook config-changed 2024-11-10 20:04:27 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 19 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published 2024-11-10 20:04:27 DEBUG unit.containerd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-10 20:04:27 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:27 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:27 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:04:27 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:04:27 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:04:27 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-11-10 20:04:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for containerd/0 2024-11-10 20:04:27 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:04:27 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run config-changed hook) 2024-11-10 20:04:27 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:04:27 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-11-10 20:04:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for containerd/0 2024-11-10 20:04:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run start hook) 2024-11-10 20:04:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run start hook) 2024-11-10 20:04:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for containerd/0 2024-11-10 20:04:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for containerd/0 2024-11-10 20:04:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-11-10 20:04:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:04:30 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook start 2024-11-10 20:04:31 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 19 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published 2024-11-10 20:04:31 DEBUG unit.containerd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-10 20:04:31 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:04:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:04:31 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:04:31 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2024-11-10 20:04:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for containerd/0 2024-11-10 20:04:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:04:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run start hook) 2024-11-10 20:04:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:04:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:04:31 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (12; unit: kubernetes-worker/0) hook for containerd/0 2024-11-10 20:04:31 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run relation-joined (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:04:31 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-11-10 20:04:31.540193957 +0000 UTC 2024-11-10 20:04:33 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run relation-joined (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:04:33 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:04:33 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:04:33 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running containerd-relation-joined hook for kubernetes-worker/0 2024-11-10 20:04:33 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Reactive main running for hook containerd-relation-joined 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: set flag endpoint.containerd.joined tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: set flag endpoint.containerd.changed 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: set flag endpoint.containerd.changed.egress-subnets 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: set flag endpoint.containerd.changed.ingress-address 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: set flag endpoint.containerd.changed.private-address 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: set flag endpoint.containerd.available 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: set flag endpoint.containerd.reconfigure tracer: ++ queue handler reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.joined tracer: set flag endpoint.containerd.reconfigure 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: hooks phase, 0 handlers queued 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config tracer: ++ queue handler reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: Changing permissions on existing content: 33060 -> 292 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: set flag containerd.restart tracer: ++ queue handler reactive/containerd.py:551:restart_containerd 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: cleared flag endpoint.containerd.reconfigure tracer: -- dequeue handler reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:551:restart_containerd 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: status-set: maintenance: Restarting containerd 2024-11-10 20:04:34 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: cleared flag containerd.restart tracer: -- dequeue handler reactive/containerd.py:551:restart_containerd 2024-11-10 20:04:34 INFO unit.containerd/0.juju-log server.go:316 containerd:12: status-set: active: Container runtime available 2024-11-10 20:04:35 INFO juju.worker.uniter.operation runhook.go:159 ran "containerd-relation-joined" hook (via explicit, bespoke hook script) 2024-11-10 20:04:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:04:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:04:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run relation-joined (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:04:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:04:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:04:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: kubernetes-worker/0) hook for containerd/0 2024-11-10 20:04:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run relation-changed (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:04:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run relation-changed (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:04:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:04:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:04:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running containerd-relation-changed hook for kubernetes-worker/0 2024-11-10 20:04:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:04:39 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Reactive main running for hook containerd-relation-changed 2024-11-10 20:04:39 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.joined 2024-11-10 20:04:39 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: hooks phase, 0 handlers queued 2024-11-10 20:04:39 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:04:39 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:04:39 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:04:39 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:04:39 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:04:39 INFO unit.containerd/0.juju-log server.go:316 containerd:12: status-set: active: Container runtime available 2024-11-10 20:04:40 INFO juju.worker.uniter.operation runhook.go:159 ran "containerd-relation-changed" hook (via explicit, bespoke hook script) 2024-11-10 20:04:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:04:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:04:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run relation-changed (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:04:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:04:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:04:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:04:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-10 20:04:55 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for containerd/0 2024-11-10 20:04:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:04:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:07:05 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-11-10 20:08:07 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:08:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:08:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:08:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:08:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:08:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:08:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:08:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:08:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:08:08 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.joined 2024-11-10 20:08:08 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:08:08 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:08:08 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:08:08 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:08:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:08:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:08:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:08:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:08:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:08:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:09:37 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for containerd/0 : {12 {map[kubernetes-worker/0:{1}] map[] []}} 2024-11-10 20:09:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:09:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:09:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: kubernetes-worker/0) hook for containerd/0 2024-11-10 20:09:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run relation-changed (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:09:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run relation-changed (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:09:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:09:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:09:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running containerd-relation-changed hook for kubernetes-worker/0 2024-11-10 20:09:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:09:37 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Reactive main running for hook containerd-relation-changed 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: set flag endpoint.containerd.changed.sandbox_image tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: set flag endpoint.containerd.reconfigure tracer: ++ queue handler reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: starting handler dispatch, 27 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined tracer: set flag endpoint.containerd.reconfigure 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer: hooks phase, 0 handlers queued 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config tracer: ++ queue handler reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Setting sandbox_image to: rocks.canonical.com:443/cdk/pause:3.4.1 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: Writing file /etc/containerd/config.toml root:root 444 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: set flag containerd.restart tracer: ++ queue handler reactive/containerd.py:551:restart_containerd 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: cleared flag endpoint.containerd.reconfigure tracer: -- dequeue handler reactive/containerd.py:664:container_runtime_relation_changed 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: Invoking reactive handler: reactive/containerd.py:551:restart_containerd 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: status-set: maintenance: Restarting containerd 2024-11-10 20:09:38 DEBUG unit.containerd/0.juju-log server.go:316 containerd:12: tracer> tracer: cleared flag containerd.restart tracer: -- dequeue handler reactive/containerd.py:551:restart_containerd 2024-11-10 20:09:38 INFO unit.containerd/0.juju-log server.go:316 containerd:12: status-set: active: Container runtime available 2024-11-10 20:09:38 INFO juju.worker.uniter.operation runhook.go:159 ran "containerd-relation-changed" hook (via explicit, bespoke hook script) 2024-11-10 20:09:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: kubernetes-worker/0) hook" for containerd/0 2024-11-10 20:09:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:09:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run relation-changed (12; unit: kubernetes-worker/0) hook) 2024-11-10 20:09:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:09:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:09:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:09:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-10 20:12:36 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:12:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:12:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:12:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:12:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:12:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:12:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:12:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:12:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:12:37 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:12:37 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:12:37 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:12:37 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:12:37 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:12:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:12:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:12:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:12:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:12:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:12:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:18:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:18:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:18:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:18:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:18:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:18:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:18:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:18:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:18:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:18:02 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:18:02 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:18:02 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:18:02 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:18:02 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:18:02 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:18:02 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:18:02 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:18:02 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:18:03 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:18:03 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:18:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:18:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:18:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:18:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:18:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:18:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:23:23 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:23:23 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:23:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:23:23 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:23:23 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:23:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:23:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:23:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:23:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:23:24 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:23:24 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:23:24 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:23:24 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:23:24 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:23:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:23:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:23:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:23:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:23:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:23:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:28:52 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:28:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:28:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:28:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:28:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:28:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:28:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:28:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:28:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:28:52 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:28:53 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:28:53 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:28:53 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:28:53 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:28:53 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:28:53 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:28:53 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:28:53 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:28:53 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:28:53 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:28:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:28:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:28:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:28:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:28:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:33:33 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:33:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:33:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:33:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:33:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:33:33 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:33:33 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:33:33 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:33:33 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:33:34 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:33:34 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:33:34 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:33:34 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:33:34 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:33:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:33:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:33:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:33:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:33:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:39:16 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:39:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:39:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:39:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:39:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:39:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:39:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:39:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:39:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:39:16 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:39:16 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:39:16 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:39:16 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:39:17 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:39:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:39:17 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:39:17 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:39:17 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:39:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:39:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:43:29 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:43:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:43:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:43:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:43:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:43:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:43:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:43:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:43:30 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:43:30 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:43:30 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:43:30 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:43:30 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:43:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:43:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:43:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:43:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:43:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:43:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:47:37 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:47:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:47:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:47:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:47:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:47:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:47:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:47:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:47:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:47:37 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:47:37 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:47:37 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:47:37 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:47:38 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:47:38 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:47:38 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:47:38 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:47:38 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:47:38 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:47:38 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:47:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:47:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:47:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:47:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:47:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:47:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:51:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:51:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:51:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:51:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:51:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:51:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:51:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:51:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:51:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:51:57 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:51:57 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:51:57 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:51:57 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:51:58 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:51:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:51:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:51:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:51:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:51:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:51:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:57:22 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 20:57:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:57:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 20:57:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 20:57:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 20:57:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 20:57:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 20:57:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 20:57:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 20:57:22 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 20:57:22 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 20:57:22 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 20:57:22 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 20:57:23 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 20:57:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 20:57:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 20:57:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 20:57:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 20:57:23 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 20:57:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:01:27 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:01:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:01:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:01:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:01:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:01:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:01:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:01:28 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:01:28 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:01:28 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:01:28 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:01:28 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:01:28 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:01:28 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:01:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:01:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:01:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:01:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:01:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:01:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:07:25 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:07:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:07:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:07:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:07:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:07:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:07:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:07:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:07:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:07:25 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:07:26 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:07:26 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:07:26 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:07:26 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:07:26 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:07:26 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:07:26 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:07:26 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:07:26 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:07:26 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:07:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:07:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:07:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:07:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:07:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:07:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:12:27 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:12:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:12:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:12:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:12:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:12:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:12:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:12:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:12:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:12:27 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:12:28 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:12:28 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:12:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:12:28 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:12:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:12:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:12:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:12:28 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:12:28 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:12:28 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:12:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:12:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:12:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:12:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:12:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:12:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:16:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:16:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:16:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:16:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:16:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:16:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:16:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:16:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:16:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:16:31 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:16:31 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:16:31 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:16:31 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:16:31 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:16:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:16:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:16:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:16:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:16:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:16:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:20:32 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:20:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:20:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:20:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:20:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:20:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:20:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:20:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:20:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:20:32 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:20:32 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:20:32 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:20:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:20:32 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:20:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:20:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:20:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:20:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:20:33 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:20:33 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:20:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:20:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:20:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:20:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:20:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:20:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:24:35 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:24:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:24:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:24:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:24:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:24:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:24:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:24:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:24:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:24:35 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:24:35 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:24:35 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:24:35 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:24:36 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:24:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:24:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:24:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:24:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:24:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:24:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:26:51 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for containerd/0: ok=true 2024-11-10 21:26:51 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2024-11-10 21:26:51 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2024-11-10 21:26:51 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2024-11-10 21:26:51 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2024-11-10 21:26:51 INFO juju.worker.uniter uniter.go:319 unit "containerd/0" shutting down: catacomb 0xc0005fd680 is dying 2024-11-10 21:26:51 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-11-10 21:26:51.703917554 +0000 UTC 2024-11-10 21:26:51 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2024-11-10 21:26:51 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-11-10 21:26:51.731296457 +0000 UTC 2024-11-10 21:26:51 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "containerd/0" (leader=true) entered scope for relation "containerd:containerd kubernetes-worker:container-runtime" 2024-11-10 21:26:51 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-containerd-0/run.socket } 2024-11-10 21:26:51 INFO juju.worker.uniter uniter.go:335 unit "containerd/0" started 2024-11-10 21:26:51 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-11-10 21:26:51 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for containerd/0: ok=true 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for containerd/0 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for containerd/0: ok=true 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for containerd/0: ok=true 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for containerd/0: [] ok=true 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for containerd/0: ok=true, hashes=[b37fd87fc50fe3559fb75340eda764704a239898380d4ccf6bd560e2cae9d72c] 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for containerd/0: ok=true, hashes=[038f12e9a041abf4c5c6210614ad1d900bde866e4b926a377bb2cb30237b52d4] 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for containerd/0: ok=true, hashes=[cf69cceac072fc1a45838fd7d472afdd6752342bc620f8a8e4373fd6ee414642] 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for containerd/0: [] ok=true 2024-11-10 21:26:52 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for containerd/0 2024-11-10 21:26:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:26:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:26:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-10 21:32:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:32:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:32:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:32:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:32:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:32:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:32:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:32:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:32:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:32:05 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:32:05 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:32:05 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:32:05 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:32:05 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:32:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:32:05 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:32:05 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:32:05 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:32:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:32:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:37:58 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:37:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:37:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:37:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:37:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:37:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:37:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:37:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:37:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:38:00 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:38:00 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:38:00 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:38:00 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:38:00 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:38:00 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:38:00 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:38:00 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:38:00 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:38:01 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:38:01 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:38:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:38:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:38:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:38:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:38:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:38:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:43:46 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:43:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:43:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:43:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:43:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:43:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:43:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:43:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:43:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:43:50 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:43:50 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:43:50 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:43:50 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:43:51 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:43:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:43:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:43:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:43:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:43:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:43:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:49:05 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:49:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:49:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:49:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:49:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:49:06 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:49:06 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:49:06 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:49:06 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:49:06 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:49:06 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:49:06 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:49:06 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:49:06 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:49:06 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:49:06 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:49:06 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:49:06 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:49:07 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:49:07 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:49:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:49:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:49:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:49:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:49:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:49:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:53:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:53:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:53:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:53:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:53:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:53:31 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:53:31 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:53:31 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:53:31 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:53:32 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:53:32 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:53:32 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:53:32 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:53:33 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:53:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:53:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:53:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:53:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:53:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:53:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:59:05 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for containerd/0 2024-11-10 21:59:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:59:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12 2024-11-10 21:59:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for containerd/0 2024-11-10 21:59:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for containerd/0 uniter (run update-status hook) 2024-11-10 21:59:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for containerd/0 uniter (run update-status hook) 2024-11-10 21:59:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for containerd/0 2024-11-10 21:59:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for containerd/0 2024-11-10 21:59:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-containerd-0/agent.socket } 2024-11-10 21:59:07 INFO unit.containerd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-11-10 21:59:07 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag config.default.custom-registry-ca tracer: set flag config.default.custom_registries tracer: set flag config.default.disable-juju-proxy tracer: set flag config.default.enable-cgroups tracer: set flag config.default.gpu_driver tracer: set flag config.default.http_proxy tracer: set flag config.default.https_proxy tracer: set flag config.default.no_proxy tracer: set flag config.default.runtime tracer: set flag config.default.shim tracer: set flag config.set.custom_registries tracer: set flag config.set.gpu_driver tracer: set flag config.set.runtime tracer: set flag config.set.shim tracer: set flag containerd.br_netfilter.enabled tracer: set flag containerd.installed tracer: set flag containerd.nvidia.checked tracer: set flag containerd.ready tracer: set flag containerd.version-published tracer: set flag endpoint.containerd.available tracer: set flag endpoint.containerd.changed tracer: set flag endpoint.containerd.changed.egress-subnets tracer: set flag endpoint.containerd.changed.ingress-address tracer: set flag endpoint.containerd.changed.private-address tracer: set flag endpoint.containerd.changed.sandbox_image tracer: set flag endpoint.containerd.joined 2024-11-10 21:59:07 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/containerd.py:225:update_status 2024-11-10 21:59:07 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:225:update_status 2024-11-10 21:59:07 DEBUG unit.containerd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry tracer: ++ queue handler hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted tracer: ++ queue handler reactive/container_runtime_common.py:15:enable_grub_cgroups tracer: ++ queue handler reactive/containerd.py:567:publish_config 2024-11-10 21:59:07 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/container_runtime_common.py:15:enable_grub_cgroups 2024-11-10 21:59:07 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: reactive/containerd.py:567:publish_config 2024-11-10 21:59:07 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/untrusted-container-runtime/provides.py:18:broken:untrusted 2024-11-10 21:59:07 INFO unit.containerd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/docker-registry/requires.py:58:remove_ready:docker-registry 2024-11-10 21:59:08 INFO unit.containerd/0.juju-log server.go:316 status-set: active: Container runtime available 2024-11-10 21:59:08 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-10 21:59:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for containerd/0 2024-11-10 21:59:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-10 21:59:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for containerd/0 uniter (run update-status hook) 2024-11-10 21:59:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for containerd/0 2024-11-10 21:59:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-10 21:59:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-worker/0" already joined relation 12