2025-04-15 15:11:05 INFO juju unit_agent.go:289 Starting unit workers for "tf-kubernetes-node/0"
2025-04-15 15:11:05 INFO juju.worker.apicaller connect.go:163 [43219b] "unit-tf-kubernetes-node-0" successfully connected to "252.249.0.1:17070"
2025-04-15 15:11:05 INFO juju.worker.apicaller connect.go:260 [43219b] password changed for "unit-tf-kubernetes-node-0"
2025-04-15 15:11:05 INFO juju.worker.apicaller connect.go:163 [43219b] "unit-tf-kubernetes-node-0" successfully connected to "10.0.0.249:17070"
2025-04-15 15:11:05 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE
2025-04-15 15:11:05 INFO juju.worker.logger logger.go:120 logger worker started
2025-04-15 15:11:05 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2025-04-15 15:11:05.364406967 +0000 UTC
2025-04-15 15:11:05 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.249:17070 252.249.0.1:17070 127.0.0.1:17070 [::1]:17070]]
2025-04-15 15:11:05 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done
2025-04-15 15:11:05 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully
2025-04-15 15:11:05 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher
2025-04-15 15:11:05 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-15 15:11:05.374301085 +0000 UTC
2025-04-15 15:11:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed)
2025-04-15 15:11:05 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-tf-kubernetes-node-0/run.socket <nil>}
2025-04-15 15:11:05 INFO juju.worker.uniter uniter.go:335 unit "tf-kubernetes-node/0" started
2025-04-15 15:11:05 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running
2025-04-15 15:11:05 INFO juju.worker.uniter uniter.go:651 resuming charm install
2025-04-15 15:11:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation install local:focal/contrail-kubernetes-node-0 for tf-kubernetes-node/0
2025-04-15 15:11:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install local:focal/contrail-kubernetes-node-0" for tf-kubernetes-node/0
2025-04-15 15:11:05 INFO juju.worker.uniter.charm bundles.go:81 downloading local:focal/contrail-kubernetes-node-0 from API server
2025-04-15 15:11:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install local:focal/contrail-kubernetes-node-0" for tf-kubernetes-node/0
2025-04-15 15:11:05 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "local:focal/contrail-kubernetes-node-0"
2025-04-15 15:11:05 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "local:focal/contrail-kubernetes-node-0"
2025-04-15 15:11:05 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "local:focal/contrail-kubernetes-node-0"
2025-04-15 15:11:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install local:focal/contrail-kubernetes-node-0" for tf-kubernetes-node/0
2025-04-15 15:11:05 INFO juju.worker.uniter uniter.go:361 hooks are retried false
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for tf-kubernetes-node/0: ok=true, hashes=[5148d0a621eb80671fe3615369055749b6c573f4209e8423bab18f3f575b602c]
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for tf-kubernetes-node/0: ok=true, hashes=[c42616a44e385b0189d32f83bb5510b86eeac1ef1ffcd270486c55c340467144]
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for tf-kubernetes-node/0: ok=true, hashes=[377ca09841bdc2bdedcbb8a9e8f6c53bcba87120b984be87bc44265a73ddc26e]
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for tf-kubernetes-node/0: ok=true
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for tf-kubernetes-node/0: [] ok=true
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for tf-kubernetes-node/0: [] ok=true
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for tf-kubernetes-node/0
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for tf-kubernetes-node/0: ok=true
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-node/0
2025-04-15 15:11:05 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-node/0: ok=true
2025-04-15 15:11:05 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready
2025-04-15 15:11:05 INFO juju.worker.uniter resolver.go:159 found queued "install" hook
2025-04-15 15:11:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for tf-kubernetes-node/0
2025-04-15 15:11:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-node/0 uniter (run install hook)
2025-04-15 15:11:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-node/0 : {25 {map[kubernetes-master/0:{1}] map[] []}}
2025-04-15 15:11:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed)
2025-04-15 15:11:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-node-0/agent.socket <nil>}
2025-04-15 15:11:59 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing)
2025-04-15 15:11:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2025-04-15 15:11:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed)
2025-04-15 15:12:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-node/0 uniter (run install hook)
2025-04-15 15:12:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for tf-kubernetes-node/0
2025-04-15 15:12:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for tf-kubernetes-node/0
2025-04-15 15:12:13 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook
2025-04-15 15:12:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server  {unix @/var/lib/juju/agents/unit-tf-kubernetes-node-0/agent.socket <nil>}
2025-04-15 15:12:14 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Installing logrotate with options: ['--option=Dpkg::Options::=--force-confold']
2025-04-15 15:12:14 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading package lists...
2025-04-15 15:12:14 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Building dependency tree...
2025-04-15 15:12:14 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading state information...
2025-04-15 15:12:14 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 logrotate is already the newest version (3.14.0-4ubuntu3).
2025-04-15 15:12:14 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded.
2025-04-15 15:12:14 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Installing ['apt-transport-https', 'ca-certificates', 'curl', 'software-properties-common'] with options: ['--option=Dpkg::Options::=--force-confold']
2025-04-15 15:12:14 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading package lists...
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Building dependency tree...
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading state information...
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 ca-certificates is already the newest version (20240203~20.04.1).
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 curl is already the newest version (7.68.0-1ubuntu2.25).
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 software-properties-common is already the newest version (0.99.9.12).
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 apt-transport-https is already the newest version (2.0.11).
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded.
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease
2025-04-15 15:12:15 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease
2025-04-15 15:12:17 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading package lists...
2025-04-15 15:12:17 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Installing docker.io with options: ['--option=Dpkg::Options::=--force-confold']
2025-04-15 15:12:17 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading package lists...
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Building dependency tree...
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading state information...
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 docker.io is already the newest version (26.1.3-0ubuntu1~20.04.1).
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded.
2025-04-15 15:12:18 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Installing ['docker-compose'] with options: ['--option=Dpkg::Options::=--force-confold']
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading package lists...
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Building dependency tree...
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 Reading state information...
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 docker-compose is already the newest version (1.25.0-1).
2025-04-15 15:12:18 DEBUG unit.tf-kubernetes-node/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded.
2025-04-15 15:12:19 DEBUG unit.tf-kubernetes-node/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 CTX: {'module': 'kubernetes-node', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_5_8_5-1', 'image_prefix': <function get_image_prefix at 0x7feb8e3fc8b0>, 'cluster_name': None, 'nested_mode': None, 'logging': 'logging:\n  driver: json-file\n  options:\n    max-file: "5"\n    max-size: "20m"\n'}
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_cni.env
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Making dir /etc/contrail root:root 755
2025-04-15 15:12:20 DEBUG unit.tf-kubernetes-node/0.juju-log server.go:316 Writing file /etc/contrail/common_cni.env root:root 600
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Configuration file has been created and is not logged.
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-node/docker-compose.yaml
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Making dir /etc/contrail/contrail-kubernetes-node root:root 755
2025-04-15 15:12:20 DEBUG unit.tf-kubernetes-node/0.juju-log server.go:316 Writing file /etc/contrail/contrail-kubernetes-node/docker-compose.yaml root:root 600
2025-04-15 15:12:20 INFO unit.tf-kubernetes-node/0.juju-log server.go:316 Configuration file has been created and is not logged.
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60 invalid reference format
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60 Traceback (most recent call last):
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/var/lib/juju/agents/unit-tf-kubernetes-node-0/charm/hooks/install.real", line 104, in <module>
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     main()
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/var/lib/juju/agents/unit-tf-kubernetes-node-0/charm/hooks/install.real", line 98, in main
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     hooks.execute(sys.argv)
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/var/lib/juju/agents/unit-tf-kubernetes-node-0/charm/hooks/charmhelpers/core/hookenv.py", line 945, in execute
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     self._hooks[hook_name]()
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/var/lib/juju/agents/unit-tf-kubernetes-node-0/charm/hooks/install.real", line 33, in install
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     utils.update_charm_status()
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/var/lib/juju/agents/unit-tf-kubernetes-node-0/charm/hooks/contrail_kubernetes_node_utils.py", line 61, in update_charm_status
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     common_utils.container_engine().compose_run(CONFIGS_PATH + "/docker-compose.yaml", changed)
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/var/lib/juju/agents/unit-tf-kubernetes-node-0/charm/hooks/docker_engine.py", line 219, in compose_run
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     check_call([DOCKER_COMPOSE_CLI, "-f", path, "up", "-d"], env=env)
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60     raise CalledProcessError(retcode, cmd)
2025-04-15 15:12:20 WARNING unit.tf-kubernetes-node/0.install logger.go:60 subprocess.CalledProcessError: Command '['docker-compose', '-f', '/etc/contrail/contrail-kubernetes-node/docker-compose.yaml', 'up', '-d']' returned non-zero exit status 1.
2025-04-15 15:12:21 ERROR juju.worker.uniter.operation runhook.go:153 hook "install" (via explicit, bespoke hook script) failed: exit status 1
2025-04-15 15:12:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2025-04-15 15:12:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-node/0 uniter (run install hook)
2025-04-15 15:12:21 DEBUG juju.worker.uniter.operation executor.go:115 lock released for tf-kubernetes-node/0
2025-04-15 15:12:21 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook
2025-04-15 15:12:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] error: hook failed: "install"