2024-09-02 15:50:20 INFO juju unit_agent.go:289 Starting unit workers for "tf-kubernetes-master/0" 2024-09-02 15:50:20 INFO juju.worker.apicaller connect.go:163 [2d9a41] "unit-tf-kubernetes-master-0" successfully connected to "252.50.0.1:17070" 2024-09-02 15:50:20 INFO juju.worker.apicaller connect.go:260 [2d9a41] password changed for "unit-tf-kubernetes-master-0" 2024-09-02 15:50:20 INFO juju.worker.apicaller connect.go:163 [2d9a41] "unit-tf-kubernetes-master-0" successfully connected to "252.50.0.1:17070" 2024-09-02 15:50:20 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-09-02 15:50:20 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-09-02 15:50:20 INFO juju.worker.logger logger.go:120 logger worker started 2024-09-02 15:50:20 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-02 15:50:20.69207881 +0000 UTC 2024-09-02 15:50:20 DEBUG juju.worker.dependency engine.go:580 "metric-spool" manifold worker started at 2024-09-02 15:50:20.695962157 +0000 UTC 2024-09-02 15:50:20 DEBUG juju.worker.dependency engine.go:580 "meter-status" manifold worker started at 2024-09-02 15:50:20.696268626 +0000 UTC 2024-09-02 15:50:20 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-02 15:50:20.70234328 +0000 UTC 2024-09-02 15:50:20 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-09-02 15:50:20.705350162 +0000 UTC 2024-09-02 15:50:20 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.50:17070 252.50.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-09-02 15:50:20 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-02 15:50:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-09-02 15:50:20 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-tf-kubernetes-master-0/run.socket } 2024-09-02 15:50:20 INFO juju.worker.uniter uniter.go:335 unit "tf-kubernetes-master/0" started 2024-09-02 15:50:20 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-02 15:50:20 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-09-02 15:50:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation install local:focal/contrail-kubernetes-master-0 for tf-kubernetes-master/0 2024-09-02 15:50:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-09-02 15:50:20 INFO juju.worker.uniter.charm bundles.go:81 downloading local:focal/contrail-kubernetes-master-0 from API server 2024-09-02 15:50:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-09-02 15:50:20 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "local:focal/contrail-kubernetes-master-0" 2024-09-02 15:50:20 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "local:focal/contrail-kubernetes-master-0" 2024-09-02 15:50:21 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "local:focal/contrail-kubernetes-master-0" 2024-09-02 15:50:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-09-02 15:50:21 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for tf-kubernetes-master/0: [] ok=true 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-master/0 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for tf-kubernetes-master/0: ok=true, hashes=[7b49920e5d67651ad75c596711ef23ff5b13d078ff987c8bba405610b5db3405] 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for tf-kubernetes-master/0: ok=true, hashes=[3dfed8430827e8ff7931201b24a9d468b7bcf27b57ef810c7ca3686843eee08b] 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for tf-kubernetes-master/0: ok=true 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for tf-kubernetes-master/0: ok=true, hashes=[717091a16be2d96c305c9b4226b45f970854e671f23c67935e40701334334891] 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for tf-kubernetes-master/0: ok=true 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for tf-kubernetes-master/0: [] ok=true 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-02 15:50:21 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for tf-kubernetes-master/0 2024-09-02 15:50:21 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-09-02 15:50:21 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-09-02 15:50:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for tf-kubernetes-master/0 2024-09-02 15:50:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run install hook) 2024-09-02 15:50:57 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{0}] map[] []}} 2024-09-02 15:51:15 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/0:{0}] map[] []}} 2024-09-02 15:51:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-09-02 15:51:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:51:25 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing) 2024-09-02 15:51:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:51:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-09-02 15:51:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run install hook) 2024-09-02 15:51:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for tf-kubernetes-master/0 2024-09-02 15:51:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for tf-kubernetes-master/0 2024-09-02 15:51:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-09-02 15:51:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:51:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing logrotate with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 logrotate is already the newest version (3.14.0-4ubuntu3). 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 15:51:26 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing ['apt-transport-https', 'ca-certificates', 'curl', 'software-properties-common'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-02 15:51:26 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 ca-certificates is already the newest version (20230311ubuntu0.20.04.1). 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 curl is already the newest version (7.68.0-1ubuntu2.22). 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 software-properties-common is already the newest version (0.99.9.12). 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 apt-transport-https is already the newest version (2.0.10). 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease 2024-09-02 15:51:27 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-02 15:51:28 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-02 15:51:28 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing docker.io with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-02 15:51:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {27 {map[kubernetes-master/0:{1}] map[] []}} 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 docker.io is already the newest version (24.0.5-0ubuntu1~20.04.1). 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 15:51:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing ['docker-compose'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 docker-compose is already the newest version (1.25.0-1). 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 15:51:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2024-09-02 15:51:30 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-09-02 15:51:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for tf-kubernetes-master/0 2024-09-02 15:51:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:51:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run install hook) 2024-09-02 15:51:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:51:31 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:kubernetes-master-cluster" 2024-09-02 15:51:31 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:contrail-controller tf-controller:contrail-controller" 2024-09-02 15:51:31 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-node:contrail-kubernetes-config tf-kubernetes-master:contrail-kubernetes-config" 2024-09-02 15:51:31 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:kube-api-endpoint kubernetes-master:kube-api-endpoint" 2024-09-02 15:51:31 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (18; app: tf-kubernetes-master) hook for tf-kubernetes-master/0 2024-09-02 15:51:31 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-09-02 15:51:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/1:{0}] map[] []}} 2024-09-02 15:51:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-09-02 15:51:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-02 15:51:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-02 15:51:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-created hook 2024-09-02 15:51:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:51:41 INFO juju.worker.uniter.operation runhook.go:162 skipped "kubernetes-master-cluster-relation-created" hook (missing) 2024-09-02 15:51:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-02 15:51:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:51:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-09-02 15:51:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:51:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (23; app: tf-controller) hook for tf-kubernetes-master/0 2024-09-02 15:51:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-09-02 15:51:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-09-02 15:51:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-09-02 15:51:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-09-02 15:51:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-created hook 2024-09-02 15:51:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:51:52 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-controller-relation-created" hook (missing) 2024-09-02 15:51:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-09-02 15:51:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:51:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-09-02 15:51:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:51:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (24; app: tf-kubernetes-node) hook for tf-kubernetes-master/0 2024-09-02 15:51:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-09-02 15:52:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-09-02 15:52:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-09-02 15:52:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-09-02 15:52:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-created hook 2024-09-02 15:52:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:52:03 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-kubernetes-config-relation-created" hook (missing) 2024-09-02 15:52:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-09-02 15:52:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:52:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-09-02 15:52:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:52:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (27; app: kubernetes-master) hook for tf-kubernetes-master/0 2024-09-02 15:52:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-09-02 15:52:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-created hook 2024-09-02 15:52:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:52:41 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-created" hook (missing) 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:52:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for tf-kubernetes-master/0 2024-09-02 15:52:41 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-09-02 15:52:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for tf-kubernetes-master/0 2024-09-02 15:52:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-09-02 15:52:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-09-02 15:52:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-09-02 15:52:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-09-02 15:52:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-09-02 15:52:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:52:42 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{1}] map[] []}} 2024-09-02 15:52:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster current info: {'tf-kubernetes-master/0': '10.0.0.50'} 2024-09-02 15:52:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster saved info: {} 2024-09-02 15:52:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster info: {'tf-kubernetes-master/0': '10.0.0.50'} 2024-09-02 15:52:43 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-02 15:52:43 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:52:43 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-09-02 15:52:43 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-09-02 15:52:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:52:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-09-02 15:52:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:52:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:52:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for tf-kubernetes-master/0 2024-09-02 15:52:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-09-02 15:53:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-09-02 15:53:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for tf-kubernetes-master/0 2024-09-02 15:53:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for tf-kubernetes-master/0 2024-09-02 15:53:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-09-02 15:53:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:53:19 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 /usr/bin/rsync -r --executability /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/files/plugins/ /usr/local/lib/nagios/plugins 2024-09-02 15:53:19 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Nagios user not set up, nrpe checks not updated 2024-09-02 15:53:19 WARNING unit.tf-kubernetes-master/0.config-changed logger.go:60 Error: No such object: nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-9_6_9-2 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 master-9_6_9-2: Pulling from contrail-kubernetes-kube-manager 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 2d473b07cdd5: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c29f55e1db5b: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c88cc95542d9: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 f3ecbc3b2dfb: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 fef3af5f2b7e: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 14f22fa9f52b: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 6baedbab0c07: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1c888e785ffa: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 07560b6125a5: Already exists 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1daae3b541c0: Pulling fs layer 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1343b043e5c2: Pulling fs layer 2024-09-02 15:53:19 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1343b043e5c2: Download complete 2024-09-02 15:53:20 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1daae3b541c0: Verifying Checksum 2024-09-02 15:53:20 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1daae3b541c0: Download complete 2024-09-02 15:53:21 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1daae3b541c0: Pull complete 2024-09-02 15:53:21 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 1343b043e5c2: Pull complete 2024-09-02 15:53:21 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 Digest: sha256:7ee9d1496bf4f49ddfc097c9fc797a7f782b8a697fd373ba31bead6e8bc924c8 2024-09-02 15:53:21 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 Status: Downloaded newer image for nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-9_6_9-2 2024-09-02 15:53:21 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-9_6_9-2 2024-09-02 15:53:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:53:21 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-02 15:53:21 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:53:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for tf-kubernetes-master/0 2024-09-02 15:53:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:53:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-09-02 15:53:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:53:21 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-09-02 15:53:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for tf-kubernetes-master/0 2024-09-02 15:53:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run start hook) 2024-09-02 15:53:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run start hook) 2024-09-02 15:53:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for tf-kubernetes-master/0 2024-09-02 15:53:33 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for tf-kubernetes-master/0 2024-09-02 15:53:33 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-09-02 15:53:33 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:53:33 INFO juju.worker.uniter.operation runhook.go:162 skipped "start" hook (missing) 2024-09-02 15:53:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for tf-kubernetes-master/0 2024-09-02 15:53:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:53:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run start hook) 2024-09-02 15:53:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:53:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:53:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (27; unit: kubernetes-master/0) hook for tf-kubernetes-master/0 2024-09-02 15:53:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/0) hook) 2024-09-02 15:53:33 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-09-02 15:53:33.062102724 +0000 UTC 2024-09-02 15:53:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/0) hook) 2024-09-02 15:53:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-joined hook for kubernetes-master/0 2024-09-02 15:53:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:53:35 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-joined" hook (missing) 2024-09-02 15:53:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:53:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/0) hook) 2024-09-02 15:53:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:53:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:53:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (27; unit: kubernetes-master/0) hook for tf-kubernetes-master/0 2024-09-02 15:53:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/0) hook) 2024-09-02 15:53:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/0) hook) 2024-09-02 15:53:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-changed hook for kubernetes-master/0 2024-09-02 15:53:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:53:48 WARNING unit.tf-kubernetes-master/0.kube-api-endpoint-relation-changed logger.go:60 The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port? 2024-09-02 15:53:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kube-api-endpoint:27: Can't apply manifest for service account: Command '['snap', 'run', 'kubectl', '--kubeconfig', '/root/.kube/config', 'apply', '-f', '/var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/files/contrail-kubemanager-serviceaccount.yaml']' returned non-zero exit status 1. 2024-09-02 15:53:48 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kube-api-endpoint:27: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:53:49 INFO juju.worker.uniter.operation runhook.go:159 ran "kube-api-endpoint-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:53:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:53:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/0) hook) 2024-09-02 15:53:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:53:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:53:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 15:53:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-09-02 15:53:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{2}] map[] []}} 2024-09-02 15:53:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-09-02 15:53:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/0 2024-09-02 15:53:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:53:50 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script) 2024-09-02 15:53:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:53:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-09-02 15:53:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:53:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:53:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 15:53:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:53:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:53:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-02 15:53:52 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{3}] map[] []}} 2024-09-02 15:53:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:53:52 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-02 15:53:52 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'cloud_orchestrator': None, 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:53:53 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:53:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:53:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:53:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:53:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:53:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:53:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:53:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 15:53:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:54:58 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{4}] map[] []}} 2024-09-02 15:54:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:54:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:54:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:54:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:54:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-02 15:54:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:54:59 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:54:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:54:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:54:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:54:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:54:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:54:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:54:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 15:54:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:55:06 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-02 15:55:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:55:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:55:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:55:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:55:45 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-02 15:55:45 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:55:45 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:55:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:55:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:55:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:55:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:55:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:55:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:55:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/0 2024-09-02 15:55:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-09-02 15:56:15 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-09-02 15:56:15 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:15 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/0 2024-09-02 15:56:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:56:15 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-02 15:56:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:56:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-09-02 15:56:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:56:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:56:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:56:15 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/0 2024-09-02 15:56:15 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-09-02 15:56:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-09-02 15:56:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/0 2024-09-02 15:56:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:56:24 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-02 15:56:24 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:56:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:56:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-09-02 15:56:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:56:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:56:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:56:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 15:56:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/0 2024-09-02 15:56:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-09-02 15:56:31 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-09-02 15:56:31 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-02 15:56:31 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-02 15:56:31 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/1 2024-09-02 15:56:31 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:56:32 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{5}] map[] []}} 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:56:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:56:32 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-02 15:56:32 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:56:32 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:56:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-09-02 15:56:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-02 15:56:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/1 2024-09-02 15:56:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:56:32 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-02 15:56:33 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:56:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-09-02 15:56:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:56:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-09-02 15:56:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:56:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 15:56:33 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-02 15:56:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 15:56:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 15:57:01 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{6}] map[] []}} 2024-09-02 15:57:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:57:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 15:57:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:57:01 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 15:57:01 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:57:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:57:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:57:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:57:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-02 15:57:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 15:57:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-02 15:57:01 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 15:57:01 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 15:57:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 15:57:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 15:57:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 15:57:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 15:57:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 15:57:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 15:57:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 15:57:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 15:57:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 15:57:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-02 16:00:04 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-02 16:00:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:00:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:00:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:00:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:00:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:00:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-02 16:00:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:00:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:00:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:00:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:00:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 16:00:04 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-02 16:00:04 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlFVdjZMTEFITDBLSGhDaGNUZTZYdzlqejU4MHRLdzVJbE9TSFBkUkpaWU0ifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjY1ODI4YjM2LWE2ZDAtNDI4Yy1hZDY1LTM2NjlmZjM5YjlkYSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.nuN1hI9vEUH3HLS_aoNxOj0ZYZG0nG9HslVmSxcPSiIGn4omeBWeKceE0SXEyeuGIMFmj8p0MZw-HdfZrqRG6XmEp-2pL1p3WG3rQVrNth8CMfrLOB3xMZjc3NAgPQrIl1HYXAxbkq2dlfyo8h4N2sbKqcrPqdlDcbNY01P0P_JxOfUlBXP6U-YQOCg54fBBSDARPiKDdXVtRqQlDfdimFnp0_j_Dr1xQu-6lvty-A8_uU-m2pcEZ1jt3xjMEKK_CkcW12n6yH7lwrIfek1QZi_43Aln8pa6SrZiGbgZQU28cLLPGl-dEozrctC0pjf2YkxCSDtUO5KP1N9KBZXX0Q', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 16:00:04 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-02 16:00:05 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Writing file /etc/contrail/common_kubemanager.env root:root 600 2024-09-02 16:00:05 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has been created and is not logged. 2024-09-02 16:00:05 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-02 16:00:05 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Making dir /etc/contrail/contrail-kubernetes-master root:root 755 2024-09-02 16:00:05 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Writing file /etc/contrail/contrail-kubernetes-master/docker-compose.yaml root:root 600 2024-09-02 16:00:05 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has been created and is not logged. 2024-09-02 16:00:05 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 Creating contrail-kubernetes-master_node-init_1 ... 2024-09-02 16:00:05 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-09-02 16:00:05 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60  Creating contrail-kubernetes-master_node-init_1 ... done Creating contrail-kubernetes-master_kubemanager_1 ... 2024-09-02 16:00:08 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 16:00:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:00:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 16:00:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:00:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 16:00:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:00:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:00:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:00:18 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{7}] map[] []}} 2024-09-02 16:00:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:00:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:00:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-09-02 16:00:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 16:00:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 16:00:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 16:00:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 16:00:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-09-02 16:00:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 16:00:18 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-09-02 16:00:18 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlFVdjZMTEFITDBLSGhDaGNUZTZYdzlqejU4MHRLdzVJbE9TSFBkUkpaWU0ifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjY1ODI4YjM2LWE2ZDAtNDI4Yy1hZDY1LTM2NjlmZjM5YjlkYSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.nuN1hI9vEUH3HLS_aoNxOj0ZYZG0nG9HslVmSxcPSiIGn4omeBWeKceE0SXEyeuGIMFmj8p0MZw-HdfZrqRG6XmEp-2pL1p3WG3rQVrNth8CMfrLOB3xMZjc3NAgPQrIl1HYXAxbkq2dlfyo8h4N2sbKqcrPqdlDcbNY01P0P_JxOfUlBXP6U-YQOCg54fBBSDARPiKDdXVtRqQlDfdimFnp0_j_Dr1xQu-6lvty-A8_uU-m2pcEZ1jt3xjMEKK_CkcW12n6yH7lwrIfek1QZi_43Aln8pa6SrZiGbgZQU28cLLPGl-dEozrctC0pjf2YkxCSDtUO5KP1N9KBZXX0Q', 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 16:00:18 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-02 16:00:18 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-02 16:00:18 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-02 16:00:18 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-02 16:00:18 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-09-02 16:00:18 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-09-02 16:00:19 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2 2024-09-02 16:00:21 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-02 16:00:21 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 data = yaml.load(fh) 2024-09-02 16:00:21 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 16:00:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-09-02 16:00:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 16:00:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-09-02 16:00:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 16:00:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:00:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:00:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:00:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:00:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:00:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-02 16:04:09 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-02 16:04:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:04:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:04:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:04:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:04:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:04:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-02 16:04:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:04:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:04:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:04:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:04:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 16:04:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-02 16:04:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlFVdjZMTEFITDBLSGhDaGNUZTZYdzlqejU4MHRLdzVJbE9TSFBkUkpaWU0ifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjY1ODI4YjM2LWE2ZDAtNDI4Yy1hZDY1LTM2NjlmZjM5YjlkYSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.nuN1hI9vEUH3HLS_aoNxOj0ZYZG0nG9HslVmSxcPSiIGn4omeBWeKceE0SXEyeuGIMFmj8p0MZw-HdfZrqRG6XmEp-2pL1p3WG3rQVrNth8CMfrLOB3xMZjc3NAgPQrIl1HYXAxbkq2dlfyo8h4N2sbKqcrPqdlDcbNY01P0P_JxOfUlBXP6U-YQOCg54fBBSDARPiKDdXVtRqQlDfdimFnp0_j_Dr1xQu-6lvty-A8_uU-m2pcEZ1jt3xjMEKK_CkcW12n6yH7lwrIfek1QZi_43Aln8pa6SrZiGbgZQU28cLLPGl-dEozrctC0pjf2YkxCSDtUO5KP1N9KBZXX0Q', 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 16:04:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-02 16:04:09 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-02 16:04:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-02 16:04:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-02 16:04:09 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-02 16:04:09 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-02 16:04:09 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-02 16:04:11 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-02 16:04:11 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-02 16:04:12 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 16:04:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:04:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 16:04:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:04:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 16:04:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:04:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:04:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:04:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:04:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:09:57 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-09-02 16:09:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-09-02 16:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:09:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-09-02 16:09:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:10:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:10:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:10:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:10:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-09-02 16:10:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-09-02 16:10:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-9_6_9-2', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.50'], 'controller_servers': ['10.0.0.50'], 'control_servers': ['10.0.0.50'], 'analytics_servers': ['10.0.0.50'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IlFVdjZMTEFITDBLSGhDaGNUZTZYdzlqejU4MHRLdzVJbE9TSFBkUkpaWU0ifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjY1ODI4YjM2LWE2ZDAtNDI4Yy1hZDY1LTM2NjlmZjM5YjlkYSIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.nuN1hI9vEUH3HLS_aoNxOj0ZYZG0nG9HslVmSxcPSiIGn4omeBWeKceE0SXEyeuGIMFmj8p0MZw-HdfZrqRG6XmEp-2pL1p3WG3rQVrNth8CMfrLOB3xMZjc3NAgPQrIl1HYXAxbkq2dlfyo8h4N2sbKqcrPqdlDcbNY01P0P_JxOfUlBXP6U-YQOCg54fBBSDARPiKDdXVtRqQlDfdimFnp0_j_Dr1xQu-6lvty-A8_uU-m2pcEZ1jt3xjMEKK_CkcW12n6yH7lwrIfek1QZi_43Aln8pa6SrZiGbgZQU28cLLPGl-dEozrctC0pjf2YkxCSDtUO5KP1N9KBZXX0Q', 'kubernetes_api_server': '10.0.0.50', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-09-02 16:10:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-09-02 16:10:07 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-02 16:10:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-02 16:10:07 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-09-02 16:10:08 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-09-02 16:10:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-09-02 16:10:08 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-09-02 16:10:10 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-09-02 16:10:10 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-09-02 16:10:10 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 16:10:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-09-02 16:10:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 16:10:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-09-02 16:10:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-09-02 16:10:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 16:10:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-09-02 16:10:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-09-02 16:10:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-09-02 16:10:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23