2024-11-15 01:11:32 INFO juju unit_agent.go:289 Starting unit workers for "tf-kubernetes-master/0" 2024-11-15 01:11:32 INFO juju.worker.apicaller connect.go:163 [2e0d45] "unit-tf-kubernetes-master-0" successfully connected to "252.41.0.1:17070" 2024-11-15 01:11:32 INFO juju.worker.apicaller connect.go:260 [2e0d45] password changed for "unit-tf-kubernetes-master-0" 2024-11-15 01:11:32 INFO juju.worker.apicaller connect.go:163 [2e0d45] "unit-tf-kubernetes-master-0" successfully connected to "252.41.0.1:17070" 2024-11-15 01:11:32 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-11-15 01:11:32 INFO juju.worker.logger logger.go:120 logger worker started 2024-11-15 01:11:32 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-11-15 01:11:32.409778256 +0000 UTC 2024-11-15 01:11:32 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-11-15 01:11:32 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-11-15 01:11:32 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-11-15 01:11:32.425055849 +0000 UTC 2024-11-15 01:11:32 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.41:17070 252.41.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-11-15 01:11:32 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-11-15 01:11:32.425512462 +0000 UTC 2024-11-15 01:11:32 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-11-15 01:11:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-11-15 01:11:32 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-tf-kubernetes-master-0/run.socket } 2024-11-15 01:11:32 INFO juju.worker.uniter uniter.go:335 unit "tf-kubernetes-master/0" started 2024-11-15 01:11:32 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-11-15 01:11:32 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-11-15 01:11:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation install local:focal/contrail-kubernetes-master-0 for tf-kubernetes-master/0 2024-11-15 01:11:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-11-15 01:11:32 INFO juju.worker.uniter.charm bundles.go:81 downloading local:focal/contrail-kubernetes-master-0 from API server 2024-11-15 01:11:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-11-15 01:11:32 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "local:focal/contrail-kubernetes-master-0" 2024-11-15 01:11:32 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "local:focal/contrail-kubernetes-master-0" 2024-11-15 01:11:32 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "local:focal/contrail-kubernetes-master-0" 2024-11-15 01:11:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install local:focal/contrail-kubernetes-master-0" for tf-kubernetes-master/0 2024-11-15 01:11:32 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for tf-kubernetes-master/0: [] ok=true 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for tf-kubernetes-master/0: [] ok=true 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for tf-kubernetes-master/0: ok=true 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for tf-kubernetes-master/0: ok=true, hashes=[927785efb43a9c2478d616d8323a14134b646893b434027a81d42c0327fb2850] 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for tf-kubernetes-master/0: ok=true, hashes=[3dfed8430827e8ff7931201b24a9d468b7bcf27b57ef810c7ca3686843eee08b] 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for tf-kubernetes-master/0: ok=true, hashes=[8e9367d1e5e89998f581ec7b1002b188297cd95b4dd5dd51b676ce8320b5a7d8] 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for tf-kubernetes-master/0 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for tf-kubernetes-master/0: ok=true 2024-11-15 01:11:32 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for tf-kubernetes-master/0 2024-11-15 01:11:32 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-11-15 01:11:32 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-11-15 01:11:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for tf-kubernetes-master/0 2024-11-15 01:11:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run install hook) 2024-11-15 01:12:05 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/1:{0}] map[] []}} 2024-11-15 01:12:07 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{0}] map[] []}} 2024-11-15 01:12:24 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {24 {map[tf-kubernetes-node/0:{0}] map[] []}} 2024-11-15 01:12:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-11-15 01:12:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:12:32 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing) 2024-11-15 01:12:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:12:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-11-15 01:12:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run install hook) 2024-11-15 01:12:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for tf-kubernetes-master/0 2024-11-15 01:12:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for tf-kubernetes-master/0 2024-11-15 01:12:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-11-15 01:12:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:12:32 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing logrotate with options: ['--option=Dpkg::Options::=--force-confold'] 2024-11-15 01:12:32 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 logrotate is already the newest version (3.14.0-4ubuntu3). 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-15 01:12:33 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing ['apt-transport-https', 'ca-certificates', 'curl', 'software-properties-common'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 ca-certificates is already the newest version (20230311ubuntu0.20.04.1). 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 curl is already the newest version (7.68.0-1ubuntu2.22). 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 software-properties-common is already the newest version (0.99.9.12). 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 apt-transport-https is already the newest version (2.0.10). 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease 2024-11-15 01:12:33 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease 2024-11-15 01:12:33 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {27 {map[kubernetes-master/0:{1}] map[] []}} 2024-11-15 01:12:35 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-11-15 01:12:35 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing docker.io with options: ['--option=Dpkg::Options::=--force-confold'] 2024-11-15 01:12:35 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-11-15 01:12:35 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-11-15 01:12:35 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 docker.io is already the newest version (24.0.5-0ubuntu1~20.04.1). 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-15 01:12:36 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Installing ['docker-compose'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading package lists... 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Building dependency tree... 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 Reading state information... 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 docker-compose is already the newest version (1.25.0-1). 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-11-15 01:12:36 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2024-11-15 01:12:37 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-11-15 01:12:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for tf-kubernetes-master/0 2024-11-15 01:12:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:12:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run install hook) 2024-11-15 01:12:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:12:37 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:contrail-controller tf-controller:contrail-controller" 2024-11-15 01:12:37 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-node:contrail-kubernetes-config tf-kubernetes-master:contrail-kubernetes-config" 2024-11-15 01:12:37 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:kube-api-endpoint kubernetes-master:kube-api-endpoint" 2024-11-15 01:12:37 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "tf-kubernetes-master/0" (leader=true) entered scope for relation "tf-kubernetes-master:kubernetes-master-cluster" 2024-11-15 01:12:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (23; app: tf-controller) hook for tf-kubernetes-master/0 2024-11-15 01:12:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-11-15 01:12:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-11-15 01:12:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-11-15 01:12:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-11-15 01:12:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-created hook 2024-11-15 01:12:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:12:48 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-controller-relation-created" hook (missing) 2024-11-15 01:12:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (23; app: tf-controller) hook" for tf-kubernetes-master/0 2024-11-15 01:12:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:12:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (23; app: tf-controller) hook) 2024-11-15 01:12:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:12:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (24; app: tf-kubernetes-node) hook for tf-kubernetes-master/0 2024-11-15 01:12:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-11-15 01:12:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-11-15 01:12:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-11-15 01:12:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-11-15 01:12:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-created hook 2024-11-15 01:12:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:12:59 INFO juju.worker.uniter.operation runhook.go:162 skipped "contrail-kubernetes-config-relation-created" hook (missing) 2024-11-15 01:12:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (24; app: tf-kubernetes-node) hook" for tf-kubernetes-master/0 2024-11-15 01:12:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:12:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (24; app: tf-kubernetes-node) hook) 2024-11-15 01:12:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:12:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (18; app: tf-kubernetes-master) hook for tf-kubernetes-master/0 2024-11-15 01:12:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-11-15 01:13:10 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-11-15 01:13:10 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-11-15 01:13:10 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-11-15 01:13:10 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kubernetes-master-cluster-relation-created hook 2024-11-15 01:13:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:13:11 INFO juju.worker.uniter.operation runhook.go:162 skipped "kubernetes-master-cluster-relation-created" hook (missing) 2024-11-15 01:13:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (18; app: tf-kubernetes-master) hook" for tf-kubernetes-master/0 2024-11-15 01:13:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:13:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (18; app: tf-kubernetes-master) hook) 2024-11-15 01:13:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:13:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (27; app: kubernetes-master) hook for tf-kubernetes-master/0 2024-11-15 01:13:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-11-15 01:13:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-created hook 2024-11-15 01:13:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:13:49 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-created" hook (missing) 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (27; app: kubernetes-master) hook" for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:13:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-created (27; app: kubernetes-master) hook) 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for tf-kubernetes-master/0 2024-11-15 01:13:49 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-11-15 01:13:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-11-15 01:13:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-11-15 01:13:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:13:49 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster current info: {'tf-kubernetes-master/0': '10.0.0.41'} 2024-11-15 01:13:49 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster saved info: {} 2024-11-15 01:13:49 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Cluster info: {'tf-kubernetes-master/0': '10.0.0.41'} 2024-11-15 01:13:49 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:13:50 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-11-15 01:13:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for tf-kubernetes-master/0 2024-11-15 01:13:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:13:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run leader-elected hook) 2024-11-15 01:13:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:13:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:13:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for tf-kubernetes-master/0 2024-11-15 01:13:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-11-15 01:13:50 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{1}] map[] []}} 2024-11-15 01:13:50 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-11-15 01:13:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-11-15 01:13:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for tf-kubernetes-master/0 2024-11-15 01:13:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for tf-kubernetes-master/0 2024-11-15 01:13:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-11-15 01:13:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:13:52 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 /usr/bin/rsync -r --executability /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/files/plugins/ /usr/local/lib/nagios/plugins 2024-11-15 01:13:52 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Nagios user not set up, nrpe checks not updated 2024-11-15 01:13:52 WARNING unit.tf-kubernetes-master/0.config-changed logger.go:60 Error: No such object: nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_1_8_5-3 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 master-1_1_8_5-3: Pulling from contrail-kubernetes-kube-manager 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 2d473b07cdd5: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 70572b0c32ae: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 d27e3cc7f0bc: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 16a4ce82f76c: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 ecd7efe7fa90: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 ca1dcec63e32: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 9cca6d79bcef: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 d50b79038d44: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 8f519ccd015c: Already exists 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c3da12e6973f: Pulling fs layer 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c1a57c578978: Pulling fs layer 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c1a57c578978: Download complete 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c3da12e6973f: Verifying Checksum 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c3da12e6973f: Download complete 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c3da12e6973f: Pull complete 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 c1a57c578978: Pull complete 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 Digest: sha256:c54948ddb25173841aae22f9303e492ed1295b90aafcccae604312e9049ca32c 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 Status: Downloaded newer image for nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_1_8_5-3 2024-11-15 01:13:52 DEBUG unit.tf-kubernetes-master/0.config-changed logger.go:60 nexus.gz1.opensdn.io:5101/contrail-kubernetes-kube-manager:master-1_1_8_5-3 2024-11-15 01:13:52 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': [], 'control_servers': [], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': [], 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:13:52 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-11-15 01:13:53 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:13:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for tf-kubernetes-master/0 2024-11-15 01:13:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:13:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run config-changed hook) 2024-11-15 01:13:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:13:53 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-11-15 01:13:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for tf-kubernetes-master/0 2024-11-15 01:13:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run start hook) 2024-11-15 01:14:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run start hook) 2024-11-15 01:14:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for tf-kubernetes-master/0 2024-11-15 01:14:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for tf-kubernetes-master/0 2024-11-15 01:14:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-11-15 01:14:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:14:42 INFO juju.worker.uniter.operation runhook.go:162 skipped "start" hook (missing) 2024-11-15 01:14:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for tf-kubernetes-master/0 2024-11-15 01:14:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:14:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run start hook) 2024-11-15 01:14:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:14:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:14:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:14:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-11-15 01:14:42 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-11-15 01:14:42.898126614 +0000 UTC 2024-11-15 01:14:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-11-15 01:14:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:43 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-joined hook for tf-controller/0 2024-11-15 01:14:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:14:44 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-joined" hook (via explicit, bespoke hook script) 2024-11-15 01:14:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:14:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (23; unit: tf-controller/0) hook) 2024-11-15 01:14:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:14:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:14:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (27; unit: kubernetes-master/0) hook for tf-kubernetes-master/0 2024-11-15 01:14:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/0) hook) 2024-11-15 01:14:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/0) hook) 2024-11-15 01:14:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-joined hook for kubernetes-master/0 2024-11-15 01:14:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:14:48 INFO juju.worker.uniter.operation runhook.go:162 skipped "kube-api-endpoint-relation-joined" hook (missing) 2024-11-15 01:14:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:14:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (27; unit: kubernetes-master/0) hook) 2024-11-15 01:14:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:14:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:14:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:14:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:14:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{2}] map[] []}} 2024-11-15 01:14:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:14:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:14:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-11-15 01:14:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:14:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:14:59 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:15:00 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:15:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:15:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:15:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:15:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:15:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/0 2024-11-15 01:15:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-11-15 01:15:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-11-15 01:15:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/0 2024-11-15 01:15:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:15:22 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-11-15 01:15:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:15:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/0) hook) 2024-11-15 01:15:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:15:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:15:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:15:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:15:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:15:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:15:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-11-15 01:15:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:15:24 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:15:24 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': None, 'kubernetes_api_secure_port': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:15:24 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:15:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:15:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:15:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:15:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:15:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:15:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (27; unit: kubernetes-master/0) hook for tf-kubernetes-master/0 2024-11-15 01:15:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/0) hook) 2024-11-15 01:16:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/0) hook) 2024-11-15 01:16:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-11-15 01:16:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-11-15 01:16:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running kube-api-endpoint-relation-changed hook for kubernetes-master/0 2024-11-15 01:16:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:16:22 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kube-api-endpoint:27: Can't get secret for token: Incorrect padding 2024-11-15 01:16:22 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 kube-api-endpoint:27: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': [], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:16:22 INFO juju.worker.uniter.operation runhook.go:159 ran "kube-api-endpoint-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:16:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (27; unit: kubernetes-master/0) hook" for tf-kubernetes-master/0 2024-11-15 01:16:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:16:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (27; unit: kubernetes-master/0) hook) 2024-11-15 01:16:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:16:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:16:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:16:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/0) hook for tf-kubernetes-master/0 2024-11-15 01:16:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-11-15 01:17:22 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-11-15 01:17:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-11-15 01:17:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/0 2024-11-15 01:17:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:17:36 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{3}] map[] []}} 2024-11-15 01:17:36 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-11-15 01:17:36 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:17:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:17:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/0) hook) 2024-11-15 01:17:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:17:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:17:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:17:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:39 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:39 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:39 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-11-15 01:17:39 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:17:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:17:39 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:17:39 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:17:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:17:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:17:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:17:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:17:39 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/0 2024-11-15 01:17:39 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-11-15 01:17:48 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{4}] map[] []}} 2024-11-15 01:17:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-11-15 01:17:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-11-15 01:17:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-11-15 01:17:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-joined hook for tf-kubernetes-node/1 2024-11-15 01:17:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:17:49 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-joined" hook (via explicit, bespoke hook script) 2024-11-15 01:17:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-11-15 01:17:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:17:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-joined (24; unit: tf-kubernetes-node/1) hook) 2024-11-15 01:17:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:17:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:17:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:17:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-11-15 01:17:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:17:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:17:56 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:17:56 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:17:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (24; unit: tf-kubernetes-node/1) hook for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-11-15 01:17:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-11-15 01:17:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-kubernetes-config-relation-changed hook for tf-kubernetes-node/1 2024-11-15 01:17:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:17:57 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-kubernetes-config-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:17:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (24; unit: tf-kubernetes-node/1) hook" for tf-kubernetes-master/0 2024-11-15 01:17:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:17:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (24; unit: tf-kubernetes-node/1) hook) 2024-11-15 01:17:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:17:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:17:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-15 01:17:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:17:57 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{5}] map[] []}} 2024-11-15 01:17:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:17:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:17:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:17:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:17:57 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-11-15 01:18:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:18:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:18:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:18:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-11-15 01:18:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:18:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:18:11 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:18:11 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{6}] map[] []}} 2024-11-15 01:18:12 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:18:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:18:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:18:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:18:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': None, 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:18:12 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:18:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:18:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:18:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:18:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-15 01:18:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:18:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:21:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-11-15 01:21:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:21:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-11-15 01:21:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:21:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:21:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:21:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:21:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IjJsbEhQd0QtbkgyeUs2dHBRZFUwV2g3SkFuWkxXdDBxaTNSaXd1NWRob0UifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImU2MGYwNWEyLTg0N2YtNDdlMC1iNTE5LTVjYjUwODUwZDYzNCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ro5UNWe-WU84L85WvZLnC1obPCTHnH2mFBnSONy6i9GSQ0WA1nhn3vx6UYfYqBiID2FeTWVI1TISWwDM81VZONpELaw2QHX_UpTAojx67S7UWedtUyV5uETQQ6xHxx5BbqaJrpskmKrzyOLiFTidW3mJtafQZsNkT6_Ssatzr6LNVyWekBdaOkfGRBmH-3-2PziorjkbNILBZlFlRhiBBjNskeZZ0C8nokND4ZBJ-8M_9Yr72gkZfzC-QAW9_xqN-ZDE60NwORLZ4ytcizkurfVVe1ZTTU_DuVY3OdfYgVryzEX0hIbSlRk2EMSBhICdBpbpyTbyvrPHEJU9EeceDw', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-11-15 01:21:31 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Writing file /etc/contrail/common_kubemanager.env root:root 600 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has been created and is not logged. 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Making dir /etc/contrail/contrail-kubernetes-master root:root 755 2024-11-15 01:21:31 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Writing file /etc/contrail/contrail-kubernetes-master/docker-compose.yaml root:root 600 2024-11-15 01:21:31 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has been created and is not logged. 2024-11-15 01:21:31 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 Creating contrail-kubernetes-master_node-init_1 ... 2024-11-15 01:21:32 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60  Creating contrail-kubernetes-master_node-init_1 ... done Creating contrail-kubernetes-master_kubemanager_1 ... 2024-11-15 01:21:33 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for tf-kubernetes-master/0: ok=true 2024-11-15 01:21:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-15 01:21:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:21:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:21:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:21:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:21:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:21:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:21:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:22:08 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for tf-kubernetes-master/0 : {23 {map[tf-controller/0:{7}] map[] []}} 2024-11-15 01:22:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:22:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:22:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:22:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:22:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:22:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (23; unit: tf-controller/0) hook for tf-kubernetes-master/0 2024-11-15 01:22:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:22:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:22:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:22:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:22:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running contrail-controller-relation-changed hook for tf-controller/0 2024-11-15 01:22:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:22:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: ZIU: stage from relation None 2024-11-15 01:22:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IjJsbEhQd0QtbkgyeUs2dHBRZFUwV2g3SkFuWkxXdDBxaTNSaXd1NWRob0UifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImU2MGYwNWEyLTg0N2YtNDdlMC1iNTE5LTVjYjUwODUwZDYzNCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ro5UNWe-WU84L85WvZLnC1obPCTHnH2mFBnSONy6i9GSQ0WA1nhn3vx6UYfYqBiID2FeTWVI1TISWwDM81VZONpELaw2QHX_UpTAojx67S7UWedtUyV5uETQQ6xHxx5BbqaJrpskmKrzyOLiFTidW3mJtafQZsNkT6_Ssatzr6LNVyWekBdaOkfGRBmH-3-2PziorjkbNILBZlFlRhiBBjNskeZZ0C8nokND4ZBJ-8M_9Yr72gkZfzC-QAW9_xqN-ZDE60NwORLZ4ytcizkurfVVe1ZTTU_DuVY3OdfYgVryzEX0hIbSlRk2EMSBhICdBpbpyTbyvrPHEJU9EeceDw', 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:22:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-11-15 01:22:12 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-11-15 01:22:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-11-15 01:22:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-11-15 01:22:12 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Changing permissions on existing content: 33152 -> 384 2024-11-15 01:22:12 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Configuration file has not been changed. 2024-11-15 01:22:12 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 contrail-controller:23: Services actual count: 2, required count: 2 2024-11-15 01:22:14 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-11-15 01:22:14 WARNING unit.tf-kubernetes-master/0.contrail-controller-relation-changed logger.go:60 data = yaml.load(fh) 2024-11-15 01:22:14 INFO juju.worker.uniter.operation runhook.go:159 ran "contrail-controller-relation-changed" hook (via explicit, bespoke hook script) 2024-11-15 01:22:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (23; unit: tf-controller/0) hook" for tf-kubernetes-master/0 2024-11-15 01:22:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:22:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run relation-changed (23; unit: tf-controller/0) hook) 2024-11-15 01:22:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:22:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:22:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:22:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:22:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:22:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:22:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-15 01:27:08 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-11-15 01:27:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:27:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:27:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:27:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:27:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:27:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-11-15 01:27:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:27:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:27:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:27:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:27:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:27:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-11-15 01:27:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IjJsbEhQd0QtbkgyeUs2dHBRZFUwV2g3SkFuWkxXdDBxaTNSaXd1NWRob0UifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImU2MGYwNWEyLTg0N2YtNDdlMC1iNTE5LTVjYjUwODUwZDYzNCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ro5UNWe-WU84L85WvZLnC1obPCTHnH2mFBnSONy6i9GSQ0WA1nhn3vx6UYfYqBiID2FeTWVI1TISWwDM81VZONpELaw2QHX_UpTAojx67S7UWedtUyV5uETQQ6xHxx5BbqaJrpskmKrzyOLiFTidW3mJtafQZsNkT6_Ssatzr6LNVyWekBdaOkfGRBmH-3-2PziorjkbNILBZlFlRhiBBjNskeZZ0C8nokND4ZBJ-8M_9Yr72gkZfzC-QAW9_xqN-ZDE60NwORLZ4ytcizkurfVVe1ZTTU_DuVY3OdfYgVryzEX0hIbSlRk2EMSBhICdBpbpyTbyvrPHEJU9EeceDw', 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:27:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-11-15 01:27:08 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:27:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:27:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-11-15 01:27:08 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:27:08 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:27:09 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-11-15 01:27:11 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-11-15 01:27:11 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-11-15 01:27:11 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-15 01:27:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:27:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:27:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:27:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:27:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:27:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:27:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:27:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:27:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:32:29 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-11-15 01:32:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:32:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:32:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:32:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:32:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:32:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-11-15 01:32:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:32:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:32:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:32:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:32:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:32:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-11-15 01:32:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IjJsbEhQd0QtbkgyeUs2dHBRZFUwV2g3SkFuWkxXdDBxaTNSaXd1NWRob0UifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImU2MGYwNWEyLTg0N2YtNDdlMC1iNTE5LTVjYjUwODUwZDYzNCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ro5UNWe-WU84L85WvZLnC1obPCTHnH2mFBnSONy6i9GSQ0WA1nhn3vx6UYfYqBiID2FeTWVI1TISWwDM81VZONpELaw2QHX_UpTAojx67S7UWedtUyV5uETQQ6xHxx5BbqaJrpskmKrzyOLiFTidW3mJtafQZsNkT6_Ssatzr6LNVyWekBdaOkfGRBmH-3-2PziorjkbNILBZlFlRhiBBjNskeZZ0C8nokND4ZBJ-8M_9Yr72gkZfzC-QAW9_xqN-ZDE60NwORLZ4ytcizkurfVVe1ZTTU_DuVY3OdfYgVryzEX0hIbSlRk2EMSBhICdBpbpyTbyvrPHEJU9EeceDw', 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:32:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-11-15 01:32:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:32:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:32:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-11-15 01:32:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:32:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:32:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-11-15 01:32:33 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-11-15 01:32:33 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-11-15 01:32:33 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-15 01:32:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:32:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:32:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:32:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:32:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:32:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:32:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:32:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:32:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:36:29 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-11-15 01:36:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:36:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:36:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:36:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:36:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:36:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-11-15 01:36:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:36:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:36:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:36:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:36:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:36:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-11-15 01:36:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IjJsbEhQd0QtbkgyeUs2dHBRZFUwV2g3SkFuWkxXdDBxaTNSaXd1NWRob0UifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImU2MGYwNWEyLTg0N2YtNDdlMC1iNTE5LTVjYjUwODUwZDYzNCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ro5UNWe-WU84L85WvZLnC1obPCTHnH2mFBnSONy6i9GSQ0WA1nhn3vx6UYfYqBiID2FeTWVI1TISWwDM81VZONpELaw2QHX_UpTAojx67S7UWedtUyV5uETQQ6xHxx5BbqaJrpskmKrzyOLiFTidW3mJtafQZsNkT6_Ssatzr6LNVyWekBdaOkfGRBmH-3-2PziorjkbNILBZlFlRhiBBjNskeZZ0C8nokND4ZBJ-8M_9Yr72gkZfzC-QAW9_xqN-ZDE60NwORLZ4ytcizkurfVVe1ZTTU_DuVY3OdfYgVryzEX0hIbSlRk2EMSBhICdBpbpyTbyvrPHEJU9EeceDw', 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:36:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-11-15 01:36:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:36:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:36:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-11-15 01:36:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:36:29 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:36:29 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-11-15 01:36:32 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-11-15 01:36:32 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-11-15 01:36:32 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-15 01:36:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:36:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:36:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:36:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:36:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:36:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:36:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:36:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:36:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:42:22 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for tf-kubernetes-master/0 2024-11-15 01:42:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:42:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:42:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:42:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27 2024-11-15 01:42:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:42:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for tf-kubernetes-master/0 2024-11-15 01:42:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:42:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:42:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:42:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:42:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-tf-kubernetes-master-0/agent.socket } 2024-11-15 01:42:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 ZIU: stage from config None 2024-11-15 01:42:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 CTX: {'module': 'kubernetes-master', 'log_level': 'SYS_DEBUG', 'container_registry': 'nexus.gz1.opensdn.io:5101', 'contrail_version_tag': 'master-1_1_8_5-3', 'contrail_version': 9999, 'kubemanager_servers': ['10.0.0.41'], 'controller_servers': ['10.0.0.41'], 'control_servers': ['10.0.0.41'], 'analytics_servers': ['10.0.0.41'], 'ssl_enabled': False, 'certs_hash': '', 'cluster_name': 'k8s', 'cluster_project': '{}', 'cluster_network': '{}', 'pod_subnets': '10.32.0.0/12', 'ip_fabric_subnets': '10.64.0.0/12', 'service_subnets': '10.96.0.0/12', 'ip_fabric_forwarding': False, 'ip_fabric_snat': True, 'host_network_service': False, 'public_fip_pool': "{'domain':'default-domain','project':'k8s-default','name':'__fip_pool_public__','network':'__public__'}", 'kube_manager_token': 'eyJhbGciOiJSUzI1NiIsImtpZCI6IjJsbEhQd0QtbkgyeUs2dHBRZFUwV2g3SkFuWkxXdDBxaTNSaXd1NWRob0UifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJjb250cmFpbCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJjb250cmFpbC1rdWJlbWFuYWdlciIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImU2MGYwNWEyLTg0N2YtNDdlMC1iNTE5LTVjYjUwODUwZDYzNCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDpjb250cmFpbDpjb250cmFpbC1rdWJlbWFuYWdlciJ9.ro5UNWe-WU84L85WvZLnC1obPCTHnH2mFBnSONy6i9GSQ0WA1nhn3vx6UYfYqBiID2FeTWVI1TISWwDM81VZONpELaw2QHX_UpTAojx67S7UWedtUyV5uETQQ6xHxx5BbqaJrpskmKrzyOLiFTidW3mJtafQZsNkT6_Ssatzr6LNVyWekBdaOkfGRBmH-3-2PziorjkbNILBZlFlRhiBBjNskeZZ0C8nokND4ZBJ-8M_9Yr72gkZfzC-QAW9_xqN-ZDE60NwORLZ4ytcizkurfVVe1ZTTU_DuVY3OdfYgVryzEX0hIbSlRk2EMSBhICdBpbpyTbyvrPHEJU9EeceDw', 'kubernetes_api_server': '10.0.0.41', 'kubernetes_api_secure_port': '6443', 'cloud_orchestrators': ['kubernetes'], 'cloud_orchestrator': 'kubernetes', 'nested_mode': False, 'config_analytics_ssl_available': True, 'logging': 'logging:\n driver: json-file\n options:\n max-file: "5"\n max-size: "20m"\n'} 2024-11-15 01:42:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/common_kubemanager.env 2024-11-15 01:42:34 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:42:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:42:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Render and store new configuration: /etc/contrail/contrail-kubernetes-master/docker-compose.yaml 2024-11-15 01:42:34 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Changing permissions on existing content: 33152 -> 384 2024-11-15 01:42:34 INFO unit.tf-kubernetes-master/0.juju-log server.go:316 Configuration file has not been changed. 2024-11-15 01:42:34 DEBUG unit.tf-kubernetes-master/0.juju-log server.go:316 Services actual count: 2, required count: 2 2024-11-15 01:42:37 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 /var/lib/juju/agents/unit-tf-kubernetes-master-0/charm/hooks/docker_engine.py:210: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2024-11-15 01:42:37 WARNING unit.tf-kubernetes-master/0.update-status logger.go:60 data = yaml.load(fh) 2024-11-15 01:42:37 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-15 01:42:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for tf-kubernetes-master/0 2024-11-15 01:42:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-15 01:42:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for tf-kubernetes-master/0 uniter (run update-status hook) 2024-11-15 01:42:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for tf-kubernetes-master/0 2024-11-15 01:42:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-15 01:42:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-controller/0" already joined relation 23 2024-11-15 01:42:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/0" already joined relation 24 2024-11-15 01:42:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "tf-kubernetes-node/1" already joined relation 24 2024-11-15 01:42:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 27