Started by upstream project "pipeline-templates" build number 553 originally caused by: Triggered by Gerrit: https://gerrit.opensdn.io/c/opensdn-io/tf-container-builder/+/1973 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on slave-openstack-gz1_1 (openstack) in workspace /home/jenkins/workspace/collect-logs-and-cleanup [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [WS-CLEANUP] Done The recommended git tool is: git No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-jenkins.git > git init /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-jenkins.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-jenkins.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision f0edb2ba5073e836f7f735d0e1e33a24642722ef (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f f0edb2ba5073e836f7f735d0e1e33a24642722ef # timeout=10 Commit message: "Merge "increase timeout for sanity job in ansible-os-ha"" > git rev-list --no-walk f0edb2ba5073e836f7f735d0e1e33a24642722ef # timeout=10 The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-devstack.git > git init /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-devstack # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-devstack.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-devstack.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-devstack.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision 593afaf97c228569923d41458953ab5fb67c6087 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 593afaf97c228569923d41458953ab5fb67c6087 # timeout=10 Commit message: "don't ask user prompt during apt-get" > git rev-list --no-walk 593afaf97c228569923d41458953ab5fb67c6087 # timeout=10 Copied 4 artifacts from "pipeline-templates" build number 553 [collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins17588978314833684087.sh + source /home/jenkins/workspace/collect-logs-and-cleanup/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-553 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-553 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 ++ CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=I46af59da24dfd6cba029d68903bfc9b5ff3cc103 ++ GERRIT_CHANGE_ID=I46af59da24dfd6cba029d68903bfc9b5ff3cc103 ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-container-builder ++ GERRIT_PROJECT=opensdn-io/tf-container-builder ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + desc='Pipeline: pipeline-templates-553 Random: 51393 Stream: ansible-k8s-ha' + desc+='
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha' + echo 'DESCRIPTION Pipeline: pipeline-templates-553 Random: 51393 Stream: ansible-k8s-ha
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha' DESCRIPTION Pipeline: pipeline-templates-553 Random: 51393 Stream: ansible-k8s-ha
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha [description-setter] Description set: Pipeline: pipeline-templates-553 Random: 51393 Stream: ansible-k8s-ha
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha' [collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins16185444334207783798.sh + source /home/jenkins/workspace/collect-logs-and-cleanup/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-553 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-553 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 ++ CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=I46af59da24dfd6cba029d68903bfc9b5ff3cc103 ++ GERRIT_CHANGE_ID=I46af59da24dfd6cba029d68903bfc9b5ff3cc103 ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-container-builder ++ GERRIT_PROJECT=opensdn-io/tf-container-builder ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-jenkins ./patchsets-info.json + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-devstack ./patchsets-info.json [collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins6649831222203505769.sh + source /home/jenkins/workspace/collect-logs-and-cleanup/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-553 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-553 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 ++ CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_3-4 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=I46af59da24dfd6cba029d68903bfc9b5ff3cc103 ++ GERRIT_CHANGE_ID=I46af59da24dfd6cba029d68903bfc9b5ff3cc103 ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-container-builder ++ GERRIT_PROJECT=opensdn-io/tf-container-builder ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + source /home/jenkins/workspace/collect-logs-and-cleanup/deps.collect-logs-and-cleanup.51393.env ++ export PROVIDER=openstack ++ PROVIDER=openstack ++ export ENVIRONMENT_OS=rocky9 ++ ENVIRONMENT_OS=rocky9 ++ export IMAGE=4342c5af-7cec-453c-8480-30a37444aa06 ++ IMAGE=4342c5af-7cec-453c-8480-30a37444aa06 ++ export IMAGE_SSH_USER=rocky ++ IMAGE_SSH_USER=rocky ++ export INSTANCE_IDS=c55bb6e2-0da9-46a5-ad8f-393623b82a29,2d85439b-6c46-42ba-adfd-96b247d0eae7,628b4a66-725b-4f6d-91be-880a8805ffad,73112616-56a6-4579-8bbd-3fe40bed58b8,4e8a7ec8-8f09-46af-ae27-7afe900f347f, ++ INSTANCE_IDS=c55bb6e2-0da9-46a5-ad8f-393623b82a29,2d85439b-6c46-42ba-adfd-96b247d0eae7,628b4a66-725b-4f6d-91be-880a8805ffad,73112616-56a6-4579-8bbd-3fe40bed58b8,4e8a7ec8-8f09-46af-ae27-7afe900f347f, ++ export instance_ip=10.0.0.73 ++ instance_ip=10.0.0.73 ++ export CONTROLLER_NODES=10.0.0.73,10.0.0.129,10.0.0.130, ++ CONTROLLER_NODES=10.0.0.73,10.0.0.129,10.0.0.130, ++ export AGENT_NODES=10.0.0.131,10.0.0.137, ++ AGENT_NODES=10.0.0.131,10.0.0.137, ++ export ORCHESTRATOR=kubernetes ++ ORCHESTRATOR=kubernetes ++ export DEPLOYER=ansible ++ DEPLOYER=ansible ++ export JOB_LOGS_PATH=ansible-k8s-ha ++ JOB_LOGS_PATH=ansible-k8s-ha + source /home/jenkins/workspace/collect-logs-and-cleanup/vars.collect-logs-and-cleanup.51393.env ++ export MONITORING_DEPLOY_TARGET=HA ++ MONITORING_DEPLOY_TARGET=HA ++ export MONITORING_DEPLOYER=ansible ++ MONITORING_DEPLOYER=ansible ++ export MONITORING_ORCHESTRATOR=k8s ++ MONITORING_ORCHESTRATOR=k8s + export FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha + FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha + [[ -n 10.0.0.73 ]] + /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/collect_logs.sh INFO: wait for host Linux cn-jenkins-deploy-platform-ansible-k8s-396-1.novalocal 5.14.0-503.14.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Nov 15 12:04:32 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux INFO: collect logs INFO: Deploy ansible/logs (collect-logs-and-cleanup) Warning: Permanently added '10.0.0.73' (ECDSA) to the list of known hosts. Warning: Permanently added '10.0.0.73' (ECDSA) to the list of known hosts. INFO: =================== Wed Jul 23 05:58:04 AM UTC 2025 =================== [there is no tf devenv configuration to load] INFO: Applying stages logs INFO: Running stage logs at Wed Jul 23 05:58:04 AM UTC 2025 INFO: collecting logs... cp: cannot stat '/home/rocky/.tf/*.yml': No such file or directory Warning: Permanently added '10.0.0.129' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.129' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.129' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.129' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /etc/cni INFO: Collecting tf logs: /var/log/contrail/config-database INFO: Collecting tf logs: /var/log/contrail/config-database-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-database-provisioner INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rabbitmq INFO: Collecting tf logs: /var/log/contrail/zookeeper INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-k8s-396-2.novalocal:8112/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 4 drwxr-xr-x. 2 root root 6 Nov 12 2024 . drwxr-xr-x. 20 root root 4096 Jul 23 05:55 .. INFO: content of /var/crashes /var/crashes: total 4 drwxr-xr-x. 2 root root 6 Jul 23 05:55 . drwxr-xr-x. 20 root root 4096 Jul 23 05:55 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services nodetool: Failed to connect to '127.0.0.1:7200' - ConnectException: 'Connection refused (Connection refused)'. nodetool: Failed to connect to '127.0.0.1:7200' - ConnectException: 'Connection refused (Connection refused)'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. Error response from daemon: No such container: bin/bash INFO: Collecting kubernetes logs The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here INFO: Collecting kubernetes object info The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.129' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.129 ~ ~ Warning: Permanently added '10.0.0.130' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.130' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.130' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.130' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /etc/cni INFO: Collecting tf logs: /var/log/contrail/config-database INFO: Collecting tf logs: /var/log/contrail/config-database-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-database-provisioner INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rabbitmq INFO: Collecting tf logs: /var/log/contrail/zookeeper INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-k8s-396-3.novalocal:8112/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 4 drwxr-xr-x. 2 root root 6 Nov 12 2024 . drwxr-xr-x. 20 root root 4096 Jul 23 05:55 .. INFO: content of /var/crashes /var/crashes: total 4 drwxr-xr-x. 2 root root 6 Jul 23 05:55 . drwxr-xr-x. 20 root root 4096 Jul 23 05:55 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services nodetool: Failed to connect to '127.0.0.1:7200' - ConnectException: 'Connection refused (Connection refused)'. nodetool: Failed to connect to '127.0.0.1:7200' - ConnectException: 'Connection refused (Connection refused)'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. Error response from daemon: No such container: bin/bash INFO: Collecting kubernetes logs The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here INFO: Collecting kubernetes object info The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.130' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.130 ~ ~ Warning: Permanently added '10.0.0.131' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.131' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.131' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.131' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /etc/cni INFO: Collecting tf logs: /var/log/contrail/cni INFO: Collecting tf logs: /var/log/contrail/kernel-init INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rsyslogd INFO: Collecting tf logs: /var/log/contrail/vrouter-agent INFO: Collecting tf logs: /var/log/contrail/vrouter-nodemgr INFO: Collecting tf logs: /var/log/contrail/vrouter-provisioner INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-k8s-396-1.novalocal:8102/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-k8s-396-1.novalocal:8085/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 4 drwxr-xr-x. 2 root root 6 Nov 12 2024 . drwxr-xr-x. 20 root root 4096 Jul 23 05:56 .. INFO: content of /var/crashes /var/crashes: total 4 drwxr-xr-x. 2 root root 6 Jul 23 05:56 . drwxr-xr-x. 20 root root 4096 Jul 23 05:56 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services INFO: There are no required containers INFO: Collecting kubernetes logs The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here INFO: Collecting kubernetes object info The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.131' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.131 ~ ~ Warning: Permanently added '10.0.0.137' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.137' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.137' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.137' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /etc/cni INFO: Collecting tf logs: /var/log/contrail/cni INFO: Collecting tf logs: /var/log/contrail/kernel-init INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rsyslogd INFO: Collecting tf logs: /var/log/contrail/vrouter-agent INFO: Collecting tf logs: /var/log/contrail/vrouter-nodemgr INFO: Collecting tf logs: /var/log/contrail/vrouter-provisioner INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-k8s-396-2.novalocal:8102/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-k8s-396-2.novalocal:8085/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 4 drwxr-xr-x. 2 root root 6 Nov 12 2024 . drwxr-xr-x. 20 root root 4096 Jul 23 05:56 .. INFO: content of /var/crashes /var/crashes: total 4 drwxr-xr-x. 2 root root 6 Jul 23 05:56 . drwxr-xr-x. 20 root root 4096 Jul 23 05:56 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services INFO: There are no required containers INFO: Collecting kubernetes logs The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here INFO: Collecting kubernetes object info The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.137' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.137 ~ ~ Warning: Permanently added '10.0.0.73' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.73' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.73' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.73' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /etc/cni INFO: Collecting tf logs: /var/log/contrail/config-database INFO: Collecting tf logs: /var/log/contrail/config-database-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-database-provisioner INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rabbitmq INFO: Collecting tf logs: /var/log/contrail/zookeeper INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-k8s-396-1.novalocal:8112/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 4 drwxr-xr-x. 2 root root 6 Nov 12 2024 . drwxr-xr-x. 20 root root 4096 Jul 23 05:55 .. INFO: content of /var/crashes /var/crashes: total 4 drwxr-xr-x. 2 root root 6 Jul 23 05:55 . drwxr-xr-x. 20 root root 4096 Jul 23 05:55 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services nodetool: Failed to connect to '127.0.0.1:7200' - ConnectException: 'Connection refused (Connection refused)'. nodetool: Failed to connect to '127.0.0.1:7200' - ConnectException: 'Connection refused (Connection refused)'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. Error response from daemon: No such container: bin/bash INFO: Collecting kubernetes logs The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here INFO: Collecting kubernetes object info The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.73' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.73 ~ ~ INFO: Stage logs was run successfully Wed Jul 23 05:59:03 AM UTC 2025 [update tf stack configuration] Warning: Permanently added '10.0.0.73' (ED25519) to the list of known hosts. tf setup profile /home/rocky/.tf/stack.env DEPLOYER=ansible CONTRAIL_CONTAINER_TAG=master-1_9_7_3-4 CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_3-4 CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ORCHESTRATOR=kubernetes OPENSTACK_VERSION="yoga" CONTROLLER_NODES="10.0.0.73 10.0.0.129 10.0.0.130 " AGENT_NODES="10.0.0.131 10.0.0.137 " CONTROL_NODES="10.0.0.73 10.0.0.129 10.0.0.130 " SSL_ENABLE="false" LEGACY_ANALYTICS_ENABLE="true" HUGE_PAGES_1G= CONTAINER_RUNTIME=docker K8S_CA= DEPLOY_IPA_SERVER= IPA_PASSWORD= AUTH_PASSWORD='contrail123' AUTH_URL='' INFO: Successful deployment Wed Jul 23 05:59:03 AM UTC 2025 DEBUG: kill running child jobs: INFO: Deploy logs finished INFO: Copy logs from host to workspace Warning: Permanently added '10.0.0.73' (ECDSA) to the list of known hosts. ~/workspace/collect-logs-and-cleanup ~/workspace/collect-logs-and-cleanup Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. INFO: Logs collected at http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/73/1973/4/templates_553/ansible-k8s-ha ~/workspace/collect-logs-and-cleanup + /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/remove_workers.sh nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-07-23T05:31:31.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | management=10.0.0.73 | | config_drive | | | created | 2025-07-23T05:31:12Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | d0ea01ed078c820c8cbbeeee315d258ec5e02e6a34b32ee9b53bf545 | | id | c55bb6e2-0da9-46a5-ad8f-393623b82a29 | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-k8s-396_1 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-07-23T05:31:31Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='70cc976f-22b5-4e79-8aa9-70562bc43432' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-07-23T05:32:17.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | management=10.0.0.129 | | config_drive | | | created | 2025-07-23T05:32:00Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | 7d27d2705dca64a1390201840db75044265f05d54139be7110894342 | | id | 2d85439b-6c46-42ba-adfd-96b247d0eae7 | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-k8s-396_2 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-07-23T05:32:17Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='04cd4726-a86c-4262-85a0-b7ae95b643c9' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-07-23T05:33:04.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | management=10.0.0.130 | | config_drive | | | created | 2025-07-23T05:32:47Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | 4f0a24f2353ec9a8464d750af08d2f69e29b2dbad80d0a93775cdaeb | | id | 628b4a66-725b-4f6d-91be-880a8805ffad | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-k8s-396_3 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-07-23T05:33:04Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='63b35f12-9cd2-4973-a72d-53d4008600da' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-07-23T05:35:57.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | management=10.0.0.131 | | config_drive | | | created | 2025-07-23T05:35:39Z | | flavor | STD3-2-8 (2d9866a9-e955-4986-b00a-340ca54b2cac) | | hostId | 11d4cd31906e2d6fcd4a7c1036f00d8b3e591f58e1bd24fced14b8aa | | id | 73112616-56a6-4579-8bbd-3fe40bed58b8 | | image | N/A (booted from volume) | | key_name | worker | | name | an_jenkins-deploy-platform-ansible-k8s-396_1 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-07-23T05:35:57Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='a2765a2a-3bf0-41d7-ae4a-1e96049177e1' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-07-23T05:36:43.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | management=10.0.0.137 | | config_drive | | | created | 2025-07-23T05:36:26Z | | flavor | STD3-2-8 (2d9866a9-e955-4986-b00a-340ca54b2cac) | | hostId | d0ea01ed078c820c8cbbeeee315d258ec5e02e6a34b32ee9b53bf545 | | id | 4e8a7ec8-8f09-46af-ae27-7afe900f347f | | image | N/A (booted from volume) | | key_name | worker | | name | an_jenkins-deploy-platform-ansible-k8s-396_2 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-07-23T05:36:43Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='ae149b48-babe-4816-b573-93852d88da11' | +-----------------------------+----------------------------------------------------------+ Archiving artifacts Finished: SUCCESS