Started by upstream project "pipeline-templates" build number 570 originally caused by: Triggered by Gerrit: https://gerrit.opensdn.io/c/opensdn-io/tf-test/+/1976 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on slave-openstack-gz1_1 (openstack) in workspace /home/jenkins/workspace/collect-logs-and-cleanup [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [WS-CLEANUP] Done The recommended git tool is: git No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-jenkins.git > git init /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-jenkins.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-jenkins.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision f0edb2ba5073e836f7f735d0e1e33a24642722ef (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f f0edb2ba5073e836f7f735d0e1e33a24642722ef # timeout=10 Commit message: "Merge "increase timeout for sanity job in ansible-os-ha"" > git rev-list --no-walk f0edb2ba5073e836f7f735d0e1e33a24642722ef # timeout=10 The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-devstack.git > git init /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-devstack # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-devstack.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-devstack.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-devstack.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision 593afaf97c228569923d41458953ab5fb67c6087 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 593afaf97c228569923d41458953ab5fb67c6087 # timeout=10 Commit message: "don't ask user prompt during apt-get" > git rev-list --no-walk 593afaf97c228569923d41458953ab5fb67c6087 # timeout=10 Copied 4 artifacts from "pipeline-templates" build number 570 [collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins14442659075007518516.sh + source /home/jenkins/workspace/collect-logs-and-cleanup/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-570 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-570 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 ++ CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=Ic9573d0b3c01b541c84a9a3def1df190d8e16ddf ++ GERRIT_CHANGE_ID=Ic9573d0b3c01b541c84a9a3def1df190d8e16ddf ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-test ++ GERRIT_PROJECT=opensdn-io/tf-test ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + desc='Pipeline: pipeline-templates-570 Random: 38425 Stream: ansible-os-ha' + desc+='
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha' + echo 'DESCRIPTION Pipeline: pipeline-templates-570 Random: 38425 Stream: ansible-os-ha
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha' DESCRIPTION Pipeline: pipeline-templates-570 Random: 38425 Stream: ansible-os-ha
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha [description-setter] Description set: Pipeline: pipeline-templates-570 Random: 38425 Stream: ansible-os-ha
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha' [collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins6498046517567758591.sh + source /home/jenkins/workspace/collect-logs-and-cleanup/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-570 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-570 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 ++ CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=Ic9573d0b3c01b541c84a9a3def1df190d8e16ddf ++ GERRIT_CHANGE_ID=Ic9573d0b3c01b541c84a9a3def1df190d8e16ddf ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-test ++ GERRIT_PROJECT=opensdn-io/tf-test ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-jenkins ./patchsets-info.json + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-devstack ./patchsets-info.json [collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins9436374930169229573.sh + source /home/jenkins/workspace/collect-logs-and-cleanup/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-570 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-570 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 ++ CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_9_7_6-3 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=Ic9573d0b3c01b541c84a9a3def1df190d8e16ddf ++ GERRIT_CHANGE_ID=Ic9573d0b3c01b541c84a9a3def1df190d8e16ddf ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-test ++ GERRIT_PROJECT=opensdn-io/tf-test ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + source /home/jenkins/workspace/collect-logs-and-cleanup/deps.collect-logs-and-cleanup.38425.env ++ export PROVIDER=openstack ++ PROVIDER=openstack ++ export ENVIRONMENT_OS=ubuntu22 ++ ENVIRONMENT_OS=ubuntu22 ++ head -1 ++ export DATA_NETWORK=10.20.0.0/24 ++ DATA_NETWORK=10.20.0.0/24 ++ export VROUTER_GATEWAY=10.20.0.1 ++ VROUTER_GATEWAY=10.20.0.1 ++ export IMAGE=4744ca8a-852c-4f31-8cf0-48b97ea797c5 ++ IMAGE=4744ca8a-852c-4f31-8cf0-48b97ea797c5 ++ export IMAGE_SSH_USER=ubuntu ++ IMAGE_SSH_USER=ubuntu ++ export INSTANCE_IDS=fec5abc2-b0fa-40dc-8114-f69c86269355,10ff05c2-4300-4506-867e-f1163186d0fa,0e287092-618c-479c-bee0-cbb942138bcd,d86228ab-7280-4b13-b67b-24b71b71af9a,1c6b3233-a573-4993-906f-a53285637933, ++ INSTANCE_IDS=fec5abc2-b0fa-40dc-8114-f69c86269355,10ff05c2-4300-4506-867e-f1163186d0fa,0e287092-618c-479c-bee0-cbb942138bcd,d86228ab-7280-4b13-b67b-24b71b71af9a,1c6b3233-a573-4993-906f-a53285637933, ++ export instance_ip=10.0.0.38 ++ instance_ip=10.0.0.38 ++ export CONTROLLER_NODES=10.0.0.38,10.0.0.254,10.0.0.50, ++ CONTROLLER_NODES=10.0.0.38,10.0.0.254,10.0.0.50, ++ export CONTROL_NODES=10.20.0.17,10.20.0.254,10.20.0.14, ++ CONTROL_NODES=10.20.0.17,10.20.0.254,10.20.0.14, ++ export AGENT_NODES=10.0.0.48,10.0.0.49, ++ AGENT_NODES=10.0.0.48,10.0.0.49, ++ export ORCHESTRATOR=openstack ++ ORCHESTRATOR=openstack ++ export DEPLOYER=ansible ++ DEPLOYER=ansible ++ export JOB_LOGS_PATH=ansible-os-ha ++ JOB_LOGS_PATH=ansible-os-ha + source /home/jenkins/workspace/collect-logs-and-cleanup/vars.collect-logs-and-cleanup.38425.env ++ export MONITORING_DEPLOY_TARGET=HA ++ MONITORING_DEPLOY_TARGET=HA ++ export MONITORING_DEPLOYER=ansible ++ MONITORING_DEPLOYER=ansible ++ export MONITORING_ORCHESTRATOR=os ++ MONITORING_ORCHESTRATOR=os ++ export USE_DATAPLANE_NETWORK=true ++ USE_DATAPLANE_NETWORK=true ++ export TF_TEST_TARGET=sanity ++ TF_TEST_TARGET=sanity + export FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha + FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha + [[ -n 10.0.0.38 ]] + /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/collect_logs.sh INFO: wait for host Linux cn-jenkins-deploy-platform-ansible-os-3742-1 5.15.0-100-generic #110-Ubuntu SMP Wed Feb 7 13:27:48 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux INFO: collect logs INFO: Deploy ansible/logs (collect-logs-and-cleanup) Warning: Permanently added '10.0.0.38' (ECDSA) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ECDSA) to the list of known hosts. INFO: =================== Sat Aug 2 16:48:34 UTC 2025 =================== [there is no tf devenv configuration to load] INFO: Applying stages logs INFO: Running stage logs at Sat Aug 2 16:48:34 UTC 2025 INFO: collecting logs... Warning: Permanently added '10.0.0.254' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.254' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.254' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.254' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-alarm-gen INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-api INFO: Collecting tf logs: /var/log/contrail/analytics-collector INFO: Collecting tf logs: /var/log/contrail/analytics-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-snmp-collector INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-topology INFO: Collecting tf logs: /var/log/contrail/config-api INFO: Collecting tf logs: /var/log/contrail/config-database INFO: Collecting tf logs: /var/log/contrail/config-database-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-database-provisioner INFO: Collecting tf logs: /var/log/contrail/config-database-rabbitmq INFO: Collecting tf logs: /var/log/contrail/config-device-manager INFO: Collecting tf logs: /var/log/contrail/config-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-provisioner INFO: Collecting tf logs: /var/log/contrail/config-schema INFO: Collecting tf logs: /var/log/contrail/config-svc-monitor INFO: Collecting tf logs: /var/log/contrail/control-control INFO: Collecting tf logs: /var/log/contrail/control-dns INFO: Collecting tf logs: /var/log/contrail/control-named INFO: Collecting tf logs: /var/log/contrail/control-nodemgr INFO: Collecting tf logs: /var/log/contrail/control-provisioner INFO: Collecting tf logs: /var/log/contrail/database INFO: Collecting tf logs: /var/log/contrail/database-nodemgr INFO: Collecting tf logs: /var/log/contrail/database-provisioner INFO: Collecting tf logs: /var/log/contrail/database-query-engine INFO: Collecting tf logs: /var/log/contrail/device-manager-dnsmasq INFO: Collecting tf logs: /var/log/contrail/kafka INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rabbitmq INFO: Collecting tf logs: /var/log/contrail/webui-job INFO: Collecting tf logs: /var/log/contrail/webui-web INFO: Collecting tf logs: /var/log/contrail/zookeeper INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8100/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8101/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8103/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8104/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8112/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8113/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8114/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8083/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8084/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8096/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8089/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8090/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8091/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:8092/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:5995/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:5920/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-2.:5921/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 12 drwxrwxrwt 2 root root 4096 Aug 2 15:56 . drwxr-xr-x 14 root root 4096 Aug 2 16:25 .. -rw-r--r-- 1 root root 0 Aug 2 15:56 kdump_lock -rw-r--r-- 1 root root 287 Aug 2 15:56 kexec_cmd INFO: content of /var/crashes /var/crashes: total 8 drwxrwxrwx 2 root root 4096 Aug 2 16:25 . drwxr-xr-x 14 root root 4096 Aug 2 16:25 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. Error: unable to perform an operation on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3742-2'. Please see diagnostics information and suggestions below. Most common reasons for this are: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) * Target node is not running In addition to the diagnostics info below: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more * Consult server logs on node contrail@cn-jenkins-deploy-platform-ansible-os-3742-2 * If target node is configured to use long node names, don't forget to use --longnames with CLI tools DIAGNOSTICS =========== attempted to contact: ['contrail@cn-jenkins-deploy-platform-ansible-os-3742-2'] contrail@cn-jenkins-deploy-platform-ansible-os-3742-2: * connected to epmd (port 4369) on cn-jenkins-deploy-platform-ansible-os-3742-2 * epmd reports: node 'contrail' not running at all no other nodes on cn-jenkins-deploy-platform-ansible-os-3742-2 * suggestion: start the node Current node details: * node name: 'rabbitmqcli-535-contrail@cn-jenkins-deploy-platform-ansible-os-3742-2' * effective user's home directory: /var/lib/rabbitmq * Erlang cookie hash: esZsDxSN6VGbi9JkMSxNZA== Error: unable to perform an operation on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3742-2'. Please see diagnostics information and suggestions below. Most common reasons for this are: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) * Target node is not running In addition to the diagnostics info below: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more * Consult server logs on node contrail@cn-jenkins-deploy-platform-ansible-os-3742-2 * If target node is configured to use long node names, don't forget to use --longnames with CLI tools DIAGNOSTICS =========== attempted to contact: ['contrail@cn-jenkins-deploy-platform-ansible-os-3742-2'] contrail@cn-jenkins-deploy-platform-ansible-os-3742-2: * connected to epmd (port 4369) on cn-jenkins-deploy-platform-ansible-os-3742-2 * epmd reports: node 'contrail' not running at all no other nodes on cn-jenkins-deploy-platform-ansible-os-3742-2 * suggestion: start the node Current node details: * node name: 'rabbitmqcli-578-contrail@cn-jenkins-deploy-platform-ansible-os-3742-2' * effective user's home directory: /var/lib/rabbitmq * Erlang cookie hash: esZsDxSN6VGbi9JkMSxNZA== Error: unable to perform an operation on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3742-2'. Please see diagnostics information and suggestions below. Most common reasons for this are: * Target node is unreachable (e.g. due to hostname resolution, TCP connection or firewall issues) * CLI tool fails to authenticate with the server (e.g. due to CLI tool's Erlang cookie not matching that of the server) * Target node is not running In addition to the diagnostics info below: * See the CLI, clustering and networking guides on https://rabbitmq.com/documentation.html to learn more * Consult server logs on node contrail@cn-jenkins-deploy-platform-ansible-os-3742-2 * If target node is configured to use long node names, don't forget to use --longnames with CLI tools DIAGNOSTICS =========== attempted to contact: ['contrail@cn-jenkins-deploy-platform-ansible-os-3742-2'] contrail@cn-jenkins-deploy-platform-ansible-os-3742-2: * connected to epmd (port 4369) on cn-jenkins-deploy-platform-ansible-os-3742-2 * epmd reports: node 'contrail' not running at all no other nodes on cn-jenkins-deploy-platform-ansible-os-3742-2 * suggestion: start the node Current node details: * node name: 'rabbitmqcli-81-contrail@cn-jenkins-deploy-platform-ansible-os-3742-2' * effective user's home directory: /var/lib/rabbitmq * Erlang cookie hash: esZsDxSN6VGbi9JkMSxNZA== Error (argument validation): Invalid options for this command: -p : Arguments given: list_policies -p Usage rabbitmqctl [--node ] [--longnames] [--quiet] list_policies [--vhost ] [--no-table-headers] [--timeout ] INFO: Collecting kolla logs ls: cannot access '/etc/kolla': No such file or directory ls: cannot access '/var/lib/docker/volumes/kolla_logs/_data': No such file or directory /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.254' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.254 ~ ~ Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-alarm-gen INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-api INFO: Collecting tf logs: /var/log/contrail/analytics-collector INFO: Collecting tf logs: /var/log/contrail/analytics-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-snmp-collector INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-topology INFO: Collecting tf logs: /var/log/contrail/config-api INFO: Collecting tf logs: /var/log/contrail/config-database INFO: Collecting tf logs: /var/log/contrail/config-database-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-database-provisioner INFO: Collecting tf logs: /var/log/contrail/config-database-rabbitmq INFO: Collecting tf logs: /var/log/contrail/config-device-manager INFO: Collecting tf logs: /var/log/contrail/config-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-provisioner INFO: Collecting tf logs: /var/log/contrail/config-schema INFO: Collecting tf logs: /var/log/contrail/config-svc-monitor INFO: Collecting tf logs: /var/log/contrail/control-control INFO: Collecting tf logs: /var/log/contrail/control-dns INFO: Collecting tf logs: /var/log/contrail/control-named INFO: Collecting tf logs: /var/log/contrail/control-nodemgr INFO: Collecting tf logs: /var/log/contrail/control-provisioner INFO: Collecting tf logs: /var/log/contrail/database INFO: Collecting tf logs: /var/log/contrail/database-nodemgr INFO: Collecting tf logs: /var/log/contrail/database-provisioner INFO: Collecting tf logs: /var/log/contrail/database-query-engine INFO: Collecting tf logs: /var/log/contrail/device-manager-dnsmasq INFO: Collecting tf logs: /var/log/contrail/kafka INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rabbitmq INFO: Collecting tf logs: /var/log/contrail/webui-job INFO: Collecting tf logs: /var/log/contrail/webui-web INFO: Collecting tf logs: /var/log/contrail/zookeeper INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8100/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8101/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8103/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8104/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8112/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8113/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8114/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8083/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8084/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8087/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8088/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8089/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8090/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8091/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:8092/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:5995/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:5920/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-1.:5921/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 12 drwxrwxrwt 2 root root 4096 Aug 2 15:56 . drwxr-xr-x 14 root root 4096 Aug 2 16:25 .. -rw-r--r-- 1 root root 0 Aug 2 15:55 kdump_lock -rw-r--r-- 1 root root 287 Aug 2 15:56 kexec_cmd INFO: content of /var/crashes /var/crashes: total 8 drwxrwxrwx 2 root root 4096 Aug 2 16:25 . drwxr-xr-x 14 root root 4096 Aug 2 16:25 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. Error (argument validation): too many arguments. Arguments given: list_policies -p name / Usage rabbitmqctl [--node ] [--longnames] [--quiet] list_policies [--vhost ] [--no-table-headers] [--timeout ] INFO: Collecting kolla logs barbican-api barbican-keystone-listener barbican-worker cron external fluentd glance-api heat-api heat-api-cfn heat-engine horizon keystone keystone-fernet keystone-ssh kolla-toolbox mariadb memcached neutron-server nova-api nova-api-bootstrap nova-cell-bootstrap nova-conductor nova-novncproxy nova-scheduler placement-api rabbitmq ansible.log barbican fluentd glance heat horizon keystone mariadb neutron nova placement rabbitmq /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.38 ~ ~ Warning: Permanently added '10.0.0.48' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.48' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.48' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.48' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rsyslogd INFO: Collecting tf logs: /var/log/contrail/vrouter-agent INFO: Collecting tf logs: /var/log/contrail/vrouter-kernel-build-init INFO: Collecting tf logs: /var/log/contrail/vrouter-nodemgr INFO: Collecting tf logs: /var/log/contrail/vrouter-provisioner INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-os-3742-1.:8102/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-os-3742-1.:8085/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 12 drwxrwxrwt 2 root root 4096 Aug 2 16:01 . drwxr-xr-x 14 root root 4096 Aug 2 16:30 .. -rw-r--r-- 1 root root 0 Aug 2 16:01 kdump_lock -rw-r--r-- 1 root root 287 Aug 2 16:01 kexec_cmd INFO: content of /var/crashes /var/crashes: total 8 drwxr-xr-x 2 root root 4096 Aug 2 16:30 . drwxr-xr-x 14 root root 4096 Aug 2 16:30 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services INFO: There are no required containers INFO: Collecting kolla logs cron fluentd kolla-toolbox nova-compute nova-libvirt nova-ssh ansible.log fluentd libvirt nova /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.48' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.48 ~ ~ Warning: Permanently added '10.0.0.49' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.49' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.49' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.49' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rsyslogd INFO: Collecting tf logs: /var/log/contrail/vrouter-agent INFO: Collecting tf logs: /var/log/contrail/vrouter-kernel-build-init INFO: Collecting tf logs: /var/log/contrail/vrouter-nodemgr INFO: Collecting tf logs: /var/log/contrail/vrouter-provisioner INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-os-3742-2.:8102/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://an-jenkins-deploy-platform-ansible-os-3742-2.:8085/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 12 drwxrwxrwt 2 root root 4096 Aug 2 16:02 . drwxr-xr-x 14 root root 4096 Aug 2 16:30 .. -rw-r--r-- 1 root root 0 Aug 2 16:02 kdump_lock -rw-r--r-- 1 root root 287 Aug 2 16:02 kexec_cmd INFO: content of /var/crashes /var/crashes: total 8 drwxr-xr-x 2 root root 4096 Aug 2 16:30 . drwxr-xr-x 14 root root 4096 Aug 2 16:30 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services INFO: There are no required containers INFO: Collecting kolla logs cron fluentd kolla-toolbox nova-compute nova-libvirt nova-ssh ansible.log fluentd libvirt nova /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.49' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.49 ~ ~ Warning: Permanently added '10.0.0.50' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.50' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.50' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.50' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/contrail INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-alarm-gen INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-alarm-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-api INFO: Collecting tf logs: /var/log/contrail/analytics-collector INFO: Collecting tf logs: /var/log/contrail/analytics-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-nodemgr INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-provisioner INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-snmp-collector INFO: Collecting tf logs: /var/log/contrail/analytics-snmp-topology INFO: Collecting tf logs: /var/log/contrail/config-api INFO: Collecting tf logs: /var/log/contrail/config-database INFO: Collecting tf logs: /var/log/contrail/config-database-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-database-provisioner INFO: Collecting tf logs: /var/log/contrail/config-database-rabbitmq INFO: Collecting tf logs: /var/log/contrail/config-device-manager INFO: Collecting tf logs: /var/log/contrail/config-nodemgr INFO: Collecting tf logs: /var/log/contrail/config-provisioner INFO: Collecting tf logs: /var/log/contrail/config-schema INFO: Collecting tf logs: /var/log/contrail/config-svc-monitor INFO: Collecting tf logs: /var/log/contrail/control-control INFO: Collecting tf logs: /var/log/contrail/control-dns INFO: Collecting tf logs: /var/log/contrail/control-named INFO: Collecting tf logs: /var/log/contrail/control-nodemgr INFO: Collecting tf logs: /var/log/contrail/control-provisioner INFO: Collecting tf logs: /var/log/contrail/database INFO: Collecting tf logs: /var/log/contrail/database-nodemgr INFO: Collecting tf logs: /var/log/contrail/database-provisioner INFO: Collecting tf logs: /var/log/contrail/database-query-engine INFO: Collecting tf logs: /var/log/contrail/device-manager-dnsmasq INFO: Collecting tf logs: /var/log/contrail/kafka INFO: Collecting tf logs: /var/log/contrail/node-init INFO: Collecting tf logs: /var/log/contrail/rabbitmq INFO: Collecting tf logs: /var/log/contrail/webui-job INFO: Collecting tf logs: /var/log/contrail/webui-web INFO: Collecting tf logs: /var/log/contrail/zookeeper INFO: Collecting tf logs: save_introspect_info INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8100/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8101/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8103/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8104/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8112/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8113/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8114/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8083/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8084/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8089/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8090/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8091/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:8092/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:5995/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:5920/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting tf logs: introspection request: curl -s http://cn-jenkins-deploy-platform-ansible-os-3742-3.:5921/Snh_SandeshUVECacheReq?x=NodeStatus INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 12 drwxrwxrwt 2 root root 4096 Aug 2 15:57 . drwxr-xr-x 14 root root 4096 Aug 2 16:25 .. -rw-r--r-- 1 root root 0 Aug 2 15:57 kdump_lock -rw-r--r-- 1 root root 287 Aug 2 15:57 kexec_cmd INFO: content of /var/crashes /var/crashes: total 8 drwxrwxrwx 2 root root 4096 Aug 2 16:25 . drwxr-xr-x 14 root root 4096 Aug 2 16:25 .. INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. nodetool: Failed to connect to '127.0.0.1:7201' - SecurityException: 'Authentication failed! Credentials required'. Error (argument validation): too many arguments. Arguments given: list_policies -p name / Usage rabbitmqctl [--node ] [--longnames] [--quiet] list_policies [--vhost ] [--no-table-headers] [--timeout ] INFO: Collecting kolla logs ls: cannot access '/etc/kolla': No such file or directory ls: cannot access '/var/lib/docker/volumes/kolla_logs/_data': No such file or directory /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.50' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.50 ~ ~ INFO: Stage logs was run successfully Sat Aug 2 16:50:03 UTC 2025 [update tf stack configuration] tf setup profile /home/ubuntu/.tf/stack.env DEPLOYER=ansible CONTRAIL_CONTAINER_TAG=master-1_9_7_6-3 CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_9_7_6-3 CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ORCHESTRATOR=openstack OPENSTACK_VERSION="yoga" CONTROLLER_NODES="10.0.0.38 10.0.0.254 10.0.0.50 " AGENT_NODES="10.0.0.48 10.0.0.49 " CONTROL_NODES="10.20.0.17 10.20.0.254 10.20.0.14 " SSL_ENABLE="false" LEGACY_ANALYTICS_ENABLE="true" HUGE_PAGES_1G= CONTAINER_RUNTIME=docker K8S_CA= DEPLOY_IPA_SERVER= IPA_PASSWORD= OPENSTACK_CONTROLLER_NODES='10.0.0.38' OS_AUTH_URL='http://10.0.0.38:5000/v3' AUTH_PASSWORD='contrail123' AUTH_URL='' INFO: Successful deployment Sat Aug 2 16:50:03 UTC 2025 DEBUG: kill running child jobs: INFO: Deploy logs finished INFO: Copy logs from host to workspace Warning: Permanently added '10.0.0.38' (ECDSA) to the list of known hosts. ~/workspace/collect-logs-and-cleanup ~/workspace/collect-logs-and-cleanup Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. INFO: Logs collected at http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/76/1976/3/templates_570/ansible-os-ha ~/workspace/collect-logs-and-cleanup + /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/remove_workers.sh nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-08-02T15:55:41.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | data=10.20.0.17; management=10.0.0.38 | | config_drive | | | created | 2025-08-02T15:55:25Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | 27cc9fa4129e6d43ea2d56118843955f471be2a0465b8ea0494ad839 | | id | fec5abc2-b0fa-40dc-8114-f69c86269355 | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-os-3742_1 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-08-02T15:55:41Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='af19ce16-f1ae-40ec-aef0-7f5d82c1a3c2' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-08-02T15:56:29.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | data=10.20.0.254; management=10.0.0.254 | | config_drive | | | created | 2025-08-02T15:56:13Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | 2d9437b8158425b081d396db9fd67ea5c59974fcb8621dd776960593 | | id | 10ff05c2-4300-4506-867e-f1163186d0fa | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-os-3742_2 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-08-02T15:56:29Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='0b12e15a-66e7-4a3d-a628-c53ea7b49f6c' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-08-02T15:57:20.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | data=10.20.0.14; management=10.0.0.50 | | config_drive | | | created | 2025-08-02T15:57:00Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | cc3c0caf7acff7627bf94c100c0912ef6197c982556311389f32bd2a | | id | 0e287092-618c-479c-bee0-cbb942138bcd | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-os-3742_3 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-08-02T15:57:20Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='e9cd86e5-77b8-4416-a697-b4d10d6b8288' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-08-02T16:01:12.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | data=10.20.0.25; management=10.0.0.48 | | config_drive | | | created | 2025-08-02T16:00:52Z | | flavor | STD3-2-8 (2d9866a9-e955-4986-b00a-340ca54b2cac) | | hostId | af857ddf2b1dfe13a15de2a449b7b7408d21506e9a5010a9cab1672c | | id | d86228ab-7280-4b13-b67b-24b71b71af9a | | image | N/A (booted from volume) | | key_name | worker | | name | an_jenkins-deploy-platform-ansible-os-3742_1 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-08-02T16:01:12Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='49793aa2-cd96-4046-b00f-047c4b707f48' | +-----------------------------+----------------------------------------------------------+ nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-08-02T16:01:55.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | data=10.20.0.193; management=10.0.0.49 | | config_drive | | | created | 2025-08-02T16:01:39Z | | flavor | STD3-2-8 (2d9866a9-e955-4986-b00a-340ca54b2cac) | | hostId | 27cc9fa4129e6d43ea2d56118843955f471be2a0465b8ea0494ad839 | | id | 1c6b3233-a573-4993-906f-a53285637933 | | image | N/A (booted from volume) | | key_name | worker | | name | an_jenkins-deploy-platform-ansible-os-3742_2 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-08-02T16:01:55Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='cf0b313a-38c0-4803-a41a-96eb37b24811' | +-----------------------------+----------------------------------------------------------+ Archiving artifacts Finished: SUCCESS