Started by upstream project "pipeline-templates" build number 457
originally caused by:
Triggered by Gerrit: https://gerrit.opensdn.io/c/opensdn-io/tf-dev-test/+/1663
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on slave-openstack-gz1_1 (openstack) in workspace /home/jenkins/workspace/collect-logs-and-cleanup
[WS-CLEANUP] Deleting project workspace...
[WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[WS-CLEANUP] Done
The recommended git tool is: git
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/opensdn-io/tf-jenkins.git
> git init /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins # timeout=10
Fetching upstream changes from https://github.com/opensdn-io/tf-jenkins.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/opensdn-io/tf-jenkins.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
> git rev-parse refs/remotes/origin/master^{commit} # timeout=10
Checking out Revision d123cf296746e4d7c49b1db909bcef43ae30e239 (refs/remotes/origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f d123cf296746e4d7c49b1db909bcef43ae30e239 # timeout=10
Commit message: "use r24.1 tag for deployer image in ansible case"
> git rev-list --no-walk d123cf296746e4d7c49b1db909bcef43ae30e239 # timeout=10
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/opensdn-io/tf-devstack.git
> git init /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-devstack # timeout=10
Fetching upstream changes from https://github.com/opensdn-io/tf-devstack.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-devstack.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/opensdn-io/tf-devstack.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
Avoid second fetch
> git rev-parse refs/remotes/origin/master^{commit} # timeout=10
Checking out Revision 2f03a1e26e811ba39d6f10fd1924476f08a26fcf (refs/remotes/origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2f03a1e26e811ba39d6f10fd1924476f08a26fcf # timeout=10
Commit message: "fix k8s_manifests"
> git rev-list --no-walk 2f03a1e26e811ba39d6f10fd1924476f08a26fcf # timeout=10
Copied 4 artifacts from "pipeline-templates" build number 457
[collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins11084794552129246345.sh
+ source /home/jenkins/workspace/collect-logs-and-cleanup/global.env
++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-457
++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-457
++ export SLAVE=openstack
++ SLAVE=openstack
++ export SLAVE_REGION=gz1
++ SLAVE_REGION=gz1
++ export LOGS_HOST=nexus.gz1.opensdn.io
++ LOGS_HOST=nexus.gz1.opensdn.io
++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457
++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457
++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457
++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457
++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository
++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository
++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ export CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
++ CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ export GERRIT_PIPELINE=templates
++ GERRIT_PIPELINE=templates
++ export GERRIT_URL=https://gerrit.opensdn.io/
++ GERRIT_URL=https://gerrit.opensdn.io/
++ export GERRIT_CHANGE_ID=I0568aa94ef256192359b5f6a086f82b61041d867
++ GERRIT_CHANGE_ID=I0568aa94ef256192359b5f6a086f82b61041d867
++ export GERRIT_BRANCH=master
++ GERRIT_BRANCH=master
++ export GERRIT_PROJECT=opensdn-io/tf-dev-test
++ GERRIT_PROJECT=opensdn-io/tf-dev-test
++ export REPOS_CHANNEL=latest
++ REPOS_CHANNEL=latest
+ desc='Pipeline: pipeline-templates-457 Random: 76090 Stream: ansible-k8s-ubuntu24'
+ desc+='
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24'
+ echo 'DESCRIPTION Pipeline: pipeline-templates-457 Random: 76090 Stream: ansible-k8s-ubuntu24
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24'
DESCRIPTION Pipeline: pipeline-templates-457 Random: 76090 Stream: ansible-k8s-ubuntu24
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24
[description-setter] Description set: Pipeline: pipeline-templates-457 Random: 76090 Stream: ansible-k8s-ubuntu24
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24'
[collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins1413002605581728509.sh
+ source /home/jenkins/workspace/collect-logs-and-cleanup/global.env
++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-457
++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-457
++ export SLAVE=openstack
++ SLAVE=openstack
++ export SLAVE_REGION=gz1
++ SLAVE_REGION=gz1
++ export LOGS_HOST=nexus.gz1.opensdn.io
++ LOGS_HOST=nexus.gz1.opensdn.io
++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457
++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457
++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457
++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457
++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository
++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository
++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ export CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
++ CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ export GERRIT_PIPELINE=templates
++ GERRIT_PIPELINE=templates
++ export GERRIT_URL=https://gerrit.opensdn.io/
++ GERRIT_URL=https://gerrit.opensdn.io/
++ export GERRIT_CHANGE_ID=I0568aa94ef256192359b5f6a086f82b61041d867
++ GERRIT_CHANGE_ID=I0568aa94ef256192359b5f6a086f82b61041d867
++ export GERRIT_BRANCH=master
++ GERRIT_BRANCH=master
++ export GERRIT_PROJECT=opensdn-io/tf-dev-test
++ GERRIT_PROJECT=opensdn-io/tf-dev-test
++ export REPOS_CHANNEL=latest
++ REPOS_CHANNEL=latest
+ ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-jenkins ./patchsets-info.json
+ ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-devstack ./patchsets-info.json
[collect-logs-and-cleanup] $ /bin/bash -xe /tmp/jenkins16138985825568307955.sh
+ source /home/jenkins/workspace/collect-logs-and-cleanup/global.env
++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-457
++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-457
++ export SLAVE=openstack
++ SLAVE=openstack
++ export SLAVE_REGION=gz1
++ SLAVE_REGION=gz1
++ export LOGS_HOST=nexus.gz1.opensdn.io
++ LOGS_HOST=nexus.gz1.opensdn.io
++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457
++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457
++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457
++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457
++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository
++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository
++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
++ export CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
++ CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101
++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_6_3-2
++ export GERRIT_PIPELINE=templates
++ GERRIT_PIPELINE=templates
++ export GERRIT_URL=https://gerrit.opensdn.io/
++ GERRIT_URL=https://gerrit.opensdn.io/
++ export GERRIT_CHANGE_ID=I0568aa94ef256192359b5f6a086f82b61041d867
++ GERRIT_CHANGE_ID=I0568aa94ef256192359b5f6a086f82b61041d867
++ export GERRIT_BRANCH=master
++ GERRIT_BRANCH=master
++ export GERRIT_PROJECT=opensdn-io/tf-dev-test
++ GERRIT_PROJECT=opensdn-io/tf-dev-test
++ export REPOS_CHANNEL=latest
++ REPOS_CHANNEL=latest
+ source /home/jenkins/workspace/collect-logs-and-cleanup/deps.collect-logs-and-cleanup.76090.env
++ export PROVIDER=openstack
++ PROVIDER=openstack
++ export ENVIRONMENT_OS=ubuntu24
++ ENVIRONMENT_OS=ubuntu24
++ export IMAGE=67a3bd24-20fc-402e-80ca-a2edd1b355b2
++ IMAGE=67a3bd24-20fc-402e-80ca-a2edd1b355b2
++ export IMAGE_SSH_USER=ubuntu
++ IMAGE_SSH_USER=ubuntu
++ export INSTANCE_IDS=0c394a39-c801-4781-b526-8dae5dbe2aa1,
++ INSTANCE_IDS=0c394a39-c801-4781-b526-8dae5dbe2aa1,
++ export instance_ip=10.0.0.57
++ instance_ip=10.0.0.57
++ export CONTROLLER_NODES=10.0.0.57,
++ CONTROLLER_NODES=10.0.0.57,
++ export ORCHESTRATOR=kubernetes
++ ORCHESTRATOR=kubernetes
++ export DEPLOYER=ansible
++ DEPLOYER=ansible
++ export JOB_LOGS_PATH=ansible-k8s-ubuntu24
++ JOB_LOGS_PATH=ansible-k8s-ubuntu24
+ source /home/jenkins/workspace/collect-logs-and-cleanup/vars.collect-logs-and-cleanup.76090.env
++ export MONITORING_DEPLOY_TARGET=AIO
++ MONITORING_DEPLOY_TARGET=AIO
++ export MONITORING_ORCHESTRATOR=k8s
++ MONITORING_ORCHESTRATOR=k8s
++ export ENVIRONMENT_OS=ubuntu24
++ ENVIRONMENT_OS=ubuntu24
++ export MONITORING_DEPLOYER=ansible
++ MONITORING_DEPLOYER=ansible
++ export CONFIG_API_WORKER_COUNT=3
++ CONFIG_API_WORKER_COUNT=3
+ export FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24
+ FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24
+ [[ -n 10.0.0.57 ]]
+ /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/collect_logs.sh
INFO: wait for host
Linux cn-jenkins-deploy-platform-ansible-k8s-356-1 6.8.0-57-generic #59-Ubuntu SMP PREEMPT_DYNAMIC Sat Mar 15 17:40:59 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
INFO: collect logs
INFO: Deploy ansible/logs (collect-logs-and-cleanup)
Warning: Permanently added '10.0.0.57' (ECDSA) to the list of known hosts.
Warning: Permanently added '10.0.0.57' (ECDSA) to the list of known hosts.
INFO: =================== Tue May 6 06:57:08 UTC 2025 ===================
[there is no tf devenv configuration to load]
INFO: Applying stages logs
INFO: Running stage logs at Tue May 6 06:57:08 UTC 2025
INFO: collecting logs...
cp: cannot stat '/home/ubuntu/.tf/*.yml': No such file or directory
Warning: Permanently added '10.0.0.57' (ED25519) to the list of known hosts.
Warning: Permanently added '10.0.0.57' (ED25519) to the list of known hosts.
Warning: Permanently added '10.0.0.57' (ED25519) to the list of known hosts.
Warning: Permanently added '10.0.0.57' (ED25519) to the list of known hosts.
INFO: Collecting contrail-status
INFO: Collecting system statistics for logs
INFO: Collecting docker logs
INFO: Collecting TF logs
INFO: Collecting tf logs: /etc/cni
INFO: Collecting tf logs: save_introspect_info
INFO: Collecting core dumps
INFO: content of /var/crash
/var/crash:
total 8
drwxrwsrwt 2 root root 4096 Apr 3 12:56 .
drwxr-xr-x 13 root root 4096 May 6 06:34 ..
INFO: content of /var/crashes
ls: cannot access '/var/crashes': No such file or directory
ls: cannot access '/var/crashes': No such file or directory
INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services
INFO: There are no required containers
INFO: Collecting kubernetes logs
The connection to the server localhost:8080 was refused - did you specify the right host or port?
INFO: kubectl is not configured here
INFO: Collecting kubernetes object info
The connection to the server localhost:8080 was refused - did you specify the right host or port?
INFO: kubectl is not configured here
/tmp/ansible-logs/logs /tmp/ansible-logs
/tmp/ansible-logs
Warning: Permanently added '10.0.0.57' (ED25519) to the list of known hosts.
~/.tf/logs/10.0.0.57 ~
~
INFO: Stage logs was run successfully Tue May 6 06:57:11 UTC 2025
[update tf stack configuration]
Warning: Permanently added '10.0.0.57' (ED25519) to the list of known hosts.
tf setup profile /home/ubuntu/.tf/stack.env
DEPLOYER=ansible
CONTRAIL_CONTAINER_TAG=master-1_6_6_3-2
CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_6_3-2
CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101
ORCHESTRATOR=kubernetes
OPENSTACK_VERSION="yoga"
CONTROLLER_NODES="10.0.0.57 "
AGENT_NODES="10.0.0.57"
CONTROL_NODES="10.0.0.57 "
SSL_ENABLE="false"
LEGACY_ANALYTICS_ENABLE="true"
HUGE_PAGES_1G=
CONTAINER_RUNTIME=docker
K8S_CA=
DEPLOY_IPA_SERVER=
IPA_PASSWORD=
AUTH_PASSWORD='contrail123'
AUTH_URL=''
INFO: Successful deployment Tue May 6 06:57:11 UTC 2025
DEBUG: kill running child jobs:
INFO: Deploy logs finished
INFO: Copy logs from host to workspace
Warning: Permanently added '10.0.0.57' (ECDSA) to the list of known hosts.
~/workspace/collect-logs-and-cleanup ~/workspace/collect-logs-and-cleanup
Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts.
Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts.
INFO: Logs collected at http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/63/1663/2/templates_457/ansible-k8s-ubuntu24
~/workspace/collect-logs-and-cleanup
+ /home/jenkins/workspace/collect-logs-and-cleanup/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/remove_workers.sh
nova CLI is deprecated and will be removed in a future release
| locked | False |
INFO: do down nodes
+-----------------------------+----------------------------------------------------------+
| Field | Value |
+-----------------------------+----------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | GZ1 |
| OS-EXT-STS:power_state | Running |
| OS-EXT-STS:task_state | None |
| OS-EXT-STS:vm_state | active |
| OS-SRV-USG:launched_at | 2025-05-06T06:34:34.000000 |
| OS-SRV-USG:terminated_at | None |
| accessIPv4 | |
| accessIPv6 | |
| addresses | management=10.0.0.57 |
| config_drive | |
| created | 2025-05-06T06:34:13Z |
| flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) |
| hostId | 169ec9ed659fa12510fdddc94c395981891c4cf1e7cc35d5a46b6bcb |
| id | 0c394a39-c801-4781-b526-8dae5dbe2aa1 |
| image | N/A (booted from volume) |
| key_name | worker |
| name | cn_jenkins-deploy-platform-ansible-k8s-356_1 |
| progress | 0 |
| project_id | **** |
| properties | |
| status | ACTIVE |
| updated | 2025-05-06T06:34:34Z |
| user_id | 25d930adb802408885c71e341481886e |
| volumes_attached | id='c1c62ff0-46ff-4c18-a814-3fceb3634e5e' |
+-----------------------------+----------------------------------------------------------+
Archiving artifacts
Finished: SUCCESS