Started by upstream project "pipeline-nightly" build number 22 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on slave-openstack-gz1_1 (openstack) in workspace /home/jenkins/workspace/deploy-tf-k8s-manifests [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [WS-CLEANUP] Done The recommended git tool is: git No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-jenkins.git > git init /home/jenkins/workspace/deploy-tf-k8s-manifests/src/opensdn-io/tf-jenkins # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-jenkins.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-jenkins.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision a254c0f0da78c12e0a8ee66ae1dc5418a1d1c014 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f a254c0f0da78c12e0a8ee66ae1dc5418a1d1c014 # timeout=10 Commit message: "Merge "add tf- images"" > git rev-list --no-walk 484896a1fd106fa65d7f1ad5032d152382d3de82 # timeout=10 The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-devstack.git > git init /home/jenkins/workspace/deploy-tf-k8s-manifests/src/opensdn-io/tf-devstack # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-devstack.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-devstack.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-devstack.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision d9a1892692e9132932141ac1f6602965341ed565 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f d9a1892692e9132932141ac1f6602965341ed565 # timeout=10 Commit message: "Merge "add description of scale testing"" > git rev-list --no-walk a70e1b89218f73b6c9f6780530074f429c49b896 # timeout=10 Copied 3 artifacts from "pipeline-nightly" build number 22 [deploy-tf-k8s-manifests] $ /bin/bash -xe /tmp/jenkins16883613012189576121.sh + source /home/jenkins/workspace/deploy-tf-k8s-manifests/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-nightly-22 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-nightly-22 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22 ++ LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ export CONTRAIL_CONTAINER_TAG=nightly ++ CONTRAIL_CONTAINER_TAG=nightly ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=nightly ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=nightly ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=nightly ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=nightly ++ export GERRIT_PIPELINE=nightly ++ GERRIT_PIPELINE=nightly ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + desc='Pipeline: pipeline-nightly-22 Random: 12941 Stream: k8s-manifests' + desc+='
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22/k8s-manifests' + echo 'DESCRIPTION Pipeline: pipeline-nightly-22 Random: 12941 Stream: k8s-manifests
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22/k8s-manifests' DESCRIPTION Pipeline: pipeline-nightly-22 Random: 12941 Stream: k8s-manifests
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22/k8s-manifests [description-setter] Description set: Pipeline: pipeline-nightly-22 Random: 12941 Stream: k8s-manifests
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22/k8s-manifests' [deploy-tf-k8s-manifests] $ /bin/bash -xe /tmp/jenkins12404614275784489807.sh + set -eo pipefail + source /home/jenkins/workspace/deploy-tf-k8s-manifests/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-nightly-22 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-nightly-22 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22 ++ LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ export CONTRAIL_CONTAINER_TAG=nightly ++ CONTRAIL_CONTAINER_TAG=nightly ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=nightly ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=nightly ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=nightly ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=nightly ++ export GERRIT_PIPELINE=nightly ++ GERRIT_PIPELINE=nightly ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-jenkins ./patchsets-info.json + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-devstack ./patchsets-info.json [deploy-tf-k8s-manifests] $ /bin/bash -xe /tmp/jenkins14748449694890853804.sh + set -eo pipefail + source /home/jenkins/workspace/deploy-tf-k8s-manifests/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-nightly-22 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-nightly-22 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22 ++ LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/nightly/pipeline_22 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ++ export CONTRAIL_CONTAINER_TAG=nightly ++ CONTRAIL_CONTAINER_TAG=nightly ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5102 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=nightly ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=nightly ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=nightly ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=nightly ++ export GERRIT_PIPELINE=nightly ++ GERRIT_PIPELINE=nightly ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + source ./src/opensdn-io/tf-jenkins/infra/openstack/definitions ++ export PROVIDER=openstack ++ PROVIDER=openstack ++ export OS_NETWORK=management ++ OS_NETWORK=management ++ export OS_DATA_NETWORK=data ++ OS_DATA_NETWORK=data ++ export OS_SG=default ++ OS_SG=default ++ export RESERVED_INSTANCES_COUNT=3 ++ RESERVED_INSTANCES_COUNT=3 ++ export RESERVED_CORES_COUNT=16 ++ RESERVED_CORES_COUNT=16 ++ export VM_BOOT_RETRIES=120 ++ VM_BOOT_RETRIES=120 ++ export VM_BOOT_DELAY=60 ++ VM_BOOT_DELAY=60 ++ export VOLUME_TYPE=ceph-ssd ++ VOLUME_TYPE=ceph-ssd ++ ENVIRONMENT_OS=rocky9 ++ VM_TYPES=(['xsmall']='STD3-1-4' ['small']='STD3-2-8' ['medium']='STD3-4-16' ['large']='STD3-8-32') ++ declare -A VM_TYPES ++ VOLUME_SIZE=(['xsmall']='50' ['small']='50' ['medium']='80' ['large']='80') ++ declare -A VOLUME_SIZE ++ OS_IMAGES=(['CENTOS7']='prepared-centos7' ['CENTOS8']='prepared-centos8' ['UBUNTU20']='prepared-ubuntu20' ['UBUNTU22']='prepared-ubuntu22' ['ROCKY9']='prepared-rocky92') ++ declare -A OS_IMAGES ++ OS_IMAGE_USERS=(['CENTOS7']='centos' ['CENTOS8']='centos' ['UBUNTU20']='ubuntu' ['UBUNTU22']='ubuntu' ['ROCKY9']='rocky' ['ROCKY92']='rocky') ++ declare -A OS_IMAGE_USERS ++ OS_IMAGES_UP=(['CENTOS7']='centos' ['CENTOS8']='centos' ['UBUNTU20']='ubuntu' ['UBUNTU22']='ubuntu' ['ROCKY9']='rocky' ['ROCKY92']='rocky') ++ declare -A OS_IMAGES_UP ++ OS_IMAGES_DOWN=(['CENTOS7']='' ['CENTOS8']='' ['UBUNTU20']='' ['UBUNTU22']='' ['ROCKY9']='' ['ROCKY92']='') ++ declare -A OS_IMAGES_DOWN ++ SSH_OPTIONS='-T -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o PasswordAuthentication=no' + source /home/jenkins/workspace/deploy-tf-k8s-manifests/deps.deploy-tf-k8s-manifests.12941.env ++ export PROVIDER=openstack ++ PROVIDER=openstack ++ export ENVIRONMENT_OS=rocky9 ++ ENVIRONMENT_OS=rocky9 ++ export IMAGE=aa1bd152-a8d4-49ef-85ea-82a4dab8cf7f ++ IMAGE=aa1bd152-a8d4-49ef-85ea-82a4dab8cf7f ++ export IMAGE_SSH_USER=rocky ++ IMAGE_SSH_USER=rocky ++ export INSTANCE_IDS=4967e6c7-d693-4529-8d01-8381ce933ed5, ++ INSTANCE_IDS=4967e6c7-d693-4529-8d01-8381ce933ed5, ++ export instance_ip=10.0.0.36 ++ instance_ip=10.0.0.36 ++ export CONTROLLER_NODES=10.0.0.36, ++ CONTROLLER_NODES=10.0.0.36, ++ export ORCHESTRATOR=kubernetes ++ ORCHESTRATOR=kubernetes ++ export DEPLOYER=k8s_manifests ++ DEPLOYER=k8s_manifests ++ export JOB_LOGS_PATH=k8s-manifests ++ JOB_LOGS_PATH=k8s-manifests + source /home/jenkins/workspace/deploy-tf-k8s-manifests/vars.deploy-tf-k8s-manifests.12941.env ++ export MONITORING_DEPLOY_TARGET=AIO ++ MONITORING_DEPLOY_TARGET=AIO ++ export MONITORING_DEPLOYER=k8s_manifests ++ MONITORING_DEPLOYER=k8s_manifests ++ export MONITORING_ORCHESTRATOR=k8s ++ MONITORING_ORCHESTRATOR=k8s + export FULL_LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22/k8s-manifests + FULL_LOGS_PATH=/var/www/logs/jenkins_logs/nightly/pipeline_22/k8s-manifests + ./src/opensdn-io/tf-jenkins/jobs/devstack/k8s_manifests/deploy_tf.sh INFO: Deploy k8s_manifests/ (deploy-tf-k8s-manifests) Warning: Permanently added '10.0.0.36' (ECDSA) to the list of known hosts. Warning: Permanently added '10.0.0.36' (ECDSA) to the list of known hosts. INFO: =================== Mon Oct 21 01:51:22 AM UTC 2024 =================== [there is no tf devenv configuration to load] INFO: Applying stages k8s manifest tf wait INFO: Running stage k8s at Mon Oct 21 01:51:22 AM UTC 2024 Skipping stage k8s because it's finished INFO: Stage k8s was run successfully Mon Oct 21 01:51:22 AM UTC 2024 INFO: Running stage manifest at Mon Oct 21 01:51:22 AM UTC 2024 nexus.gz1.opensdn.io is an alias for nexus.opensdn.io. nexus.opensdn.io has address 212.233.90.199 INFO: ishost = true namespace = registry_url = nexus.gz1.opensdn.io:5102 INFO: Downloading 'tf-container-builder-src:nightly@nightly' (1 layers)... INFO: Download of images into '/tmp/tmp.OWKLKyUfvZ' complete. INFO: Use something like the following to load the result into a Docker daemon: INFO: tar -cC '/tmp/tmp.OWKLKyUfvZ' . | docker load INFO: Stage manifest was run successfully Mon Oct 21 01:51:23 AM UTC 2024 INFO: Running stage tf at Mon Oct 21 01:51:23 AM UTC 2024 INFO: check time sync on nodes and force sync Mon Oct 21 01:51:23 AM UTC 2024 INFO: controller nodes - 10.0.0.36 INFO: agent nodes - 10.0.0.36 INFO: openstack controller nodes - INFO: sync time on machine rocky@10.0.0.36 Warning: Permanently added '10.0.0.36' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.36' (ED25519) to the list of known hosts. INFO: Mon Oct 21 01:51:23 AM UTC 2024: ensure time is synced (chronyd) INFO: Mon Oct 21 01:51:23 AM UTC 2024: time is synced INFO: done in 0s INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 not labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled INFO: done in 0s 10.0.0.36 node/cn-jenkins-deploy-platform-k8s-manifests-102-1 labeled configmap/env created configmap/defaults-env created configmap/configzookeeperenv created configmap/contrail-analyticsdb-config created configmap/contrail-configdb-config created configmap/rabbitmq-config created configmap/kube-manager-config created Warning: spec.template.spec.imagePullSecrets[0].name: invalid empty name "" daemonset.apps/config-zookeeper created daemonset.apps/contrail-analyticsdb created daemonset.apps/contrail-configdb created daemonset.apps/contrail-analytics created daemonset.apps/contrail-analytics-snmp created daemonset.apps/contrail-analytics-alarm created daemonset.apps/contrail-controller-control created daemonset.apps/contrail-controller-config created daemonset.apps/contrail-controller-webui created daemonset.apps/redis created daemonset.apps/rabbitmq created daemonset.apps/contrail-kube-manager created daemonset.apps/contrail-agent created clusterrole.rbac.authorization.k8s.io/contrail-kube-manager created serviceaccount/contrail-kube-manager created clusterrolebinding.rbac.authorization.k8s.io/contrail-kube-manager created secret/contrail-kube-manager-token created TF Web UI will be available at https://10.0.0.36:8143 Use admin/contrail123 to log in INFO: Stage tf was run successfully Mon Oct 21 01:51:27 AM UTC 2024 INFO: Running stage wait at Mon Oct 21 01:51:27 AM UTC 2024 ........................ INFO: done in 240s INFO: Stage wait was run successfully Mon Oct 21 01:55:46 AM UTC 2024 [update tf stack configuration] tf setup profile /home/rocky/.tf/stack.env DEPLOYER=k8s_manifests CONTRAIL_CONTAINER_TAG=nightly CONTRAIL_DEPLOYER_CONTAINER_TAG=nightly CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5102 ORCHESTRATOR=kubernetes OPENSTACK_VERSION="" CONTROLLER_NODES="10.0.0.36 " AGENT_NODES="10.0.0.36" CONTROL_NODES="10.0.0.36 " SSL_ENABLE="false" LEGACY_ANALYTICS_ENABLE="true" HUGE_PAGES_1G= CONTAINER_RUNTIME=docker K8S_CA= DEPLOY_IPA_SERVER= IPA_PASSWORD= INFO: Successful deployment Mon Oct 21 01:55:46 AM UTC 2024 DEBUG: kill running child jobs: INFO: Deploy finished + exit Archiving artifacts Finished: SUCCESS