2024-08-28 12:00:50,327 - DEBUG - [10.0.0.31]: Running cmd : hostname 2024-08-28 12:00:50,516 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-1805-1 2024-08-28 12:00:50,516 - DEBUG - [10.0.0.31]: Running cmd : hostname -f 2024-08-28 12:00:50,580 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-1805-1. 2024-08-28 12:00:50,580 - DEBUG - [10.0.0.31]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-08-28 12:00:50,716 - DEBUG - Output : NAMES contrail_test_OhdXXUBDz vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_api_1 config_svcmonitor_1 config_nodemgr_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-08-28 12:00:50,717 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.0.0.31 | head -n 1 | awk '{print $2}' 2024-08-28 12:00:50,772 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-1805-1. 2024-08-28 12:00:50,772 - DEBUG - [10.0.0.31]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-08-28 12:00:50,846 - DEBUG - Output : 10.0.0.31/24 172.17.0.1/16 10.20.0.7/24 2024-08-28 12:00:50,847 - DEBUG - [10.0.0.31]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-08-28 12:00:50,904 - DEBUG - Output : 10.20.0.7/24 2024-08-28 12:00:50,905 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.20.0.7 | head -n 1 | awk '{print $2}' 2024-08-28 12:00:50,968 - DEBUG - Output : 2024-08-28 12:00:52,864 - INFO - Using existing project ['default-domain', 'admin'](b31d69b2-abc5-4164-b223-1a1f7cc9b0af) 2024-08-28 12:00:53,082 - INFO - ================================================================================ 2024-08-28 12:00:53,082 - INFO - STARTING TEST : test_contrail_status 2024-08-28 12:00:53,083 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2024-08-28 12:00:53,228 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:00:53,238 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.20.0.7': '0'}} with 2024-08-28 12:00:53,238 - INFO - Initial checks done. Running the testcase now 2024-08-28 12:00:53,238 - INFO - 2024-08-28 12:00:53,238 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-08-28 12:00:53,357 - DEBUG - Output : contrail_test_OhdXXUBDz vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_provisioner_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_api_1 config_provisioner_1 config_svcmonitor_1 config_nodemgr_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-08-28 12:00:53,357 - INFO - 10.0.0.31 2024-08-28 12:00:53,358 - INFO - config 2024-08-28 12:00:53,365 - INFO - config-nodemgr:active 2024-08-28 12:00:53,371 - INFO - api-server:active 2024-08-28 12:00:53,376 - INFO - schema:active 2024-08-28 12:00:53,382 - INFO - svc-monitor:active 2024-08-28 12:00:53,388 - INFO - device-manager:active 2024-08-28 12:00:53,388 - INFO - config-database 2024-08-28 12:00:53,388 - INFO - config-cassandra:active 2024-08-28 12:00:53,388 - INFO - config-zookeeper:active 2024-08-28 12:00:53,388 - INFO - config-rabbitmq:active 2024-08-28 12:00:53,388 - INFO - vrouter 2024-08-28 12:00:53,396 - INFO - vrouter-nodemgr:active 2024-08-28 12:00:53,403 - INFO - agent:active 2024-08-28 12:00:53,403 - INFO - control 2024-08-28 12:00:53,409 - INFO - control-nodemgr:active 2024-08-28 12:00:53,416 - INFO - control:active 2024-08-28 12:00:53,417 - INFO - named:active 2024-08-28 12:00:53,423 - INFO - dns:active 2024-08-28 12:00:53,423 - INFO - analytics 2024-08-28 12:00:53,430 - INFO - analytics-nodemgr:active 2024-08-28 12:00:53,436 - INFO - analytics-api:active 2024-08-28 12:00:53,443 - INFO - collector:active 2024-08-28 12:00:53,443 - INFO - analytics-database 2024-08-28 12:00:53,443 - INFO - analytics-cassandra:active 2024-08-28 12:00:53,450 - INFO - analyticsdb-nodemgr:active 2024-08-28 12:00:53,457 - INFO - query-engine:active 2024-08-28 12:00:53,457 - INFO - webui 2024-08-28 12:00:53,457 - INFO - webui:active 2024-08-28 12:00:53,457 - INFO - webui-middleware:active 2024-08-28 12:00:53,457 - INFO - redis:active 2024-08-28 12:00:53,457 - INFO - analytics_snmp 2024-08-28 12:00:53,463 - INFO - snmp-collector:active 2024-08-28 12:00:53,463 - INFO - snmp-topology:active 2024-08-28 12:00:53,463 - INFO - analytics_alarm 2024-08-28 12:00:53,463 - INFO - alarmgen:active 2024-08-28 12:00:53,463 - INFO - All the contrail services are up on all nodes 2024-08-28 12:00:53,463 - INFO - contrail-status passed 2024-08-28 12:00:53,594 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:00:53,601 - DEBUG - No XMPP flaps were noticed during the test 2024-08-28 12:00:53,601 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2024-08-28 12:00:53,601 - INFO - -------------------------------------------------------------------------------- 2024-08-28 12:00:56,450 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:00:57,087 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:01,873 - INFO - admin user already present 2024-08-28 12:01:02,779 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:03,505 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:07,290 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:07,609 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:11,673 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:13,324 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:16,925 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:17,567 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:21,263 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:21,914 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:25,534 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:26,191 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:29,922 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:32,377 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:36,030 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:36,666 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:40,277 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:40,941 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:41,093 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:41,770 - DEBUG - Requesting: http://10.0.0.31:8085/Snh_AgentXmppConnectionStatusReq? 2024-08-28 12:01:50,371 - DEBUG - [10.0.0.31]: Running cmd : hostname 2024-08-28 12:01:50,977 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-1805-1 2024-08-28 12:01:50,977 - DEBUG - [10.0.0.31]: Running cmd : hostname -f 2024-08-28 12:01:51,040 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-1805-1. 2024-08-28 12:01:51,040 - DEBUG - [10.0.0.31]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-08-28 12:01:51,177 - DEBUG - Output : NAMES contrail_test_OhdXXUBDz vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_api_1 config_svcmonitor_1 config_nodemgr_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-08-28 12:01:51,177 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.0.0.31 | head -n 1 | awk '{print $2}' 2024-08-28 12:01:51,240 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-1805-1. 2024-08-28 12:01:51,240 - DEBUG - [10.0.0.31]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-08-28 12:01:51,314 - DEBUG - Output : 10.0.0.31/24 172.17.0.1/16 10.20.0.7/24 2024-08-28 12:01:51,314 - DEBUG - [10.0.0.31]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-08-28 12:01:51,372 - DEBUG - Output : 10.20.0.7/24 2024-08-28 12:01:51,372 - DEBUG - [10.0.0.31]: Running cmd : getent hosts 10.20.0.7 | head -n 1 | awk '{print $2}' 2024-08-28 12:01:51,446 - DEBUG - Output : 2024-08-28 12:01:52,414 - DEBUG - Not creating keypair since it exists 2024-08-28 12:01:52,868 - INFO - Using existing project ['default-domain', 'admin'](b31d69b2-abc5-4164-b223-1a1f7cc9b0af) 2024-08-28 12:01:53,158 - INFO - ================================================================================ 2024-08-28 12:01:53,158 - INFO - STARTING TEST : test_contrail_status 2024-08-28 12:01:53,159 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2024-08-28 12:01:53,296 - DEBUG - Skipping xmpp flap check 2024-08-28 12:01:53,297 - INFO - Initial checks done. Running the testcase now 2024-08-28 12:01:53,297 - INFO - 2024-08-28 12:01:53,297 - DEBUG - [10.0.0.31]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2024-08-28 12:01:53,428 - DEBUG - Output : contrail_test_OhdXXUBDz vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_provisioner_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_provisioner_1 control_nodemgr_1 control_control_1 webui_web_1 webui_job_1 config_devicemgr_1 config_schema_1 config_dnsmasq_1 config_api_1 config_provisioner_1 config_svcmonitor_1 config_nodemgr_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_cassandra_1 config_database_zookeeper_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2024-08-28 12:01:53,428 - INFO - 10.0.0.31 2024-08-28 12:01:53,428 - INFO - config 2024-08-28 12:01:53,439 - INFO - config-nodemgr:active 2024-08-28 12:01:53,457 - INFO - api-server:active 2024-08-28 12:01:53,463 - INFO - schema:active 2024-08-28 12:01:53,468 - INFO - svc-monitor:active 2024-08-28 12:01:53,474 - INFO - device-manager:active 2024-08-28 12:01:53,474 - INFO - config-database 2024-08-28 12:01:53,474 - INFO - config-cassandra:active 2024-08-28 12:01:53,474 - INFO - config-zookeeper:active 2024-08-28 12:01:53,475 - INFO - config-rabbitmq:active 2024-08-28 12:01:53,475 - INFO - vrouter 2024-08-28 12:01:53,483 - INFO - vrouter-nodemgr:active 2024-08-28 12:01:53,495 - INFO - agent:active 2024-08-28 12:01:53,496 - INFO - control 2024-08-28 12:01:53,504 - INFO - control-nodemgr:active 2024-08-28 12:01:53,511 - INFO - control:active 2024-08-28 12:01:53,511 - INFO - named:active 2024-08-28 12:01:53,518 - INFO - dns:active 2024-08-28 12:01:53,518 - INFO - analytics 2024-08-28 12:01:53,525 - INFO - analytics-nodemgr:active 2024-08-28 12:01:53,530 - INFO - analytics-api:active 2024-08-28 12:01:53,537 - INFO - collector:active 2024-08-28 12:01:53,537 - INFO - analytics-database 2024-08-28 12:01:53,537 - INFO - analytics-cassandra:active 2024-08-28 12:01:53,545 - INFO - analyticsdb-nodemgr:active 2024-08-28 12:01:53,553 - INFO - query-engine:active 2024-08-28 12:01:53,553 - INFO - webui 2024-08-28 12:01:53,553 - INFO - webui:active 2024-08-28 12:01:53,553 - INFO - webui-middleware:active 2024-08-28 12:01:53,553 - INFO - redis:active 2024-08-28 12:01:53,553 - INFO - analytics_snmp 2024-08-28 12:01:53,559 - INFO - snmp-collector:active 2024-08-28 12:01:53,559 - INFO - snmp-topology:active 2024-08-28 12:01:53,559 - INFO - analytics_alarm 2024-08-28 12:01:53,559 - INFO - alarmgen:active 2024-08-28 12:01:53,560 - INFO - All the contrail services are up on all nodes 2024-08-28 12:01:53,560 - INFO - contrail-status passed 2024-08-28 12:01:53,708 - DEBUG - Skipping xmpp flap check 2024-08-28 12:01:53,708 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2024-08-28 12:01:53,708 - INFO - --------------------------------------------------------------------------------