2025-08-07 16:37:42,391 - DEBUG - [10.0.0.249]: Running cmd : hostname 2025-08-07 16:37:42,779 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3773-1 2025-08-07 16:37:42,780 - DEBUG - [10.0.0.249]: Running cmd : hostname -f 2025-08-07 16:37:42,880 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3773-1. 2025-08-07 16:37:42,881 - DEBUG - [10.0.0.249]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-08-07 16:37:43,081 - DEBUG - Output : NAMES contrail_test_A4BePdigg vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_nodemgr_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_control_1 control_nodemgr_1 webui_job_1 webui_web_1 config_devicemgr_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_api_1 config_dnsmasq_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-08-07 16:37:43,082 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.0.0.249 | head -n 1 | awk '{print $2}' 2025-08-07 16:37:43,173 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3773-1. 2025-08-07 16:37:43,173 - DEBUG - [10.0.0.249]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-08-07 16:37:43,279 - DEBUG - Output : 127.0.0.1/8 10.0.0.249/24 172.17.0.1/16 10.20.0.17/24 2025-08-07 16:37:43,280 - DEBUG - [10.0.0.249]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-08-07 16:37:43,379 - DEBUG - Output : 10.20.0.17/24 2025-08-07 16:37:43,380 - DEBUG - [10.0.0.249]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}' 2025-08-07 16:37:43,487 - DEBUG - Output : 2025-08-07 16:37:46,051 - INFO - Using existing project ['default-domain', 'admin'](b892b91b-c603-4e7e-81b6-a044b4b1a53e) 2025-08-07 16:37:46,231 - INFO - ================================================================================ 2025-08-07 16:37:46,232 - INFO - STARTING TEST : test_contrail_status 2025-08-07 16:37:46,233 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-07 16:37:46,385 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:37:46,408 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.17': '0'}} with 2025-08-07 16:37:46,408 - INFO - Initial checks done. Running the testcase now 2025-08-07 16:37:46,409 - INFO - 2025-08-07 16:37:46,409 - DEBUG - [10.0.0.249]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-08-07 16:37:46,557 - DEBUG - Output : contrail_test_A4BePdigg vrouter_vrouter-agent_1 vrouter_provisioner_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_topology_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_alarm_nodemgr_1 analytics_alarm_provisioner_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_nodemgr_1 analytics_provisioner_1 analytics_collector_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_provisioner_1 analytics_database_cassandra_1 control_named_1 control_dns_1 control_control_1 control_nodemgr_1 control_provisioner_1 webui_job_1 webui_web_1 config_devicemgr_1 config_svcmonitor_1 config_schema_1 config_nodemgr_1 config_api_1 config_dnsmasq_1 config_provisioner_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-08-07 16:37:46,557 - INFO - 10.0.0.249 2025-08-07 16:37:46,558 - INFO - config 2025-08-07 16:37:46,571 - INFO - config-nodemgr:active 2025-08-07 16:37:46,583 - INFO - api-server:active 2025-08-07 16:37:46,592 - INFO - schema:active 2025-08-07 16:37:46,604 - INFO - svc-monitor:active 2025-08-07 16:37:46,612 - INFO - device-manager:active 2025-08-07 16:37:46,613 - INFO - config-database 2025-08-07 16:37:46,613 - INFO - config-cassandra:active 2025-08-07 16:37:46,613 - INFO - config-zookeeper:active 2025-08-07 16:37:46,613 - INFO - config-rabbitmq:active 2025-08-07 16:37:46,614 - INFO - vrouter 2025-08-07 16:37:46,629 - INFO - vrouter-nodemgr:active 2025-08-07 16:37:46,645 - INFO - agent:active 2025-08-07 16:37:46,645 - INFO - control 2025-08-07 16:37:46,658 - INFO - control-nodemgr:active 2025-08-07 16:37:46,675 - INFO - control:active 2025-08-07 16:37:46,676 - INFO - named:active 2025-08-07 16:37:46,693 - INFO - dns:active 2025-08-07 16:37:46,694 - INFO - analytics 2025-08-07 16:37:46,710 - INFO - analytics-nodemgr:active 2025-08-07 16:37:46,724 - INFO - analytics-api:active 2025-08-07 16:37:46,743 - INFO - collector:active 2025-08-07 16:37:46,743 - INFO - analytics-database 2025-08-07 16:37:46,744 - INFO - analytics-cassandra:active 2025-08-07 16:37:46,761 - INFO - analyticsdb-nodemgr:active 2025-08-07 16:37:46,784 - INFO - query-engine:active 2025-08-07 16:37:46,785 - INFO - webui 2025-08-07 16:37:46,785 - INFO - webui:active 2025-08-07 16:37:46,785 - INFO - webui-middleware:active 2025-08-07 16:37:46,786 - INFO - redis:active 2025-08-07 16:37:46,786 - INFO - analytics_snmp 2025-08-07 16:37:46,799 - INFO - snmp-collector:active 2025-08-07 16:37:46,800 - INFO - snmp-topology:active 2025-08-07 16:37:46,800 - INFO - analytics_alarm 2025-08-07 16:37:46,800 - INFO - alarmgen:active 2025-08-07 16:37:46,801 - INFO - All the contrail services are up on all nodes 2025-08-07 16:37:46,801 - INFO - contrail-status passed 2025-08-07 16:37:47,002 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:37:47,019 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 16:37:47,019 - INFO - END TEST : test_contrail_status : PASSED[0:00:01] 2025-08-07 16:37:47,020 - INFO - -------------------------------------------------------------------------------- 2025-08-07 16:37:50,927 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:37:54,080 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:37:55,677 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:37:55,699 - DEBUG - [10.0.0.249]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2025-08-07 16:38:01,730 - DEBUG - Output : 2025-08-07 16:37:58,416 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-08-07 16:37:58,460 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2025-08-07 16:37:58,868 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2025-08-07 16:38:00,173 INFO: (v1.41) Checker check_orphan_resources: Success 2025-08-07 16:38:01,058 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2025-08-07 16:38:01,059 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2025-08-07 16:38:01,539 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2025-08-07 16:38:01,561 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2025-08-07 16:38:01,569 INFO: (v1.41) Checker check_subnet_uuid: Success 2025-08-07 16:38:01,579 INFO: (v1.41) Checker check_subnet_addr_alloc: Success 2025-08-07 16:38:01,611 INFO: (v1.41) Checker check_route_targets_id: Success 2025-08-07 16:38:01,621 INFO: (v1.41) Checker check_virtual_networks_id: Success 2025-08-07 16:38:01,628 INFO: (v1.41) Checker check_security_groups_id: Success 2025-08-07 16:38:01,630 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2025-08-07 16:38:01,933 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:05,348 - INFO - admin user already present 2025-08-07 16:38:06,707 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:08,983 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:14,551 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:15,032 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:24,354 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:28,928 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:33,451 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:36,080 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:36,299 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:37,646 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:42,448 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:47,562 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:52,521 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:38:56,922 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:01,855 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:06,565 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:11,379 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:11,602 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:14,956 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:15,159 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:19,366 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:23,857 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:28,790 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:32,053 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:37,086 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:39,250 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:44,242 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:49,046 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:54,097 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:39:56,752 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:40:01,633 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:40:03,565 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:40:03,774 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:40:05,500 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:40:05,682 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:40:07,374 - DEBUG - Requesting: http://10.0.0.249:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 16:44:16,017 - INFO - Using existing project ['default-domain', 'admin'](b892b91b-c603-4e7e-81b6-a044b4b1a53e) 2025-08-07 16:44:16,038 - INFO - ================================================================================ 2025-08-07 16:44:16,039 - INFO - STARTING TEST : test_contrail_status 2025-08-07 16:44:16,039 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-07 16:44:16,230 - DEBUG - Skipping xmpp flap check 2025-08-07 16:44:16,230 - INFO - Initial checks done. Running the testcase now 2025-08-07 16:44:16,231 - INFO - 2025-08-07 16:44:16,451 - INFO - 10.0.0.249 2025-08-07 16:44:16,451 - INFO - config 2025-08-07 16:44:16,469 - INFO - config-nodemgr:active 2025-08-07 16:44:16,486 - INFO - api-server:active 2025-08-07 16:44:16,509 - INFO - schema:active 2025-08-07 16:44:16,519 - INFO - svc-monitor:active 2025-08-07 16:44:16,530 - INFO - device-manager:active 2025-08-07 16:44:16,531 - INFO - config-database 2025-08-07 16:44:16,531 - INFO - config-cassandra:active 2025-08-07 16:44:16,531 - INFO - config-zookeeper:active 2025-08-07 16:44:16,531 - INFO - config-rabbitmq:active 2025-08-07 16:44:16,531 - INFO - vrouter 2025-08-07 16:44:16,548 - INFO - vrouter-nodemgr:active 2025-08-07 16:44:16,557 - INFO - agent:active 2025-08-07 16:44:16,558 - INFO - control 2025-08-07 16:44:16,567 - INFO - control-nodemgr:active 2025-08-07 16:44:16,583 - INFO - control:active 2025-08-07 16:44:16,583 - INFO - named:active 2025-08-07 16:44:16,600 - INFO - dns:active 2025-08-07 16:44:16,600 - INFO - analytics 2025-08-07 16:44:16,616 - INFO - analytics-nodemgr:active 2025-08-07 16:44:16,629 - INFO - analytics-api:active 2025-08-07 16:44:16,647 - INFO - collector:active 2025-08-07 16:44:16,647 - INFO - analytics-database 2025-08-07 16:44:16,647 - INFO - analytics-cassandra:active 2025-08-07 16:44:16,662 - INFO - analyticsdb-nodemgr:active 2025-08-07 16:44:16,677 - INFO - query-engine:active 2025-08-07 16:44:16,677 - INFO - webui 2025-08-07 16:44:16,678 - INFO - webui:active 2025-08-07 16:44:16,678 - INFO - webui-middleware:active 2025-08-07 16:44:16,678 - INFO - redis:active 2025-08-07 16:44:16,678 - INFO - analytics_snmp 2025-08-07 16:44:16,688 - INFO - snmp-collector:active 2025-08-07 16:44:16,689 - INFO - snmp-topology:active 2025-08-07 16:44:16,689 - INFO - analytics_alarm 2025-08-07 16:44:16,689 - INFO - alarmgen:active 2025-08-07 16:44:16,689 - INFO - All the contrail services are up on all nodes 2025-08-07 16:44:16,689 - INFO - contrail-status passed 2025-08-07 16:44:16,876 - DEBUG - Skipping xmpp flap check 2025-08-07 16:44:16,876 - INFO - END TEST : test_contrail_status : PASSED[0:00:00] 2025-08-07 16:44:16,877 - INFO - --------------------------------------------------------------------------------