2025-12-19 16:17:42,250 - DEBUG - [10.0.0.33]: Running cmd : hostname 2025-12-19 16:17:42,590 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4910-1 2025-12-19 16:17:42,590 - DEBUG - [10.0.0.33]: Running cmd : hostname -f 2025-12-19 16:17:42,666 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4910-1. 2025-12-19 16:17:42,666 - DEBUG - [10.0.0.33]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-12-19 16:17:42,782 - DEBUG - Output : NAMES contrail_test_npB5hVpJt vrouter_vrouter-agent_1 vrouter_nodemgr_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_kafka_1 analytics_api_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_dns_1 control_control_1 webui_job_1 webui_web_1 config_devicemgr_1 config_schema_1 config_api_1 config_nodemgr_1 config_dnsmasq_1 config_svcmonitor_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-12-19 16:17:42,782 - DEBUG - [10.0.0.33]: Running cmd : getent hosts 10.0.0.33 | head -n 1 | awk '{print $2}' 2025-12-19 16:17:42,871 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4910-1. 2025-12-19 16:17:42,872 - DEBUG - [10.0.0.33]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-12-19 16:17:42,974 - DEBUG - Output : 127.0.0.1/8 10.0.0.33/24 172.17.0.1/16 10.20.0.17/24 2025-12-19 16:17:42,974 - DEBUG - [10.0.0.33]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-12-19 16:17:43,043 - DEBUG - Output : 10.20.0.17/24 2025-12-19 16:17:43,044 - DEBUG - [10.0.0.33]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}' 2025-12-19 16:17:43,140 - DEBUG - Output : 2025-12-19 16:17:45,476 - INFO - Using existing project ['default-domain', 'admin'](ceda5a4c-5ed4-4097-8a90-475c31ca529b) 2025-12-19 16:17:45,697 - INFO - ================================================================================ 2025-12-19 16:17:45,697 - INFO - STARTING TEST : test_contrail_status 2025-12-19 16:17:45,697 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-12-19 16:17:45,860 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:17:45,873 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.17': '0'}} with 2025-12-19 16:17:45,873 - INFO - Initial checks done. Running the testcase now 2025-12-19 16:17:45,873 - INFO - 2025-12-19 16:17:45,873 - DEBUG - [10.0.0.33]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-12-19 16:17:46,014 - DEBUG - Output : contrail_test_npB5hVpJt vrouter_vrouter-agent_1 vrouter_nodemgr_1 vrouter_provisioner_1 rsyslogd_rsyslogd_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_snmp_provisioner_1 analytics_snmp_topology_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_alarm_provisioner_1 analytics_alarm_kafka_1 analytics_api_1 analytics_provisioner_1 analytics_collector_1 analytics_nodemgr_1 analytics_database_nodemgr_1 analytics_database_provisioner_1 analytics_database_query-engine_1 analytics_database_cassandra_1 control_named_1 control_nodemgr_1 control_dns_1 control_provisioner_1 control_control_1 webui_job_1 webui_web_1 config_devicemgr_1 config_schema_1 config_provisioner_1 config_api_1 config_nodemgr_1 config_dnsmasq_1 config_svcmonitor_1 config_database_provisioner_1 config_database_nodemgr_1 config_database_rabbitmq_1 config_database_zookeeper_1 config_database_cassandra_1 redis_redis_1 barbican_worker barbican_keystone_listener barbican_api horizon heat_engine heat_api_cfn heat_api neutron_server nova_compute nova_libvirt nova_ssh nova_novncproxy nova_conductor nova_api nova_scheduler placement_api glance_api keystone keystone_fernet keystone_ssh rabbitmq memcached mariadb cron kolla_toolbox fluentd 2025-12-19 16:17:46,014 - INFO - 10.0.0.33 2025-12-19 16:17:46,015 - INFO - config 2025-12-19 16:17:46,022 - INFO - config-nodemgr:active 2025-12-19 16:17:46,030 - INFO - api-server:active 2025-12-19 16:17:46,035 - INFO - schema:active 2025-12-19 16:17:46,040 - INFO - svc-monitor:active 2025-12-19 16:17:46,045 - INFO - device-manager:active 2025-12-19 16:17:46,046 - INFO - config-database 2025-12-19 16:17:46,046 - INFO - config-cassandra:active 2025-12-19 16:17:46,046 - INFO - config-zookeeper:active 2025-12-19 16:17:46,046 - INFO - config-rabbitmq:active 2025-12-19 16:17:46,046 - INFO - vrouter 2025-12-19 16:17:46,050 - INFO - vrouter-nodemgr:active 2025-12-19 16:17:46,055 - INFO - agent:active 2025-12-19 16:17:46,055 - INFO - control 2025-12-19 16:17:46,065 - INFO - control-nodemgr:active 2025-12-19 16:17:46,073 - INFO - control:active 2025-12-19 16:17:46,074 - INFO - named:active 2025-12-19 16:17:46,082 - INFO - dns:active 2025-12-19 16:17:46,082 - INFO - analytics 2025-12-19 16:17:46,091 - INFO - analytics-nodemgr:active 2025-12-19 16:17:46,096 - INFO - analytics-api:active 2025-12-19 16:17:46,102 - INFO - collector:active 2025-12-19 16:17:46,102 - INFO - analytics-database 2025-12-19 16:17:46,102 - INFO - analytics-cassandra:active 2025-12-19 16:17:46,109 - INFO - analyticsdb-nodemgr:active 2025-12-19 16:17:46,116 - INFO - query-engine:active 2025-12-19 16:17:46,116 - INFO - webui 2025-12-19 16:17:46,116 - INFO - webui:active 2025-12-19 16:17:46,116 - INFO - webui-middleware:active 2025-12-19 16:17:46,116 - INFO - redis:active 2025-12-19 16:17:46,116 - INFO - analytics_snmp 2025-12-19 16:17:46,121 - INFO - snmp-collector:active 2025-12-19 16:17:46,122 - INFO - snmp-topology:active 2025-12-19 16:17:46,122 - INFO - analytics_alarm 2025-12-19 16:17:46,122 - INFO - alarmgen:active 2025-12-19 16:17:46,122 - INFO - All the contrail services are up on all nodes 2025-12-19 16:17:46,122 - INFO - contrail-status passed 2025-12-19 16:17:46,280 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:17:46,288 - DEBUG - No XMPP flaps were noticed during the test 2025-12-19 16:17:46,288 - INFO - END TEST : test_contrail_status : PASSED[0:00:01] 2025-12-19 16:17:46,288 - INFO - -------------------------------------------------------------------------------- 2025-12-19 16:17:49,702 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:17:52,643 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-52772115:ctest-vn22-91623291:ctest-vn22-91623291 2025-12-19 16:17:52,653 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-52772115:ctest-vn22-91623291:ctest-vn22-91623291 2025-12-19 16:17:52,664 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-52772115:ctest-vn22-91623291:ctest-vn22-91623291 2025-12-19 16:18:15,434 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-52772115:ctest-vn22-91623291 2025-12-19 16:18:15,440 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-52772115:ctest-vn22-91623291:ctest-vn22-91623291 2025-12-19 16:18:15,445 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-52772115:ctest-vn22-91623291:ctest-vn22-91623291 2025-12-19 16:18:15,599 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:16,966 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:16,982 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check' 2025-12-19 16:18:20,882 - DEBUG - Output : 2025-12-19 16:18:19,800 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-12-19 16:18:19,826 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success 2025-12-19 16:18:19,939 INFO: (v1.41) Checker check_obj_mandatory_fields: Success 2025-12-19 16:18:20,235 INFO: (v1.41) Checker check_orphan_resources: Success 2025-12-19 16:18:20,488 INFO: (v1.41) Checker check_fq_name_uuid_match: Success 2025-12-19 16:18:20,488 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before. 2025-12-19 16:18:20,657 INFO: (v1.41) Checker check_duplicate_fq_name: Success 2025-12-19 16:18:20,673 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success 2025-12-19 16:18:20,681 INFO: (v1.41) Checker check_subnet_uuid: Success 2025-12-19 16:18:20,694 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed: ZK subnet path '/api-server/subnets' does ends with a valid IP network 2025-12-19 16:18:20,731 INFO: (v1.41) Checker check_route_targets_id: Success 2025-12-19 16:18:20,741 INFO: (v1.41) Checker check_virtual_networks_id: Success 2025-12-19 16:18:20,753 INFO: (v1.41) Checker check_security_groups_id: Success 2025-12-19 16:18:20,756 INFO: (v1.41) Checker check_ipam_subnet_method: Success 2025-12-19 16:18:20,759 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success 2025-12-19 16:18:21,073 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:21,316 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:21,499 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:21,675 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:21,856 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:25,236 - INFO - admin user already present 2025-12-19 16:18:26,357 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:18:28,788 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:28,794 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:28,799 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:29,949 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738:ctest-vn1-29204738 2025-12-19 16:18:29,958 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738:ctest-vn1-29204738 2025-12-19 16:18:29,964 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738:ctest-vn1-29204738 2025-12-19 16:18:39,470 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:17751bd6-00b9-4ed0-8181-7ad32b66006a 2025-12-19 16:18:39,486 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738:ctest-vn1-29204738 2025-12-19 16:18:39,497 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:17751bd6-00b9-4ed0-8181-7ad32b66006a 2025-12-19 16:18:50,838 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9a2e4f50-1200-45b5-a1e2-ddeb1475d5ac 2025-12-19 16:18:50,850 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:50,857 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9a2e4f50-1200-45b5-a1e2-ddeb1475d5ac 2025-12-19 16:18:52,511 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:17751bd6-00b9-4ed0-8181-7ad32b66006a 2025-12-19 16:18:52,526 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522 2025-12-19 16:18:52,539 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:52,551 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_Inet4UcRouteReq?x=3 2025-12-19 16:18:58,832 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738 2025-12-19 16:18:58,838 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738:ctest-vn1-29204738 2025-12-19 16:18:58,847 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-vn1-29204738:ctest-vn1-29204738 2025-12-19 16:18:59,191 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522 2025-12-19 16:18:59,199 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:59,211 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48563200:ctest-fvn-23561522:ctest-fvn-23561522 2025-12-19 16:18:59,535 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:04,272 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:04,838 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:13,620 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:16,671 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:21,027 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:23,523 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:23,840 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:31,738 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4ceaf71d-9623-4389-9ea1-55b30e70d902 2025-12-19 16:19:31,744 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-69664400:ctest-vn1-43053503:ctest-vn1-43053503 2025-12-19 16:19:31,751 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4ceaf71d-9623-4389-9ea1-55b30e70d902 2025-12-19 16:19:40,017 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8ae05b94-07d6-4200-b4ec-3aecfafeb940 2025-12-19 16:19:40,028 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-69664400:ctest-vn1-43053503:ctest-vn1-43053503 2025-12-19 16:19:40,035 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8ae05b94-07d6-4200-b4ec-3aecfafeb940 2025-12-19 16:19:45,967 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:19:49,996 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:20:00,831 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:465a2d9b-c955-48ac-9319-e426f049da49 2025-12-19 16:20:00,845 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-98892390:ctest-vn1-13833880:ctest-vn1-13833880 2025-12-19 16:20:00,853 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:465a2d9b-c955-48ac-9319-e426f049da49 2025-12-19 16:20:07,023 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:18b4a23f-ae0b-4ab9-9e05-19cd3aacabdd 2025-12-19 16:20:07,031 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-98892390:ctest-vn2-11824704:ctest-vn2-11824704 2025-12-19 16:20:07,037 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:18b4a23f-ae0b-4ab9-9e05-19cd3aacabdd 2025-12-19 16:20:25,941 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:20:30,018 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:20:42,468 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:38cac409-b36c-4918-a813-36d5bb4614ba 2025-12-19 16:20:42,478 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-71620478:ctest-vn-56001157:ctest-vn-56001157 2025-12-19 16:20:42,485 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:38cac409-b36c-4918-a813-36d5bb4614ba 2025-12-19 16:20:48,830 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:27982667-ae10-4502-99cc-4b97635f11f1 2025-12-19 16:20:48,843 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-71620478:ctest-ext_vn-32252354:ctest-ext_vn-32252354 2025-12-19 16:20:48,852 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:27982667-ae10-4502-99cc-4b97635f11f1 2025-12-19 16:20:57,715 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:01,776 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:06,417 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-30346673:ctest-vn-30346673 2025-12-19 16:21:06,426 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-30346673:ctest-vn-30346673 2025-12-19 16:21:06,440 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-30346673:ctest-vn-30346673 2025-12-19 16:21:07,039 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-04260877:ctest-vn-04260877 2025-12-19 16:21:07,049 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-04260877:ctest-vn-04260877 2025-12-19 16:21:07,062 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-04260877:ctest-vn-04260877 2025-12-19 16:21:07,718 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-04260877 2025-12-19 16:21:07,729 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-04260877:ctest-vn-04260877 2025-12-19 16:21:07,740 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-04260877:ctest-vn-04260877 2025-12-19 16:21:08,073 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-30346673 2025-12-19 16:21:08,079 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-30346673:ctest-vn-30346673 2025-12-19 16:21:08,084 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-40712634:ctest-vn-30346673:ctest-vn-30346673 2025-12-19 16:21:08,382 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:12,880 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:13,209 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:16,515 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-29619113:ctest-vn4-84419495:ctest-vn4-84419495 2025-12-19 16:21:16,524 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-29619113:ctest-vn4-84419495:ctest-vn4-84419495 2025-12-19 16:21:16,532 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-29619113:ctest-vn4-84419495:ctest-vn4-84419495 2025-12-19 16:21:17,011 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-29619113:ctest-vn4-84419495 2025-12-19 16:21:17,021 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-29619113:ctest-vn4-84419495:ctest-vn4-84419495 2025-12-19 16:21:17,030 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-29619113:ctest-vn4-84419495:ctest-vn4-84419495 2025-12-19 16:21:17,562 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:17,895 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:22,258 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:21:25,766 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175:ctest-vn-77283175 2025-12-19 16:21:25,776 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175:ctest-vn-77283175 2025-12-19 16:21:25,783 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175:ctest-vn-77283175 2025-12-19 16:21:26,216 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325:ctest-vn-85236325 2025-12-19 16:21:26,223 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325:ctest-vn-85236325 2025-12-19 16:21:26,230 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325:ctest-vn-85236325 2025-12-19 16:21:34,594 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ef0db42e-73ea-4573-a27c-1dfde698a542 2025-12-19 16:21:34,602 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175:ctest-vn-77283175 2025-12-19 16:21:34,613 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ef0db42e-73ea-4573-a27c-1dfde698a542 2025-12-19 16:21:45,953 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1f87897c-0186-4ab1-98bc-dd7c0958993c 2025-12-19 16:21:45,962 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325:ctest-vn-85236325 2025-12-19 16:21:45,968 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1f87897c-0186-4ab1-98bc-dd7c0958993c 2025-12-19 16:21:58,724 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325 2025-12-19 16:21:58,731 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325:ctest-vn-85236325 2025-12-19 16:21:58,737 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-85236325:ctest-vn-85236325 2025-12-19 16:21:59,080 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175 2025-12-19 16:21:59,087 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175:ctest-vn-77283175 2025-12-19 16:21:59,092 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-87580539:ctest-vn-77283175:ctest-vn-77283175 2025-12-19 16:21:59,422 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:03,870 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:10,388 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:14,909 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:17,470 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-mgmt_vn-81166057:ctest-mgmt_vn-81166057 2025-12-19 16:22:17,481 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-mgmt_vn-81166057:ctest-mgmt_vn-81166057 2025-12-19 16:22:17,490 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-mgmt_vn-81166057:ctest-mgmt_vn-81166057 2025-12-19 16:22:18,714 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-left_vn-20311397:ctest-left_vn-20311397 2025-12-19 16:22:18,724 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-left_vn-20311397:ctest-left_vn-20311397 2025-12-19 16:22:18,733 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-left_vn-20311397:ctest-left_vn-20311397 2025-12-19 16:22:19,952 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-right_vn-60393724:ctest-right_vn-60393724 2025-12-19 16:22:19,959 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-right_vn-60393724:ctest-right_vn-60393724 2025-12-19 16:22:19,969 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-right_vn-60393724:ctest-right_vn-60393724 2025-12-19 16:22:31,729 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-right_vn-60393724 2025-12-19 16:22:31,736 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-right_vn-60393724:ctest-right_vn-60393724 2025-12-19 16:22:31,745 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-right_vn-60393724:ctest-right_vn-60393724 2025-12-19 16:22:32,032 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-left_vn-20311397 2025-12-19 16:22:32,040 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-left_vn-20311397:ctest-left_vn-20311397 2025-12-19 16:22:32,050 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-left_vn-20311397:ctest-left_vn-20311397 2025-12-19 16:22:32,388 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-mgmt_vn-81166057 2025-12-19 16:22:32,397 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-mgmt_vn-81166057:ctest-mgmt_vn-81166057 2025-12-19 16:22:32,407 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-32088943:ctest-mgmt_vn-81166057:ctest-mgmt_vn-81166057 2025-12-19 16:22:32,728 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:38,185 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:48,610 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:53,254 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:22:59,042 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:23:03,295 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:23:07,259 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:23:07,589 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:23:11,240 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:23:11,552 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:23:17,742 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58156492:ctest-vn-56300204:ctest-vn-56300204 2025-12-19 16:23:17,753 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58156492:ctest-vn-56300204:ctest-vn-56300204 2025-12-19 16:23:17,763 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58156492:ctest-vn-56300204:ctest-vn-56300204 2025-12-19 16:23:19,248 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-58156492:ctest-vn-56300204 2025-12-19 16:23:19,255 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58156492:ctest-vn-56300204:ctest-vn-56300204 2025-12-19 16:23:19,262 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58156492:ctest-vn-56300204:ctest-vn-56300204 2025-12-19 16:23:19,706 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq? 2025-12-19 16:25:27,731 - INFO - Using existing project ['default-domain', 'admin'](ceda5a4c-5ed4-4097-8a90-475c31ca529b) 2025-12-19 16:25:27,752 - INFO - ================================================================================ 2025-12-19 16:25:27,753 - INFO - STARTING TEST : test_contrail_status 2025-12-19 16:25:27,753 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-12-19 16:25:27,929 - DEBUG - Skipping xmpp flap check 2025-12-19 16:25:27,929 - INFO - Initial checks done. Running the testcase now 2025-12-19 16:25:27,929 - INFO - 2025-12-19 16:25:28,149 - INFO - 10.0.0.33 2025-12-19 16:25:28,149 - INFO - config 2025-12-19 16:25:28,157 - INFO - config-nodemgr:active 2025-12-19 16:25:28,164 - INFO - api-server:active 2025-12-19 16:25:28,169 - INFO - schema:active 2025-12-19 16:25:28,175 - INFO - svc-monitor:active 2025-12-19 16:25:28,180 - INFO - device-manager:active 2025-12-19 16:25:28,180 - INFO - config-database 2025-12-19 16:25:28,180 - INFO - config-cassandra:active 2025-12-19 16:25:28,180 - INFO - config-zookeeper:active 2025-12-19 16:25:28,181 - INFO - config-rabbitmq:active 2025-12-19 16:25:28,181 - INFO - vrouter 2025-12-19 16:25:28,186 - INFO - vrouter-nodemgr:active 2025-12-19 16:25:28,193 - INFO - agent:active 2025-12-19 16:25:28,193 - INFO - control 2025-12-19 16:25:28,199 - INFO - control-nodemgr:active 2025-12-19 16:25:28,208 - INFO - control:active 2025-12-19 16:25:28,208 - INFO - named:active 2025-12-19 16:25:28,215 - INFO - dns:active 2025-12-19 16:25:28,215 - INFO - analytics 2025-12-19 16:25:28,223 - INFO - analytics-nodemgr:active 2025-12-19 16:25:28,229 - INFO - analytics-api:active 2025-12-19 16:25:28,239 - INFO - collector:active 2025-12-19 16:25:28,239 - INFO - analytics-database 2025-12-19 16:25:28,239 - INFO - analytics-cassandra:active 2025-12-19 16:25:28,247 - INFO - analyticsdb-nodemgr:active 2025-12-19 16:25:28,254 - INFO - query-engine:active 2025-12-19 16:25:28,255 - INFO - webui 2025-12-19 16:25:28,255 - INFO - webui:active 2025-12-19 16:25:28,255 - INFO - webui-middleware:active 2025-12-19 16:25:28,255 - INFO - redis:active 2025-12-19 16:25:28,255 - INFO - analytics_snmp 2025-12-19 16:25:28,261 - INFO - snmp-collector:active 2025-12-19 16:25:28,261 - INFO - snmp-topology:active 2025-12-19 16:25:28,261 - INFO - analytics_alarm 2025-12-19 16:25:28,262 - INFO - alarmgen:active 2025-12-19 16:25:28,262 - INFO - All the contrail services are up on all nodes 2025-12-19 16:25:28,262 - INFO - contrail-status passed 2025-12-19 16:25:28,406 - DEBUG - Skipping xmpp flap check 2025-12-19 16:25:28,406 - INFO - END TEST : test_contrail_status : PASSED[0:00:01] 2025-12-19 16:25:28,406 - INFO - --------------------------------------------------------------------------------