2025-07-22 20:57:06,349 - DEBUG - [10.0.0.38]: Running cmd : hostname
2025-07-22 20:57:06,542 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3695-1
2025-07-22 20:57:06,542 - DEBUG - [10.0.0.38]: Running cmd : hostname -f
2025-07-22 20:57:06,605 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3695-1.
2025-07-22 20:57:06,605 - DEBUG - [10.0.0.38]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-07-22 20:57:06,696 - DEBUG - Output : NAMES
contrail_test_6unXZnP0t
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_api_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_nodemgr_1
control_control_1
control_dns_1
webui_web_1
webui_job_1
config_devicemgr_1
config_nodemgr_1
config_svcmonitor_1
config_dnsmasq_1
config_api_1
config_schema_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_zookeeper_1
config_database_cassandra_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-07-22 20:57:06,696 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.0.0.38 | head -n 1 | awk '{print $2}'
2025-07-22 20:57:06,756 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-3695-1.
2025-07-22 20:57:06,756 - DEBUG - [10.0.0.38]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-07-22 20:57:06,817 - DEBUG - Output : 10.0.0.38/24
172.17.0.1/16
10.20.0.17/24
2025-07-22 20:57:06,817 - DEBUG - [10.0.0.38]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-07-22 20:57:06,877 - DEBUG - Output : 10.20.0.17/24
2025-07-22 20:57:06,877 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}'
2025-07-22 20:57:06,941 - DEBUG - Output :
2025-07-22 20:57:08,631 - INFO - Using existing project ['default-domain', 'admin'](26448ecc-0706-4ca5-8436-ee2b1b1605e9)
2025-07-22 20:57:08,792 - INFO - ================================================================================
2025-07-22 20:57:08,792 - INFO - STARTING TEST : test_contrail_status
2025-07-22 20:57:08,793 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-07-22 20:57:08,911 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:08,917 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.17': '0'}} with
2025-07-22 20:57:08,917 - INFO - Initial checks done. Running the testcase now
2025-07-22 20:57:08,918 - INFO -
2025-07-22 20:57:08,918 - DEBUG - [10.0.0.38]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-07-22 20:57:09,022 - DEBUG - Output : contrail_test_6unXZnP0t
vrouter_vrouter-agent_1
vrouter_nodemgr_1
vrouter_provisioner_1
rsyslogd_rsyslogd_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_provisioner_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_provisioner_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_provisioner_1
analytics_api_1
analytics_nodemgr_1
analytics_collector_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_provisioner_1
analytics_database_cassandra_1
control_named_1
control_nodemgr_1
control_control_1
control_provisioner_1
control_dns_1
webui_web_1
webui_job_1
config_devicemgr_1
config_nodemgr_1
config_provisioner_1
config_svcmonitor_1
config_dnsmasq_1
config_api_1
config_schema_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_provisioner_1
config_database_zookeeper_1
config_database_cassandra_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-07-22 20:57:09,023 - INFO - 10.0.0.38
2025-07-22 20:57:09,023 - INFO - config
2025-07-22 20:57:09,030 - INFO - config-nodemgr:active
2025-07-22 20:57:09,034 - INFO - api-server:active
2025-07-22 20:57:09,038 - INFO - schema:active
2025-07-22 20:57:09,042 - INFO - svc-monitor:active
2025-07-22 20:57:09,048 - INFO - device-manager:active
2025-07-22 20:57:09,048 - INFO - config-database
2025-07-22 20:57:09,048 - INFO - config-cassandra:active
2025-07-22 20:57:09,048 - INFO - config-zookeeper:active
2025-07-22 20:57:09,048 - INFO - config-rabbitmq:active
2025-07-22 20:57:09,048 - INFO - vrouter
2025-07-22 20:57:09,053 - INFO - vrouter-nodemgr:active
2025-07-22 20:57:09,058 - INFO - agent:active
2025-07-22 20:57:09,059 - INFO - control
2025-07-22 20:57:09,064 - INFO - control-nodemgr:active
2025-07-22 20:57:09,069 - INFO - control:active
2025-07-22 20:57:09,069 - INFO - named:active
2025-07-22 20:57:09,074 - INFO - dns:active
2025-07-22 20:57:09,074 - INFO - analytics
2025-07-22 20:57:09,080 - INFO - analytics-nodemgr:active
2025-07-22 20:57:09,084 - INFO - analytics-api:active
2025-07-22 20:57:09,089 - INFO - collector:active
2025-07-22 20:57:09,089 - INFO - analytics-database
2025-07-22 20:57:09,089 - INFO - analytics-cassandra:active
2025-07-22 20:57:09,094 - INFO - analyticsdb-nodemgr:active
2025-07-22 20:57:09,099 - INFO - query-engine:active
2025-07-22 20:57:09,099 - INFO - webui
2025-07-22 20:57:09,099 - INFO - webui:active
2025-07-22 20:57:09,099 - INFO - webui-middleware:active
2025-07-22 20:57:09,099 - INFO - redis:active
2025-07-22 20:57:09,099 - INFO - analytics_snmp
2025-07-22 20:57:09,103 - INFO - snmp-collector:active
2025-07-22 20:57:09,103 - INFO - snmp-topology:active
2025-07-22 20:57:09,103 - INFO - analytics_alarm
2025-07-22 20:57:09,103 - INFO - alarmgen:active
2025-07-22 20:57:09,103 - INFO - All the contrail services are up on all nodes
2025-07-22 20:57:09,104 - INFO - contrail-status passed
2025-07-22 20:57:09,223 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:09,229 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 20:57:09,229 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-07-22 20:57:09,230 - INFO - --------------------------------------------------------------------------------
2025-07-22 20:57:11,379 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:13,468 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-54367039:ctest-vn22-93418685:ctest-vn22-93418685
2025-07-22 20:57:13,474 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-54367039:ctest-vn22-93418685:ctest-vn22-93418685
2025-07-22 20:57:13,480 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-54367039:ctest-vn22-93418685:ctest-vn22-93418685
2025-07-22 20:57:29,248 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-54367039:ctest-vn22-93418685
2025-07-22 20:57:29,254 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-54367039:ctest-vn22-93418685:ctest-vn22-93418685
2025-07-22 20:57:29,260 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-54367039:ctest-vn22-93418685:ctest-vn22-93418685
2025-07-22 20:57:29,407 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:30,439 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:30,446 - DEBUG - [10.0.0.38]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2025-07-22 20:57:34,377 - DEBUG - Output : 2025-07-22 20:57:32,704 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2025-07-22 20:57:32,724 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2025-07-22 20:57:32,949 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2025-07-22 20:57:33,489 INFO: (v1.41) Checker check_orphan_resources: Success
2025-07-22 20:57:33,932 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2025-07-22 20:57:33,932 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2025-07-22 20:57:34,178 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2025-07-22 20:57:34,193 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2025-07-22 20:57:34,200 INFO: (v1.41) Checker check_subnet_uuid: Success
2025-07-22 20:57:34,210 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2025-07-22 20:57:34,241 INFO: (v1.41) Checker check_route_targets_id: Success
2025-07-22 20:57:34,250 INFO: (v1.41) Checker check_virtual_networks_id: Success
2025-07-22 20:57:34,257 INFO: (v1.41) Checker check_security_groups_id: Success
2025-07-22 20:57:34,259 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2025-07-22 20:57:34,546 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:37,018 - INFO - admin user already present
2025-07-22 20:57:37,811 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:57:39,757 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:57:39,762 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:57:39,768 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:57:40,636 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451:ctest-vn1-43067451
2025-07-22 20:57:40,641 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451:ctest-vn1-43067451
2025-07-22 20:57:40,646 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451:ctest-vn1-43067451
2025-07-22 20:57:43,814 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c3a8942e-dcdd-47ed-9237-3dbe56b40be8
2025-07-22 20:57:43,820 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451:ctest-vn1-43067451
2025-07-22 20:57:43,826 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c3a8942e-dcdd-47ed-9237-3dbe56b40be8
2025-07-22 20:57:58,859 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:082b8079-6e5b-4209-a232-aaad1bc13f64
2025-07-22 20:57:58,865 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:57:58,870 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:082b8079-6e5b-4209-a232-aaad1bc13f64
2025-07-22 20:58:00,392 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c3a8942e-dcdd-47ed-9237-3dbe56b40be8
2025-07-22 20:58:00,399 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299
2025-07-22 20:58:00,404 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:58:00,409 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_Inet4UcRouteReq?x=3
2025-07-22 20:58:05,642 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451
2025-07-22 20:58:05,647 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451:ctest-vn1-43067451
2025-07-22 20:58:05,653 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-vn1-43067451:ctest-vn1-43067451
2025-07-22 20:58:05,908 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299
2025-07-22 20:58:05,913 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:58:05,918 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-94952855:ctest-fvn-66179299:ctest-fvn-66179299
2025-07-22 20:58:06,181 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:09,373 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:09,734 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:16,318 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:18,757 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:21,778 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:23,849 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:24,138 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:31,248 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:63b8a131-6b59-42ab-ae0c-2a4efcbcf153
2025-07-22 20:58:31,254 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-07972766:ctest-vn1-62073680:ctest-vn1-62073680
2025-07-22 20:58:31,260 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:63b8a131-6b59-42ab-ae0c-2a4efcbcf153
2025-07-22 20:58:37,188 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a08ca2af-2633-466e-948b-550fdec64baf
2025-07-22 20:58:37,194 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-07972766:ctest-vn1-62073680:ctest-vn1-62073680
2025-07-22 20:58:37,199 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a08ca2af-2633-466e-948b-550fdec64baf
2025-07-22 20:58:42,589 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:45,797 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:58:55,938 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1fab4869-a826-4751-928e-9391a980311a
2025-07-22 20:58:55,944 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-01178556:ctest-vn1-71840103:ctest-vn1-71840103
2025-07-22 20:58:55,950 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1fab4869-a826-4751-928e-9391a980311a
2025-07-22 20:58:59,740 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44c44abb-bc76-4cfb-bf00-16c048436412
2025-07-22 20:58:59,746 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-01178556:ctest-vn2-87972628:ctest-vn2-87972628
2025-07-22 20:58:59,751 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44c44abb-bc76-4cfb-bf00-16c048436412
2025-07-22 20:59:21,325 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:59:25,038 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:59:35,858 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:47534c8b-2120-46fa-9999-2f966dab8067
2025-07-22 20:59:35,866 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-29791221:ctest-vn-58975975:ctest-vn-58975975
2025-07-22 20:59:35,872 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:47534c8b-2120-46fa-9999-2f966dab8067
2025-07-22 20:59:41,772 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cf177737-ecf4-4bc0-a331-91412b03e3cf
2025-07-22 20:59:41,778 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-29791221:ctest-ext_vn-48366597:ctest-ext_vn-48366597
2025-07-22 20:59:41,784 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cf177737-ecf4-4bc0-a331-91412b03e3cf
2025-07-22 20:59:50,149 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:59:53,358 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 20:59:56,975 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-76665561:ctest-vn-76665561
2025-07-22 20:59:56,981 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-76665561:ctest-vn-76665561
2025-07-22 20:59:56,987 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-76665561:ctest-vn-76665561
2025-07-22 20:59:57,374 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-16713667:ctest-vn-16713667
2025-07-22 20:59:57,380 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-16713667:ctest-vn-16713667
2025-07-22 20:59:57,386 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-16713667:ctest-vn-16713667
2025-07-22 20:59:57,931 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-16713667
2025-07-22 20:59:57,937 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-16713667:ctest-vn-16713667
2025-07-22 20:59:57,942 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-16713667:ctest-vn-16713667
2025-07-22 20:59:58,207 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-76665561
2025-07-22 20:59:58,213 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-76665561:ctest-vn-76665561
2025-07-22 20:59:58,218 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-31348678:ctest-vn-76665561:ctest-vn-76665561
2025-07-22 20:59:58,482 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:01,578 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:01,866 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:04,591 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-17024200:ctest-vn4-30355898:ctest-vn4-30355898
2025-07-22 21:00:04,597 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-17024200:ctest-vn4-30355898:ctest-vn4-30355898
2025-07-22 21:00:04,602 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-17024200:ctest-vn4-30355898:ctest-vn4-30355898
2025-07-22 21:00:05,012 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-17024200:ctest-vn4-30355898
2025-07-22 21:00:05,019 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-17024200:ctest-vn4-30355898:ctest-vn4-30355898
2025-07-22 21:00:05,027 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-17024200:ctest-vn4-30355898:ctest-vn4-30355898
2025-07-22 21:00:05,500 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:05,789 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:08,894 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:12,043 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881:ctest-vn-89789881
2025-07-22 21:00:12,049 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881:ctest-vn-89789881
2025-07-22 21:00:12,055 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881:ctest-vn-89789881
2025-07-22 21:00:12,383 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930:ctest-vn-20707930
2025-07-22 21:00:12,388 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930:ctest-vn-20707930
2025-07-22 21:00:12,393 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930:ctest-vn-20707930
2025-07-22 21:00:20,038 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c296b555-8d78-4dee-81ca-d69d2446ed68
2025-07-22 21:00:20,044 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881:ctest-vn-89789881
2025-07-22 21:00:20,050 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c296b555-8d78-4dee-81ca-d69d2446ed68
2025-07-22 21:00:31,140 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:96b8d9d2-f5a9-47a0-b761-edf88e752a81
2025-07-22 21:00:31,146 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930:ctest-vn-20707930
2025-07-22 21:00:31,151 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:96b8d9d2-f5a9-47a0-b761-edf88e752a81
2025-07-22 21:00:42,572 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930
2025-07-22 21:00:42,579 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930:ctest-vn-20707930
2025-07-22 21:00:42,585 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-20707930:ctest-vn-20707930
2025-07-22 21:00:42,855 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881
2025-07-22 21:00:42,863 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881:ctest-vn-89789881
2025-07-22 21:00:42,871 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-96840378:ctest-vn-89789881:ctest-vn-89789881
2025-07-22 21:00:43,141 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:46,278 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:00:55,970 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:19677a83-86ee-4514-b83c-f8c7c1214f97
2025-07-22 21:00:55,977 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-76005554:ctest-bgpaas_vn-25233612:ctest-bgpaas_vn-25233612
2025-07-22 21:00:55,984 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:19677a83-86ee-4514-b83c-f8c7c1214f97
2025-07-22 21:01:02,055 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4a17527c-8d2c-4ff2-852f-ec09030c0ad0
2025-07-22 21:01:02,063 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-76005554:ctest-bgpaas_vn-93226989:ctest-bgpaas_vn-93226989
2025-07-22 21:01:02,071 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4a17527c-8d2c-4ff2-852f-ec09030c0ad0
2025-07-22 21:01:03,770 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:10,514 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:13,786 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:15,747 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-mgmt_vn-99949289:ctest-mgmt_vn-99949289
2025-07-22 21:01:15,754 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-mgmt_vn-99949289:ctest-mgmt_vn-99949289
2025-07-22 21:01:15,760 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-mgmt_vn-99949289:ctest-mgmt_vn-99949289
2025-07-22 21:01:16,730 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-left_vn-51332316:ctest-left_vn-51332316
2025-07-22 21:01:16,737 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-left_vn-51332316:ctest-left_vn-51332316
2025-07-22 21:01:16,743 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-left_vn-51332316:ctest-left_vn-51332316
2025-07-22 21:01:17,674 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-right_vn-11757375:ctest-right_vn-11757375
2025-07-22 21:01:17,679 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-right_vn-11757375:ctest-right_vn-11757375
2025-07-22 21:01:17,685 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-right_vn-11757375:ctest-right_vn-11757375
2025-07-22 21:01:23,122 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-right_vn-11757375
2025-07-22 21:01:23,127 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-right_vn-11757375:ctest-right_vn-11757375
2025-07-22 21:01:23,133 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-right_vn-11757375:ctest-right_vn-11757375
2025-07-22 21:01:23,385 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-left_vn-51332316
2025-07-22 21:01:23,391 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-left_vn-51332316:ctest-left_vn-51332316
2025-07-22 21:01:23,396 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-left_vn-51332316:ctest-left_vn-51332316
2025-07-22 21:01:23,665 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-mgmt_vn-99949289
2025-07-22 21:01:23,670 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-mgmt_vn-99949289:ctest-mgmt_vn-99949289
2025-07-22 21:01:23,676 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-60809216:ctest-mgmt_vn-99949289:ctest-mgmt_vn-99949289
2025-07-22 21:01:23,942 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:27,862 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:37,122 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:40,409 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:44,341 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:47,378 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:50,198 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:50,489 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:53,010 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:53,298 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:01:57,531 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58269866:ctest-vn-51703949:ctest-vn-51703949
2025-07-22 21:01:57,538 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58269866:ctest-vn-51703949:ctest-vn-51703949
2025-07-22 21:01:57,544 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58269866:ctest-vn-51703949:ctest-vn-51703949
2025-07-22 21:01:58,450 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-58269866:ctest-vn-51703949
2025-07-22 21:01:58,456 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58269866:ctest-vn-51703949:ctest-vn-51703949
2025-07-22 21:01:58,461 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-58269866:ctest-vn-51703949:ctest-vn-51703949
2025-07-22 21:01:58,822 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 21:03:27,467 - INFO - Using existing project ['default-domain', 'admin'](26448ecc-0706-4ca5-8436-ee2b1b1605e9)
2025-07-22 21:03:27,477 - INFO - ================================================================================
2025-07-22 21:03:27,477 - INFO - STARTING TEST : test_contrail_status
2025-07-22 21:03:27,477 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-07-22 21:03:27,610 - DEBUG - Skipping xmpp flap check
2025-07-22 21:03:27,610 - INFO - Initial checks done. Running the testcase now
2025-07-22 21:03:27,610 - INFO -
2025-07-22 21:03:27,710 - INFO - 10.0.0.38
2025-07-22 21:03:27,711 - INFO - config
2025-07-22 21:03:27,718 - INFO - config-nodemgr:active
2025-07-22 21:03:27,724 - INFO - api-server:active
2025-07-22 21:03:27,728 - INFO - schema:active
2025-07-22 21:03:27,732 - INFO - svc-monitor:active
2025-07-22 21:03:27,737 - INFO - device-manager:active
2025-07-22 21:03:27,737 - INFO - config-database
2025-07-22 21:03:27,738 - INFO - config-cassandra:active
2025-07-22 21:03:27,738 - INFO - config-zookeeper:active
2025-07-22 21:03:27,738 - INFO - config-rabbitmq:active
2025-07-22 21:03:27,738 - INFO - vrouter
2025-07-22 21:03:27,744 - INFO - vrouter-nodemgr:active
2025-07-22 21:03:27,751 - INFO - agent:active
2025-07-22 21:03:27,751 - INFO - control
2025-07-22 21:03:27,756 - INFO - control-nodemgr:active
2025-07-22 21:03:27,762 - INFO - control:active
2025-07-22 21:03:27,762 - INFO - named:active
2025-07-22 21:03:27,767 - INFO - dns:active
2025-07-22 21:03:27,767 - INFO - analytics
2025-07-22 21:03:27,773 - INFO - analytics-nodemgr:active
2025-07-22 21:03:27,777 - INFO - analytics-api:active
2025-07-22 21:03:27,783 - INFO - collector:active
2025-07-22 21:03:27,783 - INFO - analytics-database
2025-07-22 21:03:27,783 - INFO - analytics-cassandra:active
2025-07-22 21:03:27,789 - INFO - analyticsdb-nodemgr:active
2025-07-22 21:03:27,794 - INFO - query-engine:active
2025-07-22 21:03:27,794 - INFO - webui
2025-07-22 21:03:27,794 - INFO - webui:active
2025-07-22 21:03:27,794 - INFO - webui-middleware:active
2025-07-22 21:03:27,794 - INFO - redis:active
2025-07-22 21:03:27,795 - INFO - analytics_snmp
2025-07-22 21:03:27,799 - INFO - snmp-collector:active
2025-07-22 21:03:27,799 - INFO - snmp-topology:active
2025-07-22 21:03:27,799 - INFO - analytics_alarm
2025-07-22 21:03:27,799 - INFO - alarmgen:active
2025-07-22 21:03:27,799 - INFO - All the contrail services are up on all nodes
2025-07-22 21:03:27,799 - INFO - contrail-status passed
2025-07-22 21:03:27,920 - DEBUG - Skipping xmpp flap check
2025-07-22 21:03:27,920 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-07-22 21:03:27,920 - INFO - --------------------------------------------------------------------------------