2026-03-03 13:19:28,329 - DEBUG - [10.0.0.33]: Running cmd : hostname
2026-03-03 13:19:28,533 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5423-1
2026-03-03 13:19:28,533 - DEBUG - [10.0.0.33]: Running cmd : hostname -f
2026-03-03 13:19:28,592 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5423-1.
2026-03-03 13:19:28,592 - DEBUG - [10.0.0.33]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2026-03-03 13:19:28,682 - DEBUG - Output : NAMES
contrail_test_qu8dBoBbl
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_collector_1
analytics_api_1
analytics_database_nodemgr_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_schema_1
config_dnsmasq_1
config_nodemgr_1
config_api_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2026-03-03 13:19:28,683 - DEBUG - [10.0.0.33]: Running cmd : getent hosts 10.0.0.33 | head -n 1 | awk '{print $2}'
2026-03-03 13:19:28,748 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-5423-1.
2026-03-03 13:19:28,749 - DEBUG - [10.0.0.33]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2026-03-03 13:19:28,812 - DEBUG - Output : 127.0.0.1/8
10.0.0.33/24
172.17.0.1/16
10.20.0.14/24
2026-03-03 13:19:28,813 - DEBUG - [10.0.0.33]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2026-03-03 13:19:28,876 - DEBUG - Output : 10.20.0.14/24
2026-03-03 13:19:28,876 - DEBUG - [10.0.0.33]: Running cmd : getent hosts 10.20.0.14 | head -n 1 | awk '{print $2}'
2026-03-03 13:19:28,940 - DEBUG - Output :
2026-03-03 13:19:30,947 - INFO - Using existing project ['default-domain', 'admin'](c8a044a9-a139-4a1c-87e3-ddd75c6b1a32)
2026-03-03 13:19:31,076 - INFO - ================================================================================
2026-03-03 13:19:31,077 - INFO - STARTING TEST : test_contrail_status
2026-03-03 13:19:31,077 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-03-03 13:19:31,194 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:19:31,200 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.14': '0'}} with
2026-03-03 13:19:31,200 - INFO - Initial checks done. Running the testcase now
2026-03-03 13:19:31,200 - INFO -
2026-03-03 13:19:31,201 - DEBUG - [10.0.0.33]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2026-03-03 13:19:31,291 - DEBUG - Output : contrail_test_qu8dBoBbl
vrouter_vrouter-agent_1
vrouter_nodemgr_1
vrouter_provisioner_1
rsyslogd_rsyslogd_1
analytics_snmp_provisioner_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_snmp_snmp-collector_1
analytics_alarm_nodemgr_1
analytics_alarm_alarm-gen_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_collector_1
analytics_provisioner_1
analytics_api_1
analytics_database_nodemgr_1
analytics_database_provisioner_1
analytics_database_query-engine_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_provisioner_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_svcmonitor_1
config_provisioner_1
config_schema_1
config_dnsmasq_1
config_nodemgr_1
config_api_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2026-03-03 13:19:31,291 - INFO - 10.0.0.33
2026-03-03 13:19:31,291 - INFO - config
2026-03-03 13:19:31,296 - INFO - config-nodemgr:active
2026-03-03 13:19:31,300 - INFO - api-server:active
2026-03-03 13:19:31,303 - INFO - schema:active
2026-03-03 13:19:31,307 - INFO - svc-monitor:active
2026-03-03 13:19:31,312 - INFO - device-manager:active
2026-03-03 13:19:31,312 - INFO - config-database
2026-03-03 13:19:31,312 - INFO - config-cassandra:active
2026-03-03 13:19:31,312 - INFO - config-zookeeper:active
2026-03-03 13:19:31,312 - INFO - config-rabbitmq:active
2026-03-03 13:19:31,312 - INFO - vrouter
2026-03-03 13:19:31,316 - INFO - vrouter-nodemgr:active
2026-03-03 13:19:31,320 - INFO - agent:active
2026-03-03 13:19:31,321 - INFO - control
2026-03-03 13:19:31,325 - INFO - control-nodemgr:active
2026-03-03 13:19:31,329 - INFO - control:active
2026-03-03 13:19:31,329 - INFO - named:active
2026-03-03 13:19:31,334 - INFO - dns:active
2026-03-03 13:19:31,334 - INFO - analytics
2026-03-03 13:19:31,339 - INFO - analytics-nodemgr:active
2026-03-03 13:19:31,343 - INFO - analytics-api:active
2026-03-03 13:19:31,348 - INFO - collector:active
2026-03-03 13:19:31,349 - INFO - analytics-database
2026-03-03 13:19:31,349 - INFO - analytics-cassandra:active
2026-03-03 13:19:31,353 - INFO - analyticsdb-nodemgr:active
2026-03-03 13:19:31,359 - INFO - query-engine:active
2026-03-03 13:19:31,359 - INFO - webui
2026-03-03 13:19:31,359 - INFO - webui:active
2026-03-03 13:19:31,359 - INFO - webui-middleware:active
2026-03-03 13:19:31,359 - INFO - redis:active
2026-03-03 13:19:31,359 - INFO - analytics_snmp
2026-03-03 13:19:31,363 - INFO - snmp-collector:active
2026-03-03 13:19:31,363 - INFO - snmp-topology:active
2026-03-03 13:19:31,364 - INFO - analytics_alarm
2026-03-03 13:19:31,364 - INFO - alarmgen:active
2026-03-03 13:19:31,364 - INFO - All the contrail services are up on all nodes
2026-03-03 13:19:31,364 - INFO - contrail-status passed
2026-03-03 13:19:31,482 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:19:31,488 - DEBUG - No XMPP flaps were noticed during the test
2026-03-03 13:19:31,488 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-03-03 13:19:31,488 - INFO - --------------------------------------------------------------------------------
2026-03-03 13:19:33,910 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:19:36,094 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-03656986:ctest-vn22-69050860:ctest-vn22-69050860
2026-03-03 13:19:36,104 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-03656986:ctest-vn22-69050860:ctest-vn22-69050860
2026-03-03 13:19:36,109 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-03656986:ctest-vn22-69050860:ctest-vn22-69050860
2026-03-03 13:19:56,996 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-03656986:ctest-vn22-69050860
2026-03-03 13:19:57,002 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-03656986:ctest-vn22-69050860:ctest-vn22-69050860
2026-03-03 13:19:57,007 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-03656986:ctest-vn22-69050860:ctest-vn22-69050860
2026-03-03 13:19:57,138 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:19:58,246 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:19:58,252 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2026-03-03 13:20:01,464 - DEBUG - Output : 2026-03-03 13:20:00,737 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2026-03-03 13:20:00,759 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2026-03-03 13:20:00,840 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2026-03-03 13:20:01,011 INFO: (v1.41) Checker check_orphan_resources: Success
2026-03-03 13:20:01,188 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2026-03-03 13:20:01,188 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2026-03-03 13:20:01,277 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2026-03-03 13:20:01,288 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2026-03-03 13:20:01,293 INFO: (v1.41) Checker check_subnet_uuid: Success
2026-03-03 13:20:01,301 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2026-03-03 13:20:01,329 INFO: (v1.41) Checker check_route_targets_id: Success
2026-03-03 13:20:01,337 INFO: (v1.41) Checker check_virtual_networks_id: Success
2026-03-03 13:20:01,344 INFO: (v1.41) Checker check_security_groups_id: Success
2026-03-03 13:20:01,347 INFO: (v1.41) Checker check_ipam_subnet_method: Success
2026-03-03 13:20:01,349 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2026-03-03 13:20:01,623 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:01,814 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:01,975 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:02,130 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:02,291 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:04,871 - INFO - admin user already present
2026-03-03 13:20:05,704 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:07,626 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:07,630 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:07,634 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:08,467 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973:ctest-vn1-08198973
2026-03-03 13:20:08,472 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973:ctest-vn1-08198973
2026-03-03 13:20:08,476 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973:ctest-vn1-08198973
2026-03-03 13:20:11,783 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:699e0f7a-26f9-4380-91d4-3188609c299d
2026-03-03 13:20:11,789 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973:ctest-vn1-08198973
2026-03-03 13:20:11,794 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:699e0f7a-26f9-4380-91d4-3188609c299d
2026-03-03 13:20:21,797 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ff8336b1-181c-4dc6-a030-ee182b23c90b
2026-03-03 13:20:21,803 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:21,809 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ff8336b1-181c-4dc6-a030-ee182b23c90b
2026-03-03 13:20:23,326 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:699e0f7a-26f9-4380-91d4-3188609c299d
2026-03-03 13:20:23,331 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705
2026-03-03 13:20:23,336 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:23,340 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_Inet4UcRouteReq?x=3
2026-03-03 13:20:28,948 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973
2026-03-03 13:20:28,952 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973:ctest-vn1-08198973
2026-03-03 13:20:28,956 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-vn1-08198973:ctest-vn1-08198973
2026-03-03 13:20:29,198 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705
2026-03-03 13:20:29,202 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:29,206 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-48687030:ctest-fvn-88208705:ctest-fvn-88208705
2026-03-03 13:20:29,465 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:32,749 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:33,133 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:39,433 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:41,749 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:44,913 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:47,497 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:47,789 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:20:54,924 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aad1fd8f-7b07-4f6a-a08b-344d21f0c637
2026-03-03 13:20:54,930 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-97793345:ctest-vn1-00148848:ctest-vn1-00148848
2026-03-03 13:20:54,935 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:aad1fd8f-7b07-4f6a-a08b-344d21f0c637
2026-03-03 13:21:00,812 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:973ba1a4-343d-4830-8ad9-8bcd431b0636
2026-03-03 13:21:00,818 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-97793345:ctest-vn1-00148848:ctest-vn1-00148848
2026-03-03 13:21:00,823 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:973ba1a4-343d-4830-8ad9-8bcd431b0636
2026-03-03 13:21:05,933 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:21:09,337 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:21:19,115 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a0c7e390-40da-47f3-a235-f1a7971d1e83
2026-03-03 13:21:19,124 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-09113191:ctest-vn1-59608384:ctest-vn1-59608384
2026-03-03 13:21:19,131 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a0c7e390-40da-47f3-a235-f1a7971d1e83
2026-03-03 13:21:25,032 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:56bdf291-df1f-4146-ba9e-cb34ada3fe63
2026-03-03 13:21:25,039 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-09113191:ctest-vn2-56642588:ctest-vn2-56642588
2026-03-03 13:21:25,045 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:56bdf291-df1f-4146-ba9e-cb34ada3fe63
2026-03-03 13:21:46,912 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:21:50,121 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:01,204 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dde67151-ddcf-4e2b-8cfd-6658d8664915
2026-03-03 13:22:01,210 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-80860243:ctest-vn-60912928:ctest-vn-60912928
2026-03-03 13:22:01,216 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:dde67151-ddcf-4e2b-8cfd-6658d8664915
2026-03-03 13:22:07,095 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:74b32f7d-fe32-4e84-9f2d-69b115e752ff
2026-03-03 13:22:07,100 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-80860243:ctest-ext_vn-20960823:ctest-ext_vn-20960823
2026-03-03 13:22:07,104 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:74b32f7d-fe32-4e84-9f2d-69b115e752ff
2026-03-03 13:22:15,089 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:18,221 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:21,888 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-69963065:ctest-vn-69963065
2026-03-03 13:22:21,894 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-69963065:ctest-vn-69963065
2026-03-03 13:22:21,897 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-69963065:ctest-vn-69963065
2026-03-03 13:22:22,206 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-35584462:ctest-vn-35584462
2026-03-03 13:22:22,210 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-35584462:ctest-vn-35584462
2026-03-03 13:22:22,214 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-35584462:ctest-vn-35584462
2026-03-03 13:22:22,701 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-35584462
2026-03-03 13:22:22,705 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-35584462:ctest-vn-35584462
2026-03-03 13:22:22,709 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-35584462:ctest-vn-35584462
2026-03-03 13:22:22,947 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-69963065
2026-03-03 13:22:22,951 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-69963065:ctest-vn-69963065
2026-03-03 13:22:22,955 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-42742227:ctest-vn-69963065:ctest-vn-69963065
2026-03-03 13:22:23,213 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:26,324 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:26,613 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:29,193 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-27474631:ctest-vn4-24890064:ctest-vn4-24890064
2026-03-03 13:22:29,197 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-27474631:ctest-vn4-24890064:ctest-vn4-24890064
2026-03-03 13:22:29,202 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-27474631:ctest-vn4-24890064:ctest-vn4-24890064
2026-03-03 13:22:29,550 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-27474631:ctest-vn4-24890064
2026-03-03 13:22:29,554 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-27474631:ctest-vn4-24890064:ctest-vn4-24890064
2026-03-03 13:22:29,559 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-27474631:ctest-vn4-24890064:ctest-vn4-24890064
2026-03-03 13:22:30,005 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:30,293 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:33,453 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:22:36,578 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-02688560:ctest-vn-02688560
2026-03-03 13:22:36,583 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-02688560:ctest-vn-02688560
2026-03-03 13:22:36,587 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-02688560:ctest-vn-02688560
2026-03-03 13:22:36,871 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-17799525:ctest-vn-17799525
2026-03-03 13:22:36,875 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-17799525:ctest-vn-17799525
2026-03-03 13:22:36,879 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-17799525:ctest-vn-17799525
2026-03-03 13:28:04,081 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-17799525
2026-03-03 13:28:04,086 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-17799525:ctest-vn-17799525
2026-03-03 13:28:04,091 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-17799525:ctest-vn-17799525
2026-03-03 13:28:09,367 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-02688560
2026-03-03 13:28:09,372 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-02688560:ctest-vn-02688560
2026-03-03 13:28:09,376 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-24175971:ctest-vn-02688560:ctest-vn-02688560
2026-03-03 13:28:09,637 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:13,061 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:18,022 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:21,377 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:23,230 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-mgmt_vn-37884977:ctest-mgmt_vn-37884977
2026-03-03 13:28:23,235 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-mgmt_vn-37884977:ctest-mgmt_vn-37884977
2026-03-03 13:28:23,239 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-mgmt_vn-37884977:ctest-mgmt_vn-37884977
2026-03-03 13:28:24,059 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-left_vn-11392912:ctest-left_vn-11392912
2026-03-03 13:28:24,064 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-left_vn-11392912:ctest-left_vn-11392912
2026-03-03 13:28:24,069 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-left_vn-11392912:ctest-left_vn-11392912
2026-03-03 13:28:24,902 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-right_vn-73835636:ctest-right_vn-73835636
2026-03-03 13:28:24,907 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-right_vn-73835636:ctest-right_vn-73835636
2026-03-03 13:28:24,911 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-right_vn-73835636:ctest-right_vn-73835636
2026-03-03 13:28:30,134 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-right_vn-73835636
2026-03-03 13:28:30,139 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-right_vn-73835636:ctest-right_vn-73835636
2026-03-03 13:28:30,144 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-right_vn-73835636:ctest-right_vn-73835636
2026-03-03 13:28:30,383 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-left_vn-11392912
2026-03-03 13:28:30,388 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-left_vn-11392912:ctest-left_vn-11392912
2026-03-03 13:28:30,392 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-left_vn-11392912:ctest-left_vn-11392912
2026-03-03 13:28:30,626 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-mgmt_vn-37884977
2026-03-03 13:28:30,631 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-mgmt_vn-37884977:ctest-mgmt_vn-37884977
2026-03-03 13:28:30,635 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-63584047:ctest-mgmt_vn-37884977:ctest-mgmt_vn-37884977
2026-03-03 13:28:30,902 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:34,154 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:43,285 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:46,530 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:50,522 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:53,717 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:56,565 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:56,853 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:59,338 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:28:59,625 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:29:03,902 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-96832697:ctest-vn-70258411:ctest-vn-70258411
2026-03-03 13:29:03,907 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-96832697:ctest-vn-70258411:ctest-vn-70258411
2026-03-03 13:29:03,911 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-96832697:ctest-vn-70258411:ctest-vn-70258411
2026-03-03 13:29:04,797 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-96832697:ctest-vn-70258411
2026-03-03 13:29:04,802 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-96832697:ctest-vn-70258411:ctest-vn-70258411
2026-03-03 13:29:04,806 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-96832697:ctest-vn-70258411:ctest-vn-70258411
2026-03-03 13:29:05,153 - DEBUG - Requesting: http://10.0.0.33:8085/Snh_AgentXmppConnectionStatusReq?
2026-03-03 13:30:42,144 - INFO - Using existing project ['default-domain', 'admin'](c8a044a9-a139-4a1c-87e3-ddd75c6b1a32)
2026-03-03 13:30:42,151 - INFO - ================================================================================
2026-03-03 13:30:42,151 - INFO - STARTING TEST : test_contrail_status
2026-03-03 13:30:42,151 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2026-03-03 13:30:42,275 - DEBUG - Skipping xmpp flap check
2026-03-03 13:30:42,275 - INFO - Initial checks done. Running the testcase now
2026-03-03 13:30:42,275 - INFO -
2026-03-03 13:30:42,369 - INFO - 10.0.0.33
2026-03-03 13:30:42,369 - INFO - config
2026-03-03 13:30:42,376 - INFO - config-nodemgr:active
2026-03-03 13:30:42,381 - INFO - api-server:active
2026-03-03 13:30:42,385 - INFO - schema:active
2026-03-03 13:30:42,389 - INFO - svc-monitor:active
2026-03-03 13:30:42,393 - INFO - device-manager:active
2026-03-03 13:30:42,393 - INFO - config-database
2026-03-03 13:30:42,393 - INFO - config-cassandra:active
2026-03-03 13:30:42,393 - INFO - config-zookeeper:active
2026-03-03 13:30:42,393 - INFO - config-rabbitmq:active
2026-03-03 13:30:42,393 - INFO - vrouter
2026-03-03 13:30:42,398 - INFO - vrouter-nodemgr:active
2026-03-03 13:30:42,402 - INFO - agent:active
2026-03-03 13:30:42,403 - INFO - control
2026-03-03 13:30:42,407 - INFO - control-nodemgr:active
2026-03-03 13:30:42,411 - INFO - control:active
2026-03-03 13:30:42,412 - INFO - named:active
2026-03-03 13:30:42,416 - INFO - dns:active
2026-03-03 13:30:42,416 - INFO - analytics
2026-03-03 13:30:42,421 - INFO - analytics-nodemgr:active
2026-03-03 13:30:42,425 - INFO - analytics-api:active
2026-03-03 13:30:42,429 - INFO - collector:active
2026-03-03 13:30:42,429 - INFO - analytics-database
2026-03-03 13:30:42,429 - INFO - analytics-cassandra:active
2026-03-03 13:30:42,434 - INFO - analyticsdb-nodemgr:active
2026-03-03 13:30:42,440 - INFO - query-engine:active
2026-03-03 13:30:42,440 - INFO - webui
2026-03-03 13:30:42,440 - INFO - webui:active
2026-03-03 13:30:42,440 - INFO - webui-middleware:active
2026-03-03 13:30:42,440 - INFO - redis:active
2026-03-03 13:30:42,440 - INFO - analytics_snmp
2026-03-03 13:30:42,445 - INFO - snmp-collector:active
2026-03-03 13:30:42,445 - INFO - snmp-topology:active
2026-03-03 13:30:42,445 - INFO - analytics_alarm
2026-03-03 13:30:42,445 - INFO - alarmgen:active
2026-03-03 13:30:42,445 - INFO - All the contrail services are up on all nodes
2026-03-03 13:30:42,445 - INFO - contrail-status passed
2026-03-03 13:30:42,566 - DEBUG - Skipping xmpp flap check
2026-03-03 13:30:42,566 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2026-03-03 13:30:42,566 - INFO - --------------------------------------------------------------------------------