2025-10-05 07:13:43,205 - DEBUG - [10.0.0.38]: Running cmd : hostname
2025-10-05 07:13:43,405 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4213-1
2025-10-05 07:13:43,406 - DEBUG - [10.0.0.38]: Running cmd : hostname -f
2025-10-05 07:13:43,465 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4213-1.
2025-10-05 07:13:43,465 - DEBUG - [10.0.0.38]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-10-05 07:13:43,556 - DEBUG - Output : NAMES
contrail_test_1hmEbEYrk
vrouter_vrouter-agent_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_kafka_1
analytics_api_1
analytics_collector_1
analytics_nodemgr_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_api_1
config_svcmonitor_1
config_schema_1
config_dnsmasq_1
config_nodemgr_1
config_database_nodemgr_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-10-05 07:13:43,557 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.0.0.38 | head -n 1 | awk '{print $2}'
2025-10-05 07:13:43,617 - DEBUG - Output : cn-jenkins-deploy-platform-ansible-os-4213-1.
2025-10-05 07:13:43,617 - DEBUG - [10.0.0.38]: Running cmd : ip -4 -o addr show | awk '{print $4}'
2025-10-05 07:13:43,678 - DEBUG - Output : 127.0.0.1/8
10.0.0.38/24
172.17.0.1/16
10.20.0.17/24
2025-10-05 07:13:43,678 - DEBUG - [10.0.0.38]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}'
2025-10-05 07:13:43,737 - DEBUG - Output : 10.20.0.17/24
2025-10-05 07:13:43,737 - DEBUG - [10.0.0.38]: Running cmd : getent hosts 10.20.0.17 | head -n 1 | awk '{print $2}'
2025-10-05 07:13:43,797 - DEBUG - Output :
2025-10-05 07:13:45,384 - INFO - Using existing project ['default-domain', 'admin'](38a77cd6-02be-4176-8df1-90918103d1a5)
2025-10-05 07:13:45,531 - INFO - ================================================================================
2025-10-05 07:13:45,531 - INFO - STARTING TEST : test_contrail_status
2025-10-05 07:13:45,531 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-10-05 07:13:45,662 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:13:45,668 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.17': '0'}} with
2025-10-05 07:13:45,668 - INFO - Initial checks done. Running the testcase now
2025-10-05 07:13:45,668 - INFO -
2025-10-05 07:13:45,668 - DEBUG - [10.0.0.38]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null
2025-10-05 07:13:45,743 - DEBUG - Output : contrail_test_1hmEbEYrk
vrouter_vrouter-agent_1
vrouter_provisioner_1
vrouter_nodemgr_1
rsyslogd_rsyslogd_1
analytics_snmp_nodemgr_1
analytics_snmp_provisioner_1
analytics_snmp_snmp-collector_1
analytics_snmp_topology_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_provisioner_1
analytics_alarm_kafka_1
analytics_api_1
analytics_collector_1
analytics_provisioner_1
analytics_nodemgr_1
analytics_database_provisioner_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
control_named_1
control_control_1
control_dns_1
control_provisioner_1
control_nodemgr_1
webui_web_1
webui_job_1
config_devicemgr_1
config_api_1
config_provisioner_1
config_svcmonitor_1
config_schema_1
config_dnsmasq_1
config_nodemgr_1
config_database_nodemgr_1
config_database_provisioner_1
config_database_rabbitmq_1
config_database_cassandra_1
config_database_zookeeper_1
redis_redis_1
barbican_worker
barbican_keystone_listener
barbican_api
horizon
heat_engine
heat_api_cfn
heat_api
neutron_server
nova_compute
nova_libvirt
nova_ssh
nova_novncproxy
nova_conductor
nova_api
nova_scheduler
placement_api
glance_api
keystone
keystone_fernet
keystone_ssh
rabbitmq
memcached
mariadb
cron
kolla_toolbox
fluentd
2025-10-05 07:13:45,743 - INFO - 10.0.0.38
2025-10-05 07:13:45,743 - INFO - config
2025-10-05 07:13:45,747 - INFO - config-nodemgr:active
2025-10-05 07:13:45,751 - INFO - api-server:active
2025-10-05 07:13:45,754 - INFO - schema:active
2025-10-05 07:13:45,757 - INFO - svc-monitor:active
2025-10-05 07:13:45,760 - INFO - device-manager:active
2025-10-05 07:13:45,760 - INFO - config-database
2025-10-05 07:13:45,760 - INFO - config-cassandra:active
2025-10-05 07:13:45,760 - INFO - config-zookeeper:active
2025-10-05 07:13:45,760 - INFO - config-rabbitmq:active
2025-10-05 07:13:45,761 - INFO - vrouter
2025-10-05 07:13:45,764 - INFO - vrouter-nodemgr:active
2025-10-05 07:13:45,768 - INFO - agent:active
2025-10-05 07:13:45,768 - INFO - control
2025-10-05 07:13:45,772 - INFO - control-nodemgr:active
2025-10-05 07:13:45,776 - INFO - control:active
2025-10-05 07:13:45,776 - INFO - named:active
2025-10-05 07:13:45,780 - INFO - dns:active
2025-10-05 07:13:45,780 - INFO - analytics
2025-10-05 07:13:45,783 - INFO - analytics-nodemgr:active
2025-10-05 07:13:45,787 - INFO - analytics-api:active
2025-10-05 07:13:45,792 - INFO - collector:active
2025-10-05 07:13:45,792 - INFO - analytics-database
2025-10-05 07:13:45,792 - INFO - analytics-cassandra:active
2025-10-05 07:13:45,796 - INFO - analyticsdb-nodemgr:active
2025-10-05 07:13:45,800 - INFO - query-engine:active
2025-10-05 07:13:45,800 - INFO - webui
2025-10-05 07:13:45,800 - INFO - webui:active
2025-10-05 07:13:45,800 - INFO - webui-middleware:active
2025-10-05 07:13:45,800 - INFO - redis:active
2025-10-05 07:13:45,800 - INFO - analytics_snmp
2025-10-05 07:13:45,803 - INFO - snmp-collector:active
2025-10-05 07:13:45,803 - INFO - snmp-topology:active
2025-10-05 07:13:45,803 - INFO - analytics_alarm
2025-10-05 07:13:45,803 - INFO - alarmgen:active
2025-10-05 07:13:45,803 - INFO - All the contrail services are up on all nodes
2025-10-05 07:13:45,803 - INFO - contrail-status passed
2025-10-05 07:13:45,919 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:13:45,924 - DEBUG - No XMPP flaps were noticed during the test
2025-10-05 07:13:45,924 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-10-05 07:13:45,924 - INFO - --------------------------------------------------------------------------------
2025-10-05 07:13:47,992 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:13:50,025 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-40042096:ctest-vn22-84104520:ctest-vn22-84104520
2025-10-05 07:13:50,031 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-40042096:ctest-vn22-84104520:ctest-vn22-84104520
2025-10-05 07:13:50,035 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-40042096:ctest-vn22-84104520:ctest-vn22-84104520
2025-10-05 07:14:05,686 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-40042096:ctest-vn22-84104520
2025-10-05 07:14:05,692 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-40042096:ctest-vn22-84104520:ctest-vn22-84104520
2025-10-05 07:14:05,696 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-AnalyticsBasicTestSanity-40042096:ctest-vn22-84104520:ctest-vn22-84104520
2025-10-05 07:14:05,828 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:06,798 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:06,804 - DEBUG - [10.0.0.38]: Running cmd : docker exec --privileged -it config_api_1 /bin/bash -c 'db-manage check'
2025-10-05 07:14:09,689 - DEBUG - Output : 2025-10-05 07:14:09,075 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success
2025-10-05 07:14:09,089 INFO: (v1.41) Checker check_cassandra_keyspace_replication: Success
2025-10-05 07:14:09,161 INFO: (v1.41) Checker check_obj_mandatory_fields: Success
2025-10-05 07:14:09,297 INFO: (v1.41) Checker check_orphan_resources: Success
2025-10-05 07:14:09,447 INFO: (v1.41) Checker check_fq_name_uuid_match: Success
2025-10-05 07:14:09,447 WARNING: Be careful, that check can return false positive errors if stale FQ names and stale resources were not cleaned before. Run at least commands 'clean_obj_missing_mandatory_fields', 'clean_orphan_resources' and 'clean_stale_fq_names' before.
2025-10-05 07:14:09,524 INFO: (v1.41) Checker check_duplicate_fq_name: Success
2025-10-05 07:14:09,534 INFO: (v1.41) Checker check_route_targets_routing_instance_backrefs: Success
2025-10-05 07:14:09,539 INFO: (v1.41) Checker check_subnet_uuid: Success
2025-10-05 07:14:09,547 ERROR: (v1.41) Checker check_subnet_addr_alloc: Failed:
ZK subnet path '/api-server/subnets' does ends with a valid IP network
2025-10-05 07:14:09,568 INFO: (v1.41) Checker check_route_targets_id: Success
2025-10-05 07:14:09,575 INFO: (v1.41) Checker check_virtual_networks_id: Success
2025-10-05 07:14:09,582 INFO: (v1.41) Checker check_security_groups_id: Success
2025-10-05 07:14:09,583 INFO: (v1.41) Checker check_aggregated_ethernet_id: Success
2025-10-05 07:14:09,840 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:10,016 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:10,172 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:10,328 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:10,489 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:12,928 - INFO - admin user already present
2025-10-05 07:14:13,675 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:15,564 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:15,569 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:15,572 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:16,370 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747:ctest-vn1-01725747
2025-10-05 07:14:16,375 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747:ctest-vn1-01725747
2025-10-05 07:14:16,380 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747:ctest-vn1-01725747
2025-10-05 07:14:24,553 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b2153ae2-28a5-4aa5-aa3d-c16afd11709c
2025-10-05 07:14:24,557 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747:ctest-vn1-01725747
2025-10-05 07:14:24,561 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b2153ae2-28a5-4aa5-aa3d-c16afd11709c
2025-10-05 07:14:35,490 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8a0e18d4-1c08-42e1-9b1b-3ca692967925
2025-10-05 07:14:35,495 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:35,498 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8a0e18d4-1c08-42e1-9b1b-3ca692967925
2025-10-05 07:14:37,008 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:b2153ae2-28a5-4aa5-aa3d-c16afd11709c
2025-10-05 07:14:37,013 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746
2025-10-05 07:14:37,017 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:37,021 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_Inet4UcRouteReq?x=3
2025-10-05 07:14:42,506 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747
2025-10-05 07:14:42,510 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747:ctest-vn1-01725747
2025-10-05 07:14:42,513 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-vn1-01725747:ctest-vn1-01725747
2025-10-05 07:14:42,768 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746
2025-10-05 07:14:42,773 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:42,777 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-FloatingipBasicTestSanity-75039705:ctest-fvn-55657746:ctest-fvn-55657746
2025-10-05 07:14:43,043 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:46,034 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:46,399 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:52,419 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:54,359 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:57,402 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:59,339 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:14:59,634 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:15:06,686 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:541435e5-a7bf-4c7d-aae5-87607b3f4f75
2025-10-05 07:15:06,692 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-43813694:ctest-vn1-95137749:ctest-vn1-95137749
2025-10-05 07:15:06,696 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:541435e5-a7bf-4c7d-aae5-87607b3f4f75
2025-10-05 07:15:12,537 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e2978aa9-22e0-499c-a867-004d76f28746
2025-10-05 07:15:12,541 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestPorts-43813694:ctest-vn1-95137749:ctest-vn1-95137749
2025-10-05 07:15:12,545 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e2978aa9-22e0-499c-a867-004d76f28746
2025-10-05 07:15:17,634 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:15:20,643 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:15:30,501 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2f6e03a1-e803-42c6-a8b0-9949dc0f5fc5
2025-10-05 07:15:30,506 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-92230787:ctest-vn1-01840674:ctest-vn1-01840674
2025-10-05 07:15:30,510 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2f6e03a1-e803-42c6-a8b0-9949dc0f5fc5
2025-10-05 07:15:36,356 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1a530976-77af-42ca-bf1f-57c65487e71f
2025-10-05 07:15:36,361 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRouters-92230787:ctest-vn2-87323761:ctest-vn2-87323761
2025-10-05 07:15:36,365 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1a530976-77af-42ca-bf1f-57c65487e71f
2025-10-05 07:15:57,986 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:01,042 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:11,751 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2b733f01-6dbf-4fc2-a03b-0b9bd268a58f
2025-10-05 07:16:11,756 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-34350343:ctest-vn-56284415:ctest-vn-56284415
2025-10-05 07:16:11,760 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2b733f01-6dbf-4fc2-a03b-0b9bd268a58f
2025-10-05 07:16:17,589 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cfd6e449-e6e1-48d1-92a1-920fd5a936af
2025-10-05 07:16:17,594 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRoutersBasic-34350343:ctest-ext_vn-06143406:ctest-ext_vn-06143406
2025-10-05 07:16:17,598 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cfd6e449-e6e1-48d1-92a1-920fd5a936af
2025-10-05 07:16:25,610 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:28,619 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:31,961 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-63049807:ctest-vn-63049807
2025-10-05 07:16:31,965 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-63049807:ctest-vn-63049807
2025-10-05 07:16:31,969 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-63049807:ctest-vn-63049807
2025-10-05 07:16:32,223 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-97425339:ctest-vn-97425339
2025-10-05 07:16:32,227 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-97425339:ctest-vn-97425339
2025-10-05 07:16:32,230 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-97425339:ctest-vn-97425339
2025-10-05 07:16:32,761 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-97425339
2025-10-05 07:16:32,766 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-97425339:ctest-vn-97425339
2025-10-05 07:16:32,770 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-97425339:ctest-vn-97425339
2025-10-05 07:16:33,003 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-63049807
2025-10-05 07:16:33,007 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-63049807:ctest-vn-63049807
2025-10-05 07:16:33,011 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-54016112:ctest-vn-63049807:ctest-vn-63049807
2025-10-05 07:16:33,274 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:36,175 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:36,466 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:38,944 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72877410:ctest-vn4-75238536:ctest-vn4-75238536
2025-10-05 07:16:38,948 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72877410:ctest-vn4-75238536:ctest-vn4-75238536
2025-10-05 07:16:38,952 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72877410:ctest-vn4-75238536:ctest-vn4-75238536
2025-10-05 07:16:39,272 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72877410:ctest-vn4-75238536
2025-10-05 07:16:39,276 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72877410:ctest-vn4-75238536:ctest-vn4-75238536
2025-10-05 07:16:39,280 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicyNegativeIpv4v6-72877410:ctest-vn4-75238536:ctest-vn4-75238536
2025-10-05 07:16:39,714 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:39,998 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:42,963 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:16:45,916 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928:ctest-vn-01997928
2025-10-05 07:16:45,920 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928:ctest-vn-01997928
2025-10-05 07:16:45,924 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928:ctest-vn-01997928
2025-10-05 07:16:46,173 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251:ctest-vn-11299251
2025-10-05 07:16:46,177 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251:ctest-vn-11299251
2025-10-05 07:16:46,181 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251:ctest-vn-11299251
2025-10-05 07:16:53,545 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0894734f-8e22-4660-a07b-344952b2f9de
2025-10-05 07:16:53,550 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928:ctest-vn-01997928
2025-10-05 07:16:53,554 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0894734f-8e22-4660-a07b-344952b2f9de
2025-10-05 07:16:59,413 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c5356bb6-e422-41b2-b443-f3ddc31461d4
2025-10-05 07:16:59,418 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251:ctest-vn-11299251
2025-10-05 07:16:59,422 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c5356bb6-e422-41b2-b443-f3ddc31461d4
2025-10-05 07:17:11,024 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251
2025-10-05 07:17:11,028 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251:ctest-vn-11299251
2025-10-05 07:17:11,032 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-11299251:ctest-vn-11299251
2025-10-05 07:17:11,270 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928
2025-10-05 07:17:11,274 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928:ctest-vn-01997928
2025-10-05 07:17:11,277 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicPolicy-67470871:ctest-vn-01997928:ctest-vn-01997928
2025-10-05 07:17:11,539 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:17:14,574 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:17:24,126 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0779cd96-c97a-482b-ae64-c4bed5906614
2025-10-05 07:17:24,131 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-15335263:ctest-bgpaas_vn-38896026:ctest-bgpaas_vn-38896026
2025-10-05 07:17:24,135 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0779cd96-c97a-482b-ae64-c4bed5906614
2025-10-05 07:17:29,979 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:537ade81-4270-4aa2-be99-a0825e23e6f3
2025-10-05 07:17:29,983 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestRP-15335263:ctest-bgpaas_vn-00957261:ctest-bgpaas_vn-00957261
2025-10-05 07:17:29,987 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:537ade81-4270-4aa2-be99-a0825e23e6f3
2025-10-05 07:17:31,639 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:17:37,895 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:17:40,783 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:17:42,552 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-mgmt_vn-05005252:ctest-mgmt_vn-05005252
2025-10-05 07:17:42,556 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-mgmt_vn-05005252:ctest-mgmt_vn-05005252
2025-10-05 07:17:42,560 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-mgmt_vn-05005252:ctest-mgmt_vn-05005252
2025-10-05 07:17:43,323 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-left_vn-80388251:ctest-left_vn-80388251
2025-10-05 07:17:43,328 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-left_vn-80388251:ctest-left_vn-80388251
2025-10-05 07:17:43,333 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-left_vn-80388251:ctest-left_vn-80388251
2025-10-05 07:17:44,071 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-right_vn-63473737:ctest-right_vn-63473737
2025-10-05 07:17:44,076 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-right_vn-63473737:ctest-right_vn-63473737
2025-10-05 07:17:44,079 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-right_vn-63473737:ctest-right_vn-63473737
2025-10-05 07:17:49,125 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-right_vn-63473737
2025-10-05 07:17:49,130 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-right_vn-63473737:ctest-right_vn-63473737
2025-10-05 07:17:49,134 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-right_vn-63473737:ctest-right_vn-63473737
2025-10-05 07:17:49,363 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-left_vn-80388251
2025-10-05 07:17:49,367 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-left_vn-80388251:ctest-left_vn-80388251
2025-10-05 07:17:49,371 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-left_vn-80388251:ctest-left_vn-80388251
2025-10-05 07:17:49,605 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-mgmt_vn-05005252
2025-10-05 07:17:49,610 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-mgmt_vn-05005252:ctest-mgmt_vn-05005252
2025-10-05 07:17:49,614 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestSvcRegr-62321052:ctest-mgmt_vn-05005252:ctest-mgmt_vn-05005252
2025-10-05 07:17:49,879 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:17:52,970 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:01,967 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:05,029 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:09,047 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:12,607 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:15,251 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:15,538 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:17,915 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:18,202 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:18:22,231 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-86628973:ctest-vn-75856298:ctest-vn-75856298
2025-10-05 07:18:22,236 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-86628973:ctest-vn-75856298:ctest-vn-75856298
2025-10-05 07:18:22,240 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-86628973:ctest-vn-75856298:ctest-vn-75856298
2025-10-05 07:18:22,906 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VnListReq?name=default-domain:ctest-TestBasicVMVN-86628973:ctest-vn-75856298
2025-10-05 07:18:22,910 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-86628973:ctest-vn-75856298:ctest-vn-75856298
2025-10-05 07:18:22,914 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_VrfListReq?name=default-domain:ctest-TestBasicVMVN-86628973:ctest-vn-75856298:ctest-vn-75856298
2025-10-05 07:18:23,255 - DEBUG - Requesting: http://10.0.0.38:8085/Snh_AgentXmppConnectionStatusReq?
2025-10-05 07:20:10,226 - INFO - Using existing project ['default-domain', 'admin'](38a77cd6-02be-4176-8df1-90918103d1a5)
2025-10-05 07:20:10,234 - INFO - ================================================================================
2025-10-05 07:20:10,234 - INFO - STARTING TEST : test_contrail_status
2025-10-05 07:20:10,234 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active
2025-10-05 07:20:10,351 - DEBUG - Skipping xmpp flap check
2025-10-05 07:20:10,352 - INFO - Initial checks done. Running the testcase now
2025-10-05 07:20:10,352 - INFO -
2025-10-05 07:20:10,444 - INFO - 10.0.0.38
2025-10-05 07:20:10,444 - INFO - config
2025-10-05 07:20:10,449 - INFO - config-nodemgr:active
2025-10-05 07:20:10,453 - INFO - api-server:active
2025-10-05 07:20:10,456 - INFO - schema:active
2025-10-05 07:20:10,461 - INFO - svc-monitor:active
2025-10-05 07:20:10,466 - INFO - device-manager:active
2025-10-05 07:20:10,466 - INFO - config-database
2025-10-05 07:20:10,466 - INFO - config-cassandra:active
2025-10-05 07:20:10,466 - INFO - config-zookeeper:active
2025-10-05 07:20:10,466 - INFO - config-rabbitmq:active
2025-10-05 07:20:10,466 - INFO - vrouter
2025-10-05 07:20:10,471 - INFO - vrouter-nodemgr:active
2025-10-05 07:20:10,476 - INFO - agent:active
2025-10-05 07:20:10,476 - INFO - control
2025-10-05 07:20:10,481 - INFO - control-nodemgr:active
2025-10-05 07:20:10,485 - INFO - control:active
2025-10-05 07:20:10,485 - INFO - named:active
2025-10-05 07:20:10,489 - INFO - dns:active
2025-10-05 07:20:10,490 - INFO - analytics
2025-10-05 07:20:10,494 - INFO - analytics-nodemgr:active
2025-10-05 07:20:10,497 - INFO - analytics-api:active
2025-10-05 07:20:10,500 - INFO - collector:active
2025-10-05 07:20:10,501 - INFO - analytics-database
2025-10-05 07:20:10,501 - INFO - analytics-cassandra:active
2025-10-05 07:20:10,504 - INFO - analyticsdb-nodemgr:active
2025-10-05 07:20:10,508 - INFO - query-engine:active
2025-10-05 07:20:10,508 - INFO - webui
2025-10-05 07:20:10,508 - INFO - webui:active
2025-10-05 07:20:10,508 - INFO - webui-middleware:active
2025-10-05 07:20:10,508 - INFO - redis:active
2025-10-05 07:20:10,508 - INFO - analytics_snmp
2025-10-05 07:20:10,511 - INFO - snmp-collector:active
2025-10-05 07:20:10,511 - INFO - snmp-topology:active
2025-10-05 07:20:10,511 - INFO - analytics_alarm
2025-10-05 07:20:10,511 - INFO - alarmgen:active
2025-10-05 07:20:10,512 - INFO - All the contrail services are up on all nodes
2025-10-05 07:20:10,512 - INFO - contrail-status passed
2025-10-05 07:20:10,628 - DEBUG - Skipping xmpp flap check
2025-10-05 07:20:10,628 - INFO - END TEST : test_contrail_status : PASSED[0:00:00]
2025-10-05 07:20:10,629 - INFO - --------------------------------------------------------------------------------