2025-10-30 02:19:55,770 - INFO - Using existing project ['default-domain', 'admin'](4f8b91c9-4f47-4fe0-ac3e-4769319c554e)
2025-10-30 02:19:55,779 - INFO - ================================================================================
2025-10-30 02:19:55,779 - INFO - STARTING TEST    : test_contrail_status
2025-10-30 02:19:55,779 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active
        
2025-10-30 02:19:56,416 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.131': '0', '10.20.0.254': '0'}, '10.0.0.65': {'10.20.0.254': '0', '10.20.0.131': '0'}} with
2025-10-30 02:19:56,416 - INFO - Initial checks done. Running the testcase now
2025-10-30 02:19:56,417 - INFO - 
2025-10-30 02:19:56,489 - INFO - 10.0.0.242
2025-10-30 02:19:56,490 - INFO -   config
2025-10-30 02:19:56,496 - INFO -     config-nodemgr:active
2025-10-30 02:19:56,500 - INFO -     api-server:active
2025-10-30 02:19:56,503 - INFO -     schema:backup
2025-10-30 02:19:56,506 - INFO -     svc-monitor:backup
2025-10-30 02:19:56,509 - INFO -     device-manager:backup
2025-10-30 02:19:56,509 - INFO -   config-database
2025-10-30 02:19:56,509 - INFO -     config-cassandra:active
2025-10-30 02:19:56,509 - INFO -     config-zookeeper:active
2025-10-30 02:19:56,509 - INFO -     config-rabbitmq:active
2025-10-30 02:19:56,509 - INFO -   control
2025-10-30 02:19:56,513 - INFO -     control-nodemgr:active
2025-10-30 02:19:56,518 - INFO -     control:active
2025-10-30 02:19:56,518 - INFO -     named:active
2025-10-30 02:19:56,523 - INFO -     dns:active
2025-10-30 02:19:56,523 - INFO -   analytics
2025-10-30 02:19:56,528 - INFO -     analytics-nodemgr:active
2025-10-30 02:19:56,532 - INFO -     analytics-api:active
2025-10-30 02:19:56,537 - INFO -     collector:active
2025-10-30 02:19:56,537 - INFO -   analytics-database
2025-10-30 02:19:56,537 - INFO -     analytics-cassandra:active
2025-10-30 02:19:56,542 - INFO -     analyticsdb-nodemgr:active
2025-10-30 02:19:56,548 - INFO -     query-engine:active
2025-10-30 02:19:56,548 - INFO -   webui
2025-10-30 02:19:56,548 - INFO -     webui:active
2025-10-30 02:19:56,548 - INFO -     webui-middleware:active
2025-10-30 02:19:56,548 - INFO -     redis:active
2025-10-30 02:19:56,548 - INFO -   analytics_snmp
2025-10-30 02:19:56,552 - INFO -     snmp-collector:active
2025-10-30 02:19:56,552 - INFO -     snmp-topology:active
2025-10-30 02:19:56,552 - INFO -   analytics_alarm
2025-10-30 02:19:56,553 - INFO -     alarmgen:active
2025-10-30 02:19:56,609 - INFO - 10.0.0.254
2025-10-30 02:19:56,609 - INFO -   config
2025-10-30 02:19:56,616 - INFO -     config-nodemgr:active
2025-10-30 02:19:56,620 - INFO -     api-server:active
2025-10-30 02:19:56,624 - INFO -     schema:active
2025-10-30 02:19:56,628 - INFO -     svc-monitor:active
2025-10-30 02:19:56,632 - INFO -     device-manager:active
2025-10-30 02:19:56,632 - INFO -   config-database
2025-10-30 02:19:56,632 - INFO -     config-cassandra:active
2025-10-30 02:19:56,632 - INFO -     config-zookeeper:active
2025-10-30 02:19:56,632 - INFO -     config-rabbitmq:active
2025-10-30 02:19:56,632 - INFO -   control
2025-10-30 02:19:56,639 - INFO -     control-nodemgr:active
2025-10-30 02:19:56,644 - INFO -     control:active
2025-10-30 02:19:56,644 - INFO -     named:active
2025-10-30 02:19:56,649 - INFO -     dns:active
2025-10-30 02:19:56,649 - INFO -   analytics
2025-10-30 02:19:56,654 - INFO -     analytics-nodemgr:active
2025-10-30 02:19:56,660 - INFO -     analytics-api:active
2025-10-30 02:19:56,664 - INFO -     collector:active
2025-10-30 02:19:56,665 - INFO -   analytics-database
2025-10-30 02:19:56,665 - INFO -     analytics-cassandra:active
2025-10-30 02:19:56,669 - INFO -     analyticsdb-nodemgr:active
2025-10-30 02:19:56,673 - INFO -     query-engine:active
2025-10-30 02:19:56,673 - INFO -   webui
2025-10-30 02:19:56,673 - INFO -     webui:active
2025-10-30 02:19:56,673 - INFO -     webui-middleware:active
2025-10-30 02:19:56,673 - INFO -     redis:active
2025-10-30 02:19:56,673 - INFO -   analytics_snmp
2025-10-30 02:19:56,677 - INFO -     snmp-collector:active
2025-10-30 02:19:56,677 - INFO -     snmp-topology:active
2025-10-30 02:19:56,677 - INFO -   analytics_alarm
2025-10-30 02:19:56,677 - INFO -     alarmgen:active
2025-10-30 02:19:56,734 - INFO - 10.0.0.240
2025-10-30 02:19:56,734 - INFO -   config
2025-10-30 02:19:56,740 - INFO -     config-nodemgr:active
2025-10-30 02:19:56,744 - INFO -     api-server:active
2025-10-30 02:19:56,747 - INFO -     schema:backup
2025-10-30 02:19:56,750 - INFO -     svc-monitor:backup
2025-10-30 02:19:56,753 - INFO -     device-manager:backup
2025-10-30 02:19:56,753 - INFO -   config-database
2025-10-30 02:19:56,753 - INFO -     config-cassandra:active
2025-10-30 02:19:56,753 - INFO -     config-zookeeper:active
2025-10-30 02:19:56,753 - INFO -     config-rabbitmq:active
2025-10-30 02:19:56,753 - INFO -   control
2025-10-30 02:19:56,758 - INFO -     control-nodemgr:active
2025-10-30 02:19:56,763 - INFO -     control:active
2025-10-30 02:19:56,763 - INFO -     named:active
2025-10-30 02:19:56,768 - INFO -     dns:active
2025-10-30 02:19:56,768 - INFO -   analytics
2025-10-30 02:19:56,773 - INFO -     analytics-nodemgr:active
2025-10-30 02:19:56,777 - INFO -     analytics-api:active
2025-10-30 02:19:56,781 - INFO -     collector:active
2025-10-30 02:19:56,781 - INFO -   analytics-database
2025-10-30 02:19:56,781 - INFO -     analytics-cassandra:active
2025-10-30 02:19:56,786 - INFO -     analyticsdb-nodemgr:active
2025-10-30 02:19:56,790 - INFO -     query-engine:active
2025-10-30 02:19:56,790 - INFO -   webui
2025-10-30 02:19:56,790 - INFO -     webui:active
2025-10-30 02:19:56,790 - INFO -     webui-middleware:active
2025-10-30 02:19:56,790 - INFO -     redis:active
2025-10-30 02:19:56,790 - INFO -   analytics_snmp
2025-10-30 02:19:56,795 - INFO -     snmp-collector:active
2025-10-30 02:19:56,795 - INFO -     snmp-topology:active
2025-10-30 02:19:56,795 - INFO -   analytics_alarm
2025-10-30 02:19:56,795 - INFO -     alarmgen:active
2025-10-30 02:19:56,851 - INFO - 10.0.0.129
2025-10-30 02:19:56,851 - INFO -   vrouter
2025-10-30 02:19:56,857 - INFO -     vrouter-nodemgr:active
2025-10-30 02:19:56,861 - INFO -     agent:active
2025-10-30 02:19:56,921 - INFO - 10.0.0.65
2025-10-30 02:19:56,921 - INFO -   vrouter
2025-10-30 02:19:56,928 - INFO -     vrouter-nodemgr:active
2025-10-30 02:19:56,934 - INFO -     agent:active
2025-10-30 02:19:56,935 - INFO - All the contrail services are up on all nodes
2025-10-30 02:19:56,935 - INFO - contrail-status passed
2025-10-30 02:19:57,570 - DEBUG - No XMPP flaps were noticed during the test
2025-10-30 02:19:57,571 - INFO - END TEST : test_contrail_status : PASSED[0:00:02]
2025-10-30 02:19:57,571 - INFO - --------------------------------------------------------------------------------
2025-10-30 04:14:12,387 - INFO - Using existing project ['default-domain', 'admin'](4f8b91c9-4f47-4fe0-ac3e-4769319c554e)
2025-10-30 04:14:12,398 - INFO - ================================================================================
2025-10-30 04:14:12,398 - INFO - STARTING TEST    : test_contrail_status
2025-10-30 04:14:12,398 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active
        
2025-10-30 04:14:13,673 - DEBUG - Skipping xmpp flap check
2025-10-30 04:14:13,673 - INFO - Initial checks done. Running the testcase now
2025-10-30 04:14:13,673 - INFO - 
2025-10-30 04:14:13,885 - INFO - 10.0.0.242
2025-10-30 04:14:13,886 - INFO -   config
2025-10-30 04:14:13,894 - INFO -     config-nodemgr:active
2025-10-30 04:14:13,900 - INFO -     api-server:active
2025-10-30 04:14:13,905 - INFO -     schema:backup
2025-10-30 04:14:13,909 - INFO -     svc-monitor:backup
2025-10-30 04:14:13,912 - INFO -     device-manager:backup
2025-10-30 04:14:13,912 - INFO -   config-database
2025-10-30 04:14:13,912 - INFO -     config-cassandra:active
2025-10-30 04:14:13,913 - INFO -     config-zookeeper:active
2025-10-30 04:14:13,913 - INFO -     config-rabbitmq:active
2025-10-30 04:14:13,913 - INFO -   control
2025-10-30 04:14:13,920 - INFO -     control-nodemgr:active
2025-10-30 04:14:13,926 - INFO -     control:active
2025-10-30 04:14:13,926 - INFO -     named:active
2025-10-30 04:14:13,939 - INFO -     dns:active
2025-10-30 04:14:13,939 - INFO -   analytics
2025-10-30 04:14:13,944 - INFO -     analytics-nodemgr:active
2025-10-30 04:14:13,949 - INFO -     analytics-api:active
2025-10-30 04:14:13,969 - INFO -     collector:active
2025-10-30 04:14:13,969 - INFO -   analytics-database
2025-10-30 04:14:13,969 - INFO -     analytics-cassandra:active
2025-10-30 04:14:13,974 - INFO -     analyticsdb-nodemgr:active
2025-10-30 04:14:13,993 - INFO -     query-engine:active
2025-10-30 04:14:13,993 - INFO -   webui
2025-10-30 04:14:13,993 - INFO -     webui:active
2025-10-30 04:14:13,993 - INFO -     webui-middleware:active
2025-10-30 04:14:13,993 - INFO -     redis:active
2025-10-30 04:14:13,994 - INFO -   analytics_snmp
2025-10-30 04:14:14,000 - INFO -     snmp-collector:active
2025-10-30 04:14:14,000 - INFO -     snmp-topology:active
2025-10-30 04:14:14,000 - INFO -   analytics_alarm
2025-10-30 04:14:14,000 - INFO -     alarmgen:active
2025-10-30 04:14:14,091 - INFO - 10.0.0.254
2025-10-30 04:14:14,091 - INFO -   config
2025-10-30 04:14:14,097 - INFO -     config-nodemgr:active
2025-10-30 04:14:14,102 - INFO -     api-server:active
2025-10-30 04:14:14,107 - INFO -     schema:active
2025-10-30 04:14:14,112 - INFO -     svc-monitor:active
2025-10-30 04:14:14,116 - INFO -     device-manager:active
2025-10-30 04:14:14,116 - INFO -   config-database
2025-10-30 04:14:14,116 - INFO -     config-cassandra:active
2025-10-30 04:14:14,116 - INFO -     config-zookeeper:active
2025-10-30 04:14:14,116 - INFO -     config-rabbitmq:active
2025-10-30 04:14:14,116 - INFO -   control
2025-10-30 04:14:14,121 - INFO -     control-nodemgr:active
2025-10-30 04:14:14,125 - INFO -     control:active
2025-10-30 04:14:14,126 - INFO -     named:active
2025-10-30 04:14:14,130 - INFO -     dns:active
2025-10-30 04:14:14,130 - INFO -   analytics
2025-10-30 04:14:14,135 - INFO -     analytics-nodemgr:active
2025-10-30 04:14:14,139 - INFO -     analytics-api:active
2025-10-30 04:14:14,144 - INFO -     collector:active
2025-10-30 04:14:14,144 - INFO -   analytics-database
2025-10-30 04:14:14,144 - INFO -     analytics-cassandra:active
2025-10-30 04:14:14,148 - INFO -     analyticsdb-nodemgr:active
2025-10-30 04:14:14,153 - INFO -     query-engine:active
2025-10-30 04:14:14,153 - INFO -   webui
2025-10-30 04:14:14,153 - INFO -     webui:active
2025-10-30 04:14:14,154 - INFO -     webui-middleware:active
2025-10-30 04:14:14,154 - INFO -     redis:active
2025-10-30 04:14:14,154 - INFO -   analytics_snmp
2025-10-30 04:14:14,159 - INFO -     snmp-collector:active
2025-10-30 04:14:14,159 - INFO -     snmp-topology:active
2025-10-30 04:14:14,159 - INFO -   analytics_alarm
2025-10-30 04:14:14,159 - INFO -     alarmgen:active
2025-10-30 04:14:14,267 - INFO - 10.0.0.240
2025-10-30 04:14:14,267 - INFO -   config
2025-10-30 04:14:14,273 - INFO -     config-nodemgr:active
2025-10-30 04:14:14,278 - INFO -     api-server:active
2025-10-30 04:14:14,282 - INFO -     schema:backup
2025-10-30 04:14:14,286 - INFO -     svc-monitor:backup
2025-10-30 04:14:14,290 - INFO -     device-manager:backup
2025-10-30 04:14:14,290 - INFO -   config-database
2025-10-30 04:14:14,290 - INFO -     config-cassandra:active
2025-10-30 04:14:14,290 - INFO -     config-zookeeper:active
2025-10-30 04:14:14,290 - INFO -     config-rabbitmq:active
2025-10-30 04:14:14,290 - INFO -   control
2025-10-30 04:14:14,295 - INFO -     control-nodemgr:active
2025-10-30 04:14:14,302 - INFO -     control:active
2025-10-30 04:14:14,302 - INFO -     named:active
2025-10-30 04:14:14,310 - INFO -     dns:active
2025-10-30 04:14:14,310 - INFO -   analytics
2025-10-30 04:14:14,316 - INFO -     analytics-nodemgr:active
2025-10-30 04:14:14,322 - INFO -     analytics-api:active
2025-10-30 04:14:14,330 - INFO -     collector:active
2025-10-30 04:14:14,331 - INFO -   analytics-database
2025-10-30 04:14:14,331 - INFO -     analytics-cassandra:active
2025-10-30 04:14:14,338 - INFO -     analyticsdb-nodemgr:active
2025-10-30 04:14:14,345 - INFO -     query-engine:active
2025-10-30 04:14:14,345 - INFO -   webui
2025-10-30 04:14:14,346 - INFO -     webui:active
2025-10-30 04:14:14,346 - INFO -     webui-middleware:active
2025-10-30 04:14:14,346 - INFO -     redis:active
2025-10-30 04:14:14,346 - INFO -   analytics_snmp
2025-10-30 04:14:14,351 - INFO -     snmp-collector:active
2025-10-30 04:14:14,351 - INFO -     snmp-topology:active
2025-10-30 04:14:14,351 - INFO -   analytics_alarm
2025-10-30 04:14:14,351 - INFO -     alarmgen:active
2025-10-30 04:14:14,441 - INFO - 10.0.0.129
2025-10-30 04:14:14,441 - INFO -   vrouter
2025-10-30 04:14:14,447 - INFO -     vrouter-nodemgr:active
2025-10-30 04:14:14,453 - INFO -     agent:active
2025-10-30 04:14:14,540 - INFO - 10.0.0.65
2025-10-30 04:14:14,540 - INFO -   vrouter
2025-10-30 04:14:14,545 - INFO -     vrouter-nodemgr:active
2025-10-30 04:14:14,551 - INFO -     agent:active
2025-10-30 04:14:14,551 - INFO - All the contrail services are up on all nodes
2025-10-30 04:14:14,551 - INFO - contrail-status passed
2025-10-30 04:14:15,842 - DEBUG - Skipping xmpp flap check
2025-10-30 04:14:15,842 - INFO - END TEST : test_contrail_status : PASSED[0:00:03]
2025-10-30 04:14:15,842 - INFO - --------------------------------------------------------------------------------