2025-10-13 02:05:46,710 - INFO - Using existing project ['default-domain', 'admin'](46f40d4e-ed17-4d16-8bf0-099186d25886)
2025-10-13 02:05:46,720 - INFO - ================================================================================
2025-10-13 02:05:46,720 - INFO - STARTING TEST    : test_contrail_status
2025-10-13 02:05:46,721 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active
        
2025-10-13 02:05:47,367 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.27': {'10.20.0.18': '0', '10.20.0.129': '0'}} with
2025-10-13 02:05:47,367 - INFO - Initial checks done. Running the testcase now
2025-10-13 02:05:47,367 - INFO - 
2025-10-13 02:05:47,435 - INFO - 10.0.0.22
2025-10-13 02:05:47,436 - INFO -   config
2025-10-13 02:05:47,441 - INFO -     config-nodemgr:active
2025-10-13 02:05:47,445 - INFO -     api-server:active
2025-10-13 02:05:47,448 - INFO -     schema:backup
2025-10-13 02:05:47,450 - INFO -     svc-monitor:backup
2025-10-13 02:05:47,453 - INFO -     device-manager:backup
2025-10-13 02:05:47,453 - INFO -   config-database
2025-10-13 02:05:47,453 - INFO -     config-cassandra:active
2025-10-13 02:05:47,453 - INFO -     config-zookeeper:active
2025-10-13 02:05:47,453 - INFO -     config-rabbitmq:active
2025-10-13 02:05:47,453 - INFO -   control
2025-10-13 02:05:47,457 - INFO -     control-nodemgr:active
2025-10-13 02:05:47,461 - INFO -     control:active
2025-10-13 02:05:47,461 - INFO -     named:active
2025-10-13 02:05:47,465 - INFO -     dns:active
2025-10-13 02:05:47,465 - INFO -   analytics
2025-10-13 02:05:47,469 - INFO -     analytics-nodemgr:active
2025-10-13 02:05:47,473 - INFO -     analytics-api:active
2025-10-13 02:05:47,477 - INFO -     collector:active
2025-10-13 02:05:47,477 - INFO -   analytics-database
2025-10-13 02:05:47,477 - INFO -     analytics-cassandra:active
2025-10-13 02:05:47,482 - INFO -     analyticsdb-nodemgr:active
2025-10-13 02:05:47,486 - INFO -     query-engine:active
2025-10-13 02:05:47,486 - INFO -   webui
2025-10-13 02:05:47,486 - INFO -     webui:active
2025-10-13 02:05:47,486 - INFO -     webui-middleware:active
2025-10-13 02:05:47,486 - INFO -     redis:active
2025-10-13 02:05:47,487 - INFO -   analytics_snmp
2025-10-13 02:05:47,490 - INFO -     snmp-collector:active
2025-10-13 02:05:47,490 - INFO -     snmp-topology:active
2025-10-13 02:05:47,490 - INFO -   analytics_alarm
2025-10-13 02:05:47,490 - INFO -     alarmgen:active
2025-10-13 02:05:47,547 - INFO - 10.0.0.19
2025-10-13 02:05:47,547 - INFO -   config
2025-10-13 02:05:47,552 - INFO -     config-nodemgr:active
2025-10-13 02:05:47,556 - INFO -     api-server:active
2025-10-13 02:05:47,559 - INFO -     schema:backup
2025-10-13 02:05:47,563 - INFO -     svc-monitor:active
2025-10-13 02:05:47,566 - INFO -     device-manager:backup
2025-10-13 02:05:47,566 - INFO -   config-database
2025-10-13 02:05:47,566 - INFO -     config-cassandra:active
2025-10-13 02:05:47,566 - INFO -     config-zookeeper:active
2025-10-13 02:05:47,566 - INFO -     config-rabbitmq:active
2025-10-13 02:05:47,566 - INFO -   control
2025-10-13 02:05:47,570 - INFO -     control-nodemgr:active
2025-10-13 02:05:47,575 - INFO -     control:active
2025-10-13 02:05:47,575 - INFO -     named:active
2025-10-13 02:05:47,579 - INFO -     dns:active
2025-10-13 02:05:47,579 - INFO -   analytics
2025-10-13 02:05:47,583 - INFO -     analytics-nodemgr:active
2025-10-13 02:05:47,587 - INFO -     analytics-api:active
2025-10-13 02:05:47,591 - INFO -     collector:active
2025-10-13 02:05:47,591 - INFO -   analytics-database
2025-10-13 02:05:47,591 - INFO -     analytics-cassandra:active
2025-10-13 02:05:47,595 - INFO -     analyticsdb-nodemgr:active
2025-10-13 02:05:47,599 - INFO -     query-engine:active
2025-10-13 02:05:47,600 - INFO -   webui
2025-10-13 02:05:47,600 - INFO -     webui:active
2025-10-13 02:05:47,600 - INFO -     webui-middleware:active
2025-10-13 02:05:47,600 - INFO -     redis:active
2025-10-13 02:05:47,600 - INFO -   analytics_snmp
2025-10-13 02:05:47,603 - INFO -     snmp-collector:active
2025-10-13 02:05:47,603 - INFO -     snmp-topology:active
2025-10-13 02:05:47,603 - INFO -   analytics_alarm
2025-10-13 02:05:47,603 - INFO -     alarmgen:active
2025-10-13 02:05:47,648 - INFO - 10.0.0.41
2025-10-13 02:05:47,648 - INFO -   config
2025-10-13 02:05:47,654 - INFO -     config-nodemgr:active
2025-10-13 02:05:47,659 - INFO -     api-server:active
2025-10-13 02:05:47,664 - INFO -     schema:active
2025-10-13 02:05:47,668 - INFO -     svc-monitor:backup
2025-10-13 02:05:47,672 - INFO -     device-manager:active
2025-10-13 02:05:47,673 - INFO -   config-database
2025-10-13 02:05:47,673 - INFO -     config-cassandra:active
2025-10-13 02:05:47,673 - INFO -     config-zookeeper:active
2025-10-13 02:05:47,673 - INFO -     config-rabbitmq:active
2025-10-13 02:05:47,673 - INFO -   control
2025-10-13 02:05:47,678 - INFO -     control-nodemgr:active
2025-10-13 02:05:47,684 - INFO -     control:active
2025-10-13 02:05:47,684 - INFO -     named:active
2025-10-13 02:05:47,689 - INFO -     dns:active
2025-10-13 02:05:47,689 - INFO -   analytics
2025-10-13 02:05:47,694 - INFO -     analytics-nodemgr:active
2025-10-13 02:05:47,699 - INFO -     analytics-api:active
2025-10-13 02:05:47,704 - INFO -     collector:active
2025-10-13 02:05:47,704 - INFO -   analytics-database
2025-10-13 02:05:47,704 - INFO -     analytics-cassandra:active
2025-10-13 02:05:47,709 - INFO -     analyticsdb-nodemgr:active
2025-10-13 02:05:47,714 - INFO -     query-engine:active
2025-10-13 02:05:47,714 - INFO -   webui
2025-10-13 02:05:47,715 - INFO -     webui:active
2025-10-13 02:05:47,715 - INFO -     webui-middleware:active
2025-10-13 02:05:47,715 - INFO -     redis:active
2025-10-13 02:05:47,715 - INFO -   analytics_snmp
2025-10-13 02:05:47,719 - INFO -     snmp-collector:active
2025-10-13 02:05:47,719 - INFO -     snmp-topology:active
2025-10-13 02:05:47,719 - INFO -   analytics_alarm
2025-10-13 02:05:47,719 - INFO -     alarmgen:active
2025-10-13 02:05:47,764 - INFO - 10.0.0.249
2025-10-13 02:05:47,764 - INFO -   vrouter
2025-10-13 02:05:47,768 - INFO -     vrouter-nodemgr:active
2025-10-13 02:05:47,773 - INFO -     agent:active
2025-10-13 02:05:47,817 - INFO - 10.0.0.27
2025-10-13 02:05:47,817 - INFO -   vrouter
2025-10-13 02:05:47,823 - INFO -     vrouter-nodemgr:active
2025-10-13 02:05:47,828 - INFO -     agent:active
2025-10-13 02:05:47,828 - INFO - All the contrail services are up on all nodes
2025-10-13 02:05:47,828 - INFO - contrail-status passed
2025-10-13 02:05:48,440 - DEBUG - No XMPP flaps were noticed during the test
2025-10-13 02:05:48,440 - INFO - END TEST : test_contrail_status : PASSED[0:00:02]
2025-10-13 02:05:48,440 - INFO - --------------------------------------------------------------------------------
2025-10-13 04:03:50,144 - INFO - Using existing project ['default-domain', 'admin'](46f40d4e-ed17-4d16-8bf0-099186d25886)
2025-10-13 04:03:50,153 - INFO - ================================================================================
2025-10-13 04:03:50,153 - INFO - STARTING TEST    : test_contrail_status
2025-10-13 04:03:50,153 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active
        
2025-10-13 04:03:51,409 - DEBUG - Skipping xmpp flap check
2025-10-13 04:03:51,409 - INFO - Initial checks done. Running the testcase now
2025-10-13 04:03:51,409 - INFO - 
2025-10-13 04:03:51,518 - INFO - 10.0.0.22
2025-10-13 04:03:51,518 - INFO -   config
2025-10-13 04:03:51,524 - INFO -     config-nodemgr:active
2025-10-13 04:03:51,528 - INFO -     api-server:active
2025-10-13 04:03:51,531 - INFO -     schema:backup
2025-10-13 04:03:51,534 - INFO -     svc-monitor:backup
2025-10-13 04:03:51,536 - INFO -     device-manager:backup
2025-10-13 04:03:51,536 - INFO -   config-database
2025-10-13 04:03:51,537 - INFO -     config-cassandra:active
2025-10-13 04:03:51,537 - INFO -     config-zookeeper:active
2025-10-13 04:03:51,537 - INFO -     config-rabbitmq:active
2025-10-13 04:03:51,537 - INFO -   control
2025-10-13 04:03:51,541 - INFO -     control-nodemgr:active
2025-10-13 04:03:51,546 - INFO -     control:active
2025-10-13 04:03:51,546 - INFO -     named:active
2025-10-13 04:03:51,556 - INFO -     dns:active
2025-10-13 04:03:51,556 - INFO -   analytics
2025-10-13 04:03:51,560 - INFO -     analytics-nodemgr:active
2025-10-13 04:03:51,564 - INFO -     analytics-api:active
2025-10-13 04:03:51,576 - INFO -     collector:active
2025-10-13 04:03:51,576 - INFO -   analytics-database
2025-10-13 04:03:51,576 - INFO -     analytics-cassandra:active
2025-10-13 04:03:51,580 - INFO -     analyticsdb-nodemgr:active
2025-10-13 04:03:51,604 - INFO -     query-engine:active
2025-10-13 04:03:51,605 - INFO -   webui
2025-10-13 04:03:51,605 - INFO -     webui:active
2025-10-13 04:03:51,605 - INFO -     webui-middleware:active
2025-10-13 04:03:51,605 - INFO -     redis:active
2025-10-13 04:03:51,605 - INFO -   analytics_snmp
2025-10-13 04:03:51,608 - INFO -     snmp-collector:active
2025-10-13 04:03:51,609 - INFO -     snmp-topology:active
2025-10-13 04:03:51,609 - INFO -   analytics_alarm
2025-10-13 04:03:51,609 - INFO -     alarmgen:active
2025-10-13 04:03:51,706 - INFO - 10.0.0.19
2025-10-13 04:03:51,706 - INFO -   config
2025-10-13 04:03:51,712 - INFO -     config-nodemgr:active
2025-10-13 04:03:51,716 - INFO -     api-server:active
2025-10-13 04:03:51,719 - INFO -     schema:backup
2025-10-13 04:03:51,723 - INFO -     svc-monitor:active
2025-10-13 04:03:51,726 - INFO -     device-manager:backup
2025-10-13 04:03:51,726 - INFO -   config-database
2025-10-13 04:03:51,726 - INFO -     config-cassandra:active
2025-10-13 04:03:51,726 - INFO -     config-zookeeper:active
2025-10-13 04:03:51,726 - INFO -     config-rabbitmq:active
2025-10-13 04:03:51,726 - INFO -   control
2025-10-13 04:03:51,731 - INFO -     control-nodemgr:active
2025-10-13 04:03:51,738 - INFO -     control:active
2025-10-13 04:03:51,738 - INFO -     named:active
2025-10-13 04:03:51,744 - INFO -     dns:active
2025-10-13 04:03:51,744 - INFO -   analytics
2025-10-13 04:03:51,749 - INFO -     analytics-nodemgr:active
2025-10-13 04:03:51,753 - INFO -     analytics-api:active
2025-10-13 04:03:51,757 - INFO -     collector:active
2025-10-13 04:03:51,757 - INFO -   analytics-database
2025-10-13 04:03:51,757 - INFO -     analytics-cassandra:active
2025-10-13 04:03:51,761 - INFO -     analyticsdb-nodemgr:active
2025-10-13 04:03:51,766 - INFO -     query-engine:active
2025-10-13 04:03:51,766 - INFO -   webui
2025-10-13 04:03:51,766 - INFO -     webui:active
2025-10-13 04:03:51,766 - INFO -     webui-middleware:active
2025-10-13 04:03:51,766 - INFO -     redis:active
2025-10-13 04:03:51,766 - INFO -   analytics_snmp
2025-10-13 04:03:51,770 - INFO -     snmp-collector:active
2025-10-13 04:03:51,770 - INFO -     snmp-topology:active
2025-10-13 04:03:51,770 - INFO -   analytics_alarm
2025-10-13 04:03:51,770 - INFO -     alarmgen:active
2025-10-13 04:03:51,855 - INFO - 10.0.0.41
2025-10-13 04:03:51,855 - INFO -   config
2025-10-13 04:03:51,861 - INFO -     config-nodemgr:active
2025-10-13 04:03:51,865 - INFO -     api-server:active
2025-10-13 04:03:51,869 - INFO -     schema:active
2025-10-13 04:03:51,872 - INFO -     svc-monitor:backup
2025-10-13 04:03:51,876 - INFO -     device-manager:active
2025-10-13 04:03:51,876 - INFO -   config-database
2025-10-13 04:03:51,876 - INFO -     config-cassandra:active
2025-10-13 04:03:51,876 - INFO -     config-zookeeper:active
2025-10-13 04:03:51,876 - INFO -     config-rabbitmq:active
2025-10-13 04:03:51,876 - INFO -   control
2025-10-13 04:03:51,880 - INFO -     control-nodemgr:active
2025-10-13 04:03:51,887 - INFO -     control:active
2025-10-13 04:03:51,887 - INFO -     named:active
2025-10-13 04:03:51,893 - INFO -     dns:active
2025-10-13 04:03:51,893 - INFO -   analytics
2025-10-13 04:03:51,897 - INFO -     analytics-nodemgr:active
2025-10-13 04:03:51,901 - INFO -     analytics-api:active
2025-10-13 04:03:51,905 - INFO -     collector:active
2025-10-13 04:03:51,906 - INFO -   analytics-database
2025-10-13 04:03:51,906 - INFO -     analytics-cassandra:active
2025-10-13 04:03:51,910 - INFO -     analyticsdb-nodemgr:active
2025-10-13 04:03:51,915 - INFO -     query-engine:active
2025-10-13 04:03:51,915 - INFO -   webui
2025-10-13 04:03:51,915 - INFO -     webui:active
2025-10-13 04:03:51,915 - INFO -     webui-middleware:active
2025-10-13 04:03:51,915 - INFO -     redis:active
2025-10-13 04:03:51,915 - INFO -   analytics_snmp
2025-10-13 04:03:51,919 - INFO -     snmp-collector:active
2025-10-13 04:03:51,919 - INFO -     snmp-topology:active
2025-10-13 04:03:51,919 - INFO -   analytics_alarm
2025-10-13 04:03:51,919 - INFO -     alarmgen:active
2025-10-13 04:03:52,006 - INFO - 10.0.0.249
2025-10-13 04:03:52,006 - INFO -   vrouter
2025-10-13 04:03:52,012 - INFO -     vrouter-nodemgr:active
2025-10-13 04:03:52,017 - INFO -     agent:active
2025-10-13 04:03:52,104 - INFO - 10.0.0.27
2025-10-13 04:03:52,104 - INFO -   vrouter
2025-10-13 04:03:52,109 - INFO -     vrouter-nodemgr:active
2025-10-13 04:03:52,115 - INFO -     agent:active
2025-10-13 04:03:52,115 - INFO - All the contrail services are up on all nodes
2025-10-13 04:03:52,115 - INFO - contrail-status passed
2025-10-13 04:03:53,381 - DEBUG - Skipping xmpp flap check
2025-10-13 04:03:53,381 - INFO - END TEST : test_contrail_status : PASSED[0:00:03]
2025-10-13 04:03:53,381 - INFO - --------------------------------------------------------------------------------