2025-07-23 15:01:36,423 - INFO - Using existing project ['default-domain', 'admin'](de188a85-0813-4d84-b64d-a8a6d4ed6ea9)
2025-07-23 15:01:36,433 - INFO - ================================================================================
2025-07-23 15:01:36,433 - INFO - STARTING TEST : test_db_nodemgr_status
2025-07-23 15:01:36,433 - INFO - TEST DESCRIPTION : Test to verify db nodemgr status
2025-07-23 15:01:37,120 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:37,120 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:37,120 - INFO -
2025-07-23 15:01:37,121 - DEBUG - Verifying if db node_mgr running...
2025-07-23 15:01:37,121 - INFO - Verifying through collector 10.0.0.73 for db node cn-jenkins-deploy-platform-ansible-os-3704-1.
2025-07-23 15:01:37,121 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3704-1.?flat
2025-07-23 15:01:37,431 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3704-1.?flat
2025-07-23 15:01:37,522 - INFO - Verifying through collector 10.0.0.73 for db node cn-jenkins-deploy-platform-ansible-os-3704-2.
2025-07-23 15:01:37,522 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3704-2.?flat
2025-07-23 15:01:37,636 - INFO - Verifying through collector 10.0.0.73 for db node cn-jenkins-deploy-platform-ansible-os-3704-3.
2025-07-23 15:01:37,636 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3704-3.?flat
2025-07-23 15:01:38,435 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:38,435 - INFO - END TEST : test_db_nodemgr_status : PASSED[0:00:02]
2025-07-23 15:01:38,435 - INFO - --------------------------------------------------------------------------------
2025-07-23 15:01:38,438 - INFO - ================================================================================
2025-07-23 15:01:38,438 - INFO - STARTING TEST : test_verify_generator_collector_connections
2025-07-23 15:01:38,438 - INFO - TEST DESCRIPTION :
Description: Verify generator:module connections to collector
1.Verify all generators connected to collector - fails otherwise
2.Get the xmpp peers in vrouter uve and get the active xmpp peer out of it
3.Verify from agent introspect that active xmpp matches with step 2 - fails otherwise
4.Get bgp peers from bgp-peer uve and verify from control node introspect that that matches - fails otherwise
Maintainer: sandipd@juniper.net
2025-07-23 15:01:39,148 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:39,149 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:39,149 - INFO -
2025-07-23 15:01:39,155 - INFO - IP 10.0.0.23 port 8083 connected to collector 10.0.0.73
2025-07-23 15:01:39,162 - INFO - IP 10.0.0.249 port 8083 connected to collector 10.0.0.73
2025-07-23 15:01:39,169 - INFO - IP 10.0.0.73 port 8083 connected to collector 10.0.0.73
2025-07-23 15:01:39,173 - INFO - IP 10.0.0.23 port 8084 connected to collector 10.0.0.23
2025-07-23 15:01:39,178 - INFO - IP 10.0.0.249 port 8084 connected to collector 10.0.0.249
2025-07-23 15:01:39,182 - INFO - IP 10.0.0.73 port 8084 connected to collector 10.0.0.23
2025-07-23 15:01:39,186 - INFO - IP 10.0.0.23 port 8087 connected to collector 10.0.0.73
2025-07-23 15:01:39,195 - INFO - IP 10.0.0.73 port 8088 connected to collector 10.0.0.73
2025-07-23 15:01:39,198 - INFO - IP 10.0.0.23 port 8090 connected to collector 10.0.0.73
2025-07-23 15:01:39,202 - INFO - IP 10.0.0.249 port 8090 connected to collector 10.0.0.23
2025-07-23 15:01:39,206 - INFO - IP 10.0.0.73 port 8090 connected to collector 10.0.0.249
2025-07-23 15:01:39,215 - INFO - IP 10.0.0.23 port 8091 connected to collector 10.0.0.249
2025-07-23 15:01:39,223 - INFO - IP 10.0.0.249 port 8091 connected to collector 10.0.0.249
2025-07-23 15:01:39,229 - INFO - IP 10.0.0.73 port 8091 connected to collector 10.0.0.249
2025-07-23 15:01:39,229 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,356 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1:Control:contrail-control:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,356 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,442 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1:Control:contrail-dns:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,442 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,497 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2:Control:contrail-control:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,498 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,535 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2:Control:contrail-dns:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,536 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,583 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3:Control:contrail-control:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,584 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,624 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3:Control:contrail-dns:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,624 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,671 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3704-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,671 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,718 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3704-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,719 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,746 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Config:contrail-schema:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,746 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,772 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Config:contrail-svc-monitor:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,792 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,820 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Config:contrail-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,820 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,844 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Config:contrail-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,844 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,867 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Config:contrail-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,885 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,907 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,907 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,928 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,929 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,950 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,950 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:39,973 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:39,974 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,001 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,001 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,029 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,029 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,051 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,051 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,077 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,077 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,119 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,123 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,166 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,167 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,208 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,208 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,249 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,250 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,290 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,291 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,332 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,332 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:40,370 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23
2025-07-23 15:01:40,421 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3704-1?flat
2025-07-23 15:01:40,723 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3704-1?flat
2025-07-23 15:01:40,809 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3704-1 vrouter uve is 10.20.0.17
2025-07-23 15:01:40,877 - DEBUG - Requesting: http://10.20.0.193:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-23 15:01:40,904 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3704-1 agent introspect is 10.20.0.17
2025-07-23 15:01:40,955 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3704-2?flat
2025-07-23 15:01:40,993 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3704-2 vrouter uve is 10.20.0.254
2025-07-23 15:01:41,019 - DEBUG - Requesting: http://10.20.0.129:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-23 15:01:41,034 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3704-2 agent introspect is 10.20.0.254
2025-07-23 15:01:41,077 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3704-1?flat
2025-07-23 15:01:41,163 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3704-1 connected to {'10.20.0.254', '10.20.0.17'} xmpp peers out of {'10.20.0.254', '10.20.0.14', '10.20.0.17'}
2025-07-23 15:01:41,164 - INFO - xmpp peer correctly displayed as ['10.20.0.254', '10.20.0.17'] for vrouter an-jenkins-deploy-platform-ansible-os-3704-1
2025-07-23 15:01:41,200 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3704-2?flat
2025-07-23 15:01:41,236 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3704-2 connected to {'10.20.0.254', '10.20.0.17'} xmpp peers out of {'10.20.0.254', '10.20.0.14', '10.20.0.17'}
2025-07-23 15:01:41,236 - INFO - xmpp peer correctly displayed as ['10.20.0.17', '10.20.0.254'] for vrouter an-jenkins-deploy-platform-ansible-os-3704-2
2025-07-23 15:01:41,236 - INFO - Verifying through opserver in 10.0.0.73
2025-07-23 15:01:41,236 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3704-1?flat
2025-07-23 15:01:41,262 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3704-2?flat
2025-07-23 15:01:41,292 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3704-3?flat
2025-07-23 15:01:41,319 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3704-1?flat
2025-07-23 15:01:41,348 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3704-2?flat
2025-07-23 15:01:41,392 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3704-3?flat
2025-07-23 15:01:41,425 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3704-1 bgp-router uve
2025-07-23 15:01:41,425 - INFO - Bgp peers = 2
2025-07-23 15:01:41,426 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3704-2 bgp-router uve
2025-07-23 15:01:41,426 - INFO - Bgp peers = 2
2025-07-23 15:01:41,426 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3704-3 bgp-router uve
2025-07-23 15:01:41,426 - INFO - Bgp peers = 2
2025-07-23 15:01:41,426 - INFO - Total xmpp peer connections found = 4
2025-07-23 15:01:42,172 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:42,172 - INFO - END TEST : test_verify_generator_collector_connections : PASSED[0:00:04]
2025-07-23 15:01:42,172 - INFO - --------------------------------------------------------------------------------
2025-07-23 15:01:42,178 - INFO - ================================================================================
2025-07-23 15:01:42,178 - INFO - STARTING TEST : test_verify_generator_connections_to_collector_node
2025-07-23 15:01:42,178 - INFO - TEST DESCRIPTION : Test to validate generator connections
2025-07-23 15:01:42,856 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:42,857 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:42,857 - INFO -
2025-07-23 15:01:42,857 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:42,918 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3704-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23
2025-07-23 15:01:42,919 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:42,945 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3704-1:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:42,945 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:42,991 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3704-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23
2025-07-23 15:01:42,991 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,013 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3704-2:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,014 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,039 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,039 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,077 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,077 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,106 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,106 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,137 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,137 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,196 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,196 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,223 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,223 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,249 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,250 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,288 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,288 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,320 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,320 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,385 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,385 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,410 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,410 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,444 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,444 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,468 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,468 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,498 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,499 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,530 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,530 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,573 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1.:Config:contrail-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,573 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,598 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2.:Config:contrail-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,598 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,626 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3.:Config:contrail-api:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,626 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,697 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1:Control:contrail-control:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,697 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,719 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,719 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,760 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-1:Control:contrail-dns:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,760 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,834 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2:Control:contrail-control:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,834 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,855 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,856 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,890 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-2:Control:contrail-dns:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,890 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,937 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3:Control:contrail-control:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,937 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,961 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.23
2025-07-23 15:01:43,961 - DEBUG - Verifying through opserver in 10.0.0.23
2025-07-23 15:01:43,993 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3704-3:Control:contrail-dns:0 is connected to collector 10.0.0.23
2025-07-23 15:01:44,704 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:44,704 - INFO - END TEST : test_verify_generator_connections_to_collector_node : PASSED[0:00:02]
2025-07-23 15:01:44,704 - INFO - --------------------------------------------------------------------------------
2025-07-23 15:01:44,708 - INFO - ================================================================================
2025-07-23 15:01:44,708 - INFO - STARTING TEST : test_verify_process_status_agent
2025-07-23 15:01:44,708 - INFO - TEST DESCRIPTION : Test to validate process_status
2025-07-23 15:01:45,414 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:45,414 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:45,414 - INFO -
2025-07-23 15:01:45,450 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.20.0.17:5269'] servers UP
2025-07-23 15:01:45,450 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1 connected to xmpp 10.20.0.17
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.20.0.254:5269'] servers UP
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1 connected to xmpp 10.20.0.254
2025-07-23 15:01:45,451 - WARNING - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.20.0.14:5269'] servers NOT UP
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.20.0.17:53'] servers UP
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1 connected to dns 10.20.0.17
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.20.0.254:53'] servers UP
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1 connected to dns 10.20.0.254
2025-07-23 15:01:45,451 - WARNING - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.20.0.14:53'] servers NOT UP
2025-07-23 15:01:45,451 - WARNING - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.0.0.249:8086'] servers UP
2025-07-23 15:01:45,451 - INFO - an-jenkins-deploy-platform-ansible-os-3704-1 connected to collector 10.0.0.249
2025-07-23 15:01:45,451 - WARNING - an-jenkins-deploy-platform-ansible-os-3704-1:contrail-vrouter-agent module connection to ['10.0.0.73:8086'] servers NOT UP
2025-07-23 15:01:46,186 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:46,187 - INFO - END TEST : test_verify_process_status_agent : PASSED[0:00:02]
2025-07-23 15:01:46,187 - INFO - --------------------------------------------------------------------------------
2025-07-23 15:01:46,190 - INFO - ================================================================================
2025-07-23 15:01:46,190 - INFO - STARTING TEST : test_verify_process_status_analytics_node
2025-07-23 15:01:46,190 - INFO - TEST DESCRIPTION : Test to validate process_status-Analytics-Node
2025-07-23 15:01:46,883 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:46,883 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:46,883 - INFO -
2025-07-23 15:01:47,105 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-collector module connection to ['10.0.0.23:8086'] servers UP
2025-07-23 15:01:47,105 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP
2025-07-23 15:01:47,105 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-collector module connection to ['10.0.0.249:6379'] servers NOT UP
2025-07-23 15:01:47,106 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-collector module connection to ['10.0.0.73:6379'] servers NOT UP
2025-07-23 15:01:47,106 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-23 15:01:47,107 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-collector module connection to ['10.0.0.23:9042'] servers UP
2025-07-23 15:01:47,151 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,151 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['10.0.0.249:8086'] servers UP
2025-07-23 15:01:47,151 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP
2025-07-23 15:01:47,151 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['10.0.0.249:6379'] servers NOT UP
2025-07-23 15:01:47,152 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['10.0.0.73:6379'] servers NOT UP
2025-07-23 15:01:47,152 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-23 15:01:47,152 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-collector module connection to ['10.0.0.23:9042'] servers UP
2025-07-23 15:01:47,196 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,196 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.249:8086'] servers NOT UP
2025-07-23 15:01:47,196 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.73:8086'] servers UP
2025-07-23 15:01:47,196 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP
2025-07-23 15:01:47,196 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.249:6379'] servers NOT UP
2025-07-23 15:01:47,196 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.73:6379'] servers NOT UP
2025-07-23 15:01:47,197 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-23 15:01:47,197 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-collector module connection to ['10.0.0.23:9042'] servers UP
2025-07-23 15:01:47,236 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,237 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-analytics-api module connection to ['10.0.0.249:8086'] servers NOT UP
2025-07-23 15:01:47,237 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-analytics-api module connection to ['10.0.0.73:8086'] servers UP
2025-07-23 15:01:47,286 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers UP
2025-07-23 15:01:47,327 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,327 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-analytics-api module connection to ['10.0.0.249:8086'] servers UP
2025-07-23 15:01:47,376 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-analytics-nodemgr module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,376 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-analytics-nodemgr module connection to ['10.0.0.249:8086'] servers UP
2025-07-23 15:01:47,427 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-analytics-nodemgr module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,427 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2.:contrail-analytics-nodemgr module connection to ['10.0.0.249:8086'] servers UP
2025-07-23 15:01:47,468 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-analytics-nodemgr module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:47,468 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3.:contrail-analytics-nodemgr module connection to ['10.0.0.249:8086'] servers UP
2025-07-23 15:01:48,149 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:48,149 - INFO - END TEST : test_verify_process_status_analytics_node : PASSED[0:00:02]
2025-07-23 15:01:48,150 - INFO - --------------------------------------------------------------------------------
2025-07-23 15:01:48,152 - INFO - ================================================================================
2025-07-23 15:01:48,153 - INFO - STARTING TEST : test_verify_process_status_config
2025-07-23 15:01:48,153 - INFO - TEST DESCRIPTION : Test to validate process_status-Config
2025-07-23 15:01:48,882 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:48,882 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:48,882 - INFO -
2025-07-23 15:01:48,940 - WARNING - No object found for module contrail-device-manager
2025-07-23 15:01:48,971 - WARNING - No object found for module contrail-device-manager
2025-07-23 15:01:49,001 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to 10.0.0.23:8086 servers UP
2025-07-23 15:01:49,001 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to 10.0.0.23:2181 servers UP
2025-07-23 15:01:49,001 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to 10.0.0.23:9161 servers NOT UP
2025-07-23 15:01:49,001 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to 10.0.0.249:9161 servers NOT UP
2025-07-23 15:01:49,002 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to 10.0.0.73:9161 servers NOT UP
2025-07-23 15:01:49,002 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3704-1.*:9161 servers NOT UP
2025-07-23 15:01:49,002 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3704-2.*:9161 servers NOT UP
2025-07-23 15:01:49,002 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3704-3.*:9161 servers NOT UP
2025-07-23 15:01:49,701 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Wed Jul 23 15:01:49 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/analytics/test_analytics.py in test_verify_process_status_config(self=)
333
334 '''
335 self.analytics_obj.verify_process_and_connection_infos_config()
336
337 @test.attr(type=['cb_sanity', 'sanity', 'dev_sanity_dpdk'])
self =
self.analytics_obj =
self.analytics_obj.verify_process_and_connection_infos_config = >
/contrail-test/tcutils/collector/analytics_tests.py in verify_process_and_connection_infos_config(self=)
4218 'contrail-api',\
4219 server,node = cfgm)
4220 assert result
4221 result = False
4222
result = False
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/analytics/test_analytics.py", line 335, in test_verify_process_status_config
self.analytics_obj.verify_process_and_connection_infos_config()
File "/contrail-test/tcutils/collector/analytics_tests.py", line 4220, in verify_process_and_connection_infos_config
assert result
AssertionError
2025-07-23 15:01:49,722 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:49,722 - INFO -
2025-07-23 15:01:49,722 - INFO - END TEST : test_verify_process_status_config : FAILED[0:00:01]
2025-07-23 15:01:49,722 - INFO - --------------------------------------------------------------------------------
2025-07-23 15:01:49,727 - INFO - ================================================================================
2025-07-23 15:01:49,727 - INFO - STARTING TEST : test_verify_process_status_control_node
2025-07-23 15:01:49,727 - INFO - TEST DESCRIPTION : Test to validate process_status-Control-Node
2025-07-23 15:01:50,431 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-07-23 15:01:50,432 - INFO - Initial checks done. Running the testcase now
2025-07-23 15:01:50,432 - INFO -
2025-07-23 15:01:50,466 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1:contrail-control module connection to 10.0.0.23:9041 servers UP
2025-07-23 15:01:50,466 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1:contrail-control module connection to 10.0.0.23:5673 servers UP
2025-07-23 15:01:50,467 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1:contrail-control module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:50,467 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-1:contrail-control module connection to ['10.0.0.249:8086'] servers NOT UP
2025-07-23 15:01:50,467 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-1:contrail-control module connection to ['10.0.0.73:8086'] servers UP
2025-07-23 15:01:50,497 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2:contrail-control module connection to 10.0.0.23:9041 servers UP
2025-07-23 15:01:50,498 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2:contrail-control module connection to 10.0.0.23:5673 servers UP
2025-07-23 15:01:50,498 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2:contrail-control module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:50,498 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-2:contrail-control module connection to ['10.0.0.249:8086'] servers NOT UP
2025-07-23 15:01:50,498 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-2:contrail-control module connection to ['10.0.0.73:8086'] servers UP
2025-07-23 15:01:50,527 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3:contrail-control module connection to 10.0.0.23:9041 servers UP
2025-07-23 15:01:50,527 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3:contrail-control module connection to 10.0.0.23:5673 servers UP
2025-07-23 15:01:50,527 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3:contrail-control module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-23 15:01:50,527 - WARNING - cn-jenkins-deploy-platform-ansible-os-3704-3:contrail-control module connection to ['10.0.0.249:8086'] servers NOT UP
2025-07-23 15:01:50,528 - INFO - cn-jenkins-deploy-platform-ansible-os-3704-3:contrail-control module connection to ['10.0.0.73:8086'] servers UP
2025-07-23 15:01:51,259 - DEBUG - No XMPP flaps were noticed during the test
2025-07-23 15:01:51,259 - INFO - END TEST : test_verify_process_status_control_node : PASSED[0:00:02]
2025-07-23 15:01:51,259 - INFO - --------------------------------------------------------------------------------