2025-08-02 23:09:57,345 - INFO - Using existing project ['default-domain', 'admin'](479fef05-dd36-4231-8389-de2ae3fa83e8) 2025-08-02 23:09:57,358 - INFO - ================================================================================ 2025-08-02 23:09:57,358 - INFO - STARTING TEST : test_db_nodemgr_status 2025-08-02 23:09:57,358 - INFO - TEST DESCRIPTION : Test to verify db nodemgr status 2025-08-02 23:09:58,062 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:09:58,062 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:09:58,062 - INFO - 2025-08-02 23:09:58,062 - DEBUG - Verifying if db node_mgr running... 2025-08-02 23:09:58,062 - INFO - Verifying through collector 10.0.0.50 for db node cn-jenkins-deploy-platform-ansible-os-3743-1. 2025-08-02 23:09:58,062 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3743-1.?flat 2025-08-02 23:09:58,359 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3743-1.?flat 2025-08-02 23:09:58,458 - INFO - Verifying through collector 10.0.0.50 for db node cn-jenkins-deploy-platform-ansible-os-3743-2. 2025-08-02 23:09:58,458 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3743-2.?flat 2025-08-02 23:09:58,572 - INFO - Verifying through collector 10.0.0.50 for db node cn-jenkins-deploy-platform-ansible-os-3743-3. 2025-08-02 23:09:58,572 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3743-3.?flat 2025-08-02 23:09:59,436 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:09:59,436 - INFO - END TEST : test_db_nodemgr_status : PASSED[0:00:02] 2025-08-02 23:09:59,436 - INFO - -------------------------------------------------------------------------------- 2025-08-02 23:09:59,438 - INFO - ================================================================================ 2025-08-02 23:09:59,438 - INFO - STARTING TEST : test_verify_generator_collector_connections 2025-08-02 23:09:59,438 - INFO - TEST DESCRIPTION : Description: Verify generator:module connections to collector 1.Verify all generators connected to collector - fails otherwise 2.Get the xmpp peers in vrouter uve and get the active xmpp peer out of it 3.Verify from agent introspect that active xmpp matches with step 2 - fails otherwise 4.Get bgp peers from bgp-peer uve and verify from control node introspect that that matches - fails otherwise Maintainer: sandipd@juniper.net 2025-08-02 23:10:00,202 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:10:00,202 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:10:00,202 - INFO - 2025-08-02 23:10:00,211 - INFO - IP 10.0.0.38 port 8083 connected to collector 10.0.0.50 2025-08-02 23:10:00,227 - INFO - IP 10.0.0.254 port 8083 connected to collector 10.0.0.50 2025-08-02 23:10:00,241 - INFO - IP 10.0.0.50 port 8083 connected to collector 10.0.0.50 2025-08-02 23:10:00,247 - INFO - IP 10.0.0.38 port 8084 connected to collector 10.0.0.50 2025-08-02 23:10:00,256 - INFO - IP 10.0.0.254 port 8084 connected to collector 10.0.0.38 2025-08-02 23:10:00,265 - INFO - IP 10.0.0.50 port 8084 connected to collector 10.0.0.50 2025-08-02 23:10:00,271 - INFO - IP 10.0.0.38 port 8087 connected to collector 10.0.0.38 2025-08-02 23:10:00,283 - INFO - IP 10.0.0.50 port 8088 connected to collector 10.0.0.38 2025-08-02 23:10:00,289 - INFO - IP 10.0.0.38 port 8090 connected to collector 10.0.0.50 2025-08-02 23:10:00,296 - INFO - IP 10.0.0.254 port 8090 connected to collector 10.0.0.254 2025-08-02 23:10:00,301 - INFO - IP 10.0.0.50 port 8090 connected to collector 10.0.0.50 2025-08-02 23:10:00,306 - INFO - IP 10.0.0.38 port 8091 connected to collector 10.0.0.50 2025-08-02 23:10:00,321 - INFO - IP 10.0.0.254 port 8091 connected to collector 10.0.0.50 2025-08-02 23:10:00,335 - INFO - IP 10.0.0.50 port 8091 connected to collector 10.0.0.50 2025-08-02 23:10:00,335 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,453 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1:Control:contrail-control:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,453 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,541 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1:Control:contrail-dns:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,541 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,585 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2:Control:contrail-control:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,585 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,627 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2:Control:contrail-dns:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,627 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,682 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3:Control:contrail-control:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,682 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,726 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3:Control:contrail-dns:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,726 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,785 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3743-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,786 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,828 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3743-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,828 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,851 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Config:contrail-schema:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,852 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,886 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Config:contrail-svc-monitor:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,909 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,937 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Config:contrail-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,937 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:00,963 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Config:contrail-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:00,964 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,010 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Config:contrail-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,036 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,067 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,067 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,103 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,103 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,132 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,132 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,161 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,161 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,187 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,187 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,217 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,217 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,247 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,247 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,272 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,272 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,299 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,299 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,338 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,338 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,369 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,369 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,413 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,413 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,445 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,445 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,485 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,485 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:01,525 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.38 2025-08-02 23:10:01,636 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3743-1 vrouter uve is 10.20.0.17 2025-08-02 23:10:01,662 - DEBUG - Requesting: http://10.20.0.25:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-02 23:10:01,677 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3743-1 agent introspect is 10.20.0.17 2025-08-02 23:10:01,801 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3743-2 vrouter uve is 10.20.0.17 2025-08-02 23:10:01,828 - DEBUG - Requesting: http://10.20.0.193:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-02 23:10:01,842 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3743-2 agent introspect is 10.20.0.17 2025-08-02 23:10:01,961 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3743-1 connected to {'10.20.0.14', '10.20.0.17'} xmpp peers out of {'10.20.0.14', '10.20.0.17', '10.20.0.254'} 2025-08-02 23:10:01,962 - INFO - xmpp peer correctly displayed as ['10.20.0.17', '10.20.0.14'] for vrouter an-jenkins-deploy-platform-ansible-os-3743-1 2025-08-02 23:10:02,085 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3743-2 connected to {'10.20.0.14', '10.20.0.17'} xmpp peers out of {'10.20.0.14', '10.20.0.17', '10.20.0.254'} 2025-08-02 23:10:02,085 - INFO - xmpp peer correctly displayed as ['10.20.0.17', '10.20.0.14'] for vrouter an-jenkins-deploy-platform-ansible-os-3743-2 2025-08-02 23:10:02,086 - INFO - Verifying through opserver in 10.0.0.50 2025-08-02 23:10:02,086 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3743-1?flat 2025-08-02 23:10:02,125 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3743-2?flat 2025-08-02 23:10:02,157 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3743-3?flat 2025-08-02 23:10:02,192 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3743-1?flat 2025-08-02 23:10:02,224 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3743-2?flat 2025-08-02 23:10:02,270 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3743-3?flat 2025-08-02 23:10:02,312 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3743-1 bgp-router uve 2025-08-02 23:10:02,312 - INFO - Bgp peers = 2 2025-08-02 23:10:02,312 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3743-2 bgp-router uve 2025-08-02 23:10:02,312 - INFO - Bgp peers = 2 2025-08-02 23:10:02,313 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3743-3 bgp-router uve 2025-08-02 23:10:02,313 - INFO - Bgp peers = 2 2025-08-02 23:10:02,313 - INFO - Total xmpp peer connections found = 4 2025-08-02 23:10:03,046 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:10:03,047 - INFO - END TEST : test_verify_generator_collector_connections : PASSED[0:00:04] 2025-08-02 23:10:03,047 - INFO - -------------------------------------------------------------------------------- 2025-08-02 23:10:03,049 - INFO - ================================================================================ 2025-08-02 23:10:03,049 - INFO - STARTING TEST : test_verify_generator_connections_to_collector_node 2025-08-02 23:10:03,049 - INFO - TEST DESCRIPTION : Test to validate generator connections 2025-08-02 23:10:03,798 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:10:03,798 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:10:03,798 - INFO - 2025-08-02 23:10:03,798 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:03,843 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3743-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.38 2025-08-02 23:10:03,843 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:03,875 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3743-1:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:03,875 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:03,917 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3743-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.38 2025-08-02 23:10:03,917 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:03,945 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3743-2:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:03,945 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:03,969 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:03,969 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,004 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,004 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,027 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,027 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,054 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,054 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,091 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,091 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,114 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,114 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,141 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,141 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,172 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,173 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,198 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,199 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,227 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,227 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,249 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,249 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,287 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,287 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,323 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,323 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,358 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,358 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,391 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,392 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,419 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1.:Config:contrail-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,419 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,449 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2.:Config:contrail-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,450 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,484 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3.:Config:contrail-api:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,485 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,574 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1:Control:contrail-control:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,574 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,601 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,601 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,651 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-1:Control:contrail-dns:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,651 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,708 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2:Control:contrail-control:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,708 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,732 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,732 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,772 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-2:Control:contrail-dns:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,773 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,877 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3:Control:contrail-control:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,877 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,902 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.38 2025-08-02 23:10:04,902 - DEBUG - Verifying through opserver in 10.0.0.38 2025-08-02 23:10:04,936 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3743-3:Control:contrail-dns:0 is connected to collector 10.0.0.38 2025-08-02 23:10:05,663 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:10:05,663 - INFO - END TEST : test_verify_generator_connections_to_collector_node : PASSED[0:00:02] 2025-08-02 23:10:05,663 - INFO - -------------------------------------------------------------------------------- 2025-08-02 23:10:05,665 - INFO - ================================================================================ 2025-08-02 23:10:05,665 - INFO - STARTING TEST : test_verify_process_status_agent 2025-08-02 23:10:05,665 - INFO - TEST DESCRIPTION : Test to validate process_status 2025-08-02 23:10:06,389 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:10:06,389 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:10:06,389 - INFO - 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.20.0.17:5269'] servers UP 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1 connected to xmpp 10.20.0.17 2025-08-02 23:10:06,437 - WARNING - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.20.0.254:5269'] servers NOT UP 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.20.0.14:5269'] servers UP 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1 connected to xmpp 10.20.0.14 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.20.0.17:53'] servers UP 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1 connected to dns 10.20.0.17 2025-08-02 23:10:06,437 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.20.0.254:53'] servers UP 2025-08-02 23:10:06,438 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1 connected to dns 10.20.0.254 2025-08-02 23:10:06,438 - WARNING - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.20.0.14:53'] servers NOT UP 2025-08-02 23:10:06,438 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.0.0.38:8086'] servers UP 2025-08-02 23:10:06,438 - INFO - an-jenkins-deploy-platform-ansible-os-3743-1 connected to collector 10.0.0.38 2025-08-02 23:10:06,438 - WARNING - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:06,438 - WARNING - an-jenkins-deploy-platform-ansible-os-3743-1:contrail-vrouter-agent module connection to ['10.0.0.50:8086'] servers NOT UP 2025-08-02 23:10:07,193 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:10:07,193 - INFO - END TEST : test_verify_process_status_agent : PASSED[0:00:02] 2025-08-02 23:10:07,193 - INFO - -------------------------------------------------------------------------------- 2025-08-02 23:10:07,196 - INFO - ================================================================================ 2025-08-02 23:10:07,196 - INFO - STARTING TEST : test_verify_process_status_analytics_node 2025-08-02 23:10:07,196 - INFO - TEST DESCRIPTION : Test to validate process_status-Analytics-Node 2025-08-02 23:10:07,898 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:10:07,898 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:10:07,898 - INFO - 2025-08-02 23:10:08,085 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-collector module connection to ['10.0.0.38:8086'] servers UP 2025-08-02 23:10:08,085 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP 2025-08-02 23:10:08,085 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-collector module connection to ['10.0.0.254:6379'] servers NOT UP 2025-08-02 23:10:08,085 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-collector module connection to ['10.0.0.50:6379'] servers NOT UP 2025-08-02 23:10:08,085 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-02 23:10:08,085 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-collector module connection to ['10.0.0.38:9042'] servers UP 2025-08-02 23:10:08,125 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,125 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['10.0.0.254:8086'] servers UP 2025-08-02 23:10:08,125 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP 2025-08-02 23:10:08,126 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['10.0.0.254:6379'] servers NOT UP 2025-08-02 23:10:08,126 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['10.0.0.50:6379'] servers NOT UP 2025-08-02 23:10:08,126 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-02 23:10:08,126 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-collector module connection to ['10.0.0.38:9042'] servers UP 2025-08-02 23:10:08,171 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,171 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:08,172 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:08,172 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP 2025-08-02 23:10:08,172 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.254:6379'] servers NOT UP 2025-08-02 23:10:08,172 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.50:6379'] servers NOT UP 2025-08-02 23:10:08,172 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-02 23:10:08,172 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-collector module connection to ['10.0.0.38:9042'] servers UP 2025-08-02 23:10:08,233 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,233 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-analytics-api module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:08,233 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-analytics-api module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:08,277 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,278 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-analytics-api module connection to ['10.0.0.254:8086'] servers UP 2025-08-02 23:10:08,325 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,325 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-analytics-api module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:08,326 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-analytics-api module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:08,372 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-analytics-nodemgr module connection to ['10.0.0.38:8086'] servers UP 2025-08-02 23:10:08,426 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-analytics-nodemgr module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,426 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-analytics-nodemgr module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:08,426 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2.:contrail-analytics-nodemgr module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:08,470 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-analytics-nodemgr module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:08,470 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-analytics-nodemgr module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:08,470 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3.:contrail-analytics-nodemgr module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:09,234 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:10:09,234 - INFO - END TEST : test_verify_process_status_analytics_node : PASSED[0:00:02] 2025-08-02 23:10:09,234 - INFO - -------------------------------------------------------------------------------- 2025-08-02 23:10:09,238 - INFO - ================================================================================ 2025-08-02 23:10:09,238 - INFO - STARTING TEST : test_verify_process_status_config 2025-08-02 23:10:09,238 - INFO - TEST DESCRIPTION : Test to validate process_status-Config 2025-08-02 23:10:10,005 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:10:10,005 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:10:10,006 - INFO - 2025-08-02 23:10:10,064 - WARNING - No object found for module contrail-device-manager 2025-08-02 23:10:10,092 - WARNING - No object found for module contrail-device-manager 2025-08-02 23:10:10,122 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.38:8086 servers NOT UP 2025-08-02 23:10:10,122 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.254:8086 servers NOT UP 2025-08-02 23:10:10,122 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.50:8086 servers UP 2025-08-02 23:10:10,122 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.38:2181 servers UP 2025-08-02 23:10:10,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.38:9161 servers NOT UP 2025-08-02 23:10:10,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.254:9161 servers NOT UP 2025-08-02 23:10:10,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to 10.0.0.50:9161 servers NOT UP 2025-08-02 23:10:10,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3743-1.*:9161 servers NOT UP 2025-08-02 23:10:10,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3743-2.*:9161 servers NOT UP 2025-08-02 23:10:10,124 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3743-3.*:9161 servers NOT UP 2025-08-02 23:10:10,887 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Sat Aug 2 23:10:10 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/analytics/test_analytics.py in test_verify_process_status_config(self=) 333 334 ''' 335 self.analytics_obj.verify_process_and_connection_infos_config() 336 337 @test.attr(type=['cb_sanity', 'sanity', 'dev_sanity_dpdk']) self = self.analytics_obj = self.analytics_obj.verify_process_and_connection_infos_config = > /contrail-test/tcutils/collector/analytics_tests.py in verify_process_and_connection_infos_config(self=) 4218 'contrail-api',\ 4219 server,node = cfgm) 4220 assert result 4221 result = False 4222 result = False AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/analytics/test_analytics.py", line 335, in test_verify_process_status_config self.analytics_obj.verify_process_and_connection_infos_config() File "/contrail-test/tcutils/collector/analytics_tests.py", line 4220, in verify_process_and_connection_infos_config assert result AssertionError 2025-08-02 23:10:10,901 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:10:10,901 - INFO - 2025-08-02 23:10:10,901 - INFO - END TEST : test_verify_process_status_config : FAILED[0:00:01] 2025-08-02 23:10:10,901 - INFO - -------------------------------------------------------------------------------- 2025-08-02 23:10:10,904 - INFO - ================================================================================ 2025-08-02 23:10:10,904 - INFO - STARTING TEST : test_verify_process_status_control_node 2025-08-02 23:10:10,905 - INFO - TEST DESCRIPTION : Test to validate process_status-Control-Node 2025-08-02 23:10:11,646 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-02 23:10:11,646 - INFO - Initial checks done. Running the testcase now 2025-08-02 23:10:11,646 - INFO - 2025-08-02 23:10:11,678 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1:contrail-control module connection to 10.0.0.38:9041 servers UP 2025-08-02 23:10:11,678 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1:contrail-control module connection to 10.0.0.38:5673 servers UP 2025-08-02 23:10:11,678 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:11,678 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-1:contrail-control module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:11,678 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-1:contrail-control module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:11,709 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2:contrail-control module connection to 10.0.0.38:9041 servers UP 2025-08-02 23:10:11,709 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2:contrail-control module connection to 10.0.0.38:5673 servers UP 2025-08-02 23:10:11,709 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:11,709 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-2:contrail-control module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:11,709 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-2:contrail-control module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:11,734 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3:contrail-control module connection to 10.0.0.38:9041 servers UP 2025-08-02 23:10:11,734 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3:contrail-control module connection to 10.0.0.38:5673 servers UP 2025-08-02 23:10:11,734 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-02 23:10:11,734 - WARNING - cn-jenkins-deploy-platform-ansible-os-3743-3:contrail-control module connection to ['10.0.0.254:8086'] servers NOT UP 2025-08-02 23:10:11,734 - INFO - cn-jenkins-deploy-platform-ansible-os-3743-3:contrail-control module connection to ['10.0.0.50:8086'] servers UP 2025-08-02 23:10:12,501 - DEBUG - No XMPP flaps were noticed during the test 2025-08-02 23:10:12,501 - INFO - END TEST : test_verify_process_status_control_node : PASSED[0:00:02] 2025-08-02 23:10:12,501 - INFO - --------------------------------------------------------------------------------