2025-08-11 02:10:22,452 - INFO - Using existing project ['default-domain', 'admin'](957e4036-0d22-4e95-939e-d861b3da2619) 2025-08-11 02:10:22,467 - INFO - ================================================================================ 2025-08-11 02:10:22,468 - INFO - STARTING TEST : test_db_nodemgr_status 2025-08-11 02:10:22,468 - INFO - TEST DESCRIPTION : Test to verify db nodemgr status 2025-08-11 02:10:23,098 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:23,098 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:23,098 - INFO - 2025-08-11 02:10:23,098 - DEBUG - Verifying if db node_mgr running... 2025-08-11 02:10:23,098 - INFO - Verifying through collector 10.0.0.141 for db node cn-jenkins-deploy-platform-ansible-os-3794-1. 2025-08-11 02:10:23,098 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3794-1.?flat 2025-08-11 02:10:23,390 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3794-1.?flat 2025-08-11 02:10:23,449 - INFO - Verifying through collector 10.0.0.141 for db node cn-jenkins-deploy-platform-ansible-os-3794-2. 2025-08-11 02:10:23,449 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3794-2.?flat 2025-08-11 02:10:23,510 - INFO - Verifying through collector 10.0.0.141 for db node cn-jenkins-deploy-platform-ansible-os-3794-3. 2025-08-11 02:10:23,511 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3794-3.?flat 2025-08-11 02:10:24,189 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:24,189 - INFO - END TEST : test_db_nodemgr_status : PASSED[0:00:02] 2025-08-11 02:10:24,189 - INFO - -------------------------------------------------------------------------------- 2025-08-11 02:10:24,191 - INFO - ================================================================================ 2025-08-11 02:10:24,191 - INFO - STARTING TEST : test_verify_generator_collector_connections 2025-08-11 02:10:24,192 - INFO - TEST DESCRIPTION : Description: Verify generator:module connections to collector 1.Verify all generators connected to collector - fails otherwise 2.Get the xmpp peers in vrouter uve and get the active xmpp peer out of it 3.Verify from agent introspect that active xmpp matches with step 2 - fails otherwise 4.Get bgp peers from bgp-peer uve and verify from control node introspect that that matches - fails otherwise Maintainer: sandipd@juniper.net 2025-08-11 02:10:24,810 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:24,810 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:24,810 - INFO - 2025-08-11 02:10:24,815 - INFO - IP 10.0.0.23 port 8083 connected to collector 10.0.0.141 2025-08-11 02:10:24,820 - INFO - IP 10.0.0.38 port 8083 connected to collector 10.0.0.141 2025-08-11 02:10:24,825 - INFO - IP 10.0.0.141 port 8083 connected to collector 10.0.0.141 2025-08-11 02:10:24,829 - INFO - IP 10.0.0.23 port 8084 connected to collector 10.0.0.141 2025-08-11 02:10:24,832 - INFO - IP 10.0.0.38 port 8084 connected to collector 10.0.0.38 2025-08-11 02:10:24,836 - INFO - IP 10.0.0.141 port 8084 connected to collector 10.0.0.38 2025-08-11 02:10:24,843 - INFO - IP 10.0.0.141 port 8087 connected to collector 10.0.0.141 2025-08-11 02:10:24,851 - INFO - IP 10.0.0.141 port 8088 connected to collector 10.0.0.141 2025-08-11 02:10:24,854 - INFO - IP 10.0.0.23 port 8090 connected to collector 10.0.0.23 2025-08-11 02:10:24,857 - INFO - IP 10.0.0.38 port 8090 connected to collector 10.0.0.38 2025-08-11 02:10:24,861 - INFO - IP 10.0.0.141 port 8090 connected to collector 10.0.0.38 2025-08-11 02:10:24,866 - INFO - IP 10.0.0.23 port 8091 connected to collector 10.0.0.141 2025-08-11 02:10:24,871 - INFO - IP 10.0.0.38 port 8091 connected to collector 10.0.0.141 2025-08-11 02:10:24,879 - INFO - IP 10.0.0.141 port 8091 connected to collector 10.0.0.141 2025-08-11 02:10:24,879 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:24,979 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1:Control:contrail-control:0 is connected to collector 10.0.0.23 2025-08-11 02:10:24,980 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,058 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1:Control:contrail-dns:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,058 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,112 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2:Control:contrail-control:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,112 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,148 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2:Control:contrail-dns:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,148 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,194 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3:Control:contrail-control:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,194 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,227 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3:Control:contrail-dns:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,227 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,264 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3794-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,264 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,302 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3794-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,302 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,320 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Config:contrail-schema:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,320 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,339 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Config:contrail-svc-monitor:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,355 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,374 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Config:contrail-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,374 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,398 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Config:contrail-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,398 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,424 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Config:contrail-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,442 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,464 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,464 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,483 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,483 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,503 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,503 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,522 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,523 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,543 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,543 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,566 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,566 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,585 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,585 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,610 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,610 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,633 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,633 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,669 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,669 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,707 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,707 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,744 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,745 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,781 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,781 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,816 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,816 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:25,840 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23 2025-08-11 02:10:25,879 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3794-1?flat 2025-08-11 02:10:25,915 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3794-1 vrouter uve is 10.20.0.129 2025-08-11 02:10:25,939 - DEBUG - Requesting: http://10.20.0.192:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-11 02:10:25,951 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3794-1 agent introspect is 10.20.0.129 2025-08-11 02:10:26,032 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3794-2 vrouter uve is 10.20.0.25 2025-08-11 02:10:26,056 - DEBUG - Requesting: http://10.20.0.201:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-11 02:10:26,066 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3794-2 agent introspect is 10.20.0.25 2025-08-11 02:10:26,103 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3794-1?flat 2025-08-11 02:10:26,138 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3794-1 connected to {'10.20.0.18', '10.20.0.129'} xmpp peers out of {'10.20.0.25', '10.20.0.129', '10.20.0.18'} 2025-08-11 02:10:26,138 - INFO - xmpp peer correctly displayed as ['10.20.0.18', '10.20.0.129'] for vrouter an-jenkins-deploy-platform-ansible-os-3794-1 2025-08-11 02:10:26,222 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3794-2 connected to {'10.20.0.25', '10.20.0.129'} xmpp peers out of {'10.20.0.25', '10.20.0.129', '10.20.0.18'} 2025-08-11 02:10:26,222 - INFO - xmpp peer correctly displayed as ['10.20.0.129', '10.20.0.25'] for vrouter an-jenkins-deploy-platform-ansible-os-3794-2 2025-08-11 02:10:26,222 - INFO - Verifying through opserver in 10.0.0.141 2025-08-11 02:10:26,222 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3794-1?flat 2025-08-11 02:10:26,247 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3794-2?flat 2025-08-11 02:10:26,270 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3794-3?flat 2025-08-11 02:10:26,296 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3794-1?flat 2025-08-11 02:10:26,319 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3794-2?flat 2025-08-11 02:10:26,340 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3794-3?flat 2025-08-11 02:10:26,363 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3794-1 bgp-router uve 2025-08-11 02:10:26,363 - INFO - Bgp peers = 2 2025-08-11 02:10:26,364 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3794-2 bgp-router uve 2025-08-11 02:10:26,364 - INFO - Bgp peers = 2 2025-08-11 02:10:26,364 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3794-3 bgp-router uve 2025-08-11 02:10:26,364 - INFO - Bgp peers = 2 2025-08-11 02:10:26,364 - INFO - Total xmpp peer connections found = 4 2025-08-11 02:10:26,990 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:26,990 - INFO - END TEST : test_verify_generator_collector_connections : PASSED[0:00:02] 2025-08-11 02:10:26,991 - INFO - -------------------------------------------------------------------------------- 2025-08-11 02:10:26,996 - INFO - ================================================================================ 2025-08-11 02:10:26,996 - INFO - STARTING TEST : test_verify_generator_connections_to_collector_node 2025-08-11 02:10:26,996 - INFO - TEST DESCRIPTION : Test to validate generator connections 2025-08-11 02:10:27,608 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:27,609 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:27,609 - INFO - 2025-08-11 02:10:27,609 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,644 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3794-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,644 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,665 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3794-1:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,665 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,717 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3794-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,717 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,742 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3794-2:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,742 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,764 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,765 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,798 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,798 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,824 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,824 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,844 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,844 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,875 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,875 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,899 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,900 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,924 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,924 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,957 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,957 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:27,978 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:27,978 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,001 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,001 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,020 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,020 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,046 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,046 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,066 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,066 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,090 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,090 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,110 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,110 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,135 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1.:Config:contrail-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,135 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,157 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2.:Config:contrail-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,157 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,180 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3.:Config:contrail-api:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,180 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,226 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1:Control:contrail-control:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,226 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,248 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,248 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,278 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-1:Control:contrail-dns:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,278 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,323 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2:Control:contrail-control:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,323 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,342 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,342 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,383 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-2:Control:contrail-dns:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,384 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,428 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3:Control:contrail-control:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,428 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,447 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.23 2025-08-11 02:10:28,447 - DEBUG - Verifying through opserver in 10.0.0.23 2025-08-11 02:10:28,473 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3794-3:Control:contrail-dns:0 is connected to collector 10.0.0.23 2025-08-11 02:10:29,086 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:29,086 - INFO - END TEST : test_verify_generator_connections_to_collector_node : PASSED[0:00:03] 2025-08-11 02:10:29,086 - INFO - -------------------------------------------------------------------------------- 2025-08-11 02:10:29,088 - INFO - ================================================================================ 2025-08-11 02:10:29,088 - INFO - STARTING TEST : test_verify_process_status_agent 2025-08-11 02:10:29,088 - INFO - TEST DESCRIPTION : Test to validate process_status 2025-08-11 02:10:29,686 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:29,686 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:29,686 - INFO - 2025-08-11 02:10:29,717 - WARNING - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.20.0.25:5269'] servers NOT UP 2025-08-11 02:10:29,717 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.20.0.129:5269'] servers UP 2025-08-11 02:10:29,717 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1 connected to xmpp 10.20.0.129 2025-08-11 02:10:29,717 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.20.0.18:5269'] servers UP 2025-08-11 02:10:29,717 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1 connected to xmpp 10.20.0.18 2025-08-11 02:10:29,717 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.20.0.25:53'] servers UP 2025-08-11 02:10:29,718 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1 connected to dns 10.20.0.25 2025-08-11 02:10:29,718 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.20.0.129:53'] servers UP 2025-08-11 02:10:29,718 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1 connected to dns 10.20.0.129 2025-08-11 02:10:29,718 - WARNING - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.20.0.18:53'] servers NOT UP 2025-08-11 02:10:29,718 - WARNING - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:29,718 - WARNING - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-11 02:10:29,718 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1:contrail-vrouter-agent module connection to ['10.0.0.141:8086'] servers UP 2025-08-11 02:10:29,718 - INFO - an-jenkins-deploy-platform-ansible-os-3794-1 connected to collector 10.0.0.141 2025-08-11 02:10:30,333 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:30,333 - INFO - END TEST : test_verify_process_status_agent : PASSED[0:00:01] 2025-08-11 02:10:30,333 - INFO - -------------------------------------------------------------------------------- 2025-08-11 02:10:30,336 - INFO - ================================================================================ 2025-08-11 02:10:30,336 - INFO - STARTING TEST : test_verify_process_status_analytics_node 2025-08-11 02:10:30,336 - INFO - TEST DESCRIPTION : Test to validate process_status-Analytics-Node 2025-08-11 02:10:30,941 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:30,941 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:30,941 - INFO - 2025-08-11 02:10:31,109 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-collector module connection to ['10.0.0.23:8086'] servers UP 2025-08-11 02:10:31,109 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP 2025-08-11 02:10:31,109 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP 2025-08-11 02:10:31,109 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-collector module connection to ['10.0.0.141:6379'] servers NOT UP 2025-08-11 02:10:31,109 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-11 02:10:31,109 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-collector module connection to ['10.0.0.23:9042'] servers UP 2025-08-11 02:10:31,146 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:31,146 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['10.0.0.38:8086'] servers UP 2025-08-11 02:10:31,146 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP 2025-08-11 02:10:31,146 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP 2025-08-11 02:10:31,146 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['10.0.0.141:6379'] servers NOT UP 2025-08-11 02:10:31,146 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-11 02:10:31,146 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-collector module connection to ['10.0.0.23:9042'] servers UP 2025-08-11 02:10:31,183 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:31,183 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-11 02:10:31,183 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.141:8086'] servers UP 2025-08-11 02:10:31,183 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP 2025-08-11 02:10:31,183 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP 2025-08-11 02:10:31,183 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.141:6379'] servers NOT UP 2025-08-11 02:10:31,183 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-11 02:10:31,183 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-collector module connection to ['10.0.0.23:9042'] servers UP 2025-08-11 02:10:31,222 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers UP 2025-08-11 02:10:31,255 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:31,256 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers UP 2025-08-11 02:10:31,292 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:31,292 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers UP 2025-08-11 02:10:31,328 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-analytics-nodemgr module connection to ['10.0.0.23:8086'] servers UP 2025-08-11 02:10:31,376 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2.:contrail-analytics-nodemgr module connection to ['10.0.0.23:8086'] servers UP 2025-08-11 02:10:31,413 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3.:contrail-analytics-nodemgr module connection to ['10.0.0.23:8086'] servers UP 2025-08-11 02:10:32,030 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:32,030 - INFO - END TEST : test_verify_process_status_analytics_node : PASSED[0:00:02] 2025-08-11 02:10:32,030 - INFO - -------------------------------------------------------------------------------- 2025-08-11 02:10:32,032 - INFO - ================================================================================ 2025-08-11 02:10:32,032 - INFO - STARTING TEST : test_verify_process_status_config 2025-08-11 02:10:32,032 - INFO - TEST DESCRIPTION : Test to validate process_status-Config 2025-08-11 02:10:32,647 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:32,647 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:32,647 - INFO - 2025-08-11 02:10:32,672 - WARNING - No object found for module contrail-device-manager 2025-08-11 02:10:32,695 - WARNING - No object found for module contrail-device-manager 2025-08-11 02:10:32,745 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.23:8086 servers NOT UP 2025-08-11 02:10:32,745 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.38:8086 servers NOT UP 2025-08-11 02:10:32,745 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.141:8086 servers UP 2025-08-11 02:10:32,745 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.23:2181 servers UP 2025-08-11 02:10:32,746 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.23:9161 servers NOT UP 2025-08-11 02:10:32,746 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.38:9161 servers NOT UP 2025-08-11 02:10:32,746 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to 10.0.0.141:9161 servers NOT UP 2025-08-11 02:10:32,746 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3794-1.*:9161 servers NOT UP 2025-08-11 02:10:32,746 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3794-2.*:9161 servers NOT UP 2025-08-11 02:10:32,747 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3794-3.*:9161 servers NOT UP 2025-08-11 02:10:33,367 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Mon Aug 11 02:10:32 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/analytics/test_analytics.py in test_verify_process_status_config(self=) 333 334 ''' 335 self.analytics_obj.verify_process_and_connection_infos_config() 336 337 @test.attr(type=['cb_sanity', 'sanity', 'dev_sanity_dpdk']) self = self.analytics_obj = self.analytics_obj.verify_process_and_connection_infos_config = > /contrail-test/tcutils/collector/analytics_tests.py in verify_process_and_connection_infos_config(self=) 4218 'contrail-api',\ 4219 server,node = cfgm) 4220 assert result 4221 result = False 4222 result = False AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/analytics/test_analytics.py", line 335, in test_verify_process_status_config self.analytics_obj.verify_process_and_connection_infos_config() File "/contrail-test/tcutils/collector/analytics_tests.py", line 4220, in verify_process_and_connection_infos_config assert result AssertionError 2025-08-11 02:10:33,381 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:33,381 - INFO - 2025-08-11 02:10:33,381 - INFO - END TEST : test_verify_process_status_config : FAILED[0:00:01] 2025-08-11 02:10:33,381 - INFO - -------------------------------------------------------------------------------- 2025-08-11 02:10:33,384 - INFO - ================================================================================ 2025-08-11 02:10:33,384 - INFO - STARTING TEST : test_verify_process_status_control_node 2025-08-11 02:10:33,384 - INFO - TEST DESCRIPTION : Test to validate process_status-Control-Node 2025-08-11 02:10:33,994 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-11 02:10:33,994 - INFO - Initial checks done. Running the testcase now 2025-08-11 02:10:33,994 - INFO - 2025-08-11 02:10:34,023 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1:contrail-control module connection to 10.0.0.23:9041 servers UP 2025-08-11 02:10:34,023 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1:contrail-control module connection to 10.0.0.23:5673 servers UP 2025-08-11 02:10:34,023 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1:contrail-control module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:34,025 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-1:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-11 02:10:34,025 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-1:contrail-control module connection to ['10.0.0.141:8086'] servers UP 2025-08-11 02:10:34,059 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2:contrail-control module connection to 10.0.0.23:9041 servers UP 2025-08-11 02:10:34,059 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2:contrail-control module connection to 10.0.0.23:5673 servers UP 2025-08-11 02:10:34,059 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2:contrail-control module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:34,059 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-2:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-11 02:10:34,059 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-2:contrail-control module connection to ['10.0.0.141:8086'] servers UP 2025-08-11 02:10:34,087 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3:contrail-control module connection to 10.0.0.23:9041 servers UP 2025-08-11 02:10:34,087 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3:contrail-control module connection to 10.0.0.23:5673 servers UP 2025-08-11 02:10:34,088 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3:contrail-control module connection to ['10.0.0.23:8086'] servers NOT UP 2025-08-11 02:10:34,088 - WARNING - cn-jenkins-deploy-platform-ansible-os-3794-3:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP 2025-08-11 02:10:34,088 - INFO - cn-jenkins-deploy-platform-ansible-os-3794-3:contrail-control module connection to ['10.0.0.141:8086'] servers UP 2025-08-11 02:10:34,717 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 02:10:34,718 - INFO - END TEST : test_verify_process_status_control_node : PASSED[0:00:01] 2025-08-11 02:10:34,718 - INFO - --------------------------------------------------------------------------------