2025-07-31 02:37:08,501 - INFO - Using existing project ['default-domain', 'admin'](2761afbf-24b2-4f6f-abe2-e910af9609e1)
2025-07-31 02:37:08,544 - INFO - ================================================================================
2025-07-31 02:37:08,544 - INFO - STARTING TEST : test_db_nodemgr_status
2025-07-31 02:37:08,544 - INFO - TEST DESCRIPTION : Test to verify db nodemgr status
2025-07-31 02:37:09,299 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:09,299 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:09,301 - INFO -
2025-07-31 02:37:09,302 - DEBUG - Verifying if db node_mgr running...
2025-07-31 02:37:09,303 - INFO - Verifying through collector 10.0.0.61 for db node cn-jenkins-deploy-platform-ansible-os-3732-1.
2025-07-31 02:37:09,305 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:09,701 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:09,792 - INFO - Verifying through collector 10.0.0.61 for db node cn-jenkins-deploy-platform-ansible-os-3732-2.
2025-07-31 02:37:09,793 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat
2025-07-31 02:37:09,872 - INFO - Verifying through collector 10.0.0.61 for db node cn-jenkins-deploy-platform-ansible-os-3732-3.
2025-07-31 02:37:09,872 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat
2025-07-31 02:37:10,613 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:10,613 - INFO - END TEST : test_db_nodemgr_status : PASSED[0:00:02]
2025-07-31 02:37:10,613 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:10,616 - INFO - ================================================================================
2025-07-31 02:37:10,616 - INFO - STARTING TEST : test_verify_generator_collector_connections
2025-07-31 02:37:10,616 - INFO - TEST DESCRIPTION :
Description: Verify generator:module connections to collector
1.Verify all generators connected to collector - fails otherwise
2.Get the xmpp peers in vrouter uve and get the active xmpp peer out of it
3.Verify from agent introspect that active xmpp matches with step 2 - fails otherwise
4.Get bgp peers from bgp-peer uve and verify from control node introspect that that matches - fails otherwise
Maintainer: sandipd@juniper.net
2025-07-31 02:37:11,272 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:11,272 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:11,272 - INFO -
2025-07-31 02:37:11,284 - INFO - IP 10.0.0.41 port 8083 connected to collector 10.0.0.61
2025-07-31 02:37:11,291 - INFO - IP 10.0.0.38 port 8083 connected to collector 10.0.0.61
2025-07-31 02:37:11,303 - INFO - IP 10.0.0.61 port 8083 connected to collector 10.0.0.61
2025-07-31 02:37:11,308 - INFO - IP 10.0.0.41 port 8084 connected to collector 10.0.0.61
2025-07-31 02:37:11,313 - INFO - IP 10.0.0.38 port 8084 connected to collector 10.0.0.61
2025-07-31 02:37:11,318 - INFO - IP 10.0.0.61 port 8084 connected to collector 10.0.0.61
2025-07-31 02:37:11,328 - INFO - IP 10.0.0.61 port 8087 connected to collector 10.0.0.38
2025-07-31 02:37:11,338 - INFO - IP 10.0.0.61 port 8088 connected to collector 10.0.0.61
2025-07-31 02:37:11,342 - INFO - IP 10.0.0.41 port 8090 connected to collector 10.0.0.61
2025-07-31 02:37:11,346 - INFO - IP 10.0.0.38 port 8090 connected to collector 10.0.0.38
2025-07-31 02:37:11,352 - INFO - IP 10.0.0.61 port 8090 connected to collector 10.0.0.38
2025-07-31 02:37:11,361 - INFO - IP 10.0.0.41 port 8091 connected to collector 10.0.0.61
2025-07-31 02:37:11,374 - INFO - IP 10.0.0.38 port 8091 connected to collector 10.0.0.61
2025-07-31 02:37:11,382 - INFO - IP 10.0.0.61 port 8091 connected to collector 10.0.0.61
2025-07-31 02:37:11,382 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,475 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,475 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,554 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-dns:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,554 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,613 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,613 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,650 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-dns:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,650 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,701 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,701 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,732 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-dns:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,732 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,774 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,774 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,816 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,816 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,838 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-schema:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,838 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,864 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-svc-monitor:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,885 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,906 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,906 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,932 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Config:contrail-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,932 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:11,958 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Config:contrail-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:11,983 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,007 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,007 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,030 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,031 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,054 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,054 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,089 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,089 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,112 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,112 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,137 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,137 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,164 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,164 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,185 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,185 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,205 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,205 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,242 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,242 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,270 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,270 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,305 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,305 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,335 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,335 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,376 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,377 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:12,405 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.41
2025-07-31 02:37:12,443 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat
2025-07-31 02:37:12,478 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3732-1 vrouter uve is 10.20.0.193
2025-07-31 02:37:12,503 - DEBUG - Requesting: http://10.20.0.192:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 02:37:12,516 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3732-1 agent introspect is 10.20.0.193
2025-07-31 02:37:12,594 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat
2025-07-31 02:37:12,646 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3732-2 vrouter uve is 10.20.0.18
2025-07-31 02:37:12,683 - DEBUG - Requesting: http://10.20.0.201:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 02:37:12,703 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3732-2 agent introspect is 10.20.0.18
2025-07-31 02:37:12,784 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat
2025-07-31 02:37:12,852 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3732-1 connected to {'10.20.0.18', '10.20.0.193'} xmpp peers out of {'10.20.0.18', '10.20.0.193', '10.20.0.25'}
2025-07-31 02:37:12,852 - INFO - xmpp peer correctly displayed as ['10.20.0.193', '10.20.0.18'] for vrouter an-jenkins-deploy-platform-ansible-os-3732-1
2025-07-31 02:37:12,940 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat
2025-07-31 02:37:12,992 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3732-2 connected to {'10.20.0.18', '10.20.0.193'} xmpp peers out of {'10.20.0.18', '10.20.0.193', '10.20.0.25'}
2025-07-31 02:37:12,993 - INFO - xmpp peer correctly displayed as ['10.20.0.18', '10.20.0.193'] for vrouter an-jenkins-deploy-platform-ansible-os-3732-2
2025-07-31 02:37:12,993 - INFO - Verifying through opserver in 10.0.0.61
2025-07-31 02:37:12,993 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-1?flat
2025-07-31 02:37:13,030 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-2?flat
2025-07-31 02:37:13,078 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-3?flat
2025-07-31 02:37:13,123 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-1?flat
2025-07-31 02:37:13,162 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-2?flat
2025-07-31 02:37:13,210 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-3?flat
2025-07-31 02:37:13,246 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3732-1 bgp-router uve
2025-07-31 02:37:13,246 - INFO - Bgp peers = 2
2025-07-31 02:37:13,246 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3732-2 bgp-router uve
2025-07-31 02:37:13,247 - INFO - Bgp peers = 2
2025-07-31 02:37:13,247 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3732-3 bgp-router uve
2025-07-31 02:37:13,247 - INFO - Bgp peers = 2
2025-07-31 02:37:13,247 - INFO - Total xmpp peer connections found = 4
2025-07-31 02:37:14,011 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:14,011 - INFO - END TEST : test_verify_generator_collector_connections : PASSED[0:00:04]
2025-07-31 02:37:14,012 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:14,023 - INFO - ================================================================================
2025-07-31 02:37:14,023 - INFO - STARTING TEST : test_verify_generator_connections_to_collector_node
2025-07-31 02:37:14,024 - INFO - TEST DESCRIPTION : Test to validate generator connections
2025-07-31 02:37:14,775 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:14,775 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:14,776 - INFO -
2025-07-31 02:37:14,776 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:14,864 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.41
2025-07-31 02:37:14,864 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:14,890 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:14,890 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:14,929 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.41
2025-07-31 02:37:14,929 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:14,953 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:14,953 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:14,975 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:14,976 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,021 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,022 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,050 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,050 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,075 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,075 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,127 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,128 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,161 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,161 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,192 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,192 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,238 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,238 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,275 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,275 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,318 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,319 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,348 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,349 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,389 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,389 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,424 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,424 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,465 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,465 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,496 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,496 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,531 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,531 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,560 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2.:Config:contrail-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,560 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,597 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3.:Config:contrail-api:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,597 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,647 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,648 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,671 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,671 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,708 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-dns:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,708 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,770 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,770 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,792 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,792 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,829 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-dns:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,830 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,887 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,888 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,920 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.41
2025-07-31 02:37:15,920 - DEBUG - Verifying through opserver in 10.0.0.41
2025-07-31 02:37:15,948 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-dns:0 is connected to collector 10.0.0.41
2025-07-31 02:37:16,672 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:16,673 - INFO - END TEST : test_verify_generator_connections_to_collector_node : PASSED[0:00:02]
2025-07-31 02:37:16,673 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:16,681 - INFO - ================================================================================
2025-07-31 02:37:16,681 - INFO - STARTING TEST : test_verify_process_status_agent
2025-07-31 02:37:16,681 - INFO - TEST DESCRIPTION : Test to validate process_status
2025-07-31 02:37:17,443 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:17,443 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:17,443 - INFO -
2025-07-31 02:37:17,540 - WARNING - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.20.0.25:5269'] servers NOT UP
2025-07-31 02:37:17,540 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.20.0.193:5269'] servers UP
2025-07-31 02:37:17,540 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1 connected to xmpp 10.20.0.193
2025-07-31 02:37:17,541 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.20.0.18:5269'] servers UP
2025-07-31 02:37:17,542 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1 connected to xmpp 10.20.0.18
2025-07-31 02:37:17,542 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.20.0.25:53'] servers UP
2025-07-31 02:37:17,542 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1 connected to dns 10.20.0.25
2025-07-31 02:37:17,542 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.20.0.193:53'] servers UP
2025-07-31 02:37:17,543 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1 connected to dns 10.20.0.193
2025-07-31 02:37:17,543 - WARNING - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.20.0.18:53'] servers NOT UP
2025-07-31 02:37:17,543 - WARNING - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:17,543 - WARNING - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:17,543 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1:contrail-vrouter-agent module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:17,544 - INFO - an-jenkins-deploy-platform-ansible-os-3732-1 connected to collector 10.0.0.61
2025-07-31 02:37:18,311 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:18,311 - INFO - END TEST : test_verify_process_status_agent : PASSED[0:00:02]
2025-07-31 02:37:18,312 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:18,320 - INFO - ================================================================================
2025-07-31 02:37:18,320 - INFO - STARTING TEST : test_verify_process_status_analytics_node
2025-07-31 02:37:18,321 - INFO - TEST DESCRIPTION : Test to validate process_status-Analytics-Node
2025-07-31 02:37:19,073 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:19,073 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:19,073 - INFO -
2025-07-31 02:37:19,472 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-collector module connection to ['10.0.0.41:8086'] servers UP
2025-07-31 02:37:19,472 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-collector module connection to ['10.0.0.41:6379'] servers NOT UP
2025-07-31 02:37:19,473 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP
2025-07-31 02:37:19,473 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-collector module connection to ['10.0.0.61:6379'] servers NOT UP
2025-07-31 02:37:19,474 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-31 02:37:19,474 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-collector module connection to ['10.0.0.41:9042'] servers UP
2025-07-31 02:37:19,550 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:19,551 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['10.0.0.38:8086'] servers UP
2025-07-31 02:37:19,551 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['10.0.0.41:6379'] servers NOT UP
2025-07-31 02:37:19,552 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP
2025-07-31 02:37:19,552 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['10.0.0.61:6379'] servers NOT UP
2025-07-31 02:37:19,552 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-31 02:37:19,552 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-collector module connection to ['10.0.0.41:9042'] servers UP
2025-07-31 02:37:19,649 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:19,649 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:19,649 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:19,649 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.41:6379'] servers NOT UP
2025-07-31 02:37:19,649 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.38:6379'] servers NOT UP
2025-07-31 02:37:19,649 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.61:6379'] servers NOT UP
2025-07-31 02:37:19,649 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-31 02:37:19,649 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-collector module connection to ['10.0.0.41:9042'] servers UP
2025-07-31 02:37:19,698 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-analytics-api module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:19,698 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:19,698 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-analytics-api module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:19,740 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-analytics-api module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:19,741 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers UP
2025-07-31 02:37:19,804 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-analytics-api module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:19,804 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-analytics-api module connection to ['10.0.0.38:8086'] servers UP
2025-07-31 02:37:19,889 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-analytics-nodemgr module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:19,889 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-analytics-nodemgr module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:19,889 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-analytics-nodemgr module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:19,951 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2.:contrail-analytics-nodemgr module connection to ['10.0.0.41:8086'] servers UP
2025-07-31 02:37:20,023 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3.:contrail-analytics-nodemgr module connection to ['10.0.0.41:8086'] servers UP
2025-07-31 02:37:20,766 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:20,766 - INFO - END TEST : test_verify_process_status_analytics_node : PASSED[0:00:02]
2025-07-31 02:37:20,766 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:20,771 - INFO - ================================================================================
2025-07-31 02:37:20,772 - INFO - STARTING TEST : test_verify_process_status_config
2025-07-31 02:37:20,773 - INFO - TEST DESCRIPTION : Test to validate process_status-Config
2025-07-31 02:37:21,477 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:21,477 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:21,477 - INFO -
2025-07-31 02:37:21,513 - WARNING - No object found for module contrail-device-manager
2025-07-31 02:37:21,555 - WARNING - No object found for module contrail-device-manager
2025-07-31 02:37:21,621 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.41:8086 servers NOT UP
2025-07-31 02:37:21,621 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.38:8086 servers NOT UP
2025-07-31 02:37:21,622 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.61:8086 servers UP
2025-07-31 02:37:21,623 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.41:2181 servers UP
2025-07-31 02:37:21,623 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.41:9161 servers NOT UP
2025-07-31 02:37:21,623 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.38:9161 servers NOT UP
2025-07-31 02:37:21,623 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to 10.0.0.61:9161 servers NOT UP
2025-07-31 02:37:21,624 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3732-1.*:9161 servers NOT UP
2025-07-31 02:37:21,624 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3732-2.*:9161 servers NOT UP
2025-07-31 02:37:21,625 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3732-3.*:9161 servers NOT UP
2025-07-31 02:37:22,279 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Thu Jul 31 02:37:21 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/analytics/test_analytics.py in test_verify_process_status_config(self=)
333
334 '''
335 self.analytics_obj.verify_process_and_connection_infos_config()
336
337 @test.attr(type=['cb_sanity', 'sanity', 'dev_sanity_dpdk'])
self =
self.analytics_obj =
self.analytics_obj.verify_process_and_connection_infos_config = >
/contrail-test/tcutils/collector/analytics_tests.py in verify_process_and_connection_infos_config(self=)
4218 'contrail-api',\
4219 server,node = cfgm)
4220 assert result
4221 result = False
4222
result = False
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/analytics/test_analytics.py", line 335, in test_verify_process_status_config
self.analytics_obj.verify_process_and_connection_infos_config()
File "/contrail-test/tcutils/collector/analytics_tests.py", line 4220, in verify_process_and_connection_infos_config
assert result
AssertionError
2025-07-31 02:37:22,309 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:22,309 - INFO -
2025-07-31 02:37:22,309 - INFO - END TEST : test_verify_process_status_config : FAILED[0:00:02]
2025-07-31 02:37:22,309 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:22,313 - INFO - ================================================================================
2025-07-31 02:37:22,313 - INFO - STARTING TEST : test_verify_process_status_control_node
2025-07-31 02:37:22,313 - INFO - TEST DESCRIPTION : Test to validate process_status-Control-Node
2025-07-31 02:37:23,072 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:23,072 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:23,072 - INFO -
2025-07-31 02:37:23,127 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1:contrail-control module connection to 10.0.0.41:9041 servers UP
2025-07-31 02:37:23,127 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1:contrail-control module connection to 10.0.0.41:5673 servers UP
2025-07-31 02:37:23,128 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1:contrail-control module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:23,128 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-1:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:23,128 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-1:contrail-control module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:23,179 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2:contrail-control module connection to 10.0.0.41:9041 servers UP
2025-07-31 02:37:23,180 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2:contrail-control module connection to 10.0.0.41:5673 servers UP
2025-07-31 02:37:23,180 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2:contrail-control module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:23,180 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-2:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:23,180 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-2:contrail-control module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:23,231 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3:contrail-control module connection to 10.0.0.41:9041 servers UP
2025-07-31 02:37:23,232 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3:contrail-control module connection to 10.0.0.41:5673 servers UP
2025-07-31 02:37:23,232 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3:contrail-control module connection to ['10.0.0.41:8086'] servers NOT UP
2025-07-31 02:37:23,232 - WARNING - cn-jenkins-deploy-platform-ansible-os-3732-3:contrail-control module connection to ['10.0.0.38:8086'] servers NOT UP
2025-07-31 02:37:23,233 - INFO - cn-jenkins-deploy-platform-ansible-os-3732-3:contrail-control module connection to ['10.0.0.61:8086'] servers UP
2025-07-31 02:37:23,978 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:23,978 - INFO - END TEST : test_verify_process_status_control_node : PASSED[0:00:01]
2025-07-31 02:37:23,978 - INFO - --------------------------------------------------------------------------------