2025-07-22 15:10:24,370 - INFO - Using existing project ['default-domain', 'admin'](68089ba1-97ae-492d-977e-83ce60694bc6)
2025-07-22 15:10:24,388 - INFO - ================================================================================
2025-07-22 15:10:24,388 - INFO - STARTING TEST : test_db_nodemgr_status
2025-07-22 15:10:24,389 - INFO - TEST DESCRIPTION : Test to verify db nodemgr status
2025-07-22 15:10:25,068 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:25,068 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:25,069 - INFO -
2025-07-22 15:10:25,069 - DEBUG - Verifying if db node_mgr running...
2025-07-22 15:10:25,069 - INFO - Verifying through collector 10.0.0.23 for db node cn-jenkins-deploy-platform-ansible-os-3693-1.
2025-07-22 15:10:25,069 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3693-1.?flat
2025-07-22 15:10:25,396 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3693-1.?flat
2025-07-22 15:10:25,490 - INFO - Verifying through collector 10.0.0.23 for db node cn-jenkins-deploy-platform-ansible-os-3693-2.
2025-07-22 15:10:25,490 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3693-2.?flat
2025-07-22 15:10:25,559 - INFO - Verifying through collector 10.0.0.23 for db node cn-jenkins-deploy-platform-ansible-os-3693-3.
2025-07-22 15:10:25,559 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3693-3.?flat
2025-07-22 15:10:26,287 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:26,287 - INFO - END TEST : test_db_nodemgr_status : PASSED[0:00:02]
2025-07-22 15:10:26,287 - INFO - --------------------------------------------------------------------------------
2025-07-22 15:10:26,291 - INFO - ================================================================================
2025-07-22 15:10:26,292 - INFO - STARTING TEST : test_verify_generator_collector_connections
2025-07-22 15:10:26,292 - INFO - TEST DESCRIPTION :
Description: Verify generator:module connections to collector
1.Verify all generators connected to collector - fails otherwise
2.Get the xmpp peers in vrouter uve and get the active xmpp peer out of it
3.Verify from agent introspect that active xmpp matches with step 2 - fails otherwise
4.Get bgp peers from bgp-peer uve and verify from control node introspect that that matches - fails otherwise
Maintainer: sandipd@juniper.net
2025-07-22 15:10:26,959 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:26,959 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:26,959 - INFO -
2025-07-22 15:10:26,967 - INFO - IP 10.0.0.254 port 8083 connected to collector 10.0.0.23
2025-07-22 15:10:26,973 - INFO - IP 10.0.0.50 port 8083 connected to collector 10.0.0.23
2025-07-22 15:10:26,980 - INFO - IP 10.0.0.23 port 8083 connected to collector 10.0.0.23
2025-07-22 15:10:26,984 - INFO - IP 10.0.0.254 port 8084 connected to collector 10.0.0.23
2025-07-22 15:10:26,989 - INFO - IP 10.0.0.50 port 8084 connected to collector 10.0.0.23
2025-07-22 15:10:26,994 - INFO - IP 10.0.0.23 port 8084 connected to collector 10.0.0.23
2025-07-22 15:10:26,998 - INFO - IP 10.0.0.254 port 8087 connected to collector 10.0.0.50
2025-07-22 15:10:27,003 - INFO - IP 10.0.0.254 port 8088 connected to collector 10.0.0.50
2025-07-22 15:10:27,007 - INFO - IP 10.0.0.254 port 8090 connected to collector 10.0.0.23
2025-07-22 15:10:27,011 - INFO - IP 10.0.0.50 port 8090 connected to collector 10.0.0.254
2025-07-22 15:10:27,016 - INFO - IP 10.0.0.23 port 8090 connected to collector 10.0.0.23
2025-07-22 15:10:27,030 - INFO - IP 10.0.0.254 port 8091 connected to collector 10.0.0.254
2025-07-22 15:10:27,043 - INFO - IP 10.0.0.50 port 8091 connected to collector 10.0.0.254
2025-07-22 15:10:27,053 - INFO - IP 10.0.0.23 port 8091 connected to collector 10.0.0.254
2025-07-22 15:10:27,053 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,172 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1:Control:contrail-control:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,173 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,264 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1:Control:contrail-dns:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,264 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,331 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2:Control:contrail-control:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,331 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,373 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2:Control:contrail-dns:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,373 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,431 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3:Control:contrail-control:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,431 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,469 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3:Control:contrail-dns:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,470 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,516 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3693-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,516 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,559 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3693-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,559 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,587 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Config:contrail-schema:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,587 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,620 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Config:contrail-svc-monitor:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,644 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,667 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Config:contrail-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,667 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,688 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Config:contrail-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,688 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,710 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Config:contrail-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,730 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,751 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,751 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,774 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,774 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,802 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,802 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,826 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,826 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,849 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,849 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,873 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,873 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,896 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,896 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,924 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,926 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,947 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,948 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:27,992 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.254
2025-07-22 15:10:27,992 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:28,038 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.254
2025-07-22 15:10:28,038 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:28,073 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.254
2025-07-22 15:10:28,073 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:28,110 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.254
2025-07-22 15:10:28,112 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:28,145 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.254
2025-07-22 15:10:28,146 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:28,182 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.254
2025-07-22 15:10:28,228 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3693-1?flat
2025-07-22 15:10:28,609 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3693-1?flat
2025-07-22 15:10:28,708 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3693-1 vrouter uve is 10.20.0.14
2025-07-22 15:10:28,733 - DEBUG - Requesting: http://10.20.0.25:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 15:10:28,747 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3693-1 agent introspect is 10.20.0.14
2025-07-22 15:10:28,788 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3693-2?flat
2025-07-22 15:10:28,827 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3693-2 vrouter uve is 10.20.0.14
2025-07-22 15:10:28,864 - DEBUG - Requesting: http://10.20.0.193:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-22 15:10:28,876 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3693-2 agent introspect is 10.20.0.14
2025-07-22 15:10:28,940 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3693-1?flat
2025-07-22 15:10:29,042 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3693-1 connected to {'10.20.0.14', '10.20.0.17'} xmpp peers out of {'10.20.0.14', '10.20.0.17', '10.20.0.254'}
2025-07-22 15:10:29,042 - INFO - xmpp peer correctly displayed as ['10.20.0.14', '10.20.0.17'] for vrouter an-jenkins-deploy-platform-ansible-os-3693-1
2025-07-22 15:10:29,094 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3693-2?flat
2025-07-22 15:10:29,133 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3693-2 connected to {'10.20.0.14', '10.20.0.254'} xmpp peers out of {'10.20.0.14', '10.20.0.17', '10.20.0.254'}
2025-07-22 15:10:29,134 - INFO - xmpp peer correctly displayed as ['10.20.0.14', '10.20.0.254'] for vrouter an-jenkins-deploy-platform-ansible-os-3693-2
2025-07-22 15:10:29,134 - INFO - Verifying through opserver in 10.0.0.23
2025-07-22 15:10:29,134 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3693-1?flat
2025-07-22 15:10:29,161 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3693-2?flat
2025-07-22 15:10:29,191 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3693-3?flat
2025-07-22 15:10:29,220 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3693-1?flat
2025-07-22 15:10:29,254 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3693-2?flat
2025-07-22 15:10:29,286 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3693-3?flat
2025-07-22 15:10:29,318 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3693-1 bgp-router uve
2025-07-22 15:10:29,318 - INFO - Bgp peers = 2
2025-07-22 15:10:29,318 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3693-2 bgp-router uve
2025-07-22 15:10:29,318 - INFO - Bgp peers = 2
2025-07-22 15:10:29,318 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3693-3 bgp-router uve
2025-07-22 15:10:29,318 - INFO - Bgp peers = 2
2025-07-22 15:10:29,318 - INFO - Total xmpp peer connections found = 4
2025-07-22 15:10:29,982 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:29,982 - INFO - END TEST : test_verify_generator_collector_connections : PASSED[0:00:03]
2025-07-22 15:10:29,982 - INFO - --------------------------------------------------------------------------------
2025-07-22 15:10:29,988 - INFO - ================================================================================
2025-07-22 15:10:29,988 - INFO - STARTING TEST : test_verify_generator_connections_to_collector_node
2025-07-22 15:10:29,988 - INFO - TEST DESCRIPTION : Test to validate generator connections
2025-07-22 15:10:30,642 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:30,642 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:30,642 - INFO -
2025-07-22 15:10:30,642 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,684 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3693-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,684 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,704 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3693-1:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,705 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,745 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3693-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,745 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,766 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3693-2:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,766 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,786 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,786 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,819 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,819 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,844 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,844 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,865 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,865 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,896 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,896 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,918 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,918 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,940 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,940 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,971 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,971 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:30,994 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:30,994 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,026 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,026 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,047 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,047 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,077 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,078 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,100 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,100 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,130 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,131 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,153 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,153 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,175 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1.:Config:contrail-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,176 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,196 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2.:Config:contrail-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,196 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,224 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3.:Config:contrail-api:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,224 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,271 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1:Control:contrail-control:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,271 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,297 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,297 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,339 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-1:Control:contrail-dns:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,339 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,388 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2:Control:contrail-control:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,388 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,409 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,409 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,442 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-2:Control:contrail-dns:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,443 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,498 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3:Control:contrail-control:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,498 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,518 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.254
2025-07-22 15:10:31,518 - DEBUG - Verifying through opserver in 10.0.0.254
2025-07-22 15:10:31,562 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3693-3:Control:contrail-dns:0 is connected to collector 10.0.0.254
2025-07-22 15:10:32,216 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:32,216 - INFO - END TEST : test_verify_generator_connections_to_collector_node : PASSED[0:00:03]
2025-07-22 15:10:32,216 - INFO - --------------------------------------------------------------------------------
2025-07-22 15:10:32,218 - INFO - ================================================================================
2025-07-22 15:10:32,218 - INFO - STARTING TEST : test_verify_process_status_agent
2025-07-22 15:10:32,218 - INFO - TEST DESCRIPTION : Test to validate process_status
2025-07-22 15:10:32,865 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:32,865 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:32,865 - INFO -
2025-07-22 15:10:32,913 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.20.0.17:5269'] servers UP
2025-07-22 15:10:32,914 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1 connected to xmpp 10.20.0.17
2025-07-22 15:10:32,915 - WARNING - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.20.0.254:5269'] servers NOT UP
2025-07-22 15:10:32,915 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.20.0.14:5269'] servers UP
2025-07-22 15:10:32,915 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1 connected to xmpp 10.20.0.14
2025-07-22 15:10:32,915 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.20.0.17:53'] servers UP
2025-07-22 15:10:32,915 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1 connected to dns 10.20.0.17
2025-07-22 15:10:32,915 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.20.0.254:53'] servers UP
2025-07-22 15:10:32,915 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1 connected to dns 10.20.0.254
2025-07-22 15:10:32,915 - WARNING - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.20.0.14:53'] servers NOT UP
2025-07-22 15:10:32,916 - WARNING - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:32,916 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.0.0.50:8086'] servers UP
2025-07-22 15:10:32,916 - INFO - an-jenkins-deploy-platform-ansible-os-3693-1 connected to collector 10.0.0.50
2025-07-22 15:10:32,916 - WARNING - an-jenkins-deploy-platform-ansible-os-3693-1:contrail-vrouter-agent module connection to ['10.0.0.23:8086'] servers NOT UP
2025-07-22 15:10:33,562 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:33,562 - INFO - END TEST : test_verify_process_status_agent : PASSED[0:00:01]
2025-07-22 15:10:33,562 - INFO - --------------------------------------------------------------------------------
2025-07-22 15:10:33,564 - INFO - ================================================================================
2025-07-22 15:10:33,564 - INFO - STARTING TEST : test_verify_process_status_analytics_node
2025-07-22 15:10:33,565 - INFO - TEST DESCRIPTION : Test to validate process_status-Analytics-Node
2025-07-22 15:10:34,209 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:34,209 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:34,210 - INFO -
2025-07-22 15:10:34,504 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-collector module connection to ['10.0.0.254:8086'] servers UP
2025-07-22 15:10:34,504 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-collector module connection to ['10.0.0.254:6379'] servers NOT UP
2025-07-22 15:10:34,504 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-collector module connection to ['10.0.0.50:6379'] servers NOT UP
2025-07-22 15:10:34,507 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP
2025-07-22 15:10:34,507 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-22 15:10:34,507 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-collector module connection to ['10.0.0.254:9042'] servers UP
2025-07-22 15:10:34,582 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:34,582 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['10.0.0.50:8086'] servers UP
2025-07-22 15:10:34,582 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['10.0.0.254:6379'] servers NOT UP
2025-07-22 15:10:34,586 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['10.0.0.50:6379'] servers NOT UP
2025-07-22 15:10:34,587 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP
2025-07-22 15:10:34,587 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-22 15:10:34,587 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-collector module connection to ['10.0.0.254:9042'] servers UP
2025-07-22 15:10:34,641 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:34,641 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.50:8086'] servers NOT UP
2025-07-22 15:10:34,641 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.23:8086'] servers UP
2025-07-22 15:10:34,641 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.254:6379'] servers NOT UP
2025-07-22 15:10:34,642 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.50:6379'] servers NOT UP
2025-07-22 15:10:34,642 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.23:6379'] servers NOT UP
2025-07-22 15:10:34,642 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP
2025-07-22 15:10:34,642 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-collector module connection to ['10.0.0.254:9042'] servers UP
2025-07-22 15:10:34,733 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-analytics-api module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:34,733 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-analytics-api module connection to ['10.0.0.50:8086'] servers NOT UP
2025-07-22 15:10:34,733 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers UP
2025-07-22 15:10:34,788 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-analytics-api module connection to ['10.0.0.254:8086'] servers UP
2025-07-22 15:10:34,834 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-analytics-api module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:34,834 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-analytics-api module connection to ['10.0.0.50:8086'] servers NOT UP
2025-07-22 15:10:34,834 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-analytics-api module connection to ['10.0.0.23:8086'] servers UP
2025-07-22 15:10:34,881 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-analytics-nodemgr module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:34,881 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-analytics-nodemgr module connection to ['10.0.0.50:8086'] servers UP
2025-07-22 15:10:34,936 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-analytics-nodemgr module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:34,936 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2.:contrail-analytics-nodemgr module connection to ['10.0.0.50:8086'] servers UP
2025-07-22 15:10:34,981 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3.:contrail-analytics-nodemgr module connection to ['10.0.0.254:8086'] servers UP
2025-07-22 15:10:35,626 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:35,626 - INFO - END TEST : test_verify_process_status_analytics_node : PASSED[0:00:02]
2025-07-22 15:10:35,626 - INFO - --------------------------------------------------------------------------------
2025-07-22 15:10:35,632 - INFO - ================================================================================
2025-07-22 15:10:35,632 - INFO - STARTING TEST : test_verify_process_status_config
2025-07-22 15:10:35,632 - INFO - TEST DESCRIPTION : Test to validate process_status-Config
2025-07-22 15:10:36,269 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:36,269 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:36,269 - INFO -
2025-07-22 15:10:36,337 - WARNING - No object found for module contrail-device-manager
2025-07-22 15:10:36,364 - WARNING - No object found for module contrail-device-manager
2025-07-22 15:10:36,403 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.254:8086 servers NOT UP
2025-07-22 15:10:36,403 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.50:8086 servers NOT UP
2025-07-22 15:10:36,403 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.23:8086 servers UP
2025-07-22 15:10:36,404 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.254:2181 servers UP
2025-07-22 15:10:36,404 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.254:9161 servers NOT UP
2025-07-22 15:10:36,405 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.50:9161 servers NOT UP
2025-07-22 15:10:36,405 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to 10.0.0.23:9161 servers NOT UP
2025-07-22 15:10:36,405 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3693-1.*:9161 servers NOT UP
2025-07-22 15:10:36,406 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3693-2.*:9161 servers NOT UP
2025-07-22 15:10:36,407 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3693-3.*:9161 servers NOT UP
2025-07-22 15:10:37,051 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Tue Jul 22 15:10:36 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/analytics/test_analytics.py in test_verify_process_status_config(self=)
333
334 '''
335 self.analytics_obj.verify_process_and_connection_infos_config()
336
337 @test.attr(type=['cb_sanity', 'sanity', 'dev_sanity_dpdk'])
self =
self.analytics_obj =
self.analytics_obj.verify_process_and_connection_infos_config = >
/contrail-test/tcutils/collector/analytics_tests.py in verify_process_and_connection_infos_config(self=)
4218 'contrail-api',\
4219 server,node = cfgm)
4220 assert result
4221 result = False
4222
result = False
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/analytics/test_analytics.py", line 335, in test_verify_process_status_config
self.analytics_obj.verify_process_and_connection_infos_config()
File "/contrail-test/tcutils/collector/analytics_tests.py", line 4220, in verify_process_and_connection_infos_config
assert result
AssertionError
2025-07-22 15:10:37,066 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:37,066 - INFO -
2025-07-22 15:10:37,067 - INFO - END TEST : test_verify_process_status_config : FAILED[0:00:02]
2025-07-22 15:10:37,067 - INFO - --------------------------------------------------------------------------------
2025-07-22 15:10:37,069 - INFO - ================================================================================
2025-07-22 15:10:37,070 - INFO - STARTING TEST : test_verify_process_status_control_node
2025-07-22 15:10:37,070 - INFO - TEST DESCRIPTION : Test to validate process_status-Control-Node
2025-07-22 15:10:37,714 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 15:10:37,714 - INFO - Initial checks done. Running the testcase now
2025-07-22 15:10:37,714 - INFO -
2025-07-22 15:10:37,741 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1:contrail-control module connection to 10.0.0.254:9041 servers UP
2025-07-22 15:10:37,741 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1:contrail-control module connection to 10.0.0.254:5673 servers UP
2025-07-22 15:10:37,741 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1:contrail-control module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:37,741 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-1:contrail-control module connection to ['10.0.0.50:8086'] servers NOT UP
2025-07-22 15:10:37,741 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-1:contrail-control module connection to ['10.0.0.23:8086'] servers UP
2025-07-22 15:10:37,765 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2:contrail-control module connection to 10.0.0.254:9041 servers UP
2025-07-22 15:10:37,765 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2:contrail-control module connection to 10.0.0.254:5673 servers UP
2025-07-22 15:10:37,766 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2:contrail-control module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:37,766 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-2:contrail-control module connection to ['10.0.0.50:8086'] servers NOT UP
2025-07-22 15:10:37,766 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-2:contrail-control module connection to ['10.0.0.23:8086'] servers UP
2025-07-22 15:10:37,789 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3:contrail-control module connection to 10.0.0.254:9041 servers UP
2025-07-22 15:10:37,789 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3:contrail-control module connection to 10.0.0.254:5673 servers UP
2025-07-22 15:10:37,789 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3:contrail-control module connection to ['10.0.0.254:8086'] servers NOT UP
2025-07-22 15:10:37,789 - WARNING - cn-jenkins-deploy-platform-ansible-os-3693-3:contrail-control module connection to ['10.0.0.50:8086'] servers NOT UP
2025-07-22 15:10:37,789 - INFO - cn-jenkins-deploy-platform-ansible-os-3693-3:contrail-control module connection to ['10.0.0.23:8086'] servers UP
2025-07-22 15:10:38,442 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 15:10:38,442 - INFO - END TEST : test_verify_process_status_control_node : PASSED[0:00:01]
2025-07-22 15:10:38,442 - INFO - --------------------------------------------------------------------------------