2025-08-06 07:30:50,353 - INFO - Using existing project ['default-domain', 'admin'](adb0a682-d2c0-454a-9f6b-407a61f242d6) 2025-08-06 07:30:50,364 - INFO - ================================================================================ 2025-08-06 07:30:50,368 - INFO - STARTING TEST : test_contrail_alarms 2025-08-06 07:30:50,368 - INFO - TEST DESCRIPTION : Test to check if alarms are present 2025-08-06 07:30:51,088 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-08-06 07:30:51,088 - INFO - Initial checks done. Running the testcase now 2025-08-06 07:30:51,088 - INFO - 2025-08-06 07:30:51,088 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/alarms 2025-08-06 07:30:51,478 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/alarms 2025-08-06 07:30:52,260 - DEBUG - No XMPP flaps were noticed during the test 2025-08-06 07:30:52,260 - INFO - END TEST : test_contrail_alarms : PASSED[0:00:02] 2025-08-06 07:30:52,260 - INFO - -------------------------------------------------------------------------------- 2025-08-06 07:30:52,263 - INFO - ================================================================================ 2025-08-06 07:30:52,263 - INFO - STARTING TEST : test_contrail_status 2025-08-06 07:30:52,263 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-06 07:30:52,947 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-08-06 07:30:52,947 - INFO - Initial checks done. Running the testcase now 2025-08-06 07:30:52,947 - INFO - 2025-08-06 07:30:53,046 - INFO - 10.0.0.48 2025-08-06 07:30:53,046 - INFO - config 2025-08-06 07:30:53,053 - INFO - config-nodemgr:active 2025-08-06 07:30:53,062 - INFO - api-server:active 2025-08-06 07:30:53,068 - INFO - schema:backup 2025-08-06 07:30:53,073 - INFO - svc-monitor:backup 2025-08-06 07:30:53,079 - INFO - device-manager:backup 2025-08-06 07:30:53,079 - INFO - config-database 2025-08-06 07:30:53,079 - INFO - config-cassandra:active 2025-08-06 07:30:53,080 - INFO - config-zookeeper:active 2025-08-06 07:30:53,080 - INFO - config-rabbitmq:active 2025-08-06 07:30:53,080 - INFO - control 2025-08-06 07:30:53,086 - INFO - control-nodemgr:active 2025-08-06 07:30:53,093 - INFO - control:active 2025-08-06 07:30:53,093 - INFO - named:active 2025-08-06 07:30:53,099 - INFO - dns:active 2025-08-06 07:30:53,099 - INFO - analytics 2025-08-06 07:30:53,105 - INFO - analytics-nodemgr:active 2025-08-06 07:30:53,110 - INFO - analytics-api:active 2025-08-06 07:30:53,116 - INFO - collector:active 2025-08-06 07:30:53,117 - INFO - analytics-database 2025-08-06 07:30:53,117 - INFO - analytics-cassandra:active 2025-08-06 07:30:53,123 - INFO - analyticsdb-nodemgr:active 2025-08-06 07:30:53,133 - INFO - query-engine:active 2025-08-06 07:30:53,133 - INFO - webui 2025-08-06 07:30:53,133 - INFO - webui:active 2025-08-06 07:30:53,133 - INFO - webui-middleware:active 2025-08-06 07:30:53,133 - INFO - redis:active 2025-08-06 07:30:53,133 - INFO - analytics_snmp 2025-08-06 07:30:53,140 - INFO - snmp-collector:active 2025-08-06 07:30:53,140 - INFO - snmp-topology:active 2025-08-06 07:30:53,140 - INFO - analytics_alarm 2025-08-06 07:30:53,141 - INFO - alarmgen:active 2025-08-06 07:30:53,208 - INFO - 10.0.0.254 2025-08-06 07:30:53,208 - INFO - config 2025-08-06 07:30:53,215 - INFO - config-nodemgr:active 2025-08-06 07:30:53,223 - INFO - api-server:active 2025-08-06 07:30:53,233 - INFO - schema:backup 2025-08-06 07:30:53,243 - INFO - svc-monitor:active 2025-08-06 07:30:53,247 - INFO - device-manager:backup 2025-08-06 07:30:53,248 - INFO - config-database 2025-08-06 07:30:53,248 - INFO - config-cassandra:active 2025-08-06 07:30:53,248 - INFO - config-zookeeper:active 2025-08-06 07:30:53,248 - INFO - config-rabbitmq:active 2025-08-06 07:30:53,248 - INFO - control 2025-08-06 07:30:53,262 - INFO - control-nodemgr:active 2025-08-06 07:30:53,271 - INFO - control:active 2025-08-06 07:30:53,271 - INFO - named:active 2025-08-06 07:30:53,279 - INFO - dns:active 2025-08-06 07:30:53,279 - INFO - analytics 2025-08-06 07:30:53,287 - INFO - analytics-nodemgr:active 2025-08-06 07:30:53,297 - INFO - analytics-api:active 2025-08-06 07:30:53,303 - INFO - collector:active 2025-08-06 07:30:53,303 - INFO - analytics-database 2025-08-06 07:30:53,304 - INFO - analytics-cassandra:active 2025-08-06 07:30:53,311 - INFO - analyticsdb-nodemgr:active 2025-08-06 07:30:53,320 - INFO - query-engine:active 2025-08-06 07:30:53,320 - INFO - webui 2025-08-06 07:30:53,320 - INFO - webui:active 2025-08-06 07:30:53,320 - INFO - webui-middleware:active 2025-08-06 07:30:53,320 - INFO - redis:active 2025-08-06 07:30:53,320 - INFO - analytics_snmp 2025-08-06 07:30:53,327 - INFO - snmp-collector:active 2025-08-06 07:30:53,330 - INFO - snmp-topology:active 2025-08-06 07:30:53,330 - INFO - analytics_alarm 2025-08-06 07:30:53,330 - INFO - alarmgen:active 2025-08-06 07:30:53,394 - INFO - 10.0.0.38 2025-08-06 07:30:53,395 - INFO - config 2025-08-06 07:30:53,402 - INFO - config-nodemgr:active 2025-08-06 07:30:53,407 - INFO - api-server:active 2025-08-06 07:30:53,412 - INFO - schema:active 2025-08-06 07:30:53,416 - INFO - svc-monitor:backup 2025-08-06 07:30:53,421 - INFO - device-manager:active 2025-08-06 07:30:53,421 - INFO - config-database 2025-08-06 07:30:53,421 - INFO - config-cassandra:active 2025-08-06 07:30:53,421 - INFO - config-zookeeper:active 2025-08-06 07:30:53,421 - INFO - config-rabbitmq:active 2025-08-06 07:30:53,421 - INFO - control 2025-08-06 07:30:53,427 - INFO - control-nodemgr:active 2025-08-06 07:30:53,439 - INFO - control:active 2025-08-06 07:30:53,439 - INFO - named:active 2025-08-06 07:30:53,451 - INFO - dns:active 2025-08-06 07:30:53,452 - INFO - analytics 2025-08-06 07:30:53,466 - INFO - analytics-nodemgr:active 2025-08-06 07:30:53,475 - INFO - analytics-api:active 2025-08-06 07:30:53,489 - INFO - collector:active 2025-08-06 07:30:53,490 - INFO - analytics-database 2025-08-06 07:30:53,490 - INFO - analytics-cassandra:active 2025-08-06 07:30:53,498 - INFO - analyticsdb-nodemgr:active 2025-08-06 07:30:53,504 - INFO - query-engine:active 2025-08-06 07:30:53,504 - INFO - webui 2025-08-06 07:30:53,504 - INFO - webui:active 2025-08-06 07:30:53,505 - INFO - webui-middleware:active 2025-08-06 07:30:53,505 - INFO - redis:active 2025-08-06 07:30:53,505 - INFO - analytics_snmp 2025-08-06 07:30:53,510 - INFO - snmp-collector:active 2025-08-06 07:30:53,511 - INFO - snmp-topology:active 2025-08-06 07:30:53,511 - INFO - analytics_alarm 2025-08-06 07:30:53,512 - INFO - alarmgen:active 2025-08-06 07:30:53,565 - INFO - 10.0.0.49 2025-08-06 07:30:53,566 - INFO - vrouter 2025-08-06 07:30:53,575 - INFO - vrouter-nodemgr:active 2025-08-06 07:30:53,585 - INFO - agent:active 2025-08-06 07:30:53,635 - INFO - 10.0.0.57 2025-08-06 07:30:53,636 - INFO - vrouter 2025-08-06 07:30:53,646 - INFO - vrouter-nodemgr:active 2025-08-06 07:30:53,656 - INFO - agent:active 2025-08-06 07:30:53,657 - INFO - All the contrail services are up on all nodes 2025-08-06 07:30:53,658 - INFO - contrail-status passed 2025-08-06 07:30:54,329 - DEBUG - No XMPP flaps were noticed during the test 2025-08-06 07:30:54,329 - INFO - END TEST : test_contrail_status : PASSED[0:00:02] 2025-08-06 07:30:54,329 - INFO - -------------------------------------------------------------------------------- 2025-08-06 07:30:57,145 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1:Control:contrail-control:0?flat 2025-08-06 07:30:57,289 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1:Control:contrail-dns:0?flat 2025-08-06 07:30:57,406 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2:Control:contrail-control:0?flat 2025-08-06 07:30:57,493 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2:Control:contrail-dns:0?flat 2025-08-06 07:30:57,531 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3:Control:contrail-control:0?flat 2025-08-06 07:30:57,605 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3:Control:contrail-dns:0?flat 2025-08-06 07:30:57,650 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-1:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:30:57,717 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-2:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:30:57,772 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Config:contrail-schema:0?flat 2025-08-06 07:30:57,802 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Config:contrail-svc-monitor:0?flat 2025-08-06 07:30:57,827 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generators 2025-08-06 07:30:57,851 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Config:contrail-api:0?flat 2025-08-06 07:30:57,893 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Config:contrail-api:0?flat 2025-08-06 07:30:57,926 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Config:contrail-api:0?flat 2025-08-06 07:30:57,959 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generators 2025-08-06 07:30:57,982 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,012 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,045 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,076 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,099 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,121 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,147 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,171 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,194 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:30:58,217 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-collector:0?flat 2025-08-06 07:30:58,262 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Database:contrail-query-engine:0?flat 2025-08-06 07:30:58,296 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-collector:0?flat 2025-08-06 07:30:58,334 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Database:contrail-query-engine:0?flat 2025-08-06 07:30:58,379 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-collector:0?flat 2025-08-06 07:30:58,431 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Database:contrail-query-engine:0?flat 2025-08-06 07:30:58,498 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-1:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:30:58,986 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-2:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:30:59,157 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-1:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:30:59,317 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-2:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:31:00,945 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-1:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:31:00,989 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-1:Compute:contrail-vrouter-nodemgr:0?flat 2025-08-06 07:31:01,013 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-2:Compute:contrail-vrouter-agent:0?flat 2025-08-06 07:31:01,068 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3761-2:Compute:contrail-vrouter-nodemgr:0?flat 2025-08-06 07:31:01,092 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-analytics-nodemgr:0?flat 2025-08-06 07:31:01,114 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-collector:0?flat 2025-08-06 07:31:01,154 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:31:01,180 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-analytics-nodemgr:0?flat 2025-08-06 07:31:01,215 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-collector:0?flat 2025-08-06 07:31:01,257 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:31:01,280 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-analytics-nodemgr:0?flat 2025-08-06 07:31:01,309 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-collector:0?flat 2025-08-06 07:31:01,343 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Analytics:contrail-analytics-api:0?flat 2025-08-06 07:31:01,373 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Database:contrail-query-engine:0?flat 2025-08-06 07:31:01,417 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Database:contrail-database-nodemgr:0?flat 2025-08-06 07:31:01,441 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Database:contrail-query-engine:0?flat 2025-08-06 07:31:01,483 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Database:contrail-database-nodemgr:0?flat 2025-08-06 07:31:01,514 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Database:contrail-query-engine:0?flat 2025-08-06 07:31:01,556 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Database:contrail-database-nodemgr:0?flat 2025-08-06 07:31:01,594 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1.:Config:contrail-api:0?flat 2025-08-06 07:31:01,617 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2.:Config:contrail-api:0?flat 2025-08-06 07:31:01,641 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3.:Config:contrail-api:0?flat 2025-08-06 07:31:01,669 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1:Control:contrail-control:0?flat 2025-08-06 07:31:01,723 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1:Control:contrail-control-nodemgr:0?flat 2025-08-06 07:31:01,749 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-1:Control:contrail-dns:0?flat 2025-08-06 07:31:01,799 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2:Control:contrail-control:0?flat 2025-08-06 07:31:01,882 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2:Control:contrail-control-nodemgr:0?flat 2025-08-06 07:31:01,925 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-2:Control:contrail-dns:0?flat 2025-08-06 07:31:01,963 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3:Control:contrail-control:0?flat 2025-08-06 07:31:02,017 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3:Control:contrail-control-nodemgr:0?flat 2025-08-06 07:31:02,044 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3761-3:Control:contrail-dns:0?flat 2025-08-06 07:31:03,383 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3761-1?flat 2025-08-06 07:31:04,792 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-1.?flat 2025-08-06 07:31:04,903 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-2.?flat 2025-08-06 07:31:04,993 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-3.?flat 2025-08-06 07:31:05,063 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-1.?flat 2025-08-06 07:31:05,189 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-2.?flat 2025-08-06 07:31:05,261 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-3.?flat 2025-08-06 07:31:05,328 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-1.?flat 2025-08-06 07:31:05,393 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-2.?flat 2025-08-06 07:31:05,438 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-3.?flat 2025-08-06 07:31:05,489 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-1.?flat 2025-08-06 07:31:05,530 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-2.?flat 2025-08-06 07:31:05,592 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3761-3.?flat 2025-08-06 07:31:06,946 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3761-1.?flat 2025-08-06 07:31:06,979 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3761-2.?flat 2025-08-06 07:31:07,007 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3761-3.?flat 2025-08-06 07:31:07,038 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3761-1.?flat 2025-08-06 07:31:08,403 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3761-1?flat 2025-08-06 07:31:08,429 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3761-2?flat 2025-08-06 07:31:08,462 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3761-3?flat 2025-08-06 10:14:03,376 - INFO - Using existing project ['default-domain', 'admin'](adb0a682-d2c0-454a-9f6b-407a61f242d6) 2025-08-06 10:14:03,411 - INFO - ================================================================================ 2025-08-06 10:14:03,411 - INFO - STARTING TEST : test_contrail_alarms 2025-08-06 10:14:03,411 - INFO - TEST DESCRIPTION : Test to check if alarms are present 2025-08-06 10:14:04,709 - DEBUG - Skipping xmpp flap check 2025-08-06 10:14:04,709 - INFO - Initial checks done. Running the testcase now 2025-08-06 10:14:04,709 - INFO - 2025-08-06 10:14:04,709 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/alarms 2025-08-06 10:14:05,060 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/alarms 2025-08-06 10:14:06,576 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Wed Aug 6 10:14:05 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/analytics/test_analytics.py in test_contrail_alarms(self=) 98 alarms = self.analytics_obj.ops_inspect[self.inputs.collector_ips[0]].get_ops_alarms() 99 if alarms: 100 assert False, "alarms generated %s" % (alarms) 101 return True 102 alarms = {'config-database-node': [{'name': 'cn-jenkins-d...ssing/incorrect.'}], '__T': 1754475244235377}}}]} AssertionError: alarms generated {'config-database-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434478235, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ3ODIzNX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434478425}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434468929, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ2ODkyOX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434469152}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434473682, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ3MzY4Mn0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434473880}}}], 'database-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466500855, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjUwMDg1NX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466501053}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466489203, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ4OTIwM30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466489397}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466494596, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ5NDU5Nn0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466494820}}}], 'config-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434488797, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ4ODc5N30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434489070}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434498539, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ5ODUzOX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434498713}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434483571, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ4MzU3MX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475066054920}}}], 'analytics-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466479428, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ3OTQyOH0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466479638}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466473697, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ3MzY5N30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466473982}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466484399, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ4NDM5OX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466484583}}}], 'analytics-alarm-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466461572, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ2MTU3Mn0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466461891}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466454463, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ1NDQ2M30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466454657}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466468437, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ2ODQzN30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466468646}}}], 'analytics-snmp-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466443337, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ0MzMzN30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475186179396}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466436950, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQzNjk1MH0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475244255387}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466448994, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ0ODk5NH0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475244235377}}}]} __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ("alarms generated {'config-database-node': [{'nam...ssing/incorrect.'}], '__T': 1754475244235377}}}]}",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/analytics/test_analytics.py", line 100, in test_contrail_alarms assert False, "alarms generated %s" % (alarms) AssertionError: alarms generated {'config-database-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434478235, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ3ODIzNX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434478425}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434468929, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ2ODkyOX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434469152}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434473682, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ3MzY4Mn0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434473880}}}], 'database-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466500855, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjUwMDg1NX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466501053}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466489203, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ4OTIwM30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466489397}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466494596, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ5NDU5Nn0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466494820}}}], 'config-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434488797, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ4ODc5N30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434489070}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434498539, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ5ODUzOX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472434498713}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472434483571, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQzNDQ4MzU3MX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475066054920}}}], 'analytics-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466479428, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ3OTQyOH0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466479638}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466473697, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ3MzY5N30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466473982}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466484399, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ4NDM5OX0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466484583}}}], 'analytics-alarm-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466461572, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ2MTU3Mn0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466461891}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466454463, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ1NDQ2M30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466454657}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466468437, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ2ODQzN30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754472466468646}}}], 'analytics-snmp-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3761-2.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466443337, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ0MzMzN30=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475186179396}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-1.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466436950, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQzNjk1MH0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475244255387}}}, {'name': 'cn-jenkins-deploy-platform-ansible-os-3761-3.', 'value': {'UVEAlarms': {'alarms': [{'type': 'default-global-system-config:system-defined-conf-incorrect', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '==', 'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'variables': []}, 'match': [{'json_operand1_value': 'null', 'json_variables': {}}]}]}]}, 'ack': False, 'timestamp': 1754472466448994, 'severity': 1, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1NDQ3MjQ2NjQ0ODk5NH0=', 'description': 'ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.'}], '__T': 1754475244235377}}}]} 2025-08-06 10:14:06,577 - DEBUG - Skipping xmpp flap check 2025-08-06 10:14:06,577 - INFO - 2025-08-06 10:14:06,577 - INFO - END TEST : test_contrail_alarms : FAILED[0:00:03] 2025-08-06 10:14:06,577 - INFO - -------------------------------------------------------------------------------- 2025-08-06 10:14:06,583 - INFO - ================================================================================ 2025-08-06 10:14:06,583 - INFO - STARTING TEST : test_contrail_status 2025-08-06 10:14:06,583 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-08-06 10:14:07,871 - DEBUG - Skipping xmpp flap check 2025-08-06 10:14:07,871 - INFO - Initial checks done. Running the testcase now 2025-08-06 10:14:07,871 - INFO - 2025-08-06 10:14:08,110 - INFO - 10.0.0.48 2025-08-06 10:14:08,110 - INFO - config 2025-08-06 10:14:08,117 - INFO - config-nodemgr:active 2025-08-06 10:14:08,122 - INFO - api-server:active 2025-08-06 10:14:08,126 - INFO - schema:backup 2025-08-06 10:14:08,131 - INFO - svc-monitor:backup 2025-08-06 10:14:08,135 - INFO - device-manager:backup 2025-08-06 10:14:08,135 - INFO - config-database 2025-08-06 10:14:08,135 - INFO - config-cassandra:active 2025-08-06 10:14:08,135 - INFO - config-zookeeper:active 2025-08-06 10:14:08,135 - INFO - config-rabbitmq:active 2025-08-06 10:14:08,135 - INFO - control 2025-08-06 10:14:08,141 - INFO - control-nodemgr:active 2025-08-06 10:14:08,149 - INFO - control:active 2025-08-06 10:14:08,149 - INFO - named:active 2025-08-06 10:14:08,158 - INFO - dns:active 2025-08-06 10:14:08,158 - INFO - analytics 2025-08-06 10:14:08,165 - INFO - analytics-nodemgr:active 2025-08-06 10:14:08,170 - INFO - analytics-api:active 2025-08-06 10:14:08,179 - INFO - collector:active 2025-08-06 10:14:08,179 - INFO - analytics-database 2025-08-06 10:14:08,179 - INFO - analytics-cassandra:active 2025-08-06 10:14:08,186 - INFO - analyticsdb-nodemgr:active 2025-08-06 10:14:08,193 - INFO - query-engine:active 2025-08-06 10:14:08,194 - INFO - webui 2025-08-06 10:14:08,194 - INFO - webui:active 2025-08-06 10:14:08,194 - INFO - webui-middleware:active 2025-08-06 10:14:08,194 - INFO - redis:active 2025-08-06 10:14:08,194 - INFO - analytics_snmp 2025-08-06 10:14:08,199 - INFO - snmp-collector:active 2025-08-06 10:14:08,199 - INFO - snmp-topology:active 2025-08-06 10:14:08,199 - INFO - analytics_alarm 2025-08-06 10:14:08,199 - INFO - alarmgen:active 2025-08-06 10:14:08,334 - INFO - 10.0.0.254 2025-08-06 10:14:08,334 - INFO - config 2025-08-06 10:14:08,345 - INFO - config-nodemgr:active 2025-08-06 10:14:08,353 - INFO - api-server:active 2025-08-06 10:14:08,361 - INFO - schema:backup 2025-08-06 10:14:08,369 - INFO - svc-monitor:active 2025-08-06 10:14:08,374 - INFO - device-manager:backup 2025-08-06 10:14:08,374 - INFO - config-database 2025-08-06 10:14:08,375 - INFO - config-cassandra:active 2025-08-06 10:14:08,375 - INFO - config-zookeeper:active 2025-08-06 10:14:08,375 - INFO - config-rabbitmq:active 2025-08-06 10:14:08,375 - INFO - control 2025-08-06 10:14:08,382 - INFO - control-nodemgr:active 2025-08-06 10:14:08,389 - INFO - control:active 2025-08-06 10:14:08,390 - INFO - named:active 2025-08-06 10:14:08,397 - INFO - dns:active 2025-08-06 10:14:08,397 - INFO - analytics 2025-08-06 10:14:08,404 - INFO - analytics-nodemgr:active 2025-08-06 10:14:08,410 - INFO - analytics-api:active 2025-08-06 10:14:08,417 - INFO - collector:active 2025-08-06 10:14:08,417 - INFO - analytics-database 2025-08-06 10:14:08,417 - INFO - analytics-cassandra:active 2025-08-06 10:14:08,425 - INFO - analyticsdb-nodemgr:active 2025-08-06 10:14:08,433 - INFO - query-engine:active 2025-08-06 10:14:08,433 - INFO - webui 2025-08-06 10:14:08,433 - INFO - webui:active 2025-08-06 10:14:08,433 - INFO - webui-middleware:active 2025-08-06 10:14:08,433 - INFO - redis:active 2025-08-06 10:14:08,434 - INFO - analytics_snmp 2025-08-06 10:14:08,440 - INFO - snmp-collector:active 2025-08-06 10:14:08,440 - INFO - snmp-topology:active 2025-08-06 10:14:08,440 - INFO - analytics_alarm 2025-08-06 10:14:08,440 - INFO - alarmgen:active 2025-08-06 10:14:08,550 - INFO - 10.0.0.38 2025-08-06 10:14:08,550 - INFO - config 2025-08-06 10:14:08,557 - INFO - config-nodemgr:active 2025-08-06 10:14:08,564 - INFO - api-server:active 2025-08-06 10:14:08,574 - INFO - schema:active 2025-08-06 10:14:08,583 - INFO - svc-monitor:backup 2025-08-06 10:14:08,590 - INFO - device-manager:active 2025-08-06 10:14:08,591 - INFO - config-database 2025-08-06 10:14:08,591 - INFO - config-cassandra:active 2025-08-06 10:14:08,591 - INFO - config-zookeeper:active 2025-08-06 10:14:08,591 - INFO - config-rabbitmq:active 2025-08-06 10:14:08,591 - INFO - control 2025-08-06 10:14:08,600 - INFO - control-nodemgr:active 2025-08-06 10:14:08,609 - INFO - control:active 2025-08-06 10:14:08,609 - INFO - named:active 2025-08-06 10:14:08,617 - INFO - dns:active 2025-08-06 10:14:08,617 - INFO - analytics 2025-08-06 10:14:08,624 - INFO - analytics-nodemgr:active 2025-08-06 10:14:08,630 - INFO - analytics-api:active 2025-08-06 10:14:08,637 - INFO - collector:active 2025-08-06 10:14:08,637 - INFO - analytics-database 2025-08-06 10:14:08,637 - INFO - analytics-cassandra:active 2025-08-06 10:14:08,643 - INFO - analyticsdb-nodemgr:active 2025-08-06 10:14:08,651 - INFO - query-engine:active 2025-08-06 10:14:08,651 - INFO - webui 2025-08-06 10:14:08,651 - INFO - webui:active 2025-08-06 10:14:08,651 - INFO - webui-middleware:active 2025-08-06 10:14:08,651 - INFO - redis:active 2025-08-06 10:14:08,651 - INFO - analytics_snmp 2025-08-06 10:14:08,657 - INFO - snmp-collector:active 2025-08-06 10:14:08,657 - INFO - snmp-topology:active 2025-08-06 10:14:08,657 - INFO - analytics_alarm 2025-08-06 10:14:08,657 - INFO - alarmgen:active 2025-08-06 10:14:08,749 - INFO - 10.0.0.49 2025-08-06 10:14:08,749 - INFO - vrouter 2025-08-06 10:14:08,757 - INFO - vrouter-nodemgr:active 2025-08-06 10:14:08,765 - INFO - agent:active 2025-08-06 10:14:08,855 - INFO - 10.0.0.57 2025-08-06 10:14:08,855 - INFO - vrouter 2025-08-06 10:14:08,862 - INFO - vrouter-nodemgr:active 2025-08-06 10:14:08,870 - INFO - agent:active 2025-08-06 10:14:08,870 - INFO - All the contrail services are up on all nodes 2025-08-06 10:14:08,870 - INFO - contrail-status passed 2025-08-06 10:14:10,170 - DEBUG - Skipping xmpp flap check 2025-08-06 10:14:10,171 - INFO - END TEST : test_contrail_status : PASSED[0:00:04] 2025-08-06 10:14:10,171 - INFO - --------------------------------------------------------------------------------