2025-07-31 02:37:04,065 - INFO - Using existing project ['default-domain', 'admin'](2761afbf-24b2-4f6f-abe2-e910af9609e1) 2025-07-31 02:37:04,077 - INFO - ================================================================================ 2025-07-31 02:37:04,077 - INFO - STARTING TEST : test_contrail_alarms 2025-07-31 02:37:04,077 - INFO - TEST DESCRIPTION : Test to check if alarms are present 2025-07-31 02:37:04,719 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 02:37:04,720 - INFO - Initial checks done. Running the testcase now 2025-07-31 02:37:04,720 - INFO - 2025-07-31 02:37:04,721 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms 2025-07-31 02:37:05,023 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms 2025-07-31 02:37:05,942 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Thu Jul 31 02:37:05 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/analytics/test_analytics.py in test_contrail_alarms(self=) 98 alarms = self.analytics_obj.ops_inspect[self.inputs.collector_ips[0]].get_ops_alarms() 99 if alarms: 100 assert False, "alarms generated %s" % (alarms) 101 return True 102 alarms = {'analytics-snmp-node': [{'name': 'cn-jenkins-de...'Process(es) reporting as non-functional.'}]}}}]} AssertionError: alarms generated {'analytics-snmp-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3732-1.', 'value': {'UVEAlarms': {'__T': 1753929423732426, 'alarms': [{'type': 'default-global-system-config:system-defined-process-connectivity', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '!=', 'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}, 'match': [{'json_operand1_value': '"Non-Functional"', 'json_variables': {'NodeStatus.process_status.module_id': '"contrail-snmp-collector"', 'NodeStatus.process_status.instance_id': '0'}}]}]}]}, 'ack': False, 'timestamp': 1753929423732192, 'severity': 0, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1MzkyOTQyMzczMjE5Mn0=', 'description': 'Process(es) reporting as non-functional.'}]}}}]} __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ("alarms generated {'analytics-snmp-node': [{'name...'Process(es) reporting as non-functional.'}]}}}]}",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/analytics/test_analytics.py", line 100, in test_contrail_alarms assert False, "alarms generated %s" % (alarms) AssertionError: alarms generated {'analytics-snmp-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3732-1.', 'value': {'UVEAlarms': {'__T': 1753929423732426, 'alarms': [{'type': 'default-global-system-config:system-defined-process-connectivity', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '!=', 'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}, 'match': [{'json_operand1_value': '"Non-Functional"', 'json_variables': {'NodeStatus.process_status.module_id': '"contrail-snmp-collector"', 'NodeStatus.process_status.instance_id': '0'}}]}]}]}, 'ack': False, 'timestamp': 1753929423732192, 'severity': 0, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1MzkyOTQyMzczMjE5Mn0=', 'description': 'Process(es) reporting as non-functional.'}]}}}]} 2025-07-31 02:37:05,974 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 02:37:05,974 - INFO -
2025-07-31 02:37:05,974 - INFO - END TEST : test_contrail_alarms : FAILED[0:00:01]
2025-07-31 02:37:05,975 - INFO - -------------------------------------------------------------------------------- 2025-07-31 02:37:05,987 - INFO - ================================================================================ 2025-07-31 02:37:05,987 - INFO - STARTING TEST : test_contrail_status 2025-07-31 02:37:05,987 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-07-31 02:37:06,723 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 02:37:06,724 - INFO - Initial checks done. Running the testcase now 2025-07-31 02:37:06,724 - INFO - 2025-07-31 02:37:06,886 - INFO - 10.0.0.41 2025-07-31 02:37:06,887 - INFO - config 2025-07-31 02:37:06,905 - INFO - config-nodemgr:active 2025-07-31 02:37:06,916 - INFO - api-server:active 2025-07-31 02:37:06,929 - INFO - schema:backup 2025-07-31 02:37:06,944 - INFO - svc-monitor:backup 2025-07-31 02:37:06,954 - INFO - device-manager:backup 2025-07-31 02:37:06,954 - INFO - config-database 2025-07-31 02:37:06,954 - INFO - config-cassandra:active 2025-07-31 02:37:06,955 - INFO - config-zookeeper:active 2025-07-31 02:37:06,955 - INFO - config-rabbitmq:active 2025-07-31 02:37:06,955 - INFO - control 2025-07-31 02:37:06,972 - INFO - control-nodemgr:active 2025-07-31 02:37:06,994 - INFO - control:active 2025-07-31 02:37:06,995 - INFO - named:active 2025-07-31 02:37:07,012 - INFO - dns:active 2025-07-31 02:37:07,013 - INFO - analytics 2025-07-31 02:37:07,037 - INFO - analytics-nodemgr:active 2025-07-31 02:37:07,051 - INFO - analytics-api:active 2025-07-31 02:37:07,067 - INFO - collector:active 2025-07-31 02:37:07,068 - INFO - analytics-database 2025-07-31 02:37:07,069 - INFO - analytics-cassandra:active 2025-07-31 02:37:07,081 - INFO - analyticsdb-nodemgr:active 2025-07-31 02:37:07,095 - INFO - query-engine:active 2025-07-31 02:37:07,095 - INFO - webui 2025-07-31 02:37:07,096 - INFO - webui:active 2025-07-31 02:37:07,096 - INFO - webui-middleware:active 2025-07-31 02:37:07,096 - INFO - redis:active 2025-07-31 02:37:07,096 - INFO - analytics_snmp 2025-07-31 02:37:07,103 - INFO - snmp-collector:active 2025-07-31 02:37:07,103 - INFO - snmp-topology:active 2025-07-31 02:37:07,103 - INFO - analytics_alarm 2025-07-31 02:37:07,104 - INFO - alarmgen:active 2025-07-31 02:37:07,162 - INFO - 10.0.0.38 2025-07-31 02:37:07,162 - INFO - config 2025-07-31 02:37:07,175 - INFO - config-nodemgr:active 2025-07-31 02:37:07,186 - INFO - api-server:active 2025-07-31 02:37:07,198 - INFO - schema:backup 2025-07-31 02:37:07,209 - INFO - svc-monitor:backup 2025-07-31 02:37:07,220 - INFO - device-manager:backup 2025-07-31 02:37:07,220 - INFO - config-database 2025-07-31 02:37:07,221 - INFO - config-cassandra:active 2025-07-31 02:37:07,221 - INFO - config-zookeeper:active 2025-07-31 02:37:07,221 - INFO - config-rabbitmq:active 2025-07-31 02:37:07,221 - INFO - control 2025-07-31 02:37:07,231 - INFO - control-nodemgr:active 2025-07-31 02:37:07,241 - INFO - control:active 2025-07-31 02:37:07,241 - INFO - named:active 2025-07-31 02:37:07,252 - INFO - dns:active 2025-07-31 02:37:07,252 - INFO - analytics 2025-07-31 02:37:07,263 - INFO - analytics-nodemgr:active 2025-07-31 02:37:07,272 - INFO - analytics-api:active 2025-07-31 02:37:07,280 - INFO - collector:active 2025-07-31 02:37:07,280 - INFO - analytics-database 2025-07-31 02:37:07,281 - INFO - analytics-cassandra:active 2025-07-31 02:37:07,288 - INFO - analyticsdb-nodemgr:active 2025-07-31 02:37:07,300 - INFO - query-engine:active 2025-07-31 02:37:07,300 - INFO - webui 2025-07-31 02:37:07,301 - INFO - webui:active 2025-07-31 02:37:07,301 - INFO - webui-middleware:active 2025-07-31 02:37:07,301 - INFO - redis:active 2025-07-31 02:37:07,301 - INFO - analytics_snmp 2025-07-31 02:37:07,308 - INFO - snmp-collector:active 2025-07-31 02:37:07,308 - INFO - snmp-topology:active 2025-07-31 02:37:07,308 - INFO - analytics_alarm 2025-07-31 02:37:07,308 - INFO - alarmgen:active 2025-07-31 02:37:07,356 - INFO - 10.0.0.61 2025-07-31 02:37:07,356 - INFO - config 2025-07-31 02:37:07,367 - INFO - config-nodemgr:active 2025-07-31 02:37:07,377 - INFO - api-server:active 2025-07-31 02:37:07,388 - INFO - schema:active 2025-07-31 02:37:07,399 - INFO - svc-monitor:active 2025-07-31 02:37:07,406 - INFO - device-manager:active 2025-07-31 02:37:07,406 - INFO - config-database 2025-07-31 02:37:07,406 - INFO - config-cassandra:active 2025-07-31 02:37:07,406 - INFO - config-zookeeper:active 2025-07-31 02:37:07,406 - INFO - config-rabbitmq:active 2025-07-31 02:37:07,406 - INFO - control 2025-07-31 02:37:07,414 - INFO - control-nodemgr:active 2025-07-31 02:37:07,422 - INFO - control:active 2025-07-31 02:37:07,422 - INFO - named:active 2025-07-31 02:37:07,428 - INFO - dns:active 2025-07-31 02:37:07,428 - INFO - analytics 2025-07-31 02:37:07,435 - INFO - analytics-nodemgr:active 2025-07-31 02:37:07,444 - INFO - analytics-api:active 2025-07-31 02:37:07,458 - INFO - collector:active 2025-07-31 02:37:07,458 - INFO - analytics-database 2025-07-31 02:37:07,458 - INFO - analytics-cassandra:active 2025-07-31 02:37:07,469 - INFO - analyticsdb-nodemgr:active 2025-07-31 02:37:07,478 - INFO - query-engine:active 2025-07-31 02:37:07,478 - INFO - webui 2025-07-31 02:37:07,478 - INFO - webui:active 2025-07-31 02:37:07,478 - INFO - webui-middleware:active 2025-07-31 02:37:07,478 - INFO - redis:active 2025-07-31 02:37:07,479 - INFO - analytics_snmp 2025-07-31 02:37:07,483 - INFO - snmp-collector:active 2025-07-31 02:37:07,484 - INFO - snmp-topology:active 2025-07-31 02:37:07,484 - INFO - analytics_alarm 2025-07-31 02:37:07,484 - INFO - alarmgen:active 2025-07-31 02:37:07,540 - INFO - 10.0.0.27 2025-07-31 02:37:07,540 - INFO - vrouter 2025-07-31 02:37:07,551 - INFO - vrouter-nodemgr:active 2025-07-31 02:37:07,561 - INFO - agent:active 2025-07-31 02:37:07,609 - INFO - 10.0.0.57 2025-07-31 02:37:07,610 - INFO - vrouter 2025-07-31 02:37:07,622 - INFO - vrouter-nodemgr:active 2025-07-31 02:37:07,634 - INFO - agent:active 2025-07-31 02:37:07,635 - INFO - All the contrail services are up on all nodes 2025-07-31 02:37:07,635 - INFO - contrail-status passed 2025-07-31 02:37:08,375 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:08,375 - INFO - END TEST : test_contrail_status : PASSED[0:00:03]
2025-07-31 02:37:08,375 - INFO - -------------------------------------------------------------------------------- 2025-07-31 02:37:11,383 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control:0?flat 2025-07-31 02:37:11,475 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-dns:0?flat 2025-07-31 02:37:11,555 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control:0?flat 2025-07-31 02:37:11,614 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-dns:0?flat 2025-07-31 02:37:11,650 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control:0?flat 2025-07-31 02:37:11,701 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-dns:0?flat 2025-07-31 02:37:11,732 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:11,774 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:11,816 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-schema:0?flat 2025-07-31 02:37:11,838 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-svc-monitor:0?flat 2025-07-31 02:37:11,865 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generators 2025-07-31 02:37:11,885 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-api:0?flat 2025-07-31 02:37:11,906 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Config:contrail-api:0?flat 2025-07-31 02:37:11,932 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Config:contrail-api:0?flat 2025-07-31 02:37:11,958 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generators 2025-07-31 02:37:11,983 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,007 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,031 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,054 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,089 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,112 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,137 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,164 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,185 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:12,205 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-collector:0?flat 2025-07-31 02:37:12,242 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-query-engine:0?flat 2025-07-31 02:37:12,270 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-collector:0?flat 2025-07-31 02:37:12,305 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-query-engine:0?flat 2025-07-31 02:37:12,335 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-collector:0?flat 2025-07-31 02:37:12,377 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-query-engine:0?flat 2025-07-31 02:37:12,406 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:12,516 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:12,704 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:12,853 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:14,776 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:14,865 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-nodemgr:0?flat 2025-07-31 02:37:14,890 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 02:37:14,929 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-nodemgr:0?flat 2025-07-31 02:37:14,954 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-nodemgr:0?flat 2025-07-31 02:37:14,976 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-collector:0?flat 2025-07-31 02:37:15,022 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:15,050 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-nodemgr:0?flat 2025-07-31 02:37:15,075 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-collector:0?flat 2025-07-31 02:37:15,128 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:15,162 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-nodemgr:0?flat 2025-07-31 02:37:15,193 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-collector:0?flat 2025-07-31 02:37:15,238 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat 2025-07-31 02:37:15,275 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-query-engine:0?flat 2025-07-31 02:37:15,319 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-database-nodemgr:0?flat 2025-07-31 02:37:15,349 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-query-engine:0?flat 2025-07-31 02:37:15,389 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-database-nodemgr:0?flat 2025-07-31 02:37:15,424 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-query-engine:0?flat 2025-07-31 02:37:15,465 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-database-nodemgr:0?flat 2025-07-31 02:37:15,497 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-api:0?flat 2025-07-31 02:37:15,531 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Config:contrail-api:0?flat 2025-07-31 02:37:15,560 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Config:contrail-api:0?flat 2025-07-31 02:37:15,597 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control:0?flat 2025-07-31 02:37:15,648 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control-nodemgr:0?flat 2025-07-31 02:37:15,671 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-dns:0?flat 2025-07-31 02:37:15,708 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control:0?flat 2025-07-31 02:37:15,771 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control-nodemgr:0?flat 2025-07-31 02:37:15,792 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-dns:0?flat 2025-07-31 02:37:15,830 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control:0?flat 2025-07-31 02:37:15,888 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control-nodemgr:0?flat 2025-07-31 02:37:15,920 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-dns:0?flat 2025-07-31 02:37:17,444 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat 2025-07-31 02:37:19,074 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat 2025-07-31 02:37:19,183 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat 2025-07-31 02:37:19,285 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat 2025-07-31 02:37:19,388 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat 2025-07-31 02:37:19,474 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat 2025-07-31 02:37:19,553 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat 2025-07-31 02:37:19,649 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat 2025-07-31 02:37:19,698 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat 2025-07-31 02:37:19,741 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat 2025-07-31 02:37:19,804 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat 2025-07-31 02:37:19,889 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat 2025-07-31 02:37:19,951 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat 2025-07-31 02:37:21,478 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat 2025-07-31 02:37:21,514 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat 2025-07-31 02:37:21,557 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat 2025-07-31 02:37:21,595 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat 2025-07-31 02:37:23,073 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-1?flat 2025-07-31 02:37:23,128 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 02:37:23,180 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-3?flat 2025-07-31 05:51:26,465 - INFO - Using existing project ['default-domain', 'admin'](2761afbf-24b2-4f6f-abe2-e910af9609e1) 2025-07-31 05:51:26,486 - INFO - ================================================================================ 2025-07-31 05:51:26,486 - INFO - STARTING TEST : test_contrail_alarms 2025-07-31 05:51:26,486 - INFO - TEST DESCRIPTION : Test to check if alarms are present 2025-07-31 05:51:27,842 - DEBUG - Skipping xmpp flap check 2025-07-31 05:51:27,842 - INFO - Initial checks done. Running the testcase now 2025-07-31 05:51:27,842 - INFO - 2025-07-31 05:51:27,842 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms 2025-07-31 05:51:28,239 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms 2025-07-31 05:51:29,791 - DEBUG - Skipping xmpp flap check
2025-07-31 05:51:29,791 - INFO - END TEST : test_contrail_alarms : PASSED[0:00:03]
2025-07-31 05:51:29,792 - INFO - -------------------------------------------------------------------------------- 2025-07-31 05:51:29,801 - INFO - ================================================================================ 2025-07-31 05:51:29,801 - INFO - STARTING TEST : test_contrail_status 2025-07-31 05:51:29,801 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-07-31 05:51:31,129 - DEBUG - Skipping xmpp flap check 2025-07-31 05:51:31,129 - INFO - Initial checks done. Running the testcase now 2025-07-31 05:51:31,130 - INFO - 2025-07-31 05:51:31,384 - INFO - 10.0.0.41 2025-07-31 05:51:31,384 - INFO - config 2025-07-31 05:51:31,402 - INFO - config-nodemgr:active 2025-07-31 05:51:31,414 - INFO - api-server:active 2025-07-31 05:51:31,427 - INFO - schema:backup 2025-07-31 05:51:31,439 - INFO - svc-monitor:backup 2025-07-31 05:51:31,454 - INFO - device-manager:backup 2025-07-31 05:51:31,454 - INFO - config-database 2025-07-31 05:51:31,454 - INFO - config-cassandra:active 2025-07-31 05:51:31,454 - INFO - config-zookeeper:active 2025-07-31 05:51:31,454 - INFO - config-rabbitmq:active 2025-07-31 05:51:31,455 - INFO - control 2025-07-31 05:51:31,468 - INFO - control-nodemgr:active 2025-07-31 05:51:31,479 - INFO - control:active 2025-07-31 05:51:31,480 - INFO - named:active 2025-07-31 05:51:31,496 - INFO - dns:active 2025-07-31 05:51:31,496 - INFO - analytics 2025-07-31 05:51:31,511 - INFO - analytics-nodemgr:active 2025-07-31 05:51:31,527 - INFO - analytics-api:active 2025-07-31 05:51:31,544 - INFO - collector:active 2025-07-31 05:51:31,544 - INFO - analytics-database 2025-07-31 05:51:31,545 - INFO - analytics-cassandra:active 2025-07-31 05:51:31,556 - INFO - analyticsdb-nodemgr:active 2025-07-31 05:51:31,567 - INFO - query-engine:active 2025-07-31 05:51:31,567 - INFO - webui 2025-07-31 05:51:31,567 - INFO - webui:active 2025-07-31 05:51:31,568 - INFO - webui-middleware:active 2025-07-31 05:51:31,568 - INFO - redis:active 2025-07-31 05:51:31,568 - INFO - analytics_snmp 2025-07-31 05:51:31,578 - INFO - snmp-collector:active 2025-07-31 05:51:31,578 - INFO - snmp-topology:active 2025-07-31 05:51:31,579 - INFO - analytics_alarm 2025-07-31 05:51:31,579 - INFO - alarmgen:active 2025-07-31 05:51:31,720 - INFO - 10.0.0.38 2025-07-31 05:51:31,721 - INFO - config 2025-07-31 05:51:31,737 - INFO - config-nodemgr:active 2025-07-31 05:51:31,749 - INFO - api-server:active 2025-07-31 05:51:31,765 - INFO - schema:backup 2025-07-31 05:51:31,781 - INFO - svc-monitor:backup 2025-07-31 05:51:31,797 - INFO - device-manager:backup 2025-07-31 05:51:31,797 - INFO - config-database 2025-07-31 05:51:31,798 - INFO - config-cassandra:active 2025-07-31 05:51:31,798 - INFO - config-zookeeper:active 2025-07-31 05:51:31,798 - INFO - config-rabbitmq:active 2025-07-31 05:51:31,798 - INFO - control 2025-07-31 05:51:31,808 - INFO - control-nodemgr:active 2025-07-31 05:51:31,819 - INFO - control:active 2025-07-31 05:51:31,820 - INFO - named:active 2025-07-31 05:51:31,832 - INFO - dns:active 2025-07-31 05:51:31,833 - INFO - analytics 2025-07-31 05:51:31,847 - INFO - analytics-nodemgr:active 2025-07-31 05:51:31,861 - INFO - analytics-api:active 2025-07-31 05:51:31,874 - INFO - collector:active 2025-07-31 05:51:31,875 - INFO - analytics-database 2025-07-31 05:51:31,875 - INFO - analytics-cassandra:active 2025-07-31 05:51:31,885 - INFO - analyticsdb-nodemgr:active 2025-07-31 05:51:31,897 - INFO - query-engine:active 2025-07-31 05:51:31,898 - INFO - webui 2025-07-31 05:51:31,898 - INFO - webui:active 2025-07-31 05:51:31,898 - INFO - webui-middleware:active 2025-07-31 05:51:31,898 - INFO - redis:active 2025-07-31 05:51:31,899 - INFO - analytics_snmp 2025-07-31 05:51:31,908 - INFO - snmp-collector:active 2025-07-31 05:51:31,908 - INFO - snmp-topology:active 2025-07-31 05:51:31,909 - INFO - analytics_alarm 2025-07-31 05:51:31,909 - INFO - alarmgen:active 2025-07-31 05:51:32,026 - INFO - 10.0.0.61 2025-07-31 05:51:32,027 - INFO - config 2025-07-31 05:51:32,044 - INFO - config-nodemgr:active 2025-07-31 05:51:32,057 - INFO - api-server:active 2025-07-31 05:51:32,063 - INFO - schema:active 2025-07-31 05:51:32,073 - INFO - svc-monitor:active 2025-07-31 05:51:32,086 - INFO - device-manager:active 2025-07-31 05:51:32,087 - INFO - config-database 2025-07-31 05:51:32,087 - INFO - config-cassandra:active 2025-07-31 05:51:32,087 - INFO - config-zookeeper:active 2025-07-31 05:51:32,087 - INFO - config-rabbitmq:active 2025-07-31 05:51:32,088 - INFO - control 2025-07-31 05:51:32,102 - INFO - control-nodemgr:active 2025-07-31 05:51:32,115 - INFO - control:active 2025-07-31 05:51:32,115 - INFO - named:active 2025-07-31 05:51:32,124 - INFO - dns:active 2025-07-31 05:51:32,124 - INFO - analytics 2025-07-31 05:51:32,132 - INFO - analytics-nodemgr:active 2025-07-31 05:51:32,141 - INFO - analytics-api:active 2025-07-31 05:51:32,153 - INFO - collector:active 2025-07-31 05:51:32,153 - INFO - analytics-database 2025-07-31 05:51:32,153 - INFO - analytics-cassandra:active 2025-07-31 05:51:32,164 - INFO - analyticsdb-nodemgr:active 2025-07-31 05:51:32,173 - INFO - query-engine:active 2025-07-31 05:51:32,173 - INFO - webui 2025-07-31 05:51:32,173 - INFO - webui:active 2025-07-31 05:51:32,173 - INFO - webui-middleware:active 2025-07-31 05:51:32,174 - INFO - redis:active 2025-07-31 05:51:32,174 - INFO - analytics_snmp 2025-07-31 05:51:32,184 - INFO - snmp-collector:active 2025-07-31 05:51:32,185 - INFO - snmp-topology:active 2025-07-31 05:51:32,185 - INFO - analytics_alarm 2025-07-31 05:51:32,185 - INFO - alarmgen:active 2025-07-31 05:51:32,290 - INFO - 10.0.0.27 2025-07-31 05:51:32,290 - INFO - vrouter 2025-07-31 05:51:32,304 - INFO - vrouter-nodemgr:active 2025-07-31 05:51:32,317 - INFO - agent:active 2025-07-31 05:51:32,433 - INFO - 10.0.0.57 2025-07-31 05:51:32,434 - INFO - vrouter 2025-07-31 05:51:32,447 - INFO - vrouter-nodemgr:active 2025-07-31 05:51:32,462 - INFO - agent:active 2025-07-31 05:51:32,462 - INFO - All the contrail services are up on all nodes 2025-07-31 05:51:32,463 - INFO - contrail-status passed 2025-07-31 05:51:33,868 - DEBUG - Skipping xmpp flap check
2025-07-31 05:51:33,868 - INFO - END TEST : test_contrail_status : PASSED[0:00:04]
2025-07-31 05:51:33,870 - INFO - --------------------------------------------------------------------------------