2025-07-31 02:37:04,065 - INFO - Using existing project ['default-domain', 'admin'](2761afbf-24b2-4f6f-abe2-e910af9609e1)
2025-07-31 02:37:04,077 - INFO - ================================================================================
2025-07-31 02:37:04,077 - INFO - STARTING TEST    : test_contrail_alarms
2025-07-31 02:37:04,077 - INFO - TEST DESCRIPTION :  Test to check if alarms are present

        
2025-07-31 02:37:04,719 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:04,720 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:04,720 - INFO - 
2025-07-31 02:37:04,721 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms
2025-07-31 02:37:05,023 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms
2025-07-31 02:37:05,942 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Thu Jul 31 02:37:05 2025

A problem occurred in a Python script.  Here is the sequence of
function calls leading up to the error, in the order they occurred.

 /contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.analytics.test_analytics.AnalyticsTestS...y.test_contrail_alarms[sanity] id=0x7f241dd48ef0>, *args=(), **kwargs={})
   78             log.info('Initial checks done. Running the testcase now')
   79             log.info('')
   80             result = function(self, *args, **kwargs)
   81             if self.inputs.upgrade:
   82                 pid = os.getpid()
result = None
function = <function AnalyticsTestSanity.test_contrail_alarms>
self = <scripts.analytics.test_analytics.AnalyticsTestS...y.test_contrail_alarms[sanity] id=0x7f241dd48ef0>
args = ()
kwargs = {}

 /contrail-test/scripts/analytics/test_analytics.py in test_contrail_alarms(self=<scripts.analytics.test_analytics.AnalyticsTestS...y.test_contrail_alarms[sanity] id=0x7f241dd48ef0>)
   98         alarms = self.analytics_obj.ops_inspect[self.inputs.collector_ips[0]].get_ops_alarms()
   99         if alarms:
  100             assert False, "alarms generated %s" % (alarms)
  101         return True
  102 
alarms = {'analytics-snmp-node': [{'name': 'cn-jenkins-de...'Process(es) reporting as non-functional.'}]}}}]}
AssertionError: alarms generated {'analytics-snmp-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3732-1.', 'value': {'UVEAlarms': {'__T': 1753929423732426, 'alarms': [{'type': 'default-global-system-config:system-defined-process-connectivity', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '!=', 'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}, 'match': [{'json_operand1_value': '"Non-Functional"', 'json_variables': {'NodeStatus.process_status.module_id': '"contrail-snmp-collector"', 'NodeStatus.process_status.instance_id': '0'}}]}]}]}, 'ack': False, 'timestamp': 1753929423732192, 'severity': 0, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1MzkyOTQyMzczMjE5Mn0=', 'description': 'Process(es) reporting as non-functional.'}]}}}]}
    __cause__ = None
    __class__ = <class 'AssertionError'>
    __context__ = None
    __delattr__ = <method-wrapper '__delattr__' of AssertionError object>
    __dict__ = {}
    __dir__ = <built-in method __dir__ of AssertionError object>
    __doc__ = 'Assertion failed.'
    __eq__ = <method-wrapper '__eq__' of AssertionError object>
    __format__ = <built-in method __format__ of AssertionError object>
    __ge__ = <method-wrapper '__ge__' of AssertionError object>
    __getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
    __gt__ = <method-wrapper '__gt__' of AssertionError object>
    __hash__ = <method-wrapper '__hash__' of AssertionError object>
    __init__ = <method-wrapper '__init__' of AssertionError object>
    __init_subclass__ = <built-in method __init_subclass__ of type object>
    __le__ = <method-wrapper '__le__' of AssertionError object>
    __lt__ = <method-wrapper '__lt__' of AssertionError object>
    __ne__ = <method-wrapper '__ne__' of AssertionError object>
    __new__ = <built-in method __new__ of type object>
    __reduce__ = <built-in method __reduce__ of AssertionError object>
    __reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
    __repr__ = <method-wrapper '__repr__' of AssertionError object>
    __setattr__ = <method-wrapper '__setattr__' of AssertionError object>
    __setstate__ = <built-in method __setstate__ of AssertionError object>
    __sizeof__ = <built-in method __sizeof__ of AssertionError object>
    __str__ = <method-wrapper '__str__' of AssertionError object>
    __subclasshook__ = <built-in method __subclasshook__ of type object>
    __suppress_context__ = False
    __traceback__ = <traceback object>
    args = ("alarms generated {'analytics-snmp-node': [{'name...'Process(es) reporting as non-functional.'}]}}}]}",)
    with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program.  Here is
the original traceback:

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/analytics/test_analytics.py", line 100, in test_contrail_alarms
    assert False, "alarms generated %s" % (alarms)
AssertionError: alarms generated {'analytics-snmp-node': [{'name': 'cn-jenkins-deploy-platform-ansible-os-3732-1.', 'value': {'UVEAlarms': {'__T': 1753929423732426, 'alarms': [{'type': 'default-global-system-config:system-defined-process-connectivity', 'alarm_rules': {'or_list': [{'and_list': [{'condition': {'operation': '!=', 'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}, 'match': [{'json_operand1_value': '"Non-Functional"', 'json_variables': {'NodeStatus.process_status.module_id': '"contrail-snmp-collector"', 'NodeStatus.process_status.instance_id': '0'}}]}]}]}, 'ack': False, 'timestamp': 1753929423732192, 'severity': 0, 'token': 'eyJob3N0X2lwIjogIjEwLjAuMC4zOCIsICJodHRwX3BvcnQiOiA1OTk1LCAidGltZXN0YW1wIjogMTc1MzkyOTQyMzczMjE5Mn0=', 'description': 'Process(es) reporting as non-functional.'}]}}}]}



2025-07-31 02:37:05,974 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:05,974 - INFO - 
2025-07-31 02:37:05,974 - INFO - END TEST : test_contrail_alarms : FAILED[0:00:01]
2025-07-31 02:37:05,975 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:05,987 - INFO - ================================================================================
2025-07-31 02:37:05,987 - INFO - STARTING TEST    : test_contrail_status
2025-07-31 02:37:05,987 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active

        
2025-07-31 02:37:06,723 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with
2025-07-31 02:37:06,724 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:37:06,724 - INFO - 
2025-07-31 02:37:06,886 - INFO - 10.0.0.41
2025-07-31 02:37:06,887 - INFO -   config
2025-07-31 02:37:06,905 - INFO -     config-nodemgr:active
2025-07-31 02:37:06,916 - INFO -     api-server:active
2025-07-31 02:37:06,929 - INFO -     schema:backup
2025-07-31 02:37:06,944 - INFO -     svc-monitor:backup
2025-07-31 02:37:06,954 - INFO -     device-manager:backup
2025-07-31 02:37:06,954 - INFO -   config-database
2025-07-31 02:37:06,954 - INFO -     config-cassandra:active
2025-07-31 02:37:06,955 - INFO -     config-zookeeper:active
2025-07-31 02:37:06,955 - INFO -     config-rabbitmq:active
2025-07-31 02:37:06,955 - INFO -   control
2025-07-31 02:37:06,972 - INFO -     control-nodemgr:active
2025-07-31 02:37:06,994 - INFO -     control:active
2025-07-31 02:37:06,995 - INFO -     named:active
2025-07-31 02:37:07,012 - INFO -     dns:active
2025-07-31 02:37:07,013 - INFO -   analytics
2025-07-31 02:37:07,037 - INFO -     analytics-nodemgr:active
2025-07-31 02:37:07,051 - INFO -     analytics-api:active
2025-07-31 02:37:07,067 - INFO -     collector:active
2025-07-31 02:37:07,068 - INFO -   analytics-database
2025-07-31 02:37:07,069 - INFO -     analytics-cassandra:active
2025-07-31 02:37:07,081 - INFO -     analyticsdb-nodemgr:active
2025-07-31 02:37:07,095 - INFO -     query-engine:active
2025-07-31 02:37:07,095 - INFO -   webui
2025-07-31 02:37:07,096 - INFO -     webui:active
2025-07-31 02:37:07,096 - INFO -     webui-middleware:active
2025-07-31 02:37:07,096 - INFO -     redis:active
2025-07-31 02:37:07,096 - INFO -   analytics_snmp
2025-07-31 02:37:07,103 - INFO -     snmp-collector:active
2025-07-31 02:37:07,103 - INFO -     snmp-topology:active
2025-07-31 02:37:07,103 - INFO -   analytics_alarm
2025-07-31 02:37:07,104 - INFO -     alarmgen:active
2025-07-31 02:37:07,162 - INFO - 10.0.0.38
2025-07-31 02:37:07,162 - INFO -   config
2025-07-31 02:37:07,175 - INFO -     config-nodemgr:active
2025-07-31 02:37:07,186 - INFO -     api-server:active
2025-07-31 02:37:07,198 - INFO -     schema:backup
2025-07-31 02:37:07,209 - INFO -     svc-monitor:backup
2025-07-31 02:37:07,220 - INFO -     device-manager:backup
2025-07-31 02:37:07,220 - INFO -   config-database
2025-07-31 02:37:07,221 - INFO -     config-cassandra:active
2025-07-31 02:37:07,221 - INFO -     config-zookeeper:active
2025-07-31 02:37:07,221 - INFO -     config-rabbitmq:active
2025-07-31 02:37:07,221 - INFO -   control
2025-07-31 02:37:07,231 - INFO -     control-nodemgr:active
2025-07-31 02:37:07,241 - INFO -     control:active
2025-07-31 02:37:07,241 - INFO -     named:active
2025-07-31 02:37:07,252 - INFO -     dns:active
2025-07-31 02:37:07,252 - INFO -   analytics
2025-07-31 02:37:07,263 - INFO -     analytics-nodemgr:active
2025-07-31 02:37:07,272 - INFO -     analytics-api:active
2025-07-31 02:37:07,280 - INFO -     collector:active
2025-07-31 02:37:07,280 - INFO -   analytics-database
2025-07-31 02:37:07,281 - INFO -     analytics-cassandra:active
2025-07-31 02:37:07,288 - INFO -     analyticsdb-nodemgr:active
2025-07-31 02:37:07,300 - INFO -     query-engine:active
2025-07-31 02:37:07,300 - INFO -   webui
2025-07-31 02:37:07,301 - INFO -     webui:active
2025-07-31 02:37:07,301 - INFO -     webui-middleware:active
2025-07-31 02:37:07,301 - INFO -     redis:active
2025-07-31 02:37:07,301 - INFO -   analytics_snmp
2025-07-31 02:37:07,308 - INFO -     snmp-collector:active
2025-07-31 02:37:07,308 - INFO -     snmp-topology:active
2025-07-31 02:37:07,308 - INFO -   analytics_alarm
2025-07-31 02:37:07,308 - INFO -     alarmgen:active
2025-07-31 02:37:07,356 - INFO - 10.0.0.61
2025-07-31 02:37:07,356 - INFO -   config
2025-07-31 02:37:07,367 - INFO -     config-nodemgr:active
2025-07-31 02:37:07,377 - INFO -     api-server:active
2025-07-31 02:37:07,388 - INFO -     schema:active
2025-07-31 02:37:07,399 - INFO -     svc-monitor:active
2025-07-31 02:37:07,406 - INFO -     device-manager:active
2025-07-31 02:37:07,406 - INFO -   config-database
2025-07-31 02:37:07,406 - INFO -     config-cassandra:active
2025-07-31 02:37:07,406 - INFO -     config-zookeeper:active
2025-07-31 02:37:07,406 - INFO -     config-rabbitmq:active
2025-07-31 02:37:07,406 - INFO -   control
2025-07-31 02:37:07,414 - INFO -     control-nodemgr:active
2025-07-31 02:37:07,422 - INFO -     control:active
2025-07-31 02:37:07,422 - INFO -     named:active
2025-07-31 02:37:07,428 - INFO -     dns:active
2025-07-31 02:37:07,428 - INFO -   analytics
2025-07-31 02:37:07,435 - INFO -     analytics-nodemgr:active
2025-07-31 02:37:07,444 - INFO -     analytics-api:active
2025-07-31 02:37:07,458 - INFO -     collector:active
2025-07-31 02:37:07,458 - INFO -   analytics-database
2025-07-31 02:37:07,458 - INFO -     analytics-cassandra:active
2025-07-31 02:37:07,469 - INFO -     analyticsdb-nodemgr:active
2025-07-31 02:37:07,478 - INFO -     query-engine:active
2025-07-31 02:37:07,478 - INFO -   webui
2025-07-31 02:37:07,478 - INFO -     webui:active
2025-07-31 02:37:07,478 - INFO -     webui-middleware:active
2025-07-31 02:37:07,478 - INFO -     redis:active
2025-07-31 02:37:07,479 - INFO -   analytics_snmp
2025-07-31 02:37:07,483 - INFO -     snmp-collector:active
2025-07-31 02:37:07,484 - INFO -     snmp-topology:active
2025-07-31 02:37:07,484 - INFO -   analytics_alarm
2025-07-31 02:37:07,484 - INFO -     alarmgen:active
2025-07-31 02:37:07,540 - INFO - 10.0.0.27
2025-07-31 02:37:07,540 - INFO -   vrouter
2025-07-31 02:37:07,551 - INFO -     vrouter-nodemgr:active
2025-07-31 02:37:07,561 - INFO -     agent:active
2025-07-31 02:37:07,609 - INFO - 10.0.0.57
2025-07-31 02:37:07,610 - INFO -   vrouter
2025-07-31 02:37:07,622 - INFO -     vrouter-nodemgr:active
2025-07-31 02:37:07,634 - INFO -     agent:active
2025-07-31 02:37:07,635 - INFO - All the contrail services are up on all nodes
2025-07-31 02:37:07,635 - INFO - contrail-status passed
2025-07-31 02:37:08,375 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:37:08,375 - INFO - END TEST : test_contrail_status : PASSED[0:00:03]
2025-07-31 02:37:08,375 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:37:11,383 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control:0?flat
2025-07-31 02:37:11,475 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-dns:0?flat
2025-07-31 02:37:11,555 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control:0?flat
2025-07-31 02:37:11,614 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-dns:0?flat
2025-07-31 02:37:11,650 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control:0?flat
2025-07-31 02:37:11,701 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-dns:0?flat
2025-07-31 02:37:11,732 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:11,774 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:11,816 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-schema:0?flat
2025-07-31 02:37:11,838 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-svc-monitor:0?flat
2025-07-31 02:37:11,865 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generators
2025-07-31 02:37:11,885 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-api:0?flat
2025-07-31 02:37:11,906 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Config:contrail-api:0?flat
2025-07-31 02:37:11,932 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Config:contrail-api:0?flat
2025-07-31 02:37:11,958 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generators
2025-07-31 02:37:11,983 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,007 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,031 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,054 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,089 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,112 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,137 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,164 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,185 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:12,205 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-collector:0?flat
2025-07-31 02:37:12,242 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-query-engine:0?flat
2025-07-31 02:37:12,270 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-collector:0?flat
2025-07-31 02:37:12,305 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-query-engine:0?flat
2025-07-31 02:37:12,335 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-collector:0?flat
2025-07-31 02:37:12,377 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-query-engine:0?flat
2025-07-31 02:37:12,406 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:12,516 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:12,704 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:12,853 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:14,776 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:14,865 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-nodemgr:0?flat
2025-07-31 02:37:14,890 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat
2025-07-31 02:37:14,929 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-nodemgr:0?flat
2025-07-31 02:37:14,954 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-nodemgr:0?flat
2025-07-31 02:37:14,976 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-collector:0?flat
2025-07-31 02:37:15,022 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:15,050 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-nodemgr:0?flat
2025-07-31 02:37:15,075 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-collector:0?flat
2025-07-31 02:37:15,128 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:15,162 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-nodemgr:0?flat
2025-07-31 02:37:15,193 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-collector:0?flat
2025-07-31 02:37:15,238 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Analytics:contrail-analytics-api:0?flat
2025-07-31 02:37:15,275 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-query-engine:0?flat
2025-07-31 02:37:15,319 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Database:contrail-database-nodemgr:0?flat
2025-07-31 02:37:15,349 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-query-engine:0?flat
2025-07-31 02:37:15,389 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Database:contrail-database-nodemgr:0?flat
2025-07-31 02:37:15,424 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-query-engine:0?flat
2025-07-31 02:37:15,465 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Database:contrail-database-nodemgr:0?flat
2025-07-31 02:37:15,497 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1.:Config:contrail-api:0?flat
2025-07-31 02:37:15,531 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2.:Config:contrail-api:0?flat
2025-07-31 02:37:15,560 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3.:Config:contrail-api:0?flat
2025-07-31 02:37:15,597 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control:0?flat
2025-07-31 02:37:15,648 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-control-nodemgr:0?flat
2025-07-31 02:37:15,671 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-1:Control:contrail-dns:0?flat
2025-07-31 02:37:15,708 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control:0?flat
2025-07-31 02:37:15,771 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-control-nodemgr:0?flat
2025-07-31 02:37:15,792 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-2:Control:contrail-dns:0?flat
2025-07-31 02:37:15,830 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control:0?flat
2025-07-31 02:37:15,888 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-control-nodemgr:0?flat
2025-07-31 02:37:15,920 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/cn-jenkins-deploy-platform-ansible-os-3732-3:Control:contrail-dns:0?flat
2025-07-31 02:37:17,444 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat
2025-07-31 02:37:19,074 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:19,183 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat
2025-07-31 02:37:19,285 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat
2025-07-31 02:37:19,388 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:19,474 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat
2025-07-31 02:37:19,553 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat
2025-07-31 02:37:19,649 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:19,698 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat
2025-07-31 02:37:19,741 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat
2025-07-31 02:37:19,804 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:19,889 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat
2025-07-31 02:37:19,951 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/analytics-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat
2025-07-31 02:37:21,478 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:21,514 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-2.?flat
2025-07-31 02:37:21,557 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-3.?flat
2025-07-31 02:37:21,595 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/config-node/cn-jenkins-deploy-platform-ansible-os-3732-1.?flat
2025-07-31 02:37:23,073 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-1?flat
2025-07-31 02:37:23,128 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-2?flat
2025-07-31 02:37:23,180 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3732-3?flat
2025-07-31 05:51:26,465 - INFO - Using existing project ['default-domain', 'admin'](2761afbf-24b2-4f6f-abe2-e910af9609e1)
2025-07-31 05:51:26,486 - INFO - ================================================================================
2025-07-31 05:51:26,486 - INFO - STARTING TEST    : test_contrail_alarms
2025-07-31 05:51:26,486 - INFO - TEST DESCRIPTION :  Test to check if alarms are present

        
2025-07-31 05:51:27,842 - DEBUG - Skipping xmpp flap check
2025-07-31 05:51:27,842 - INFO - Initial checks done. Running the testcase now
2025-07-31 05:51:27,842 - INFO - 
2025-07-31 05:51:27,842 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms
2025-07-31 05:51:28,239 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/alarms
2025-07-31 05:51:29,791 - DEBUG - Skipping xmpp flap check
2025-07-31 05:51:29,791 - INFO - END TEST : test_contrail_alarms : PASSED[0:00:03]
2025-07-31 05:51:29,792 - INFO - --------------------------------------------------------------------------------
2025-07-31 05:51:29,801 - INFO - ================================================================================
2025-07-31 05:51:29,801 - INFO - STARTING TEST    : test_contrail_status
2025-07-31 05:51:29,801 - INFO - TEST DESCRIPTION :  Test to verify that all services are running and active

        
2025-07-31 05:51:31,129 - DEBUG - Skipping xmpp flap check
2025-07-31 05:51:31,129 - INFO - Initial checks done. Running the testcase now
2025-07-31 05:51:31,130 - INFO - 
2025-07-31 05:51:31,384 - INFO - 10.0.0.41
2025-07-31 05:51:31,384 - INFO -   config
2025-07-31 05:51:31,402 - INFO -     config-nodemgr:active
2025-07-31 05:51:31,414 - INFO -     api-server:active
2025-07-31 05:51:31,427 - INFO -     schema:backup
2025-07-31 05:51:31,439 - INFO -     svc-monitor:backup
2025-07-31 05:51:31,454 - INFO -     device-manager:backup
2025-07-31 05:51:31,454 - INFO -   config-database
2025-07-31 05:51:31,454 - INFO -     config-cassandra:active
2025-07-31 05:51:31,454 - INFO -     config-zookeeper:active
2025-07-31 05:51:31,454 - INFO -     config-rabbitmq:active
2025-07-31 05:51:31,455 - INFO -   control
2025-07-31 05:51:31,468 - INFO -     control-nodemgr:active
2025-07-31 05:51:31,479 - INFO -     control:active
2025-07-31 05:51:31,480 - INFO -     named:active
2025-07-31 05:51:31,496 - INFO -     dns:active
2025-07-31 05:51:31,496 - INFO -   analytics
2025-07-31 05:51:31,511 - INFO -     analytics-nodemgr:active
2025-07-31 05:51:31,527 - INFO -     analytics-api:active
2025-07-31 05:51:31,544 - INFO -     collector:active
2025-07-31 05:51:31,544 - INFO -   analytics-database
2025-07-31 05:51:31,545 - INFO -     analytics-cassandra:active
2025-07-31 05:51:31,556 - INFO -     analyticsdb-nodemgr:active
2025-07-31 05:51:31,567 - INFO -     query-engine:active
2025-07-31 05:51:31,567 - INFO -   webui
2025-07-31 05:51:31,567 - INFO -     webui:active
2025-07-31 05:51:31,568 - INFO -     webui-middleware:active
2025-07-31 05:51:31,568 - INFO -     redis:active
2025-07-31 05:51:31,568 - INFO -   analytics_snmp
2025-07-31 05:51:31,578 - INFO -     snmp-collector:active
2025-07-31 05:51:31,578 - INFO -     snmp-topology:active
2025-07-31 05:51:31,579 - INFO -   analytics_alarm
2025-07-31 05:51:31,579 - INFO -     alarmgen:active
2025-07-31 05:51:31,720 - INFO - 10.0.0.38
2025-07-31 05:51:31,721 - INFO -   config
2025-07-31 05:51:31,737 - INFO -     config-nodemgr:active
2025-07-31 05:51:31,749 - INFO -     api-server:active
2025-07-31 05:51:31,765 - INFO -     schema:backup
2025-07-31 05:51:31,781 - INFO -     svc-monitor:backup
2025-07-31 05:51:31,797 - INFO -     device-manager:backup
2025-07-31 05:51:31,797 - INFO -   config-database
2025-07-31 05:51:31,798 - INFO -     config-cassandra:active
2025-07-31 05:51:31,798 - INFO -     config-zookeeper:active
2025-07-31 05:51:31,798 - INFO -     config-rabbitmq:active
2025-07-31 05:51:31,798 - INFO -   control
2025-07-31 05:51:31,808 - INFO -     control-nodemgr:active
2025-07-31 05:51:31,819 - INFO -     control:active
2025-07-31 05:51:31,820 - INFO -     named:active
2025-07-31 05:51:31,832 - INFO -     dns:active
2025-07-31 05:51:31,833 - INFO -   analytics
2025-07-31 05:51:31,847 - INFO -     analytics-nodemgr:active
2025-07-31 05:51:31,861 - INFO -     analytics-api:active
2025-07-31 05:51:31,874 - INFO -     collector:active
2025-07-31 05:51:31,875 - INFO -   analytics-database
2025-07-31 05:51:31,875 - INFO -     analytics-cassandra:active
2025-07-31 05:51:31,885 - INFO -     analyticsdb-nodemgr:active
2025-07-31 05:51:31,897 - INFO -     query-engine:active
2025-07-31 05:51:31,898 - INFO -   webui
2025-07-31 05:51:31,898 - INFO -     webui:active
2025-07-31 05:51:31,898 - INFO -     webui-middleware:active
2025-07-31 05:51:31,898 - INFO -     redis:active
2025-07-31 05:51:31,899 - INFO -   analytics_snmp
2025-07-31 05:51:31,908 - INFO -     snmp-collector:active
2025-07-31 05:51:31,908 - INFO -     snmp-topology:active
2025-07-31 05:51:31,909 - INFO -   analytics_alarm
2025-07-31 05:51:31,909 - INFO -     alarmgen:active
2025-07-31 05:51:32,026 - INFO - 10.0.0.61
2025-07-31 05:51:32,027 - INFO -   config
2025-07-31 05:51:32,044 - INFO -     config-nodemgr:active
2025-07-31 05:51:32,057 - INFO -     api-server:active
2025-07-31 05:51:32,063 - INFO -     schema:active
2025-07-31 05:51:32,073 - INFO -     svc-monitor:active
2025-07-31 05:51:32,086 - INFO -     device-manager:active
2025-07-31 05:51:32,087 - INFO -   config-database
2025-07-31 05:51:32,087 - INFO -     config-cassandra:active
2025-07-31 05:51:32,087 - INFO -     config-zookeeper:active
2025-07-31 05:51:32,087 - INFO -     config-rabbitmq:active
2025-07-31 05:51:32,088 - INFO -   control
2025-07-31 05:51:32,102 - INFO -     control-nodemgr:active
2025-07-31 05:51:32,115 - INFO -     control:active
2025-07-31 05:51:32,115 - INFO -     named:active
2025-07-31 05:51:32,124 - INFO -     dns:active
2025-07-31 05:51:32,124 - INFO -   analytics
2025-07-31 05:51:32,132 - INFO -     analytics-nodemgr:active
2025-07-31 05:51:32,141 - INFO -     analytics-api:active
2025-07-31 05:51:32,153 - INFO -     collector:active
2025-07-31 05:51:32,153 - INFO -   analytics-database
2025-07-31 05:51:32,153 - INFO -     analytics-cassandra:active
2025-07-31 05:51:32,164 - INFO -     analyticsdb-nodemgr:active
2025-07-31 05:51:32,173 - INFO -     query-engine:active
2025-07-31 05:51:32,173 - INFO -   webui
2025-07-31 05:51:32,173 - INFO -     webui:active
2025-07-31 05:51:32,173 - INFO -     webui-middleware:active
2025-07-31 05:51:32,174 - INFO -     redis:active
2025-07-31 05:51:32,174 - INFO -   analytics_snmp
2025-07-31 05:51:32,184 - INFO -     snmp-collector:active
2025-07-31 05:51:32,185 - INFO -     snmp-topology:active
2025-07-31 05:51:32,185 - INFO -   analytics_alarm
2025-07-31 05:51:32,185 - INFO -     alarmgen:active
2025-07-31 05:51:32,290 - INFO - 10.0.0.27
2025-07-31 05:51:32,290 - INFO -   vrouter
2025-07-31 05:51:32,304 - INFO -     vrouter-nodemgr:active
2025-07-31 05:51:32,317 - INFO -     agent:active
2025-07-31 05:51:32,433 - INFO - 10.0.0.57
2025-07-31 05:51:32,434 - INFO -   vrouter
2025-07-31 05:51:32,447 - INFO -     vrouter-nodemgr:active
2025-07-31 05:51:32,462 - INFO -     agent:active
2025-07-31 05:51:32,462 - INFO - All the contrail services are up on all nodes
2025-07-31 05:51:32,463 - INFO - contrail-status passed
2025-07-31 05:51:33,868 - DEBUG - Skipping xmpp flap check
2025-07-31 05:51:33,868 - INFO - END TEST : test_contrail_status : PASSED[0:00:04]
2025-07-31 05:51:33,870 - INFO - --------------------------------------------------------------------------------