2025-10-22 19:44:31,235 - DEBUG - [10.0.0.141]: Running cmd : hostname 2025-10-22 19:44:31,889 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-605-1 2025-10-22 19:44:31,890 - DEBUG - [10.0.0.141]: Running cmd : hostname -f 2025-10-22 19:44:31,986 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-605-1 2025-10-22 19:44:31,986 - DEBUG - [10.0.0.141]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-10-22 19:44:32,133 - DEBUG - Output : NAMES contrail_test_ZdcZzCDTp vrouter-vrouter-agent-1 vrouter-nodemgr-1 webui-web-1 webui-job-1 analytics_database-nodemgr-1 analytics_database-query-engine-1 analytics_database-cassandra-1 analytics_snmp-snmp-collector-1 analytics_snmp-topology-1 analytics_snmp-nodemgr-1 analytics_alarm-kafka-1 analytics_alarm-nodemgr-1 analytics_alarm-alarm-gen-1 analytics-nodemgr-1 analytics-api-1 analytics-collector-1 redis-redis-1 redis-stunnel-1 control-named-1 control-nodemgr-1 control-dns-1 control-control-1 config_database-zookeeper-1 config_database-cassandra-1 config_database-nodemgr-1 config_database-rabbitmq-1 config_api-devicemgr-1 config_api-nodemgr-1 config_api-schema-1 config_api-svcmonitor-1 config_api-dnsmasq-1 config_api-api-1 2025-10-22 19:44:32,134 - DEBUG - [10.0.0.141]: Running cmd : getent hosts 10.0.0.141 | head -n 1 | awk '{print $2}' 2025-10-22 19:44:32,239 - DEBUG - Output : cn-jenkins-deploy-platform-juju-os-605-1 2025-10-22 19:44:32,240 - DEBUG - [10.0.0.141]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-10-22 19:44:32,340 - DEBUG - Output : 127.0.0.1/8 252.141.0.1/8 10.77.225.1/24 172.17.0.1/16 10.0.0.141/24 2025-10-22 19:44:32,340 - DEBUG - [10.0.0.141]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-10-22 19:44:32,445 - DEBUG - Output : 10.0.0.141/24 2025-10-22 19:44:44,864 - INFO - Using existing project ['admin_domain', 'admin'](f781f28b-ae85-4ed8-be8d-6a8f1248d78b) 2025-10-22 19:44:45,042 - INFO - ================================================================================ 2025-10-22 19:44:45,042 - INFO - STARTING TEST : test_contrail_status 2025-10-22 19:44:45,042 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-10-22 19:44:45,282 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:44:45,338 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.0.0.141': '0'}} with 2025-10-22 19:44:45,338 - INFO - Initial checks done. Running the testcase now 2025-10-22 19:44:45,338 - INFO - 2025-10-22 19:44:45,338 - DEBUG - [10.0.0.141]: Running cmd : docker ps -f status=running --format {{.Names}} 2>/dev/null 2025-10-22 19:44:45,443 - DEBUG - Output : contrail_test_ZdcZzCDTp vrouter-vrouter-agent-1 vrouter-nodemgr-1 vrouter-provisioner-1 webui-web-1 webui-job-1 control-provisioner-1 config_api-provisioner-1 analytics_database-nodemgr-1 analytics_database-query-engine-1 analytics_database-provisioner-1 analytics_database-cassandra-1 analytics_snmp-snmp-collector-1 analytics_snmp-provisioner-1 analytics_snmp-topology-1 analytics_snmp-nodemgr-1 analytics_alarm-kafka-1 analytics_alarm-nodemgr-1 analytics_alarm-provisioner-1 analytics_alarm-alarm-gen-1 analytics-provisioner-1 analytics-nodemgr-1 analytics-api-1 analytics-collector-1 redis-redis-1 redis-stunnel-1 control-named-1 control-nodemgr-1 control-dns-1 control-control-1 config_database-provisioner-1 config_database-zookeeper-1 config_database-cassandra-1 config_database-nodemgr-1 config_database-rabbitmq-1 config_api-devicemgr-1 config_api-nodemgr-1 config_api-schema-1 config_api-svcmonitor-1 config_api-dnsmasq-1 config_api-api-1 2025-10-22 19:44:45,443 - INFO - 10.0.0.141 2025-10-22 19:44:45,443 - INFO - config 2025-10-22 19:44:45,508 - INFO - config-nodemgr:active 2025-10-22 19:44:45,567 - INFO - api-server:active 2025-10-22 19:44:45,627 - INFO - schema:active 2025-10-22 19:44:45,703 - INFO - svc-monitor:active 2025-10-22 19:44:45,759 - INFO - device-manager:active 2025-10-22 19:44:45,759 - INFO - config-database 2025-10-22 19:44:45,759 - INFO - config-cassandra:active 2025-10-22 19:44:45,759 - INFO - config-zookeeper:active 2025-10-22 19:44:45,760 - INFO - config-rabbitmq:active 2025-10-22 19:44:45,760 - INFO - vrouter 2025-10-22 19:44:45,816 - INFO - vrouter-nodemgr:active 2025-10-22 19:44:45,872 - INFO - agent:active 2025-10-22 19:44:45,872 - INFO - control 2025-10-22 19:44:45,936 - INFO - control-nodemgr:active 2025-10-22 19:44:46,001 - INFO - control:active 2025-10-22 19:44:46,001 - INFO - named:active 2025-10-22 19:44:46,068 - INFO - dns:active 2025-10-22 19:44:46,068 - INFO - analytics 2025-10-22 19:44:46,132 - INFO - analytics-nodemgr:active 2025-10-22 19:44:46,187 - INFO - analytics-api:active 2025-10-22 19:44:46,245 - INFO - collector:active 2025-10-22 19:44:46,245 - INFO - analytics-database 2025-10-22 19:44:46,245 - INFO - analytics-cassandra:active 2025-10-22 19:44:46,303 - INFO - analyticsdb-nodemgr:active 2025-10-22 19:44:46,363 - INFO - query-engine:active 2025-10-22 19:44:46,363 - INFO - webui 2025-10-22 19:44:46,364 - INFO - webui:active 2025-10-22 19:44:46,364 - INFO - webui-middleware:active 2025-10-22 19:44:46,364 - INFO - redis:active 2025-10-22 19:44:46,364 - INFO - analytics_snmp 2025-10-22 19:44:46,419 - INFO - snmp-collector:active 2025-10-22 19:44:46,420 - INFO - snmp-topology:active 2025-10-22 19:44:46,420 - INFO - analytics_alarm 2025-10-22 19:44:46,420 - INFO - alarmgen:active 2025-10-22 19:44:46,420 - INFO - All the contrail services are up on all nodes 2025-10-22 19:44:46,420 - INFO - contrail-status passed 2025-10-22 19:44:46,658 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:44:46,713 - DEBUG - No XMPP flaps were noticed during the test
2025-10-22 19:44:46,713 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-10-22 19:44:46,713 - INFO - -------------------------------------------------------------------------------- 2025-10-22 19:44:57,650 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:02,200 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-19457334:ctest-vn22-53535124:ctest-vn22-53535124 2025-10-22 19:45:02,256 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-19457334:ctest-vn22-53535124:ctest-vn22-53535124 2025-10-22 19:45:02,308 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-19457334:ctest-vn22-53535124:ctest-vn22-53535124 2025-10-22 19:45:30,628 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-19457334:ctest-vn22-53535124 2025-10-22 19:45:30,684 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-19457334:ctest-vn22-53535124:ctest-vn22-53535124 2025-10-22 19:45:30,736 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-AnalyticsBasicTestSanity-19457334:ctest-vn22-53535124:ctest-vn22-53535124 2025-10-22 19:45:31,166 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:32,801 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:32,857 - DEBUG - [10.0.0.141]: Running cmd : docker exec --privileged -it config_api-api-1 /bin/bash -c 'db-manage check' 2025-10-22 19:45:36,437 - DEBUG - Output : 2025-10-22 19:45:36,181 INFO: (v1.41) Checker check_zk_mode_and_node_count: Success 2025-10-22 19:45:36,236 ERROR: (v1.41) Checker check_cassandra_keyspace_replication: Exception, NoHostAvailable Python 3.9.21: /usr/bin/python3 Wed Oct 22 19:45:36 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in wrapper(*args=(,), **kwargs={}) 1535 self = args[0] 1536 try: 1537 errors = func(*args, **kwargs) 1538 if not errors: 1539 self._logger.info('(v%s) Checker %s: Success', __version__, errors undefined func = args = (,) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in check_cassandra_keyspace_replication(self=) 1635 raise CassandraConnectionError("error, {}: {}".format( 1636 error, utils.detailed_traceback())) 1637 temp_cluster.connect() 1638 for ks_name, _ in self._db_info: 1639 if self._api_args.cluster_id: temp_cluster = temp_cluster.connect = > /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection._reconnect_internal() NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) errors = {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) NoHostAvailable Python 3.9.21: /usr/bin/python3 Wed Oct 22 19:45:36 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/local/bin/db-manage in 4 import sys 5 from vnc_cfg_api_server.db_manage import main 6 if __name__ == '__main__': 7 sys.argv[0] = re.sub(r'(-script\.pyw|\.exe)?$', '', sys.argv[0]) 8 sys.exit(main()) sys = sys.exit = main = /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in main() 3451 verb = args.operation 3452 if 'db_%s' % (verb) in globals(): 3453 return globals()['db_%s' % (verb)](args, api_args) 3454 3455 if getattr(DatabaseChecker, verb, None): builtinglobals = verb = 'check' args = Namespace(operation='check', api_conf='/etc/cont...1024, log_file='/var/log/contrail/db_manage.log') api_args = Namespace(conf_file=['/etc/contrail/contrail-api...esh_base.SandeshConfig object at 0x7f8043645550>) /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in db_check(args=Namespace(operation='check', api_conf='/etc/cont...1024, log_file='/var/log/contrail/db_manage.log'), api_args=Namespace(conf_file=['/etc/contrail/contrail-api...esh_base.SandeshConfig object at 0x7f8043645550>)) 3358 # Mode and node count check across all nodes 3359 db_checker.check_zk_mode_and_node_count() 3360 db_checker.check_cassandra_keyspace_replication() 3361 # Obj UUID cassandra inconsistencies 3362 db_checker.check_obj_mandatory_fields() db_checker = db_checker.check_cassandra_keyspace_replication = > /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in wrapper(*args=(,), **kwargs={}) 1535 self = args[0] 1536 try: 1537 errors = func(*args, **kwargs) 1538 if not errors: 1539 self._logger.info('(v%s) Checker %s: Success', __version__, errors undefined func = args = (,) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py in check_cassandra_keyspace_replication(self=) 1635 raise CassandraConnectionError("error, {}: {}".format( 1636 error, utils.detailed_traceback())) 1637 temp_cluster.connect() 1638 for ks_name, _ in self._db_info: 1639 if self._api_args.cluster_id: temp_cluster = temp_cluster.connect = > /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.Cluster.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection.connect() /cassandra/cluster.py in cassandra.cluster.ControlConnection._reconnect_internal() NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) errors = {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/local/bin/db-manage", line 8, in sys.exit(main()) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 3453, in main return globals()['db_%s' % (verb)](args, api_args) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 3360, in db_check db_checker.check_cassandra_keyspace_replication() File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1537, in wrapper errors = func(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_cfg_api_server/db_manage.py", line 1637, in check_cassandra_keyspace_replication temp_cluster.connect() File "cassandra/cluster.py", line 1717, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1753, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1740, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3543, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3588, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.0.0.141:9041': ConnectionResetError(104, 'Connection reset by peer')}) 2025-10-22 19:45:36,711 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:37,121 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:37,424 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:37,740 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:38,039 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:41,810 - INFO - admin user already present 2025-10-22 19:45:43,048 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:45:47,088 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:45:47,140 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:45:47,192 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:45:49,644 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928:ctest-vn1-94617928 2025-10-22 19:45:49,696 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928:ctest-vn1-94617928 2025-10-22 19:45:49,747 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928:ctest-vn1-94617928 2025-10-22 19:46:01,721 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3eb5526f-4c67-485d-a740-be086fea3dda 2025-10-22 19:46:01,781 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928:ctest-vn1-94617928 2025-10-22 19:46:01,836 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3eb5526f-4c67-485d-a740-be086fea3dda 2025-10-22 19:46:15,933 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3b6c31d-95c1-4394-b7de-87541997c8a1 2025-10-22 19:46:15,984 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:46:16,036 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e3b6c31d-95c1-4394-b7de-87541997c8a1 2025-10-22 19:46:17,864 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3eb5526f-4c67-485d-a740-be086fea3dda 2025-10-22 19:46:17,916 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072 2025-10-22 19:46:17,968 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:46:18,024 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=3 2025-10-22 19:46:24,804 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928 2025-10-22 19:46:24,857 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928:ctest-vn1-94617928 2025-10-22 19:46:24,912 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-vn1-94617928:ctest-vn1-94617928 2025-10-22 19:46:25,536 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072 2025-10-22 19:46:25,587 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:46:25,640 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-FloatingipBasicTestSanity-87083706:ctest-fvn-99876072:ctest-fvn-99876072 2025-10-22 19:46:26,156 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:30,413 - INFO - ctest-TestHeat-13611309 user already added to project 2025-10-22 19:46:30,766 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:31,837 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:40,665 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:49,629 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:54,156 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:57,471 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:46:57,873 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:47:08,533 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8dc4639a-f683-487a-817c-7e4f24127a61 2025-10-22 19:47:08,589 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestPorts-48593546:ctest-vn1-38349601:ctest-vn1-38349601 2025-10-22 19:47:08,663 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8dc4639a-f683-487a-817c-7e4f24127a61 2025-10-22 19:47:19,433 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cda63c45-c768-458b-90ac-e2f2a8081c63 2025-10-22 19:47:19,488 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestPorts-48593546:ctest-vn1-38349601:ctest-vn1-38349601 2025-10-22 19:47:19,540 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:cda63c45-c768-458b-90ac-e2f2a8081c63 2025-10-22 19:47:26,324 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:47:30,970 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:47:44,717 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b541f9f-7593-4864-b3d0-5fc421e076ca 2025-10-22 19:47:44,777 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRouters-60768019:ctest-vn1-78431983:ctest-vn1-78431983 2025-10-22 19:47:44,836 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b541f9f-7593-4864-b3d0-5fc421e076ca 2025-10-22 19:47:51,381 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f67f020e-0da1-4a40-8029-d7713db69313 2025-10-22 19:47:51,436 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRouters-60768019:ctest-vn2-64435861:ctest-vn2-64435861 2025-10-22 19:47:51,488 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:f67f020e-0da1-4a40-8029-d7713db69313 2025-10-22 19:48:20,485 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:48:25,041 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:48:39,430 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:573f6921-1153-42d5-8005-1f938885fe25 2025-10-22 19:48:39,484 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRoutersBasic-00737303:ctest-vn-77319061:ctest-vn-77319061 2025-10-22 19:48:39,537 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:573f6921-1153-42d5-8005-1f938885fe25 2025-10-22 19:48:51,493 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ede8d94a-15f8-47cc-a353-471ec444cc04 2025-10-22 19:48:51,548 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRoutersBasic-00737303:ctest-ext_vn-31551136:ctest-ext_vn-31551136 2025-10-22 19:48:51,599 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ede8d94a-15f8-47cc-a353-471ec444cc04 2025-10-22 19:49:00,765 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:05,349 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:11,960 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-18128730:ctest-vn-18128730 2025-10-22 19:49:12,013 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-18128730:ctest-vn-18128730 2025-10-22 19:49:12,067 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-18128730:ctest-vn-18128730 2025-10-22 19:49:13,448 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-45455072:ctest-vn-45455072 2025-10-22 19:49:13,499 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-45455072:ctest-vn-45455072 2025-10-22 19:49:13,552 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-45455072:ctest-vn-45455072 2025-10-22 19:49:14,824 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-45455072 2025-10-22 19:49:14,876 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-45455072:ctest-vn-45455072 2025-10-22 19:49:14,932 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-45455072:ctest-vn-45455072 2025-10-22 19:49:15,576 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-18128730 2025-10-22 19:49:15,627 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-18128730:ctest-vn-18128730 2025-10-22 19:49:15,676 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyIpv4v6-56563109:ctest-vn-18128730:ctest-vn-18128730 2025-10-22 19:49:16,187 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:20,672 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:21,090 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:26,195 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-52444208:ctest-vn4-84593056:ctest-vn4-84593056 2025-10-22 19:49:26,252 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-52444208:ctest-vn4-84593056:ctest-vn4-84593056 2025-10-22 19:49:26,308 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-52444208:ctest-vn4-84593056:ctest-vn4-84593056 2025-10-22 19:49:27,341 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-52444208:ctest-vn4-84593056 2025-10-22 19:49:27,392 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-52444208:ctest-vn4-84593056:ctest-vn4-84593056 2025-10-22 19:49:27,443 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicyNegativeIpv4v6-52444208:ctest-vn4-84593056:ctest-vn4-84593056 2025-10-22 19:49:28,170 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:28,600 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:33,193 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:49:39,060 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148:ctest-vn-14581148 2025-10-22 19:49:39,111 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148:ctest-vn-14581148 2025-10-22 19:49:39,164 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148:ctest-vn-14581148 2025-10-22 19:49:40,524 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770:ctest-vn-22432770 2025-10-22 19:49:40,576 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770:ctest-vn-22432770 2025-10-22 19:49:40,627 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770:ctest-vn-22432770 2025-10-22 19:49:49,297 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ac3042b4-8324-45a1-a696-c26e89eafb0f 2025-10-22 19:49:49,357 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148:ctest-vn-14581148 2025-10-22 19:49:49,412 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:ac3042b4-8324-45a1-a696-c26e89eafb0f 2025-10-22 19:50:03,531 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7b294ee6-a57c-4a69-b8c1-5197bd25b2ef 2025-10-22 19:50:03,590 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770:ctest-vn-22432770 2025-10-22 19:50:03,648 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:7b294ee6-a57c-4a69-b8c1-5197bd25b2ef 2025-10-22 19:50:17,244 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770 2025-10-22 19:50:17,300 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770:ctest-vn-22432770 2025-10-22 19:50:17,361 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-22432770:ctest-vn-22432770 2025-10-22 19:50:18,092 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148 2025-10-22 19:50:18,145 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148:ctest-vn-14581148 2025-10-22 19:50:18,197 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicPolicy-62691170:ctest-vn-14581148:ctest-vn-14581148 2025-10-22 19:50:18,717 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:50:23,455 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:50:35,825 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c410b312-a290-49ba-903b-05ea085a9e8d 2025-10-22 19:50:35,880 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRP-50139866:ctest-bgpaas_vn-88649100:ctest-bgpaas_vn-88649100 2025-10-22 19:50:35,932 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c410b312-a290-49ba-903b-05ea085a9e8d 2025-10-22 19:50:47,678 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:daf836e1-0689-4f25-87f6-f82b311a7396 2025-10-22 19:50:47,733 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestRP-50139866:ctest-bgpaas_vn-36895653:ctest-bgpaas_vn-36895653 2025-10-22 19:50:47,784 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:daf836e1-0689-4f25-87f6-f82b311a7396 2025-10-22 19:50:49,639 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:50:56,854 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:51:01,386 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:51:05,024 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:51:05,076 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:51:05,128 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:51:07,376 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:51:07,428 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:51:07,480 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:51:09,805 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:51:09,856 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:51:09,913 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:51:28,273 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:902620c7-4b23-4386-956e-0f8442daf21a 2025-10-22 19:51:28,329 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:51:28,387 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:93eb0b2f-c1c8-4c6a-a006-d986460b04b8 2025-10-22 19:51:28,442 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:51:28,502 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35174429-3aa8-4af2-9ef7-54bb905bdfaf 2025-10-22 19:51:28,560 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:51:28,612 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35174429-3aa8-4af2-9ef7-54bb905bdfaf 2025-10-22 19:51:28,669 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:902620c7-4b23-4386-956e-0f8442daf21a 2025-10-22 19:51:28,729 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:93eb0b2f-c1c8-4c6a-a006-d986460b04b8 2025-10-22 19:52:10,528 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0713c72c-dc3d-4518-aede-06fc6166693f 2025-10-22 19:52:10,580 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:52:10,631 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0713c72c-dc3d-4518-aede-06fc6166693f 2025-10-22 19:52:12,961 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:551f3f9d-3fdb-4a53-b335-3e29a31f4a21 2025-10-22 19:52:13,020 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:52:13,076 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:551f3f9d-3fdb-4a53-b335-3e29a31f4a21 2025-10-22 19:52:20,149 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35174429-3aa8-4af2-9ef7-54bb905bdfaf 2025-10-22 19:52:20,204 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:902620c7-4b23-4386-956e-0f8442daf21a 2025-10-22 19:52:20,256 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:93eb0b2f-c1c8-4c6a-a006-d986460b04b8 2025-10-22 19:52:21,583 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377 2025-10-22 19:52:21,632 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:93eb0b2f-c1c8-4c6a-a006-d986460b04b8 2025-10-22 19:52:21,688 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-22 19:52:21,706 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:52:21,935 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=2 2025-10-22 19:52:22,159 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Layer2RouteReq?x=2 2025-10-22 19:52:22,175 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377 2025-10-22 19:52:22,228 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:52:22,447 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=2 2025-10-22 19:52:22,671 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Layer2RouteReq?x=2 2025-10-22 19:52:22,693 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221 2025-10-22 19:52:22,749 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:902620c7-4b23-4386-956e-0f8442daf21a 2025-10-22 19:52:22,800 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-22 19:52:22,815 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:52:23,031 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=4 2025-10-22 19:52:23,251 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Layer2RouteReq?x=4 2025-10-22 19:52:23,313 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221 2025-10-22 19:52:23,364 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:52:23,579 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=4 2025-10-22 19:52:23,795 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Layer2RouteReq?x=4 2025-10-22 19:52:23,814 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971 2025-10-22 19:52:23,868 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35174429-3aa8-4af2-9ef7-54bb905bdfaf 2025-10-22 19:52:23,920 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-10-22 19:52:23,935 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:52:24,147 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=3 2025-10-22 19:52:24,363 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Layer2RouteReq?x=3 2025-10-22 19:52:24,383 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971 2025-10-22 19:52:24,436 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:52:24,655 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=3 2025-10-22 19:52:24,879 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Layer2RouteReq?x=3 2025-10-22 19:52:25,651 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name= 2025-10-22 19:52:25,705 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=5 2025-10-22 19:52:25,763 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:93eb0b2f-c1c8-4c6a-a006-d986460b04b8 2025-10-22 19:52:25,935 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name= 2025-10-22 19:52:25,989 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_Inet4UcRouteReq?x=6 2025-10-22 19:52:26,043 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35174429-3aa8-4af2-9ef7-54bb905bdfaf 2025-10-22 19:52:34,032 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971 2025-10-22 19:52:34,083 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:52:34,136 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-right_vn-58298971:ctest-right_vn-58298971 2025-10-22 19:52:34,785 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377 2025-10-22 19:52:34,844 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:52:34,896 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-left_vn-91842377:ctest-left_vn-91842377 2025-10-22 19:52:35,508 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221 2025-10-22 19:52:35,563 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:52:35,616 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestSvcRegr-79642623:ctest-mgmt_vn-30759221:ctest-mgmt_vn-30759221 2025-10-22 19:52:36,122 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:52:40,588 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:52:51,381 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:987cdb98-e26e-4497-b377-a75f760672c3 2025-10-22 19:52:51,436 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestvDNSBasic0-13060546:ctest-vn1-vdns-23216869:ctest-vn1-vdns-23216869 2025-10-22 19:52:51,488 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:987cdb98-e26e-4497-b377-a75f760672c3 2025-10-22 19:53:06,398 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_DnsInfo? 2025-10-22 19:53:13,908 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c8ea71aa-d480-4822-b3fc-27cbccf37250 2025-10-22 19:53:13,964 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestvDNSBasic0-13060546:ctest-vn1-vdns-23216869:ctest-vn1-vdns-23216869 2025-10-22 19:53:14,016 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:c8ea71aa-d480-4822-b3fc-27cbccf37250 2025-10-22 19:53:28,362 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_DnsInfo? 2025-10-22 19:53:40,754 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:53:45,140 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:53:55,887 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:49cdd2cb-b78c-4c4c-be4d-b3b26cdcfbce 2025-10-22 19:53:55,940 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVNx-48620249:ctest-vn-52419960:ctest-vn-52419960 2025-10-22 19:53:55,992 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:49cdd2cb-b78c-4c4c-be4d-b3b26cdcfbce 2025-10-22 19:54:07,745 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e0d49f3b-96d7-4813-9922-7f3e416a57ad 2025-10-22 19:54:07,800 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVNx-48620249:ctest-vn-52419960:ctest-vn-52419960 2025-10-22 19:54:07,852 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:e0d49f3b-96d7-4813-9922-7f3e416a57ad 2025-10-22 19:54:17,600 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:54:22,212 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:54:30,647 - DEBUG - [10.0.0.141]: Running cmd : docker exec --privileged -it vrouter-vrouter-agent-1 /bin/bash -c 'echo "10.0.0.141 cn-jenkins-deploy-platform-juju-os-605-1-test" >> /etc/hosts' 2025-10-22 19:54:30,800 - DEBUG - Output : 2025-10-22 19:54:31,669 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35ab2f75-e61c-4ad3-beb8-c36c15c0dc75 2025-10-22 19:54:31,724 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn2_metadata-43991643:ctest-vn2_metadata-43991643 2025-10-22 19:54:31,776 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:35ab2f75-e61c-4ad3-beb8-c36c15c0dc75 2025-10-22 19:54:41,382 - DEBUG - [10.0.0.141]: Running cmd : docker exec --privileged -it vrouter-vrouter-agent-1 /bin/bash -c 'sed -i '$ d' /etc/hosts' 2025-10-22 19:54:41,583 - DEBUG - Output : sed: -e expression #1, char 1: missing command 2025-10-22 19:54:44,885 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:54:45,314 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:54:53,815 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fc1be34a-f591-4db8-8353-b6d1e85e79ac 2025-10-22 19:54:53,879 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-06441021:ctest-vn-06441021 2025-10-22 19:54:53,937 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fc1be34a-f591-4db8-8353-b6d1e85e79ac 2025-10-22 19:55:14,475 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:55:14,882 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:55:23,155 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-20218727:ctest-vn-20218727 2025-10-22 19:55:29,133 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44166c2c-7b0d-43da-a1e0-be7a5b5ee325 2025-10-22 19:55:29,188 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-20218727:ctest-vn-20218727 2025-10-22 19:55:29,244 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:44166c2c-7b0d-43da-a1e0-be7a5b5ee325 2025-10-22 19:55:41,089 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fd9be390-ebf3-429d-beb9-5c5abb051f3f 2025-10-22 19:55:41,140 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-20218727:ctest-vn-20218727 2025-10-22 19:55:41,191 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:fd9be390-ebf3-429d-beb9-5c5abb051f3f 2025-10-22 19:55:43,504 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a995db8a-3592-4d92-8d9e-d2e2599aed95 2025-10-22 19:55:43,557 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-20218727:ctest-vn-20218727 2025-10-22 19:55:43,608 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a995db8a-3592-4d92-8d9e-d2e2599aed95 2025-10-22 19:56:02,664 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VnListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-20218727 2025-10-22 19:56:02,715 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name=admin_domain:ctest-TestBasicVMVN-61422332:ctest-vn-20218727:ctest-vn-20218727 2025-10-22 19:56:02,769 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_VrfListReq?name= 2025-10-22 19:56:02,824 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_KRouteReq?x=2 2025-10-22 19:56:02,880 - DEBUG - Unable to fetch route details in vrouter for vrf index 2, Got :[] 2025-10-22 19:56:03,576 - DEBUG - Requesting: https://10.0.0.141:8085/Snh_AgentXmppConnectionStatusReq? 2025-10-22 19:57:59,091 - INFO - Using existing project ['admin_domain', 'admin'](f781f28b-ae85-4ed8-be8d-6a8f1248d78b) 2025-10-22 19:57:59,101 - INFO - ================================================================================ 2025-10-22 19:57:59,101 - INFO - STARTING TEST : test_contrail_status 2025-10-22 19:57:59,101 - INFO - TEST DESCRIPTION : Test to verify that all services are running and active 2025-10-22 19:57:59,323 - DEBUG - Skipping xmpp flap check 2025-10-22 19:57:59,323 - INFO - Initial checks done. Running the testcase now 2025-10-22 19:57:59,323 - INFO - 2025-10-22 19:57:59,460 - INFO - 10.0.0.141 2025-10-22 19:57:59,460 - INFO - config 2025-10-22 19:57:59,517 - INFO - config-nodemgr:active 2025-10-22 19:57:59,575 - INFO - api-server:active 2025-10-22 19:57:59,631 - INFO - schema:active 2025-10-22 19:57:59,688 - INFO - svc-monitor:active 2025-10-22 19:57:59,748 - INFO - device-manager:active 2025-10-22 19:57:59,748 - INFO - config-database 2025-10-22 19:57:59,748 - INFO - config-cassandra:active 2025-10-22 19:57:59,748 - INFO - config-zookeeper:active 2025-10-22 19:57:59,748 - INFO - config-rabbitmq:active 2025-10-22 19:57:59,748 - INFO - vrouter 2025-10-22 19:57:59,808 - INFO - vrouter-nodemgr:active 2025-10-22 19:57:59,863 - INFO - agent:active 2025-10-22 19:57:59,863 - INFO - control 2025-10-22 19:57:59,920 - INFO - control-nodemgr:active 2025-10-22 19:57:59,976 - INFO - control:active 2025-10-22 19:57:59,976 - INFO - named:active 2025-10-22 19:58:00,040 - INFO - dns:active 2025-10-22 19:58:00,040 - INFO - analytics 2025-10-22 19:58:00,100 - INFO - analytics-nodemgr:active 2025-10-22 19:58:00,156 - INFO - analytics-api:active 2025-10-22 19:58:00,211 - INFO - collector:active 2025-10-22 19:58:00,212 - INFO - analytics-database 2025-10-22 19:58:00,212 - INFO - analytics-cassandra:active 2025-10-22 19:58:00,272 - INFO - analyticsdb-nodemgr:active 2025-10-22 19:58:00,339 - INFO - query-engine:active 2025-10-22 19:58:00,339 - INFO - webui 2025-10-22 19:58:00,340 - INFO - webui:active 2025-10-22 19:58:00,340 - INFO - webui-middleware:active 2025-10-22 19:58:00,340 - INFO - redis:active 2025-10-22 19:58:00,340 - INFO - analytics_snmp 2025-10-22 19:58:00,400 - INFO - snmp-collector:active 2025-10-22 19:58:00,400 - INFO - snmp-topology:active 2025-10-22 19:58:00,400 - INFO - analytics_alarm 2025-10-22 19:58:00,400 - INFO - alarmgen:active 2025-10-22 19:58:00,400 - INFO - All the contrail services are up on all nodes 2025-10-22 19:58:00,401 - INFO - contrail-status passed 2025-10-22 19:58:00,620 - DEBUG - Skipping xmpp flap check
2025-10-22 19:58:00,620 - INFO - END TEST : test_contrail_status : PASSED[0:00:01]
2025-10-22 19:58:00,620 - INFO - --------------------------------------------------------------------------------