2025-10-17 06:27:37,634 - INFO - Domain Default found not creating 2025-10-17 06:27:37,772 - INFO - Project ctest-TestSvcRegr-14456927 not found, creating it 2025-10-17 06:27:38,217 - INFO - Created Project:ctest-TestSvcRegr-14456927, ID : 51fccc90-40d2-4648-aa2f-cf34df4e251e 2025-10-17 06:27:39,610 - INFO - ================================================================================ 2025-10-17 06:27:39,610 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-10-17 06:27:39,863 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.20.0.17': '0'}} with 2025-10-17 06:27:39,863 - INFO - Initial checks done. Running the testcase now 2025-10-17 06:27:39,863 - INFO - 2025-10-17 06:27:40,421 - DEBUG - Response for create_network : {'network': {'id': '978114c0-7c00-4ed5-a1e2-3f92346b1719', 'name': 'ctest-mgmt_vn-44662674', 'tenant_id': '51fccc9040d24648aa2fcf34df4e251e', 'project_id': '51fccc9040d24648aa2fcf34df4e251e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-14456927', 'ctest-mgmt_vn-44662674'], 'port_security_enabled': True, 'description': ''}} 2025-10-17 06:27:40,605 - DEBUG - Response for create_subnet : {'subnet': {'id': '96ba80a0-4559-4c21-929a-0d1008bd46d3', 'name': '', 'tenant_id': '51fccc9040d24648aa2fcf34df4e251e', 'network_id': '978114c0-7c00-4ed5-a1e2-3f92346b1719', 'ip_version': 4, 'cidr': '212.186.185.128/26', 'allocation_pools': [{'start': '212.186.185.130', 'end': '212.186.185.190'}], 'gateway_ip': '212.186.185.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '212.186.185.130', 'tags': [], 'project_id': '51fccc9040d24648aa2fcf34df4e251e'}} 2025-10-17 06:27:40,623 - INFO - Created VN ctest-mgmt_vn-44662674 2025-10-17 06:27:40,673 - DEBUG - VN ctest-mgmt_vn-44662674 UUID is 978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:40,782 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-10-17 06:27:41,074 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-10-17 06:27:41,100 - DEBUG - Requesting: http://10.0.0.38:8082/domain/a7cd34c9-7c21-46dd-a95f-bb2683ef8bbb 2025-10-17 06:27:41,112 - DEBUG - Requesting: http://10.0.0.38:8082/project/51fccc90-40d2-4648-aa2f-cf34df4e251e 2025-10-17 06:27:41,186 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:41,196 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:41,204 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/af4268f2-d1cb-4255-9862-0ce4b828275f 2025-10-17 06:27:41,210 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/af4268f2-d1cb-4255-9862-0ce4b828275f 2025-10-17 06:27:41,216 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/700f2e68-8e93-4436-9efe-c06402e09335 2025-10-17 06:27:41,221 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-17 06:27:41,221 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:41,230 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/af4268f2-d1cb-4255-9862-0ce4b828275f 2025-10-17 06:27:41,243 - INFO - Verified VN network id 12 for VN 978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:41,243 - INFO - Verifications in API Server for VN ctest-mgmt_vn-44662674 passed 2025-10-17 06:27:41,243 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:41,251 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/af4268f2-d1cb-4255-9862-0ce4b828275f 2025-10-17 06:27:41,257 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/af4268f2-d1cb-4255-9862-0ce4b828275f 2025-10-17 06:27:41,262 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/700f2e68-8e93-4436-9efe-c06402e09335 2025-10-17 06:27:41,272 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-14456927:ctest-mgmt_vn-44662674', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-14456927', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10917029788669464277', 'uuid-lslong': '11664955882020214553'}, 'enable': 'true', 'created': '2025-10-17T06:27:40', 'last-modified': '2025-10-17T06:27:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.690888'} 2025-10-17 06:27:41,277 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-17 06:27:41,277 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-44662674 passed 2025-10-17 06:27:41,277 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-44662674 in API_Server ====== 2025-10-17 06:27:41,277 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-10-17 06:27:41,282 - DEBUG - Requesting: http://10.0.0.38:8082/domain/a7cd34c9-7c21-46dd-a95f-bb2683ef8bbb 2025-10-17 06:27:41,292 - DEBUG - Requesting: http://10.0.0.38:8082/project/51fccc90-40d2-4648-aa2f-cf34df4e251e 2025-10-17 06:27:41,356 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/978114c0-7c00-4ed5-a1e2-3f92346b1719 2025-10-17 06:27:41,364 - DEBUG - =>VN ctest-mgmt_vn-44662674 has no policy to be verified 2025-10-17 06:27:41,364 - DEBUG - Verifying the vn in opserver 2025-10-17 06:27:41,364 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-14456927:ctest-mgmt_vn-44662674 virtual network link through opserver 10.0.0.38 2025-10-17 06:27:41,364 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-17 06:27:41,652 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-17 06:27:41,703 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-14456927:ctest-mgmt_vn-44662674', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-14456927:ctest-mgmt_vn-44662674?flat'} 2025-10-17 06:27:41,703 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-14456927:ctest-mgmt_vn-44662674 is found in opserver 2025-10-17 06:27:41,712 - DEBUG - Do not have enough data to verify VN in agent 2025-10-17 06:27:41,716 - DEBUG - VRF ids for VN ctest-mgmt_vn-44662674: {} 2025-10-17 06:27:41,812 - ERROR - Some exception while doing Neutron net-list Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present net_rsp = self.obj.list_networks(**query_dict)['networks'] File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks return self.list('networks', self.networks_path, retrieve_all, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list for r in self._pagination(collection, path, **params): File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination res = self.get(path, params=params) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get return self.retry_request("GET", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-3aa103f1-7443-4f83-99ca-a9d86ae2ed95'] 2025-10-17 06:27:41,813 - ERROR - Got exception as "The server has either erred or is incapable of performing the requested operation.

\n\n\n\nNeutron server returns request_ids: ['req-3aa103f1-7443-4f83-99ca-a9d86ae2ed95']" while creating ctest-left_vn-06077911 Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 276, in get_vn_obj_if_present net_rsp = self.obj.list_networks(**query_dict)['networks'] File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 817, in list_networks return self.list('networks', self.networks_path, retrieve_all, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 369, in list for r in self._pagination(collection, path, **params): File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination res = self.get(path, params=params) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 353, in get return self.retry_request("GET", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-3aa103f1-7443-4f83-99ca-a9d86ae2ed95'] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/fixtures/vn_test.py", line 295, in _create_vn_orch self.obj = self.orchestrator.get_vn_obj_if_present(self.vn_name, File "/contrail-test/fixtures/openstack.py", line 184, in get_vn_obj_if_present return self.quantum_h.get_vn_obj_if_present(vn_name, **kwargs) File "/contrail-test/fixtures/quantum_test.py", line 282, in get_vn_obj_if_present raise NetworkClientException(message=str(e)) quantum_test.NetworkClientException: "The server has either erred or is incapable of performing the requested operation.

\n\n\n\nNeutron server returns request_ids: ['req-3aa103f1-7443-4f83-99ca-a9d86ae2ed95']" 2025-10-17 06:27:41,816 - INFO - Deleting VN ctest-mgmt_vn-44662674 2025-10-17 06:27:41,901 - DEBUG - Response for deleting network () 2025-10-17 06:27:41,901 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/af4268f2-d1cb-4255-9862-0ce4b828275f 2025-10-17 06:27:41,907 - DEBUG - Response Code: 404 2025-10-17 06:27:41,907 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-10-17 06:27:41,913 - DEBUG - Requesting: http://10.0.0.38:8082/domain/a7cd34c9-7c21-46dd-a95f-bb2683ef8bbb 2025-10-17 06:27:41,967 - DEBUG - Requesting: http://10.0.0.38:8082/project/51fccc90-40d2-4648-aa2f-cf34df4e251e 2025-10-17 06:27:42,037 - INFO - Validated that VN ctest-mgmt_vn-44662674 is not found in API Server 2025-10-17 06:27:42,045 - DEBUG - VN ctest-mgmt_vn-44662674 is not present in Agent 10.0.0.38 2025-10-17 06:27:42,045 - INFO - Validated that VN ctest-mgmt_vn-44662674 is not in any agent 2025-10-17 06:27:42,058 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-44662674 info 2025-10-17 06:27:42,305 - ERROR - NetworkClientException Python 3.9.21: /usr/bin/python3 Fri Oct 17 06:27:41 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/svc_firewall/test_svc_fw.py in test_svc_in_network_datapath(self=) 23 @preposttest_wrapper 24 def test_svc_in_network_datapath(self): 25 return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network', 26 create_svms=True) 27 self = self.verify_svc_chain = > svc_img_name undefined service_mode undefined create_svms undefined /contrail-test/common/servicechain/verify.py in verify_svc_chain(self=, *args=(), **kwargs={'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'}) 318 def verify_svc_chain(self, *args, **kwargs): 319 svc_chain_info = kwargs.get('svc_chain_info') 320 ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs) 321 proto = kwargs.get('proto', 'any') 322 left_vn_fq_name = ret_dict.get('left_vn_fixture').vn_fq_name ret_dict undefined svc_chain_info = None self = self.config_svc_chain = > args = () kwargs = {'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'} /contrail-test/common/servicechain/config.py in config_svc_chain(self=, service_mode='in-network', service_type='firewall', max_inst=1, proto='any', svc_chain_type='parallel', src_ports=[0, 65535], dst_ports=[0, 65535], svc_img_name='cirros_in_net', st_version=2, mgmt_vn_name='ctest-mgmt_vn-44662674', mgmt_vn_subnets=['212.186.185.128/26'], mgmt_vn_fixture=, left_vn_name=None, left_vn_subnets=[], left_vn_fixture=None, right_vn_name=None, right_vn_subnets=[], right_vn_fixture=None, left_lr_child_vn_fixture=None, right_lr_child_vn_fixture=None, left_vm_name=None, left_vm_fixture=None, right_vm_name=None, right_vm_fixture=None, image_name='cirros', policy_fixture=None, st_fixture=None, si_fixture=None, port_tuples_props=None, static_route=None, svm_fixtures=[], create_svms=True, evpn=False, modify_rules=False, policy_action='pass', hosts=[], **kwargs={}) 450 left_vn_subnets, 451 left_vn_fixture, 452 left_vn_fq_name) = self._get_vn_for_config(left_vn_name, 453 left_vn_subnets, 454 left_vn_fixture, left_vn_fq_name undefined self = self._get_vn_for_config = > left_vn_name = None /contrail-test/common/servicechain/config.py in _get_vn_for_config(self=, vn_name='ctest-left_vn-06077911', vn_subnets=['178.253.143.192/26'], vn_fixture=None, vn_name_prefix='left_vn', **kwargs={}) 355 vn_subnets = vn_subnets or \ 356 [get_random_cidr(af=self.inputs.get_af())] 357 vn_fixture = vn_fixture or self.config_vn(vn_name, vn_subnets, **kwargs) 358 vn_fq_name = vn_fixture.vn_fq_name 359 return (vn_name, vn_subnets, vn_fixture, vn_fq_name) vn_fixture = None self = self.config_vn = > vn_name = 'ctest-left_vn-06077911' vn_subnets = ['178.253.143.192/26'] kwargs = {} /contrail-test/common/servicechain/config.py in config_vn(self=, vn_name='ctest-left_vn-06077911', vn_net=['178.253.143.192/26'], **kwargs={}) 134 135 def config_vn(self, vn_name, vn_net, **kwargs): 136 vn_fixture = self.useFixture(VNFixture( 137 project_name=self.inputs.project_name, connections=self.connections, 138 vn_name=vn_name, inputs=self.inputs, subnets=vn_net, **kwargs)) vn_fixture undefined self = self.useFixture = > global VNFixture = project_name undefined self.inputs = self.inputs.project_name = 'ctest-TestSvcRegr-14456927' connections undefined self.connections = vn_name = 'ctest-left_vn-06077911' inputs undefined subnets undefined vn_net = ['178.253.143.192/26'] kwargs = {} /usr/local/lib/python3.9/site-packages/testtools/testcase.py in useFixture(self=, fixture=) 754 # Gather_details worked, so raise the exception setUp 755 # encountered. 756 reraise(*exc_info) 757 else: 758 self.addCleanup(fixture.cleanUp) global reraise = exc_info = (, NetworkClientException(), ) /usr/local/lib/python3.9/site-packages/testtools/_compat3x.py in reraise(exc_class=, exc_obj=NetworkClientException(), exc_tb=, _marker=