2025-08-07 16:38:58,211 - INFO - Domain Default found not creating 2025-08-07 16:38:58,577 - INFO - Project ctest-TestBasicPolicyIpv4v6-98812577 not found, creating it 2025-08-07 16:38:59,442 - INFO - Created Project:ctest-TestBasicPolicyIpv4v6-98812577, ID : d0f78462-1445-4745-881d-d57a39c77ace 2025-08-07 16:39:01,670 - INFO - ================================================================================ 2025-08-07 16:39:01,670 - INFO - STARTING TEST : test_basic_policy_allow_deny 2025-08-07 16:39:01,670 - INFO - TEST DESCRIPTION : Create 2 Vns and allow icmp traffic between them and validate with pings Update the policy to deny the same traffic Check that pings fail 2025-08-07 16:39:01,874 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.17': '0'}} with 2025-08-07 16:39:01,875 - INFO - Initial checks done. Running the testcase now 2025-08-07 16:39:01,875 - INFO - 2025-08-07 16:39:02,661 - DEBUG - Response for create_network : {'network': {'id': '12f67c4a-4919-4f2e-864a-a49e06823a4d', 'name': 'ctest-vn-28084912', 'tenant_id': 'd0f7846214454745881dd57a39c77ace', 'project_id': 'd0f7846214454745881dd57a39c77ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-98812577', 'ctest-vn-28084912'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 16:39:02,825 - ERROR - Neutron Exception while creating subnet for vn with id 12f67c4a-4919-4f2e-864a-a49e06823a4d Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-1ce191b8-bfb4-4063-b500-6c0df425cd26'] 2025-08-07 16:39:02,989 - ERROR - Neutron Exception while creating subnet for vn with id 12f67c4a-4919-4f2e-864a-a49e06823a4d Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-cc9f71a5-40d3-43b4-ae73-e43cc6a49c16'] 2025-08-07 16:39:03,022 - INFO - Created VN ctest-vn-28084912 2025-08-07 16:39:03,087 - DEBUG - VN ctest-vn-28084912 UUID is 12f67c4a-4919-4f2e-864a-a49e06823a4d 2025-08-07 16:39:03,584 - DEBUG - Response for create_network : {'network': {'id': '4f261aaa-f491-4e35-9b91-aa77d6a892ac', 'name': 'ctest-vn-24546111', 'tenant_id': 'd0f7846214454745881dd57a39c77ace', 'project_id': 'd0f7846214454745881dd57a39c77ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-98812577', 'ctest-vn-24546111'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 16:39:03,799 - ERROR - Neutron Exception while creating subnet for vn with id 4f261aaa-f491-4e35-9b91-aa77d6a892ac Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-9cd6790a-4640-424c-9345-2d4adbdc35f4'] 2025-08-07 16:39:04,003 - ERROR - Neutron Exception while creating subnet for vn with id 4f261aaa-f491-4e35-9b91-aa77d6a892ac Traceback (most recent call last): File "/contrail-test/fixtures/quantum_test.py", line 128, in create_subnet subnet_rsp = self.obj.create_subnet({'subnet': subnet_req}) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 848, in create_subnet return self.post(self.subnets_path, body=body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 359, in post headers=headers, params=params) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 request_ids=request_ids) neutronclient.common.exceptions.InternalServerError: The server has either erred or is incapable of performing the requested operation.

Neutron server returns request_ids: ['req-08d507ef-ab8f-4358-9f5b-7dfc44e9adf6'] 2025-08-07 16:39:04,036 - INFO - Created VN ctest-vn-24546111 2025-08-07 16:39:04,099 - DEBUG - VN ctest-vn-24546111 UUID is 4f261aaa-f491-4e35-9b91-aa77d6a892ac 2025-08-07 16:39:04,229 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-98812577:ctest-vn-28084912, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-98812577:ctest-vn-24546111, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-98812577:ctest-vn-28084912, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestBasicPolicyIpv4v6-98812577:ctest-vn-24546111, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-07 16:39:04,841 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '12f67c4a-4919-4f2e-864a-a49e06823a4d', 'name': 'ctest-vn-28084912', 'tenant_id': 'd0f7846214454745881dd57a39c77ace', 'project_id': 'd0f7846214454745881dd57a39c77ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-98812577', 'ctest-vn-28084912'], 'policys': [['default-domain', 'ctest-TestBasicPolicyIpv4v6-98812577', 'ctest-policy-allow-all-95231583']], 'port_security_enabled': True, 'description': ''}} 2025-08-07 16:39:05,209 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '4f261aaa-f491-4e35-9b91-aa77d6a892ac', 'name': 'ctest-vn-24546111', 'tenant_id': 'd0f7846214454745881dd57a39c77ace', 'project_id': 'd0f7846214454745881dd57a39c77ace', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicPolicyIpv4v6-98812577', 'ctest-vn-24546111'], 'policys': [['default-domain', 'ctest-TestBasicPolicyIpv4v6-98812577', 'ctest-policy-allow-all-95231583']], 'port_security_enabled': True, 'description': ''}} 2025-08-07 16:39:05,391 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-08-07 16:39:05,727 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-08-07 16:39:05,787 - DEBUG - Requesting: http://10.0.0.249:8082/domain/18d875f7-79a7-4d7d-b759-3a18e081cd7a 2025-08-07 16:39:05,830 - DEBUG - Requesting: http://10.0.0.249:8082/project/d0f78462-1445-4745-881d-d57a39c77ace 2025-08-07 16:39:05,918 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/12f67c4a-4919-4f2e-864a-a49e06823a4d 2025-08-07 16:39:06,289 - INFO - Deleted policy ctest-policy-allow-all-95231583 2025-08-07 16:39:06,289 - INFO - Deleting VN ctest-vn-24546111 2025-08-07 16:39:06,357 - DEBUG - Response for deleting network () 2025-08-07 16:39:06,357 - INFO - Deleting VN ctest-vn-28084912 2025-08-07 16:39:06,426 - DEBUG - Response for deleting network () 2025-08-07 16:39:06,565 - ERROR - KeyError Python 3.6.8: /usr/bin/python3 Thu Aug 7 16:39:05 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/policy/test_policy_basic.py in test_basic_policy_allow_deny(self=) 109 policy_fixture = self.setup_policy_between_vns(vn1_fixture, 110 vn2_fixture, rules) 111 assert vn1_fixture.verify_on_setup() 112 assert vn2_fixture.verify_on_setup() 113 vn1_fixture = vn1_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 574 def verify_on_setup(self): 575 result = True 576 if not self.verify_vn_in_api_server(): 577 result = result and False 578 self.logger.error( self = self.verify_vn_in_api_server = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_api_server(self=) 638 639 subnets = list() 640 for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: 641 subnets.extend(ipam['attr']['ipam_subnets']) 642 for vn_subnet in self.vn_subnets: ipam undefined self = self.api_s_vn_obj = {'virtual-network': {'uuid': '12f67c4a-4919-4f2e...2/project/d0f78462-1445-4745-881d-d57a39c77ace'}} KeyError: 'network_ipam_refs' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Mapping key not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('network_ipam_refs',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/policy/test_policy_basic.py", line 111, in test_basic_policy_allow_deny assert vn1_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 576, in verify_on_setup if not self.verify_vn_in_api_server(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 640, in verify_vn_in_api_server for ipam in self.api_s_vn_obj['virtual-network']['network_ipam_refs']: KeyError: 'network_ipam_refs' 2025-08-07 16:39:06,577 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 16:39:06,578 - INFO -
2025-08-07 16:39:06,578 - INFO - END TEST : test_basic_policy_allow_deny : FAILED[0:00:05]
2025-08-07 16:39:06,578 - INFO - -------------------------------------------------------------------------------- 2025-08-07 16:39:07,471 - INFO - Deleted project: ctest-TestBasicPolicyIpv4v6-98812577, ID : d0f78462-1445-4745-881d-d57a39c77ace