2025-07-22 18:19:34,723 - INFO - Domain Default found not creating 2025-07-22 18:19:34,886 - INFO - Project ctest-FatFlowSerialIpv6-09617362 not found, creating it 2025-07-22 18:19:35,474 - INFO - Created Project:ctest-FatFlowSerialIpv6-09617362, ID : 5c8d9b7f-211d-42c3-86f3-4fef9d17cf8c 2025-07-22 18:19:36,870 - INFO - ================================================================================ 2025-07-22 18:19:36,870 - INFO - STARTING TEST : test_fat_flow_intra_vn_inter_node 2025-07-22 18:19:36,870 - INFO - TEST DESCRIPTION : Description: Verify Fat flow for intra-VN inter-Node traffic Steps: 1. create 1 VN and launch 3 VMs in it.client VMs on same node and server VM on different node. 2. on server VM, config Fat flow for udp port 53. 3. from both client VM, send UDP traffic to server on port 53 twice with diff. src ports Pass criteria: 1. on client VMs compute, 4 set of flows and on server compute, 2 set of flows should be created 2. on server compute, flow's source port should be 0 for Fat flow 2025-07-22 18:19:38,133 - DEBUG - Skipping xmpp flap check 2025-07-22 18:19:38,133 - INFO - Initial checks done. Running the testcase now 2025-07-22 18:19:38,133 - INFO - 2025-07-22 18:19:38,816 - DEBUG - Response for create_network : {'network': {'id': '87a3b1cf-6b3b-4e3e-92a4-652351ba54dd', 'name': 'ctest-vn-64880917', 'tenant_id': '5c8d9b7f211d42c386f34fef9d17cf8c', 'project_id': '5c8d9b7f211d42c386f34fef9d17cf8c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowSerialIpv6-09617362', 'ctest-vn-64880917'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 18:19:39,071 - DEBUG - Response for create_subnet : {'subnet': {'id': '310b9cee-66e2-4218-8d42-692108381bf9', 'name': '', 'tenant_id': '5c8d9b7f211d42c386f34fef9d17cf8c', 'network_id': '87a3b1cf-6b3b-4e3e-92a4-652351ba54dd', 'ip_version': 4, 'cidr': '70.121.251.0/26', 'allocation_pools': [{'start': '70.121.251.2', 'end': '70.121.251.62'}], 'gateway_ip': '70.121.251.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '70.121.251.2', 'tags': [], 'project_id': '5c8d9b7f211d42c386f34fef9d17cf8c'}} 2025-07-22 18:19:39,284 - DEBUG - Response for create_subnet : {'subnet': {'id': '7cdcdb0c-03a2-4645-b3ee-832cc8b01a4e', 'name': '', 'tenant_id': '5c8d9b7f211d42c386f34fef9d17cf8c', 'network_id': '87a3b1cf-6b3b-4e3e-92a4-652351ba54dd', 'ip_version': 6, 'cidr': '2c44:c1e3:8e8a:5bf2:3279:592e::/96', 'allocation_pools': [{'start': '2c44:c1e3:8e8a:5bf2:3279:592e:0:2', 'end': '2c44:c1e3:8e8a:5bf2:3279:592e:ffff:fffe'}], 'gateway_ip': '2c44:c1e3:8e8a:5bf2:3279:592e:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2c44:c1e3:8e8a:5bf2:3279:592e:0:2', 'tags': [], 'project_id': '5c8d9b7f211d42c386f34fef9d17cf8c'}} 2025-07-22 18:19:39,311 - INFO - Created VN ctest-vn-64880917 2025-07-22 18:19:39,328 - DEBUG - VN ctest-vn-64880917 UUID is 87a3b1cf-6b3b-4e3e-92a4-652351ba54dd 2025-07-22 18:19:39,447 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 18:19:39,741 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 18:19:39,776 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 18:19:39,796 - DEBUG - Requesting: http://10.0.0.254:8082/project/5c8d9b7f-211d-42c3-86f3-4fef9d17cf8c 2025-07-22 18:19:39,904 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/87a3b1cf-6b3b-4e3e-92a4-652351ba54dd 2025-07-22 18:19:39,929 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/87a3b1cf-6b3b-4e3e-92a4-652351ba54dd 2025-07-22 18:19:39,941 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/fa635e1c-1f4e-4fe7-b437-776b98463a72 2025-07-22 18:19:39,951 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/fa635e1c-1f4e-4fe7-b437-776b98463a72 2025-07-22 18:19:39,959 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/015a59ac-e616-4c73-9ce9-6b0e6a83ce05 2025-07-22 18:19:39,968 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 18:19:39,968 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/87a3b1cf-6b3b-4e3e-92a4-652351ba54dd 2025-07-22 18:19:39,980 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/fa635e1c-1f4e-4fe7-b437-776b98463a72 2025-07-22 18:19:40,000 - INFO - Verified VN network id 12 for VN 87a3b1cf-6b3b-4e3e-92a4-652351ba54dd 2025-07-22 18:19:40,000 - INFO - Verifications in API Server for VN ctest-vn-64880917 passed 2025-07-22 18:19:40,000 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/87a3b1cf-6b3b-4e3e-92a4-652351ba54dd 2025-07-22 18:19:40,025 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/fa635e1c-1f4e-4fe7-b437-776b98463a72 2025-07-22 18:19:40,038 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/fa635e1c-1f4e-4fe7-b437-776b98463a72 2025-07-22 18:19:40,054 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/015a59ac-e616-4c73-9ce9-6b0e6a83ce05 2025-07-22 18:19:40,075 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-09617362:ctest-vn-64880917', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-09617362', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9773851120739503678', 'uuid-lslong': '10566681828087452893'}, 'enable': 'true', 'created': '2025-07-22T18:19:38', 'last-modified': '2025-07-22T18:19:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.859430'} 2025-07-22 18:19:40,084 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 18:19:40,096 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-09617362:ctest-vn-64880917', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-09617362', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9773851120739503678', 'uuid-lslong': '10566681828087452893'}, 'enable': 'true', 'created': '2025-07-22T18:19:38', 'last-modified': '2025-07-22T18:19:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.886997'} 2025-07-22 18:19:40,105 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 18:19:40,112 - INFO - Deleting VN ctest-vn-64880917 2025-07-22 18:19:40,330 - DEBUG - Response for deleting network () 2025-07-22 18:19:41,592 - ERROR - AttributeError Python 3.6.8: /usr/bin/python3 Tue Jul 22 18:19:40 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_fat_flow_serial.py in test_fat_flow_intra_vn_inter_node(self=) 31 """ 32 vn_fixtures = self.create_vns(count=1) 33 self.verify_vns(vn_fixtures) 34 vn1_fixture = vn_fixtures[0] 35 self = self.verify_vns = > vn_fixtures = [] /contrail-test/common/vrouter/base.py in verify_vns(self=, vn_fixtures=[]) 154 def verify_vns(self, vn_fixtures): 155 for vn_fixture in vn_fixtures: 156 assert vn_fixture.verify_on_setup() 157 158 def create_vms(self, vn_fixture, count=1, image_name='ubuntu', vn_fixture = vn_fixture.verify_on_setup = > /contrail-test/fixtures/vn_test.py in verify_on_setup(self=) 579 "One or more verifications in API Server for VN %s failed" % (self.vn_name)) 580 return result 581 if not self.verify_vn_in_control_nodes(): 582 result = result and False 583 self.logger.error( self = self.verify_vn_in_control_nodes = .deco_retry..f_retry of > /contrail-test/tcutils/util.py in f_retry(*args=(,), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (,) kwargs = {} /contrail-test/fixtures/vn_test.py in verify_vn_in_control_nodes(self=) 927 for cn in self.inputs.bgp_ips: 928 cn_config_vn_obj = self.cn_inspect[cn].get_cn_config_vn( 929 vn_name=self.vn_name, project=self.project_name, domain=self.domain_name) 930 if not cn_config_vn_obj: 931 self.logger.warn('Control-node %s does not have VN %s info ' % vn_name undefined self = self.vn_name = 'ctest-vn-64880917' project undefined self.project_name = 'ctest-FatFlowSerialIpv6-09617362' domain undefined self.domain_name = 'default-domain' /contrail-test/tcutils/control/cn_introspect_utils.py in get_cn_config_vn(self=, domain='default-domain', project='ctest-FatFlowSerialIpv6-09617362', vn_name='ctest-vn-64880917') 139 def get_cn_config_vn(self, domain='default-domain', project='admin', vn_name='default-virtual-network'): 140 m = 'virtual-network:' + domain + ':' + project + ':' + vn_name 141 return self._get_if_map_table_entry(m) 142 143 def get_cn_config_fip_pool(self, domain='default-domain', project='admin', vn_name='default-virtual-network', fip_pool_name='default-floating-ip-pool'): self = self._get_if_map_table_entry = > m = 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-09617362:ctest-vn-64880917' /contrail-test/tcutils/control/cn_introspect_utils.py in _get_if_map_table_entry(self=, match='virtual-network:default-domain:ctest-FatFlowSerialIpv6-09617362:ctest-vn-64880917') 37 new_table_req = 'Snh_IFMapTableShowReq?table_name=' + table_name.group(1) + '&search_string=' + match 38 p = self.dict_get(new_table_req) 39 xp = p.xpath('./IFMapTableShowResp/ifmap_db/list/IFMapNodeShowInfo') 40 if not xp: 41 # sometime ./xpath dosen't work; work around xp undefined p = None p.xpath undefined AttributeError: 'NoneType' object has no attribute 'xpath' __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Attribute not found.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ("'NoneType' object has no attribute 'xpath'",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_fat_flow_serial.py", line 33, in test_fat_flow_intra_vn_inter_node self.verify_vns(vn_fixtures) File "/contrail-test/common/vrouter/base.py", line 156, in verify_vns assert vn_fixture.verify_on_setup() File "/contrail-test/fixtures/vn_test.py", line 581, in verify_on_setup if not self.verify_vn_in_control_nodes(): File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/fixtures/vn_test.py", line 929, in verify_vn_in_control_nodes vn_name=self.vn_name, project=self.project_name, domain=self.domain_name) File "/contrail-test/tcutils/control/cn_introspect_utils.py", line 141, in get_cn_config_vn return self._get_if_map_table_entry(m) File "/contrail-test/tcutils/control/cn_introspect_utils.py", line 39, in _get_if_map_table_entry xp = p.xpath('./IFMapTableShowResp/ifmap_db/list/IFMapNodeShowInfo') AttributeError: 'NoneType' object has no attribute 'xpath' 2025-07-22 18:19:41,593 - DEBUG - Skipping xmpp flap check 2025-07-22 18:19:41,593 - INFO - 2025-07-22 18:19:41,593 - INFO - END TEST : test_fat_flow_intra_vn_inter_node : FAILED[0:00:05] 2025-07-22 18:19:41,593 - INFO - -------------------------------------------------------------------------------- 2025-07-22 18:19:42,338 - INFO - Deleted project: ctest-FatFlowSerialIpv6-09617362, ID : 5c8d9b7f-211d-42c3-86f3-4fef9d17cf8c