2026-01-26 04:09:55,815 - INFO - Domain Default found not creating 2026-01-26 04:09:56,088 - INFO - Project ctest-FatFlowSerialIpv6-99867277 not found, creating it 2026-01-26 04:09:56,691 - INFO - Created Project:ctest-FatFlowSerialIpv6-99867277, ID : baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:09:58,213 - INFO - ================================================================================ 2026-01-26 04:09:58,213 - INFO - STARTING TEST : test_fat_flow_intra_vn_inter_node 2026-01-26 04:09:58,214 - INFO - TEST DESCRIPTION : Description: Verify Fat flow for intra-VN inter-Node traffic Steps: 1. create 1 VN and launch 3 VMs in it.client VMs on same node and server VM on different node. 2. on server VM, config Fat flow for udp port 53. 3. from both client VM, send UDP traffic to server on port 53 twice with diff. src ports Pass criteria: 1. on client VMs compute, 4 set of flows and on server compute, 2 set of flows should be created 2. on server compute, flow's source port should be 0 for Fat flow 2026-01-26 04:09:59,489 - DEBUG - Skipping xmpp flap check 2026-01-26 04:09:59,489 - INFO - Initial checks done. Running the testcase now 2026-01-26 04:09:59,489 - INFO - 2026-01-26 04:10:00,212 - DEBUG - Response for create_network : {'network': {'id': 'dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0', 'name': 'ctest-vn-54010732', 'tenant_id': 'baa70e7cb8264f99988859da7e96ce34', 'project_id': 'baa70e7cb8264f99988859da7e96ce34', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowSerialIpv6-99867277', 'ctest-vn-54010732'], 'port_security_enabled': True, 'description': ''}} 2026-01-26 04:10:00,489 - DEBUG - Response for create_subnet : {'subnet': {'id': '3cc61d32-0d6f-4f85-b78e-5de88da7568f', 'name': '', 'tenant_id': 'baa70e7cb8264f99988859da7e96ce34', 'network_id': 'dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0', 'ip_version': 4, 'cidr': '9.64.224.128/26', 'allocation_pools': [{'start': '9.64.224.130', 'end': '9.64.224.190'}], 'gateway_ip': '9.64.224.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '9.64.224.130', 'tags': [], 'project_id': 'baa70e7cb8264f99988859da7e96ce34'}} 2026-01-26 04:10:00,777 - DEBUG - Response for create_subnet : {'subnet': {'id': '1c5eb251-76a0-4c21-88fa-7e6cc0aab0d7', 'name': '', 'tenant_id': 'baa70e7cb8264f99988859da7e96ce34', 'network_id': 'dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0', 'ip_version': 6, 'cidr': '3a09:5e29:a424:ca5b:b47:2525::/96', 'allocation_pools': [{'start': '3a09:5e29:a424:ca5b:b47:2525:0:2', 'end': '3a09:5e29:a424:ca5b:b47:2525:ffff:fffe'}], 'gateway_ip': '3a09:5e29:a424:ca5b:b47:2525:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '3a09:5e29:a424:ca5b:b47:2525:0:2', 'tags': [], 'project_id': 'baa70e7cb8264f99988859da7e96ce34'}} 2026-01-26 04:10:00,804 - INFO - Created VN ctest-vn-54010732 2026-01-26 04:10:00,821 - DEBUG - VN ctest-vn-54010732 UUID is dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:00,943 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:01,249 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:01,280 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:01,300 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:01,409 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:01,424 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:01,448 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:01,457 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:01,468 - DEBUG - Route Targets: [] 2026-01-26 04:10:01,468 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:06,469 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:06,476 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:06,490 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:06,581 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:06,599 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:06,615 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:06,624 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:06,637 - DEBUG - Route Targets: [] 2026-01-26 04:10:06,637 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:11,637 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:11,645 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:11,659 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:11,771 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:11,787 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:11,799 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:11,807 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:11,814 - DEBUG - Route Targets: [] 2026-01-26 04:10:11,814 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:16,814 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:16,820 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:16,857 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:16,953 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:16,962 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:16,971 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:16,979 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:16,986 - DEBUG - Route Targets: [] 2026-01-26 04:10:16,986 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:21,987 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:21,995 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:22,010 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:22,114 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:22,125 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:22,135 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:22,143 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:22,151 - DEBUG - Route Targets: [] 2026-01-26 04:10:22,151 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:27,151 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:27,158 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:27,169 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:27,255 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:27,268 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:27,279 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:27,287 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:27,295 - DEBUG - Route Targets: [] 2026-01-26 04:10:27,295 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:32,296 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:32,302 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:32,314 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:32,401 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:32,412 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:32,428 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:32,435 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:32,441 - DEBUG - Route Targets: [] 2026-01-26 04:10:32,441 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:37,442 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:37,450 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:37,462 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:37,551 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:37,560 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:37,568 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:37,576 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:37,582 - DEBUG - Route Targets: [] 2026-01-26 04:10:37,582 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:42,583 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:42,589 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:42,599 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:42,688 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:42,703 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:42,714 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:42,721 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:42,728 - DEBUG - Route Targets: [] 2026-01-26 04:10:42,728 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:47,729 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:47,735 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:47,746 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:47,847 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:47,860 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:47,869 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:47,877 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:47,885 - DEBUG - Route Targets: [] 2026-01-26 04:10:47,885 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:52,885 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 04:10:52,893 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 04:10:52,908 - DEBUG - Requesting: http://10.0.0.141:8082/project/baa70e7c-b826-4f99-9888-59da7e96ce34 2026-01-26 04:10:53,004 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:53,019 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/dd276a5d-fb1e-4fd4-a5f8-9f7c15a5caa0 2026-01-26 04:10:53,039 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:53,050 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/0f843ff8-2c84-4274-900a-fc7bf53ace8f 2026-01-26 04:10:53,057 - DEBUG - Route Targets: [] 2026-01-26 04:10:53,057 - DEBUG - RT names not yet present for VN ctest-vn-54010732 2026-01-26 04:10:53,058 - ERROR - One or more verifications in API Server for VN ctest-vn-54010732 failed 2026-01-26 04:10:53,061 - INFO - Deleting VN ctest-vn-54010732 2026-01-26 04:10:53,243 - DEBUG - Response for deleting network () 2026-01-26 04:10:54,521 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Jan 26 04:10:53 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_fat_flow_serial.py in test_fat_flow_intra_vn_inter_node(self=) 31 """ 32 vn_fixtures = self.create_vns(count=1) 33 self.verify_vns(vn_fixtures) 34 vn1_fixture = vn_fixtures[0] 35 self = self.verify_vns = > vn_fixtures = [] /contrail-test/common/vrouter/base.py in verify_vns(self=, vn_fixtures=[]) 154 def verify_vns(self, vn_fixtures): 155 for vn_fixture in vn_fixtures: 156 assert vn_fixture.verify_on_setup() 157 158 def create_vms(self, vn_fixture, count=1, image_name='ubuntu', vn_fixture = vn_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_fat_flow_serial.py", line 33, in test_fat_flow_intra_vn_inter_node self.verify_vns(vn_fixtures) File "/contrail-test/common/vrouter/base.py", line 156, in verify_vns assert vn_fixture.verify_on_setup() AssertionError 2026-01-26 04:10:54,521 - DEBUG - Skipping xmpp flap check 2026-01-26 04:10:54,521 - INFO -
2026-01-26 04:10:54,521 - INFO - END TEST : test_fat_flow_intra_vn_inter_node : FAILED[0:00:56]
2026-01-26 04:10:54,522 - INFO - -------------------------------------------------------------------------------- 2026-01-26 04:10:55,331 - INFO - Deleted project: ctest-FatFlowSerialIpv6-99867277, ID : baa70e7c-b826-4f99-9888-59da7e96ce34