2026-01-26 03:20:30,941 - INFO - Domain Default found not creating 2026-01-26 03:20:31,107 - INFO - Project ctest-TestMtuProbe-84172452 not found, creating it 2026-01-26 03:20:31,615 - INFO - Created Project:ctest-TestMtuProbe-84172452, ID : 79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:20:33,135 - INFO - ================================================================================ 2026-01-26 03:20:33,135 - INFO - STARTING TEST : test_mtu_probe_intra_node 2026-01-26 03:20:33,135 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs in same compute node 2. client and server VMs in same compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2026-01-26 03:20:34,416 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2026-01-26 03:20:34,416 - INFO - Initial checks done. Running the testcase now 2026-01-26 03:20:34,416 - INFO - 2026-01-26 03:20:35,078 - DEBUG - Response for create_network : {'network': {'id': '331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f', 'name': 'ctest-vn-79269528', 'tenant_id': '79aa64fe7ce745ce9f84b7e2a0942337', 'project_id': '79aa64fe7ce745ce9f84b7e2a0942337', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-84172452', 'ctest-vn-79269528'], 'port_security_enabled': True, 'description': ''}} 2026-01-26 03:20:35,403 - DEBUG - Response for create_subnet : {'subnet': {'id': '70b4c3c8-629a-4c54-9f22-0448dfda6878', 'name': '', 'tenant_id': '79aa64fe7ce745ce9f84b7e2a0942337', 'network_id': '331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f', 'ip_version': 4, 'cidr': '93.42.84.128/26', 'allocation_pools': [{'start': '93.42.84.130', 'end': '93.42.84.190'}], 'gateway_ip': '93.42.84.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '93.42.84.130', 'tags': [], 'project_id': '79aa64fe7ce745ce9f84b7e2a0942337'}} 2026-01-26 03:20:35,426 - INFO - Created VN ctest-vn-79269528 2026-01-26 03:20:35,441 - DEBUG - VN ctest-vn-79269528 UUID is 331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:35,511 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:20:35,821 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:20:36,167 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:20:36,183 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:20:36,269 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:36,284 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:36,293 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:36,301 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:36,307 - DEBUG - Route Targets: [] 2026-01-26 03:20:36,307 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:20:41,308 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:20:41,316 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:20:41,327 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:20:41,419 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:41,428 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:41,439 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:41,447 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:41,455 - DEBUG - Route Targets: [] 2026-01-26 03:20:41,455 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:20:46,455 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:20:46,462 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:20:46,473 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:20:46,568 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:46,581 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:46,591 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:46,598 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:46,604 - DEBUG - Route Targets: [] 2026-01-26 03:20:46,604 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:20:51,606 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:20:51,613 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:20:51,627 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:20:51,723 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:51,734 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:51,745 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:51,753 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:51,763 - DEBUG - Route Targets: [] 2026-01-26 03:20:51,763 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:20:56,764 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:20:56,771 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:20:56,782 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:20:56,876 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:56,885 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:20:56,893 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:56,901 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:20:56,909 - DEBUG - Route Targets: [] 2026-01-26 03:20:56,909 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:01,909 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:21:01,916 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:21:01,927 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:21:02,015 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:02,029 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:02,041 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:02,048 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:02,055 - DEBUG - Route Targets: [] 2026-01-26 03:21:02,055 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:07,055 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:21:07,062 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:21:07,073 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:21:07,165 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:07,176 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:07,184 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:07,190 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:07,198 - DEBUG - Route Targets: [] 2026-01-26 03:21:07,198 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:12,200 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:21:12,207 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:21:12,218 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:21:12,309 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:12,318 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:12,327 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:12,334 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:12,341 - DEBUG - Route Targets: [] 2026-01-26 03:21:12,341 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:17,341 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:21:17,348 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:21:17,357 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:21:17,451 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:17,462 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:17,471 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:17,484 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:17,491 - DEBUG - Route Targets: [] 2026-01-26 03:21:17,491 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:22,491 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:21:22,497 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:21:22,508 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:21:22,632 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:22,644 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:22,653 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:22,659 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:22,666 - DEBUG - Route Targets: [] 2026-01-26 03:21:22,666 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:27,667 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:21:27,674 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:21:27,684 - DEBUG - Requesting: http://10.0.0.141:8082/project/79aa64fe-7ce7-45ce-9f84-b7e2a0942337 2026-01-26 03:21:27,770 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:27,779 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/331d1fc5-7d43-4f36-b8e1-b3cacdd9bd4f 2026-01-26 03:21:27,789 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:27,797 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/2ec7ab69-faa7-4aca-a83c-e0cd3817bac5 2026-01-26 03:21:27,803 - DEBUG - Route Targets: [] 2026-01-26 03:21:27,803 - DEBUG - RT names not yet present for VN ctest-vn-79269528 2026-01-26 03:21:27,803 - ERROR - One or more verifications in API Server for VN ctest-vn-79269528 failed 2026-01-26 03:21:27,805 - INFO - Deleting VN ctest-vn-79269528 2026-01-26 03:21:27,927 - DEBUG - Response for deleting network () 2026-01-26 03:21:29,197 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Jan 26 03:21:27 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vrouter/test_tcp_mtu_probe.py in test_mtu_probe_intra_node(self=) 111 """ 112 vn_fixtures = self.create_vns(count=1) 113 self.verify_vns(vn_fixtures) 114 vn1_fixture = vn_fixtures[0] 115 compute_hosts = self.orch.get_hosts() self = self.verify_vns = > vn_fixtures = [] /contrail-test/common/vrouter/base.py in verify_vns(self=, vn_fixtures=[]) 154 def verify_vns(self, vn_fixtures): 155 for vn_fixture in vn_fixtures: 156 assert vn_fixture.verify_on_setup() 157 158 def create_vms(self, vn_fixture, count=1, image_name='ubuntu', vn_fixture = vn_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vrouter/test_tcp_mtu_probe.py", line 113, in test_mtu_probe_intra_node self.verify_vns(vn_fixtures) File "/contrail-test/common/vrouter/base.py", line 156, in verify_vns assert vn_fixture.verify_on_setup() AssertionError 2026-01-26 03:21:29,211 - DEBUG - No XMPP flaps were noticed during the test 2026-01-26 03:21:29,211 - INFO -
2026-01-26 03:21:29,211 - INFO - END TEST : test_mtu_probe_intra_node : FAILED[0:00:56]
2026-01-26 03:21:29,211 - INFO - -------------------------------------------------------------------------------- 2026-01-26 03:21:29,933 - INFO - Deleted project: ctest-TestMtuProbe-84172452, ID : 79aa64fe-7ce7-45ce-9f84-b7e2a0942337