2025-08-03 00:24:38,757 - INFO - Domain Default found not creating 2025-08-03 00:24:38,929 - INFO - Project ctest-TestMtuProbe-77386939 not found, creating it 2025-08-03 00:24:39,681 - INFO - Created Project:ctest-TestMtuProbe-77386939, ID : f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:24:41,587 - INFO - ================================================================================ 2025-08-03 00:24:41,587 - INFO - STARTING TEST : test_mtu_probe_inter_node 2025-08-03 00:24:41,587 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs across compute node 2. client and server VMs across compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-08-03 00:24:42,973 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-03 00:24:42,973 - INFO - Initial checks done. Running the testcase now 2025-08-03 00:24:42,973 - INFO - 2025-08-03 00:24:43,003 - DEBUG - Services list from nova: [, , , ] 2025-08-03 00:24:43,003 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:24:43,834 - DEBUG - Response for create_network : {'network': {'id': '6471652f-e484-4186-91a3-dd3d183b6235', 'name': 'ctest-vn-16170778', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'project_id': 'f47b08429ed04aac801c284d30c77a88', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-77386939', 'ctest-vn-16170778'], 'port_security_enabled': True, 'description': ''}} 2025-08-03 00:24:44,138 - DEBUG - Response for create_subnet : {'subnet': {'id': '2bdb1bc2-f985-4f05-8ec1-3867b033c113', 'name': '', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'network_id': '6471652f-e484-4186-91a3-dd3d183b6235', 'ip_version': 4, 'cidr': '60.109.226.64/26', 'allocation_pools': [{'start': '60.109.226.66', 'end': '60.109.226.126'}], 'gateway_ip': '60.109.226.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '60.109.226.66', 'tags': [], 'project_id': 'f47b08429ed04aac801c284d30c77a88'}} 2025-08-03 00:24:44,166 - INFO - Created VN ctest-vn-16170778 2025-08-03 00:24:44,178 - DEBUG - VN ctest-vn-16170778 UUID is 6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:44,279 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:24:44,614 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:24:44,646 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028 2025-08-03 00:24:44,669 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:24:44,801 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:44,821 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:44,833 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4 2025-08-03 00:24:44,860 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4 2025-08-03 00:24:44,881 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/37519648-81e6-482c-a74c-113b85d11a02 2025-08-03 00:24:44,892 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:24:44,892 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:44,905 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4 2025-08-03 00:24:44,924 - INFO - Verified VN network id 12 for VN 6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:44,924 - INFO - Verifications in API Server for VN ctest-vn-16170778 passed 2025-08-03 00:24:44,924 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:44,945 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4 2025-08-03 00:24:44,955 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4 2025-08-03 00:24:44,964 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/37519648-81e6-482c-a74c-113b85d11a02 2025-08-03 00:24:44,996 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7237677332532838790', 'uuid-lslong': '10494474811172676149'}, 'enable': 'true', 'created': '2025-08-03T00:24:43', 'last-modified': '2025-08-03T00:24:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.908331'} 2025-08-03 00:24:45,003 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:24:45,012 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7237677332532838790', 'uuid-lslong': '10494474811172676149'}, 'enable': 'true', 'created': '2025-08-03T00:24:43', 'last-modified': '2025-08-03T00:24:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.924321'} 2025-08-03 00:24:45,022 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:24:45,029 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7237677332532838790', 'uuid-lslong': '10494474811172676149'}, 'enable': 'true', 'created': '2025-08-03T00:24:43', 'last-modified': '2025-08-03T00:24:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.943653'} 2025-08-03 00:24:45,037 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:24:45,037 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-16170778 passed 2025-08-03 00:24:45,037 - DEBUG - ====Verifying policy data for ctest-vn-16170778 in API_Server ====== 2025-08-03 00:24:45,038 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:24:45,046 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028 2025-08-03 00:24:45,062 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:24:45,192 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/6471652f-e484-4186-91a3-dd3d183b6235 2025-08-03 00:24:45,206 - DEBUG - =>VN ctest-vn-16170778 has no policy to be verified 2025-08-03 00:24:45,206 - DEBUG - Verifying the vn in opserver 2025-08-03 00:24:45,206 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 virtual network link through opserver 10.0.0.38 2025-08-03 00:24:45,206 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-03 00:24:45,574 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-03 00:24:45,689 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778?flat'} 2025-08-03 00:24:45,689 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 virtual network link through opserver 10.0.0.254 2025-08-03 00:24:45,690 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-03 00:24:46,041 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-03 00:24:46,114 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778?flat'} 2025-08-03 00:24:46,114 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 virtual network link through opserver 10.0.0.50 2025-08-03 00:24:46,114 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-03 00:24:46,444 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-03 00:24:46,528 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778?flat'} 2025-08-03 00:24:46,528 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is found in opserver 2025-08-03 00:24:46,558 - DEBUG - Do not have enough data to verify VN in agent 2025-08-03 00:24:46,570 - DEBUG - VRF ids for VN ctest-vn-16170778: {} 2025-08-03 00:24:46,570 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:24:46,570 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:24:48,029 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2) 2025-08-03 00:24:48,029 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:24:49,744 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-1) 2025-08-03 00:24:49,745 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-58669359 to be up.. 2025-08-03 00:24:49,862 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-03 00:24:54,981 - DEBUG - VM is in ACTIVE state now 2025-08-03 00:24:54,981 - INFO - VM name : ctest-TestMtuProbe-77386939-58669359 2025-08-03 00:24:55,099 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 ID is 50fa648f-2381-4215-a5b0-edf9bce16ef7 2025-08-03 00:24:55,123 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2 2025-08-03 00:24:55,223 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/50fa648f-2381-4215-a5b0-edf9bce16ef7 2025-08-03 00:24:55,518 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/50fa648f-2381-4215-a5b0-edf9bce16ef7 2025-08-03 00:24:55,575 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/31882b29-ed70-4185-aebd-3480ef3a8e40 2025-08-03 00:24:58,859 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-03 00:24:58,859 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:24:58,886 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:02,955 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-08-03 00:25:02,955 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:02,988 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:07,083 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-03 00:25:07,083 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:07,104 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:11,177 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-03 00:25:11,177 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:11,212 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:15,309 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2025-08-03 00:25:15,309 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:15,343 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:19,435 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-08-03 00:25:19,435 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:19,469 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:23,562 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-08-03 00:25:23,562 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:23,594 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:27,691 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-08-03 00:25:27,691 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:27,724 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:31,820 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-08-03 00:25:31,820 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 failed! 2025-08-03 00:25:31,853 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-16170778 is 60.109.226.65 and allocation pool is NOT set 2025-08-03 00:25:33,918 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.20 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.533 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.533/3.365/6.198/2.832 ms') 2025-08-03 00:25:33,918 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-58669359 passed 2025-08-03 00:25:34,063 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:25:34,063 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22 2025-08-03 00:25:34,131 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:25:34,262 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:25:39,263 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:25:39,263 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22 2025-08-03 00:25:39,332 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:25:39,470 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:25:44,470 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:25:44,470 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22 2025-08-03 00:25:44,540 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:25:44,632 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:25:49,632 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:25:49,633 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22 2025-08-03 00:25:49,691 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:25:49,818 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:25:54,820 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:25:54,820 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-58669359, IP 60.109.226.67, Port 22 2025-08-03 00:25:54,996 - DEBUG - VM ctest-TestMtuProbe-77386939-58669359 is ready for SSH connections 2025-08-03 00:25:54,996 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-77248185 to be up.. 2025-08-03 00:25:55,098 - DEBUG - VM is in ACTIVE state now 2025-08-03 00:25:55,098 - INFO - VM name : ctest-TestMtuProbe-77386939-77248185 2025-08-03 00:25:55,200 - DEBUG - VM ctest-TestMtuProbe-77386939-77248185 ID is c96c3730-0dab-4101-ab1b-558635014fa1 2025-08-03 00:25:55,200 - DEBUG - VM ctest-TestMtuProbe-77386939-77248185 launched on Node an-jenkins-deploy-platform-ansible-os-3743-1 2025-08-03 00:25:55,328 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/c96c3730-0dab-4101-ab1b-558635014fa1 2025-08-03 00:25:55,350 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/3a000d2b-cc24-4f4a-b6b9-867a530da530 2025-08-03 00:25:56,574 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.82 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.950 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.950/1.885/2.821/0.935 ms') 2025-08-03 00:25:56,574 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-77248185 passed 2025-08-03 00:25:56,703 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:25:56,704 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-77248185, IP 60.109.226.68, Port 22 2025-08-03 00:25:56,870 - DEBUG - VM ctest-TestMtuProbe-77386939-77248185 is ready for SSH connections 2025-08-03 00:25:56,870 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:25:56,870 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:26:15,512 - DEBUG - None 2025-08-03 00:26:15,512 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:26:15,512 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:26:55,842 - DEBUG - None 2025-08-03 00:26:55,842 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:26:55,843 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:26:55,843 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:26:55,843 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 60.109.226.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:26:55,843 - DEBUG - ping -s 56 -c 3 -W 1 60.109.226.68 2025-08-03 00:26:58,318 - DEBUG - PING 60.109.226.68 (60.109.226.68) 56(84) bytes of data. 64 bytes from 60.109.226.68: icmp_req=1 ttl=64 time=13.4 ms 64 bytes from 60.109.226.68: icmp_req=2 ttl=64 time=1.24 ms 64 bytes from 60.109.226.68: icmp_req=3 ttl=64 time=1.17 ms --- 60.109.226.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.177/5.298/13.470/5.778 ms 2025-08-03 00:26:58,319 - INFO - Ping to IP 60.109.226.68 from VM ctest-TestMtuProbe-77386939-58669359 passed 2025-08-03 00:26:58,319 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:26:58,319 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:26:58,319 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-03 00:26:58,909 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-03 00:26:58,909 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:26:58,909 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-03 00:26:59,366 - DEBUG - None 2025-08-03 00:26:59,367 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 60.109.226.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:26:59,367 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 60.109.226.68 5201 < testfile 2025-08-03 00:27:01,916 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00075422 s, 133 kB/s 2025-08-03 00:27:01,916 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:01,916 - DEBUG - ls -l testfile 2025-08-03 00:27:02,257 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:26 testfile 2025-08-03 00:27:02,258 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-77248185 2025-08-03 00:27:02,258 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:27:02,258 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:27:02,664 - DEBUG - None 2025-08-03 00:27:02,664 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:02,664 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:27:03,099 - DEBUG - None 2025-08-03 00:27:03,100 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:27:03,100 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:27:03,100 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:27:03,100 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 60.109.226.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:27:03,100 - DEBUG - ping -s 56 -c 3 -W 1 60.109.226.68 2025-08-03 00:27:05,571 - DEBUG - PING 60.109.226.68 (60.109.226.68) 56(84) bytes of data. 64 bytes from 60.109.226.68: icmp_req=1 ttl=64 time=2.92 ms 64 bytes from 60.109.226.68: icmp_req=2 ttl=64 time=1.09 ms 64 bytes from 60.109.226.68: icmp_req=3 ttl=64 time=1.23 ms --- 60.109.226.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.096/1.753/2.925/0.830 ms 2025-08-03 00:27:05,571 - INFO - Ping to IP 60.109.226.68 from VM ctest-TestMtuProbe-77386939-58669359 passed 2025-08-03 00:27:05,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:27:05,572 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:05,572 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-03 00:27:06,168 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:27 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-03 00:27:06,169 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:06,169 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-03 00:27:06,631 - DEBUG - None 2025-08-03 00:27:06,631 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 60.109.226.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:27:06,632 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 60.109.226.68 5201 < testfile 2025-08-03 00:27:09,177 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00100628 s, 99.4 kB/s 2025-08-03 00:27:09,177 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:09,178 - DEBUG - ls -l testfile 2025-08-03 00:27:09,540 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:27 testfile 2025-08-03 00:27:09,540 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-77248185 2025-08-03 00:27:09,540 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:27:09,540 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:27:09,977 - DEBUG - None 2025-08-03 00:27:09,977 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:09,978 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:27:10,400 - DEBUG - None 2025-08-03 00:27:10,401 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:27:10,401 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:27:10,401 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:27:10,401 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 60.109.226.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:27:10,401 - DEBUG - ping -s 56 -c 3 -W 1 60.109.226.68 2025-08-03 00:27:12,906 - DEBUG - PING 60.109.226.68 (60.109.226.68) 56(84) bytes of data. 64 bytes from 60.109.226.68: icmp_req=1 ttl=64 time=2.44 ms 64 bytes from 60.109.226.68: icmp_req=2 ttl=64 time=1.07 ms 64 bytes from 60.109.226.68: icmp_req=3 ttl=64 time=1.17 ms --- 60.109.226.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.072/1.562/2.442/0.623 ms 2025-08-03 00:27:12,907 - INFO - Ping to IP 60.109.226.68 from VM ctest-TestMtuProbe-77386939-58669359 passed 2025-08-03 00:27:12,907 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:27:12,907 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:12,907 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-03 00:27:13,469 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:27 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-03 00:27:13,470 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:13,470 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-03 00:27:13,913 - DEBUG - None 2025-08-03 00:27:13,913 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 60.109.226.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:27:13,913 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 60.109.226.68 5201 < testfile 2025-08-03 00:27:16,463 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000988758 s, 101 kB/s 2025-08-03 00:27:16,463 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2025-08-03 00:27:16,463 - DEBUG - ls -l testfile 2025-08-03 00:27:16,796 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:27 testfile 2025-08-03 00:27:16,796 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-77248185 2025-08-03 00:27:16,796 - INFO - Deleting VM ctest-TestMtuProbe-77386939-77248185 2025-08-03 00:27:16,889 - INFO - Deleting VM ctest-TestMtuProbe-77386939-58669359 2025-08-03 00:27:16,966 - INFO - Deleting VN ctest-vn-16170778 2025-08-03 00:27:17,025 - DEBUG - VN 6471652f-e484-4186-91a3-dd3d183b6235 still in use: Unable to complete operation on network 6471652f-e484-4186-91a3-dd3d183b6235. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a174f55b-883f-4abc-bbc9-d81420a91a06'] 2025-08-03 00:27:17,026 - WARNING - Deleting VN ctest-vn-16170778 failed..Will retry 2025-08-03 00:27:19,308 - DEBUG - Response for deleting network () 2025-08-03 00:27:19,308 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3751e43d-c2aa-435a-941f-86790c4e81c4 2025-08-03 00:27:19,316 - DEBUG - Response Code: 404 2025-08-03 00:27:19,316 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:27:19,323 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028 2025-08-03 00:27:19,382 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:27:19,494 - INFO - Validated that VN ctest-vn-16170778 is not found in API Server 2025-08-03 00:27:19,506 - DEBUG - VN ctest-vn-16170778 is not present in Agent 10.0.0.48 2025-08-03 00:27:19,519 - DEBUG - VN ctest-vn-16170778 is not present in Agent 10.0.0.49 2025-08-03 00:27:19,519 - INFO - Validated that VN ctest-vn-16170778 is not in any agent 2025-08-03 00:27:19,571 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-16170778 info 2025-08-03 00:27:20,958 - DEBUG - No XMPP flaps were noticed during the test 2025-08-03 00:27:20,958 - INFO - END TEST : test_mtu_probe_inter_node : PASSED[0:02:39] 2025-08-03 00:27:20,958 - INFO - -------------------------------------------------------------------------------- 2025-08-03 00:27:20,962 - INFO - ================================================================================ 2025-08-03 00:27:20,962 - INFO - STARTING TEST : test_mtu_probe_intra_node 2025-08-03 00:27:20,962 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs in same compute node 2. client and server VMs in same compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-08-03 00:27:22,351 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2025-08-03 00:27:22,351 - INFO - Initial checks done. Running the testcase now 2025-08-03 00:27:22,351 - INFO - 2025-08-03 00:27:22,813 - DEBUG - Response for create_network : {'network': {'id': 'c36e8bb5-5704-4bbf-a172-959d9395ef4d', 'name': 'ctest-vn-57626811', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'project_id': 'f47b08429ed04aac801c284d30c77a88', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-77386939', 'ctest-vn-57626811'], 'port_security_enabled': True, 'description': ''}} 2025-08-03 00:27:23,096 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b0fff920-8095-4f19-b717-6eaefdb1df71', 'name': '', 'tenant_id': 'f47b08429ed04aac801c284d30c77a88', 'network_id': 'c36e8bb5-5704-4bbf-a172-959d9395ef4d', 'ip_version': 4, 'cidr': '25.78.47.128/26', 'allocation_pools': [{'start': '25.78.47.130', 'end': '25.78.47.190'}], 'gateway_ip': '25.78.47.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25.78.47.130', 'tags': [], 'project_id': 'f47b08429ed04aac801c284d30c77a88'}} 2025-08-03 00:27:23,129 - INFO - Created VN ctest-vn-57626811 2025-08-03 00:27:23,142 - DEBUG - VN ctest-vn-57626811 UUID is c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,241 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:27:23,249 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028 2025-08-03 00:27:23,274 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:27:23,388 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,402 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,414 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25 2025-08-03 00:27:23,427 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25 2025-08-03 00:27:23,436 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/196e7ef3-3714-4ec7-af7c-21bdccfbc83c 2025-08-03 00:27:23,445 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:27:23,445 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,457 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25 2025-08-03 00:27:23,476 - INFO - Verified VN network id 12 for VN c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,476 - INFO - Verifications in API Server for VN ctest-vn-57626811 passed 2025-08-03 00:27:23,476 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,488 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25 2025-08-03 00:27:23,497 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25 2025-08-03 00:27:23,507 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/196e7ef3-3714-4ec7-af7c-21bdccfbc83c 2025-08-03 00:27:23,526 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14082346695799360447', 'uuid-lslong': '11633525291469893453'}, 'enable': 'true', 'created': '2025-08-03T00:27:22', 'last-modified': '2025-08-03T00:27:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506719'} 2025-08-03 00:27:23,532 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:27:23,547 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14082346695799360447', 'uuid-lslong': '11633525291469893453'}, 'enable': 'true', 'created': '2025-08-03T00:27:22', 'last-modified': '2025-08-03T00:27:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.535216'} 2025-08-03 00:27:23,564 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:27:23,572 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-77386939', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14082346695799360447', 'uuid-lslong': '11633525291469893453'}, 'enable': 'true', 'created': '2025-08-03T00:27:22', 'last-modified': '2025-08-03T00:27:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.553043'} 2025-08-03 00:27:23,580 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-03 00:27:23,581 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-57626811 passed 2025-08-03 00:27:23,581 - DEBUG - ====Verifying policy data for ctest-vn-57626811 in API_Server ====== 2025-08-03 00:27:23,581 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:27:23,590 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028 2025-08-03 00:27:23,604 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:27:23,728 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c36e8bb5-5704-4bbf-a172-959d9395ef4d 2025-08-03 00:27:23,752 - DEBUG - =>VN ctest-vn-57626811 has no policy to be verified 2025-08-03 00:27:23,752 - DEBUG - Verifying the vn in opserver 2025-08-03 00:27:23,752 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 virtual network link through opserver 10.0.0.38 2025-08-03 00:27:23,752 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-03 00:27:23,784 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811?flat'} 2025-08-03 00:27:23,784 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 virtual network link through opserver 10.0.0.254 2025-08-03 00:27:23,784 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-03 00:27:23,851 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811?flat'} 2025-08-03 00:27:23,851 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 virtual network link through opserver 10.0.0.50 2025-08-03 00:27:23,851 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-08-03 00:27:23,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811?flat'} 2025-08-03 00:27:23,916 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is found in opserver 2025-08-03 00:27:23,945 - DEBUG - Do not have enough data to verify VN in agent 2025-08-03 00:27:23,959 - DEBUG - VRF ids for VN ctest-vn-57626811: {} 2025-08-03 00:27:23,959 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:27:23,959 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:27:25,213 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2) 2025-08-03 00:27:25,214 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']} 2025-08-03 00:27:26,994 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3743-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3743-2) 2025-08-03 00:27:26,994 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-71811819 to be up.. 2025-08-03 00:27:27,096 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-03 00:27:32,249 - DEBUG - VM is in ACTIVE state now 2025-08-03 00:27:32,249 - INFO - VM name : ctest-TestMtuProbe-77386939-71811819 2025-08-03 00:27:32,370 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 ID is 71091d52-5f33-4054-8b67-5df630bc82df 2025-08-03 00:27:32,370 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2 2025-08-03 00:27:32,512 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/71091d52-5f33-4054-8b67-5df630bc82df 2025-08-03 00:27:32,537 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/519fb273-4c65-445e-892b-7fa0688e52de 2025-08-03 00:27:35,818 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2025-08-03 00:27:35,818 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:27:35,857 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:27:39,946 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-03 00:27:39,946 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:27:39,979 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:27:44,074 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-08-03 00:27:44,074 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:27:44,124 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:27:48,203 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-03 00:27:48,203 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:27:48,243 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:27:52,324 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-03 00:27:52,324 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:27:52,347 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:27:56,420 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-03 00:27:56,420 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:27:56,441 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:28:00,527 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-03 00:28:00,527 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:28:00,557 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:28:04,650 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-08-03 00:28:04,650 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:28:04,683 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:28:08,770 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-08-03 00:28:08,771 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 failed! 2025-08-03 00:28:08,788 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-77386939:ctest-vn-57626811 is 25.78.47.129 and allocation pool is NOT set 2025-08-03 00:28:12,870 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=10.6 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1018ms\r\nrtt min/avg/max/mdev = 10.589/10.589/10.589/0.000 ms') 2025-08-03 00:28:12,870 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-77386939-71811819 passed 2025-08-03 00:28:13,005 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:13,005 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22 2025-08-03 00:28:13,076 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:28:13,210 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:28:18,211 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:18,211 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22 2025-08-03 00:28:18,270 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:28:18,365 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:28:23,366 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:23,366 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22 2025-08-03 00:28:23,432 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:28:23,558 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:28:28,559 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:28,559 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22 2025-08-03 00:28:28,617 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:28:28,725 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:28:33,726 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:33,726 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-71811819, IP 25.78.47.131, Port 22 2025-08-03 00:28:33,891 - DEBUG - VM ctest-TestMtuProbe-77386939-71811819 is ready for SSH connections 2025-08-03 00:28:33,891 - INFO - Waiting for VM ctest-TestMtuProbe-77386939-83026755 to be up.. 2025-08-03 00:28:34,002 - DEBUG - VM is in ACTIVE state now 2025-08-03 00:28:34,002 - INFO - VM name : ctest-TestMtuProbe-77386939-83026755 2025-08-03 00:28:34,131 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 ID is 553ee3ad-7ecd-42a7-bcf2-02798ba1b4be 2025-08-03 00:28:34,131 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 launched on Node an-jenkins-deploy-platform-ansible-os-3743-2 2025-08-03 00:28:34,236 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/553ee3ad-7ecd-42a7-bcf2-02798ba1b4be 2025-08-03 00:28:34,254 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/318089f6-cfaf-4201-ba57-4acbafc912c7 2025-08-03 00:28:35,520 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.62 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=5.42 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1004ms\r\nrtt min/avg/max/mdev = 5.424/6.022/6.620/0.598 ms') 2025-08-03 00:28:35,521 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-77386939-83026755 passed 2025-08-03 00:28:35,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:35,678 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-83026755, IP 25.78.47.132, Port 22 2025-08-03 00:28:35,761 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-03 00:28:35,870 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-03 00:28:40,870 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:28:40,871 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-77386939-83026755, IP 25.78.47.132, Port 22 2025-08-03 00:28:41,025 - DEBUG - VM ctest-TestMtuProbe-77386939-83026755 is ready for SSH connections 2025-08-03 00:28:41,025 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:28:41,025 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:28:57,861 - DEBUG - None 2025-08-03 00:28:57,861 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:28:57,861 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:29:36,295 - DEBUG - None 2025-08-03 00:29:36,295 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:29:36,295 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:29:36,296 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:29:36,296 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.78.47.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:36,296 - DEBUG - ping -s 56 -c 3 -W 1 25.78.47.132 2025-08-03 00:29:38,775 - DEBUG - PING 25.78.47.132 (25.78.47.132) 56(84) bytes of data. 64 bytes from 25.78.47.132: icmp_req=1 ttl=64 time=10.2 ms 64 bytes from 25.78.47.132: icmp_req=2 ttl=64 time=1.19 ms 64 bytes from 25.78.47.132: icmp_req=3 ttl=64 time=0.848 ms --- 25.78.47.132 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.848/4.080/10.203/4.332 ms 2025-08-03 00:29:38,775 - INFO - Ping to IP 25.78.47.132 from VM ctest-TestMtuProbe-77386939-71811819 passed 2025-08-03 00:29:38,775 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:29:38,776 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:38,776 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-03 00:29:39,345 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-03 00:29:39,346 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:39,346 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-03 00:29:39,791 - DEBUG - None 2025-08-03 00:29:39,791 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 25.78.47.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:39,791 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 25.78.47.132 5201 < testfile 2025-08-03 00:29:42,351 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00112885 s, 88.6 kB/s 2025-08-03 00:29:42,352 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:42,352 - DEBUG - ls -l testfile 2025-08-03 00:29:42,686 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:29 testfile 2025-08-03 00:29:42,686 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-83026755 2025-08-03 00:29:42,686 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:42,686 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:29:43,107 - DEBUG - None 2025-08-03 00:29:43,107 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:43,107 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:29:43,517 - DEBUG - None 2025-08-03 00:29:43,518 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:29:43,518 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:29:43,518 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:29:43,518 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.78.47.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:43,518 - DEBUG - ping -s 56 -c 3 -W 1 25.78.47.132 2025-08-03 00:29:45,979 - DEBUG - PING 25.78.47.132 (25.78.47.132) 56(84) bytes of data. 64 bytes from 25.78.47.132: icmp_req=1 ttl=64 time=2.16 ms 64 bytes from 25.78.47.132: icmp_req=2 ttl=64 time=0.686 ms 64 bytes from 25.78.47.132: icmp_req=3 ttl=64 time=0.871 ms --- 25.78.47.132 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 0.686/1.240/2.163/0.657 ms 2025-08-03 00:29:45,979 - INFO - Ping to IP 25.78.47.132 from VM ctest-TestMtuProbe-77386939-71811819 passed 2025-08-03 00:29:45,980 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:29:45,980 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:45,980 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-03 00:29:46,547 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:29 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-03 00:29:46,547 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:46,547 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-03 00:29:47,013 - DEBUG - None 2025-08-03 00:29:47,013 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 25.78.47.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:47,013 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 25.78.47.132 5201 < testfile 2025-08-03 00:29:49,565 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00244985 s, 40.8 kB/s 2025-08-03 00:29:49,565 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:49,566 - DEBUG - ls -l testfile 2025-08-03 00:29:49,888 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:29 testfile 2025-08-03 00:29:49,888 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-83026755 2025-08-03 00:29:49,888 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:49,888 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:29:50,299 - DEBUG - None 2025-08-03 00:29:50,299 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:50,299 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-03 00:29:50,716 - DEBUG - None 2025-08-03 00:29:50,716 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:29:50,716 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-03 00:29:50,717 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:29:50,717 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 25.78.47.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:50,717 - DEBUG - ping -s 56 -c 3 -W 1 25.78.47.132 2025-08-03 00:29:53,175 - DEBUG - PING 25.78.47.132 (25.78.47.132) 56(84) bytes of data. 64 bytes from 25.78.47.132: icmp_req=1 ttl=64 time=2.49 ms 64 bytes from 25.78.47.132: icmp_req=2 ttl=64 time=0.810 ms 64 bytes from 25.78.47.132: icmp_req=3 ttl=64 time=0.878 ms --- 25.78.47.132 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.810/1.393/2.492/0.777 ms 2025-08-03 00:29:53,175 - INFO - Ping to IP 25.78.47.132 from VM ctest-TestMtuProbe-77386939-71811819 passed 2025-08-03 00:29:53,175 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-03 00:29:53,176 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:53,176 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-03 00:29:53,711 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 3 00:29 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-03 00:29:53,711 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:53,712 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-03 00:29:54,169 - DEBUG - None 2025-08-03 00:29:54,169 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 25.78.47.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:54,170 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 25.78.47.132 5201 < testfile 2025-08-03 00:29:56,748 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00104908 s, 95.3 kB/s 2025-08-03 00:29:56,748 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-03 00:29:56,748 - DEBUG - ls -l testfile 2025-08-03 00:29:57,079 - DEBUG - -rw-r--r-- 1 root root 100 Aug 3 00:29 testfile 2025-08-03 00:29:57,079 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-77386939-83026755 2025-08-03 00:29:57,079 - INFO - Deleting VM ctest-TestMtuProbe-77386939-83026755 2025-08-03 00:29:57,172 - INFO - Deleting VM ctest-TestMtuProbe-77386939-71811819 2025-08-03 00:29:57,252 - INFO - Deleting VN ctest-vn-57626811 2025-08-03 00:29:57,365 - DEBUG - VN c36e8bb5-5704-4bbf-a172-959d9395ef4d still in use: Unable to complete operation on network c36e8bb5-5704-4bbf-a172-959d9395ef4d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-742b261b-da85-4d37-a849-7435e37ecd73'] 2025-08-03 00:29:57,365 - WARNING - Deleting VN ctest-vn-57626811 failed..Will retry 2025-08-03 00:29:59,649 - DEBUG - Response for deleting network () 2025-08-03 00:29:59,649 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/30cbdf81-5b49-4643-8273-353b2408ae25 2025-08-03 00:29:59,689 - DEBUG - Response Code: 404 2025-08-03 00:29:59,689 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-03 00:29:59,698 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028 2025-08-03 00:29:59,712 - DEBUG - Requesting: http://10.0.0.38:8082/project/f47b0842-9ed0-4aac-801c-284d30c77a88 2025-08-03 00:29:59,824 - INFO - Validated that VN ctest-vn-57626811 is not found in API Server 2025-08-03 00:29:59,838 - DEBUG - VN ctest-vn-57626811 is not present in Agent 10.0.0.48 2025-08-03 00:29:59,850 - DEBUG - VN ctest-vn-57626811 is not present in Agent 10.0.0.49 2025-08-03 00:29:59,850 - INFO - Validated that VN ctest-vn-57626811 is not in any agent 2025-08-03 00:29:59,906 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-57626811 info 2025-08-03 00:30:01,305 - DEBUG - No XMPP flaps were noticed during the test 2025-08-03 00:30:01,305 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:41] 2025-08-03 00:30:01,305 - INFO - -------------------------------------------------------------------------------- 2025-08-03 00:30:02,152 - INFO - Deleted project: ctest-TestMtuProbe-77386939, ID : f47b0842-9ed0-4aac-801c-284d30c77a88