2025-10-29 19:22:30,032 - INFO - Domain Default found not creating
2025-10-29 19:22:30,319 - INFO - Project ctest-TestMtuProbe-14360921 not found, creating it
2025-10-29 19:22:30,931 - INFO - Created Project:ctest-TestMtuProbe-14360921, ID : 78893119-b36e-4308-9ea5-9abbfcd57ed1
2025-10-29 19:22:32,755 - INFO - ================================================================================
2025-10-29 19:22:32,755 - INFO - STARTING TEST : test_mtu_probe_intra_node
2025-10-29 19:22:32,755 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs in same compute node
2. client and server VMs in same compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2025-10-29 19:22:34,214 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.201': '0', '10.20.0.200': '0'}, '10.0.0.27': {'10.20.0.201': '0', '10.20.0.200': '0'}} with
2025-10-29 19:22:34,214 - INFO - Initial checks done. Running the testcase now
2025-10-29 19:22:34,214 - INFO -
2025-10-29 19:22:34,981 - DEBUG - Response for create_network : {'network': {'id': 'fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8', 'name': 'ctest-vn-57984668', 'tenant_id': '78893119b36e43089ea59abbfcd57ed1', 'project_id': '78893119b36e43089ea59abbfcd57ed1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-14360921', 'ctest-vn-57984668'], 'port_security_enabled': True, 'description': ''}}
2025-10-29 19:22:35,257 - DEBUG - Response for create_subnet : {'subnet': {'id': '639a5268-d784-486e-a877-a6e3613800a7', 'name': '', 'tenant_id': '78893119b36e43089ea59abbfcd57ed1', 'network_id': 'fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8', 'ip_version': 4, 'cidr': '166.150.20.0/26', 'allocation_pools': [{'start': '166.150.20.2', 'end': '166.150.20.62'}], 'gateway_ip': '166.150.20.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '166.150.20.2', 'tags': [], 'project_id': '78893119b36e43089ea59abbfcd57ed1'}}
2025-10-29 19:22:35,280 - INFO - Created VN ctest-vn-57984668
2025-10-29 19:22:35,295 - DEBUG - VN ctest-vn-57984668 UUID is fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:35,375 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-29 19:22:35,671 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-29 19:22:35,737 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442
2025-10-29 19:22:35,772 - DEBUG - Requesting: http://10.0.0.249:8082/project/78893119-b36e-4308-9ea5-9abbfcd57ed1
2025-10-29 19:22:35,898 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:35,918 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:35,937 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4e65036f-c499-460d-933b-926d754e8993
2025-10-29 19:22:35,950 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4e65036f-c499-460d-933b-926d754e8993
2025-10-29 19:22:35,966 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a83d534a-c015-4963-a06c-bee1958d956f
2025-10-29 19:22:35,979 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-29 19:22:35,979 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:35,998 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4e65036f-c499-460d-933b-926d754e8993
2025-10-29 19:22:36,022 - INFO - Verified VN network id 11 for VN fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:36,022 - INFO - Verifications in API Server for VN ctest-vn-57984668 passed
2025-10-29 19:22:36,023 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:36,047 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4e65036f-c499-460d-933b-926d754e8993
2025-10-29 19:22:36,065 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4e65036f-c499-460d-933b-926d754e8993
2025-10-29 19:22:36,084 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a83d534a-c015-4963-a06c-bee1958d956f
2025-10-29 19:22:36,107 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-14360921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18249061939781978764', 'uuid-lslong': '12741664989556554952'}, 'enable': 'true', 'created': '2025-10-29T19:22:34', 'last-modified': '2025-10-29T19:22:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.929792'}
2025-10-29 19:22:36,123 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-29 19:22:36,133 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-14360921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18249061939781978764', 'uuid-lslong': '12741664989556554952'}, 'enable': 'true', 'created': '2025-10-29T19:22:34', 'last-modified': '2025-10-29T19:22:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.955748'}
2025-10-29 19:22:36,143 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-29 19:22:36,152 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-14360921', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18249061939781978764', 'uuid-lslong': '12741664989556554952'}, 'enable': 'true', 'created': '2025-10-29T19:22:34', 'last-modified': '2025-10-29T19:22:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.970695'}
2025-10-29 19:22:36,163 - DEBUG - Route Targets: ['target:64512:8000004']
2025-10-29 19:22:36,163 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-57984668 passed
2025-10-29 19:22:36,164 - DEBUG - ====Verifying policy data for ctest-vn-57984668 in API_Server ======
2025-10-29 19:22:36,164 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-29 19:22:36,175 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442
2025-10-29 19:22:36,193 - DEBUG - Requesting: http://10.0.0.249:8082/project/78893119-b36e-4308-9ea5-9abbfcd57ed1
2025-10-29 19:22:36,309 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8
2025-10-29 19:22:36,320 - DEBUG - =>VN ctest-vn-57984668 has no policy to be verified
2025-10-29 19:22:36,320 - DEBUG - Verifying the vn in opserver
2025-10-29 19:22:36,320 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 virtual network link through opserver 10.0.0.249
2025-10-29 19:22:36,320 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-10-29 19:22:36,632 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-10-29 19:22:36,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668?flat'}
2025-10-29 19:22:36,722 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 virtual network link through opserver 10.0.0.19
2025-10-29 19:22:36,722 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2025-10-29 19:22:37,049 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2025-10-29 19:22:37,167 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668?flat'}
2025-10-29 19:22:37,168 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 virtual network link through opserver 10.0.0.41
2025-10-29 19:22:37,168 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks
2025-10-29 19:22:37,506 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks
2025-10-29 19:22:37,616 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668?flat'}
2025-10-29 19:22:37,617 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is found in opserver
2025-10-29 19:22:37,659 - DEBUG - Do not have enough data to verify VN in agent
2025-10-29 19:22:37,676 - DEBUG - VRF ids for VN ctest-vn-57984668: {}
2025-10-29 19:22:37,710 - DEBUG - Services list from nova: [, , , ]
2025-10-29 19:22:37,711 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4526-2', 'an-jenkins-deploy-platform-ansible-os-4526-1']}
2025-10-29 19:22:37,711 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4526-2', 'an-jenkins-deploy-platform-ansible-os-4526-1']}
2025-10-29 19:22:39,314 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-2)
2025-10-29 19:22:39,314 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4526-2', 'an-jenkins-deploy-platform-ansible-os-4526-1']}
2025-10-29 19:22:40,668 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-2)
2025-10-29 19:22:40,669 - INFO - Waiting for VM ctest-TestMtuProbe-14360921-89688862 to be up..
2025-10-29 19:22:40,771 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-10-29 19:22:45,930 - DEBUG - VM is in ACTIVE state now
2025-10-29 19:22:45,930 - INFO - VM name : ctest-TestMtuProbe-14360921-89688862
2025-10-29 19:22:46,072 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 ID is 487c8950-4078-4669-a265-fbda8eeaa805
2025-10-29 19:22:46,133 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 launched on Node an-jenkins-deploy-platform-ansible-os-4526-2
2025-10-29 19:22:46,263 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/487c8950-4078-4669-a265-fbda8eeaa805
2025-10-29 19:22:46,576 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/487c8950-4078-4669-a265-fbda8eeaa805
2025-10-29 19:22:46,622 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/11bfeec8-4410-4e60-8681-8822c2afe7d4
2025-10-29 19:22:49,818 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-29 19:22:49,818 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:22:49,836 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:22:53,911 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms')
2025-10-29 19:22:53,911 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:22:53,949 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:22:58,042 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-10-29 19:22:58,042 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:22:58,065 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:02,167 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms')
2025-10-29 19:23:02,168 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:02,189 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:06,263 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms')
2025-10-29 19:23:06,264 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:06,281 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:10,361 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-29 19:23:10,361 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:10,379 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:14,456 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-10-29 19:23:14,456 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:14,475 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:18,551 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-10-29 19:23:18,552 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:18,577 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:22,645 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-10-29 19:23:22,646 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:22,672 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:26,745 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms')
2025-10-29 19:23:26,745 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:26,775 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:30,868 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms')
2025-10-29 19:23:30,868 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 failed!
2025-10-29 19:23:30,883 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-14360921:ctest-vn-57984668 is 166.150.20.1 and allocation pool is NOT set
2025-10-29 19:23:32,954 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.67 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.721 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.721/4.697/8.673/3.976 ms')
2025-10-29 19:23:32,954 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-14360921-89688862 passed
2025-10-29 19:23:33,044 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:23:33,045 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-14360921-89688862, IP 166.150.20.3, Port 22
2025-10-29 19:23:33,116 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-29 19:23:33,278 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-29 19:23:38,279 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:23:38,279 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-14360921-89688862, IP 166.150.20.3, Port 22
2025-10-29 19:23:38,346 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-29 19:23:38,515 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-29 19:23:43,516 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:23:43,517 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-14360921-89688862, IP 166.150.20.3, Port 22
2025-10-29 19:23:43,585 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-29 19:23:43,718 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-29 19:23:48,719 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:23:48,720 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-14360921-89688862, IP 166.150.20.3, Port 22
2025-10-29 19:23:48,780 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-10-29 19:23:48,951 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 is NOT ready for SSH connections, VM status: ACTIVE
2025-10-29 19:23:53,951 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:23:53,951 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-14360921-89688862, IP 166.150.20.3, Port 22
2025-10-29 19:23:54,129 - DEBUG - VM ctest-TestMtuProbe-14360921-89688862 is ready for SSH connections
2025-10-29 19:23:54,130 - INFO - Waiting for VM ctest-TestMtuProbe-14360921-77497622 to be up..
2025-10-29 19:23:54,299 - DEBUG - VM is in ACTIVE state now
2025-10-29 19:23:54,299 - INFO - VM name : ctest-TestMtuProbe-14360921-77497622
2025-10-29 19:23:54,448 - DEBUG - VM ctest-TestMtuProbe-14360921-77497622 ID is bd469ebb-4969-441c-93e5-c84e07acff2b
2025-10-29 19:23:54,448 - DEBUG - VM ctest-TestMtuProbe-14360921-77497622 launched on Node an-jenkins-deploy-platform-ansible-os-4526-2
2025-10-29 19:23:54,610 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/bd469ebb-4969-441c-93e5-c84e07acff2b
2025-10-29 19:23:54,633 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/09baddc9-e824-47c6-8650-5dde712adf0f
2025-10-29 19:23:55,833 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.78 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.450 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.450/1.615/2.781/1.165 ms')
2025-10-29 19:23:55,833 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-14360921-77497622 passed
2025-10-29 19:23:55,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:23:55,919 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-14360921-77497622, IP 166.150.20.4, Port 22
2025-10-29 19:23:56,094 - DEBUG - VM ctest-TestMtuProbe-14360921-77497622 is ready for SSH connections
2025-10-29 19:23:56,094 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:23:56,094 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-29 19:24:18,690 - DEBUG - None
2025-10-29 19:24:18,691 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:24:18,691 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-29 19:25:00,753 - DEBUG - None
2025-10-29 19:25:00,753 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-29 19:25:00,753 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-29 19:25:00,753 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:25:00,754 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 166.150.20.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:00,754 - DEBUG - ping -s 56 -c 3 -W 1 166.150.20.4
2025-10-29 19:25:03,220 - DEBUG - PING 166.150.20.4 (166.150.20.4) 56(84) bytes of data.
64 bytes from 166.150.20.4: icmp_req=1 ttl=64 time=9.03 ms
64 bytes from 166.150.20.4: icmp_req=2 ttl=64 time=0.822 ms
64 bytes from 166.150.20.4: icmp_req=3 ttl=64 time=0.822 ms
--- 166.150.20.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.822/3.560/9.036/3.872 ms
2025-10-29 19:25:03,221 - INFO - Ping to IP 166.150.20.4 from VM ctest-TestMtuProbe-14360921-89688862 passed
2025-10-29 19:25:03,221 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:25:03,221 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:03,222 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-10-29 19:25:03,891 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-10-29 19:25:03,891 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:03,892 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-10-29 19:25:04,386 - DEBUG - None
2025-10-29 19:25:04,387 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 166.150.20.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:04,387 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 166.150.20.4 5201 < testfile
2025-10-29 19:25:07,016 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000909966 s, 110 kB/s
2025-10-29 19:25:07,016 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:07,016 - DEBUG - ls -l testfile
2025-10-29 19:25:07,341 - DEBUG - -rw-r--r-- 1 root root 100 Oct 29 19:25 testfile
2025-10-29 19:25:07,341 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-14360921-77497622
2025-10-29 19:25:07,342 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:07,342 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-29 19:25:07,791 - DEBUG - None
2025-10-29 19:25:07,791 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:07,791 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-29 19:25:08,215 - DEBUG - None
2025-10-29 19:25:08,215 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-29 19:25:08,215 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-29 19:25:08,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:25:08,216 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 166.150.20.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:08,216 - DEBUG - ping -s 56 -c 3 -W 1 166.150.20.4
2025-10-29 19:25:10,665 - DEBUG - PING 166.150.20.4 (166.150.20.4) 56(84) bytes of data.
64 bytes from 166.150.20.4: icmp_req=1 ttl=64 time=1.94 ms
64 bytes from 166.150.20.4: icmp_req=2 ttl=64 time=0.720 ms
64 bytes from 166.150.20.4: icmp_req=3 ttl=64 time=0.752 ms
--- 166.150.20.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.720/1.138/1.944/0.570 ms
2025-10-29 19:25:10,665 - INFO - Ping to IP 166.150.20.4 from VM ctest-TestMtuProbe-14360921-89688862 passed
2025-10-29 19:25:10,666 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:25:10,666 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:10,666 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-10-29 19:25:11,208 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Oct 29 19:25 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-10-29 19:25:11,208 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:11,208 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-10-29 19:25:11,651 - DEBUG - None
2025-10-29 19:25:11,651 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 166.150.20.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:11,652 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 166.150.20.4 5201 < testfile
2025-10-29 19:25:14,209 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00400237 s, 25.0 kB/s
2025-10-29 19:25:14,210 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:14,210 - DEBUG - ls -l testfile
2025-10-29 19:25:14,531 - DEBUG - -rw-r--r-- 1 root root 100 Oct 29 19:25 testfile
2025-10-29 19:25:14,531 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-14360921-77497622
2025-10-29 19:25:14,532 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:14,532 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-29 19:25:14,948 - DEBUG - None
2025-10-29 19:25:14,948 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:14,949 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-10-29 19:25:15,353 - DEBUG - None
2025-10-29 19:25:15,353 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-29 19:25:15,354 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-10-29 19:25:15,354 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:25:15,354 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 166.150.20.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:15,354 - DEBUG - ping -s 56 -c 3 -W 1 166.150.20.4
2025-10-29 19:25:17,809 - DEBUG - PING 166.150.20.4 (166.150.20.4) 56(84) bytes of data.
64 bytes from 166.150.20.4: icmp_req=1 ttl=64 time=1.60 ms
64 bytes from 166.150.20.4: icmp_req=2 ttl=64 time=0.727 ms
64 bytes from 166.150.20.4: icmp_req=3 ttl=64 time=0.723 ms
--- 166.150.20.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.723/1.016/1.600/0.414 ms
2025-10-29 19:25:17,810 - INFO - Ping to IP 166.150.20.4 from VM ctest-TestMtuProbe-14360921-89688862 passed
2025-10-29 19:25:17,810 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-10-29 19:25:17,810 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:17,811 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-10-29 19:25:18,338 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Oct 29 19:25 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-10-29 19:25:18,338 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:18,339 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-10-29 19:25:18,777 - DEBUG - None
2025-10-29 19:25:18,778 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 166.150.20.4 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:18,778 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 166.150.20.4 5201 < testfile
2025-10-29 19:25:21,291 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000893129 s, 112 kB/s
2025-10-29 19:25:21,291 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123
2025-10-29 19:25:21,292 - DEBUG - ls -l testfile
2025-10-29 19:25:21,610 - DEBUG - -rw-r--r-- 1 root root 100 Oct 29 19:25 testfile
2025-10-29 19:25:21,610 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-14360921-77497622
2025-10-29 19:25:21,610 - INFO - Deleting VM ctest-TestMtuProbe-14360921-77497622
2025-10-29 19:25:21,756 - INFO - Deleting VM ctest-TestMtuProbe-14360921-89688862
2025-10-29 19:25:21,904 - INFO - Deleting VN ctest-vn-57984668
2025-10-29 19:25:21,973 - DEBUG - VN fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8 still in use: Unable to complete operation on network fd41b125-84ce-4a8c-b0d3-7cccbd8cbcc8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-997e0df3-3ff8-45c3-8e75-bf2df47c3d3e']
2025-10-29 19:25:21,974 - WARNING - Deleting VN ctest-vn-57984668 failed..Will retry
2025-10-29 19:25:24,266 - DEBUG - Response for deleting network ()
2025-10-29 19:25:24,267 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4e65036f-c499-460d-933b-926d754e8993
2025-10-29 19:25:24,276 - DEBUG - Response Code: 404
2025-10-29 19:25:24,276 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-10-29 19:25:24,283 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442
2025-10-29 19:25:24,344 - DEBUG - Requesting: http://10.0.0.249:8082/project/78893119-b36e-4308-9ea5-9abbfcd57ed1
2025-10-29 19:25:24,480 - INFO - Validated that VN ctest-vn-57984668 is not found in API Server
2025-10-29 19:25:24,502 - DEBUG - VN ctest-vn-57984668 is not present in Agent 10.0.0.73
2025-10-29 19:25:24,518 - DEBUG - VN ctest-vn-57984668 is not present in Agent 10.0.0.27
2025-10-29 19:25:24,518 - INFO - Validated that VN ctest-vn-57984668 is not in any agent
2025-10-29 19:25:24,574 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-57984668 info
2025-10-29 19:25:26,025 - DEBUG - No XMPP flaps were noticed during the test
2025-10-29 19:25:26,026 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:54]
2025-10-29 19:25:26,026 - INFO - --------------------------------------------------------------------------------
2025-10-29 19:25:26,925 - INFO - Deleted project: ctest-TestMtuProbe-14360921, ID : 78893119-b36e-4308-9ea5-9abbfcd57ed1