2025-08-06 09:15:37,861 - INFO - Domain Default found not creating 2025-08-06 09:15:38,046 - INFO - Project ctest-TestMtuProbe-94572681 not found, creating it 2025-08-06 09:15:38,579 - INFO - Created Project:ctest-TestMtuProbe-94572681, ID : 04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:15:40,191 - INFO - ================================================================================ 2025-08-06 09:15:40,191 - INFO - STARTING TEST : test_mtu_probe_inter_node 2025-08-06 09:15:40,191 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs across compute node 2. client and server VMs across compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-08-06 09:15:41,496 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-08-06 09:15:41,496 - INFO - Initial checks done. Running the testcase now 2025-08-06 09:15:41,496 - INFO - 2025-08-06 09:15:41,520 - DEBUG - Services list from nova: [, , , ] 2025-08-06 09:15:41,520 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:15:42,399 - DEBUG - Response for create_network : {'network': {'id': '9f6cacd3-3b92-4025-ae03-fe6ef31d930e', 'name': 'ctest-vn-15100856', 'tenant_id': '04af5bc3770040998f5fa378c248de4c', 'project_id': '04af5bc3770040998f5fa378c248de4c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-94572681', 'ctest-vn-15100856'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 09:15:42,791 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fe00bb1f-17b0-4598-8f70-d37fbcd7ece8', 'name': '', 'tenant_id': '04af5bc3770040998f5fa378c248de4c', 'network_id': '9f6cacd3-3b92-4025-ae03-fe6ef31d930e', 'ip_version': 4, 'cidr': '168.235.22.64/26', 'allocation_pools': [{'start': '168.235.22.66', 'end': '168.235.22.126'}], 'gateway_ip': '168.235.22.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '168.235.22.66', 'tags': [], 'project_id': '04af5bc3770040998f5fa378c248de4c'}} 2025-08-06 09:15:42,814 - INFO - Created VN ctest-vn-15100856 2025-08-06 09:15:42,827 - DEBUG - VN ctest-vn-15100856 UUID is 9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:42,919 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:15:43,218 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:15:43,258 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 09:15:43,280 - DEBUG - Requesting: http://10.0.0.48:8082/project/04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:15:43,385 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:43,402 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:43,418 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/f546491d-738c-4c7e-9708-91fc796b1a1e 2025-08-06 09:15:43,431 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/f546491d-738c-4c7e-9708-91fc796b1a1e 2025-08-06 09:15:43,442 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/5227ec9a-0c50-4c78-b3a7-be154af3bc60 2025-08-06 09:15:43,454 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:15:43,454 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:43,470 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/f546491d-738c-4c7e-9708-91fc796b1a1e 2025-08-06 09:15:43,490 - INFO - Verified VN network id 15 for VN 9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:43,490 - INFO - Verifications in API Server for VN ctest-vn-15100856 passed 2025-08-06 09:15:43,490 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:43,504 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/f546491d-738c-4c7e-9708-91fc796b1a1e 2025-08-06 09:15:43,516 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/f546491d-738c-4c7e-9708-91fc796b1a1e 2025-08-06 09:15:43,525 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/5227ec9a-0c50-4c78-b3a7-be154af3bc60 2025-08-06 09:15:43,541 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-94572681', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11487746772752810021', 'uuid-lslong': '12539145540008252174'}, 'enable': 'true', 'created': '2025-08-06T09:15:42', 'last-modified': '2025-08-06T09:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.826993'} 2025-08-06 09:15:43,549 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:15:43,556 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-94572681', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11487746772752810021', 'uuid-lslong': '12539145540008252174'}, 'enable': 'true', 'created': '2025-08-06T09:15:42', 'last-modified': '2025-08-06T09:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.846717'} 2025-08-06 09:15:43,564 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:15:43,571 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-94572681', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11487746772752810021', 'uuid-lslong': '12539145540008252174'}, 'enable': 'true', 'created': '2025-08-06T09:15:42', 'last-modified': '2025-08-06T09:15:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.869419'} 2025-08-06 09:15:43,579 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:15:43,580 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-15100856 passed 2025-08-06 09:15:43,580 - DEBUG - ====Verifying policy data for ctest-vn-15100856 in API_Server ====== 2025-08-06 09:15:43,580 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:15:43,590 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 09:15:43,605 - DEBUG - Requesting: http://10.0.0.48:8082/project/04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:15:43,733 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/9f6cacd3-3b92-4025-ae03-fe6ef31d930e 2025-08-06 09:15:43,750 - DEBUG - =>VN ctest-vn-15100856 has no policy to be verified 2025-08-06 09:15:43,750 - DEBUG - Verifying the vn in opserver 2025-08-06 09:15:43,750 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 virtual network link through opserver 10.0.0.48 2025-08-06 09:15:43,751 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 09:15:44,062 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 09:15:44,138 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856?flat'} 2025-08-06 09:15:44,138 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 virtual network link through opserver 10.0.0.254 2025-08-06 09:15:44,138 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 09:15:44,451 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 09:15:44,517 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856?flat'} 2025-08-06 09:15:44,517 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 virtual network link through opserver 10.0.0.38 2025-08-06 09:15:44,517 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 09:15:44,813 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 09:15:44,879 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856?flat'} 2025-08-06 09:15:44,880 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is found in opserver 2025-08-06 09:15:44,907 - DEBUG - Do not have enough data to verify VN in agent 2025-08-06 09:15:44,922 - DEBUG - VRF ids for VN ctest-vn-15100856: {} 2025-08-06 09:15:44,922 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:15:44,922 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:15:46,309 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-1) 2025-08-06 09:15:46,310 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:15:48,343 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-2) 2025-08-06 09:15:48,343 - INFO - Waiting for VM ctest-TestMtuProbe-94572681-28062616 to be up.. 2025-08-06 09:15:48,496 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 09:15:53,635 - DEBUG - VM is in ACTIVE state now 2025-08-06 09:15:53,635 - INFO - VM name : ctest-TestMtuProbe-94572681-28062616 2025-08-06 09:15:53,737 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 ID is 3e84d327-a613-4834-8e83-330ffdae8483 2025-08-06 09:15:53,774 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 launched on Node an-jenkins-deploy-platform-ansible-os-3761-1 2025-08-06 09:15:53,896 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/3e84d327-a613-4834-8e83-330ffdae8483 2025-08-06 09:15:54,208 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/3e84d327-a613-4834-8e83-330ffdae8483 2025-08-06 09:15:54,248 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/dbcd5a44-304a-4fd2-afff-be98e7f53ddf 2025-08-06 09:15:57,504 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 09:15:57,505 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:15:57,530 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:01,633 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2025-08-06 09:16:01,633 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:01,658 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:05,722 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-06 09:16:05,722 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:05,741 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:09,821 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-06 09:16:09,821 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:09,844 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:13,914 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-06 09:16:13,914 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:13,932 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:18,014 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-06 09:16:18,014 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:18,030 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:22,106 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-06 09:16:22,106 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:22,124 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:26,207 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-06 09:16:26,207 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 failed! 2025-08-06 09:16:26,224 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-15100856 is 168.235.22.65 and allocation pool is NOT set 2025-08-06 09:16:28,288 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.84 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.21 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.210/3.024/4.839/1.814 ms') 2025-08-06 09:16:28,288 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-28062616 passed 2025-08-06 09:16:28,409 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:28,410 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-28062616, IP 168.235.22.67, Port 22 2025-08-06 09:16:28,480 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:16:28,585 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:16:33,586 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:33,586 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-28062616, IP 168.235.22.67, Port 22 2025-08-06 09:16:33,644 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:16:33,774 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:16:38,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:38,774 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-28062616, IP 168.235.22.67, Port 22 2025-08-06 09:16:38,843 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:16:38,944 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:16:43,944 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:43,944 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-28062616, IP 168.235.22.67, Port 22 2025-08-06 09:16:44,011 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:16:44,117 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:16:49,118 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:49,118 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-28062616, IP 168.235.22.67, Port 22 2025-08-06 09:16:49,276 - DEBUG - VM ctest-TestMtuProbe-94572681-28062616 is ready for SSH connections 2025-08-06 09:16:49,277 - INFO - Waiting for VM ctest-TestMtuProbe-94572681-98783483 to be up.. 2025-08-06 09:16:49,395 - DEBUG - VM is in ACTIVE state now 2025-08-06 09:16:49,395 - INFO - VM name : ctest-TestMtuProbe-94572681-98783483 2025-08-06 09:16:49,514 - DEBUG - VM ctest-TestMtuProbe-94572681-98783483 ID is e3c40512-5aea-4087-95d7-485461627ebb 2025-08-06 09:16:49,515 - DEBUG - VM ctest-TestMtuProbe-94572681-98783483 launched on Node an-jenkins-deploy-platform-ansible-os-3761-2 2025-08-06 09:16:49,638 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/e3c40512-5aea-4087-95d7-485461627ebb 2025-08-06 09:16:49,652 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/748c0b8c-7e88-45a5-bf35-abd3e918b4f4 2025-08-06 09:16:50,883 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.85 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.04 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.851/3.944/4.037/0.093 ms') 2025-08-06 09:16:50,883 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-98783483 passed 2025-08-06 09:16:51,004 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:51,004 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-98783483, IP 168.235.22.68, Port 22 2025-08-06 09:16:51,073 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:16:51,198 - DEBUG - VM ctest-TestMtuProbe-94572681-98783483 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:16:56,199 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:16:56,199 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-98783483, IP 168.235.22.68, Port 22 2025-08-06 09:16:56,365 - DEBUG - VM ctest-TestMtuProbe-94572681-98783483 is ready for SSH connections 2025-08-06 09:16:56,365 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:16:56,365 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:17:37,699 - DEBUG - None 2025-08-06 09:17:37,699 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:17:37,699 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:18:20,162 - DEBUG - None 2025-08-06 09:18:20,163 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:18:20,163 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:18:20,163 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:18:20,163 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 168.235.22.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:20,163 - DEBUG - ping -s 56 -c 3 -W 1 168.235.22.68 2025-08-06 09:18:22,618 - DEBUG - PING 168.235.22.68 (168.235.22.68) 56(84) bytes of data. 64 bytes from 168.235.22.68: icmp_req=1 ttl=64 time=12.0 ms 64 bytes from 168.235.22.68: icmp_req=2 ttl=64 time=1.24 ms 64 bytes from 168.235.22.68: icmp_req=3 ttl=64 time=1.34 ms --- 168.235.22.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.249/4.872/12.019/5.053 ms 2025-08-06 09:18:22,618 - INFO - Ping to IP 168.235.22.68 from VM ctest-TestMtuProbe-94572681-28062616 passed 2025-08-06 09:18:22,618 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:18:22,618 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:22,618 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 09:18:23,239 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 09:18:23,240 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:23,240 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 09:18:23,704 - DEBUG - None 2025-08-06 09:18:23,705 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 168.235.22.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:23,705 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 168.235.22.68 5201 < testfile 2025-08-06 09:18:26,210 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000802354 s, 125 kB/s 2025-08-06 09:18:26,210 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:26,210 - DEBUG - ls -l testfile 2025-08-06 09:18:26,621 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 09:18 testfile 2025-08-06 09:18:26,621 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-94572681-98783483 2025-08-06 09:18:26,621 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:26,621 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:18:27,011 - DEBUG - None 2025-08-06 09:18:27,011 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:27,011 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:18:27,438 - DEBUG - None 2025-08-06 09:18:27,438 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:18:27,438 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:18:27,438 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:18:27,438 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 168.235.22.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:27,438 - DEBUG - ping -s 56 -c 3 -W 1 168.235.22.68 2025-08-06 09:18:29,860 - DEBUG - PING 168.235.22.68 (168.235.22.68) 56(84) bytes of data. 64 bytes from 168.235.22.68: icmp_req=1 ttl=64 time=3.09 ms 64 bytes from 168.235.22.68: icmp_req=2 ttl=64 time=1.37 ms 64 bytes from 168.235.22.68: icmp_req=3 ttl=64 time=1.38 ms --- 168.235.22.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.378/1.951/3.093/0.807 ms 2025-08-06 09:18:29,860 - INFO - Ping to IP 168.235.22.68 from VM ctest-TestMtuProbe-94572681-28062616 passed 2025-08-06 09:18:29,860 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:18:29,860 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:29,860 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 09:18:30,455 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 09:18 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 09:18:30,455 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:30,455 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 09:18:31,090 - DEBUG - None 2025-08-06 09:18:31,090 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 168.235.22.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:31,090 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 168.235.22.68 5201 < testfile 2025-08-06 09:18:33,605 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000917072 s, 109 kB/s 2025-08-06 09:18:33,605 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:33,605 - DEBUG - ls -l testfile 2025-08-06 09:18:33,939 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 09:18 testfile 2025-08-06 09:18:33,940 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-94572681-98783483 2025-08-06 09:18:33,940 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:33,940 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:18:34,342 - DEBUG - None 2025-08-06 09:18:34,343 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:34,343 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:18:34,779 - DEBUG - None 2025-08-06 09:18:34,779 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:18:34,780 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:18:34,780 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:18:34,780 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 168.235.22.68, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:34,780 - DEBUG - ping -s 56 -c 3 -W 1 168.235.22.68 2025-08-06 09:18:37,211 - DEBUG - PING 168.235.22.68 (168.235.22.68) 56(84) bytes of data. 64 bytes from 168.235.22.68: icmp_req=1 ttl=64 time=3.06 ms 64 bytes from 168.235.22.68: icmp_req=2 ttl=64 time=1.39 ms 64 bytes from 168.235.22.68: icmp_req=3 ttl=64 time=1.33 ms --- 168.235.22.68 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.335/1.932/3.065/0.802 ms 2025-08-06 09:18:37,211 - INFO - Ping to IP 168.235.22.68 from VM ctest-TestMtuProbe-94572681-28062616 passed 2025-08-06 09:18:37,211 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:18:37,212 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:37,212 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 09:18:37,820 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 09:18 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 09:18:37,820 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:37,821 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 09:18:38,352 - DEBUG - None 2025-08-06 09:18:38,352 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 168.235.22.68 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:18:38,352 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 168.235.22.68 5201 < testfile 2025-08-06 09:18:40,905 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00119055 s, 84.0 kB/s 2025-08-06 09:18:40,905 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-06 09:18:40,905 - DEBUG - ls -l testfile 2025-08-06 09:18:41,259 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 09:18 testfile 2025-08-06 09:18:41,259 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-94572681-98783483 2025-08-06 09:18:41,259 - INFO - Deleting VM ctest-TestMtuProbe-94572681-98783483 2025-08-06 09:18:41,365 - INFO - Deleting VM ctest-TestMtuProbe-94572681-28062616 2025-08-06 09:18:41,461 - INFO - Deleting VN ctest-vn-15100856 2025-08-06 09:18:41,516 - DEBUG - VN 9f6cacd3-3b92-4025-ae03-fe6ef31d930e still in use: Unable to complete operation on network 9f6cacd3-3b92-4025-ae03-fe6ef31d930e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4490d409-8740-425e-ba61-e9fbeec4310c'] 2025-08-06 09:18:41,516 - WARNING - Deleting VN ctest-vn-15100856 failed..Will retry 2025-08-06 09:18:43,737 - DEBUG - Response for deleting network () 2025-08-06 09:18:43,737 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/f546491d-738c-4c7e-9708-91fc796b1a1e 2025-08-06 09:18:43,744 - DEBUG - Response Code: 404 2025-08-06 09:18:43,745 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:18:43,752 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 09:18:43,823 - DEBUG - Requesting: http://10.0.0.48:8082/project/04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:18:43,926 - INFO - Validated that VN ctest-vn-15100856 is not found in API Server 2025-08-06 09:18:43,942 - DEBUG - VN ctest-vn-15100856 is not present in Agent 10.0.0.49 2025-08-06 09:18:43,958 - DEBUG - VN ctest-vn-15100856 is not present in Agent 10.0.0.57 2025-08-06 09:18:43,958 - INFO - Validated that VN ctest-vn-15100856 is not in any agent 2025-08-06 09:18:44,004 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-15100856 info 2025-08-06 09:18:45,296 - DEBUG - No XMPP flaps were noticed during the test
2025-08-06 09:18:45,296 - INFO - END TEST : test_mtu_probe_inter_node : PASSED[0:03:05]
2025-08-06 09:18:45,296 - INFO - -------------------------------------------------------------------------------- 2025-08-06 09:18:45,299 - INFO - ================================================================================ 2025-08-06 09:18:45,299 - INFO - STARTING TEST : test_mtu_probe_intra_node 2025-08-06 09:18:45,299 - INFO - TEST DESCRIPTION : Description: check traffic configuring different tcp_mtu_probe vlaues on vm MTU probing values: 0, 1, 2 0 - Disabled (default) 1 - Disabled by default, Enabled only when ICMP black hole detected 2 - Always enabled, using the initial MSS value of tcp_base_mss system internally enables bit values for point 1&2 For test purpose, Idea is to check traffic works fine on configuring values Vm's across compute node steps: 1. create 1 VN and launch 2 VMs in same compute node 2. client and server VMs in same compute node 3. configure tcp_mtu_probe to 0, 1, 2 4. send icmp traffic assert if ping fails 5. send tcp traffic assert if tcp traffic fails Pass criteria: 1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values 2025-08-06 09:18:46,606 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-08-06 09:18:46,606 - INFO - Initial checks done. Running the testcase now 2025-08-06 09:18:46,606 - INFO - 2025-08-06 09:18:46,986 - DEBUG - Response for create_network : {'network': {'id': '69c954a9-ba7a-4b56-b2f4-43c7497d9d07', 'name': 'ctest-vn-97181863', 'tenant_id': '04af5bc3770040998f5fa378c248de4c', 'project_id': '04af5bc3770040998f5fa378c248de4c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-94572681', 'ctest-vn-97181863'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 09:18:47,283 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b7f40737-e9b4-4599-a8f7-ee2171ed03a3', 'name': '', 'tenant_id': '04af5bc3770040998f5fa378c248de4c', 'network_id': '69c954a9-ba7a-4b56-b2f4-43c7497d9d07', 'ip_version': 4, 'cidr': '79.212.188.192/26', 'allocation_pools': [{'start': '79.212.188.194', 'end': '79.212.188.254'}], 'gateway_ip': '79.212.188.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '79.212.188.194', 'tags': [], 'project_id': '04af5bc3770040998f5fa378c248de4c'}} 2025-08-06 09:18:47,310 - INFO - Created VN ctest-vn-97181863 2025-08-06 09:18:47,324 - DEBUG - VN ctest-vn-97181863 UUID is 69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,426 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:18:47,435 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 09:18:47,452 - DEBUG - Requesting: http://10.0.0.48:8082/project/04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:18:47,571 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,589 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,605 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/cfc8155b-6262-48bd-bc06-b003eab96ebf 2025-08-06 09:18:47,621 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/cfc8155b-6262-48bd-bc06-b003eab96ebf 2025-08-06 09:18:47,631 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/1a98ea0c-f3df-4b08-be27-0e278c9e4b31 2025-08-06 09:18:47,645 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:18:47,645 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,664 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/cfc8155b-6262-48bd-bc06-b003eab96ebf 2025-08-06 09:18:47,687 - INFO - Verified VN network id 15 for VN 69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,688 - INFO - Verifications in API Server for VN ctest-vn-97181863 passed 2025-08-06 09:18:47,688 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,701 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/cfc8155b-6262-48bd-bc06-b003eab96ebf 2025-08-06 09:18:47,713 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/cfc8155b-6262-48bd-bc06-b003eab96ebf 2025-08-06 09:18:47,726 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/1a98ea0c-f3df-4b08-be27-0e278c9e4b31 2025-08-06 09:18:47,745 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-94572681', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7622716932256058198', 'uuid-lslong': '12895006156279094535'}, 'enable': 'true', 'created': '2025-08-06T09:18:46', 'last-modified': '2025-08-06T09:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.546768'} 2025-08-06 09:18:47,754 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:18:47,767 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-94572681', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7622716932256058198', 'uuid-lslong': '12895006156279094535'}, 'enable': 'true', 'created': '2025-08-06T09:18:46', 'last-modified': '2025-08-06T09:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.568739'} 2025-08-06 09:18:47,776 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:18:47,783 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-94572681', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7622716932256058198', 'uuid-lslong': '12895006156279094535'}, 'enable': 'true', 'created': '2025-08-06T09:18:46', 'last-modified': '2025-08-06T09:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.564958'} 2025-08-06 09:18:47,790 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-06 09:18:47,791 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-97181863 passed 2025-08-06 09:18:47,791 - DEBUG - ====Verifying policy data for ctest-vn-97181863 in API_Server ====== 2025-08-06 09:18:47,791 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:18:47,801 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 09:18:47,821 - DEBUG - Requesting: http://10.0.0.48:8082/project/04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:18:47,965 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/69c954a9-ba7a-4b56-b2f4-43c7497d9d07 2025-08-06 09:18:47,979 - DEBUG - =>VN ctest-vn-97181863 has no policy to be verified 2025-08-06 09:18:47,980 - DEBUG - Verifying the vn in opserver 2025-08-06 09:18:47,980 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 virtual network link through opserver 10.0.0.48 2025-08-06 09:18:47,980 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-06 09:18:48,004 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863?flat'} 2025-08-06 09:18:48,004 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 virtual network link through opserver 10.0.0.254 2025-08-06 09:18:48,004 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-08-06 09:18:48,022 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863?flat'} 2025-08-06 09:18:48,022 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 virtual network link through opserver 10.0.0.38 2025-08-06 09:18:48,022 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-06 09:18:48,041 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863?flat'} 2025-08-06 09:18:48,041 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is found in opserver 2025-08-06 09:18:48,066 - DEBUG - Do not have enough data to verify VN in agent 2025-08-06 09:18:48,079 - DEBUG - VRF ids for VN ctest-vn-97181863: {} 2025-08-06 09:18:48,079 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:18:48,079 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:18:49,566 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-1) 2025-08-06 09:18:49,566 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3761-1', 'an-jenkins-deploy-platform-ansible-os-3761-2']} 2025-08-06 09:18:51,650 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-1) 2025-08-06 09:18:51,650 - INFO - Waiting for VM ctest-TestMtuProbe-94572681-06387378 to be up.. 2025-08-06 09:18:51,758 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 09:18:56,866 - DEBUG - VM is in ACTIVE state now 2025-08-06 09:18:56,867 - INFO - VM name : ctest-TestMtuProbe-94572681-06387378 2025-08-06 09:18:56,965 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 ID is e3a6931a-c70c-4f19-89c0-cf67fcd04ae8 2025-08-06 09:18:56,965 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 launched on Node an-jenkins-deploy-platform-ansible-os-3761-1 2025-08-06 09:18:57,065 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/e3a6931a-c70c-4f19-89c0-cf67fcd04ae8 2025-08-06 09:18:57,079 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/7af61c67-c2dd-446d-8bd4-bc4969c4a4a8 2025-08-06 09:19:00,317 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-06 09:19:00,317 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:00,339 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:04,412 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-08-06 09:19:04,412 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:04,431 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:08,515 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-06 09:19:08,515 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:08,533 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:12,600 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-08-06 09:19:12,600 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:12,616 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:16,702 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-08-06 09:19:16,702 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:16,720 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:20,796 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-06 09:19:20,796 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:20,815 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:24,897 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 09:19:24,897 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:24,926 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:29,019 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-08-06 09:19:29,019 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:29,041 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:33,118 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-06 09:19:33,118 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 failed! 2025-08-06 09:19:33,136 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-94572681:ctest-vn-97181863 is 79.212.188.193 and allocation pool is NOT set 2025-08-06 09:19:35,201 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.41 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.92 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.918/4.161/6.405/2.243 ms') 2025-08-06 09:19:35,201 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-94572681-06387378 passed 2025-08-06 09:19:35,322 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:19:35,322 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-06387378, IP 79.212.188.195, Port 22 2025-08-06 09:19:35,391 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:19:35,494 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:19:40,495 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:19:40,495 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-06387378, IP 79.212.188.195, Port 22 2025-08-06 09:19:40,562 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:19:40,671 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:19:45,672 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:19:45,672 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-06387378, IP 79.212.188.195, Port 22 2025-08-06 09:19:45,739 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:19:45,839 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:19:50,839 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:19:50,840 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-06387378, IP 79.212.188.195, Port 22 2025-08-06 09:19:50,906 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:19:51,024 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:19:56,024 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:19:56,024 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-06387378, IP 79.212.188.195, Port 22 2025-08-06 09:19:56,190 - DEBUG - VM ctest-TestMtuProbe-94572681-06387378 is ready for SSH connections 2025-08-06 09:19:56,190 - INFO - Waiting for VM ctest-TestMtuProbe-94572681-82640263 to be up.. 2025-08-06 09:19:56,300 - DEBUG - VM is in ACTIVE state now 2025-08-06 09:19:56,300 - INFO - VM name : ctest-TestMtuProbe-94572681-82640263 2025-08-06 09:19:56,407 - DEBUG - VM ctest-TestMtuProbe-94572681-82640263 ID is ffc02cb9-690a-447d-b1d3-54660ef80728 2025-08-06 09:19:56,407 - DEBUG - VM ctest-TestMtuProbe-94572681-82640263 launched on Node an-jenkins-deploy-platform-ansible-os-3761-1 2025-08-06 09:19:56,510 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/ffc02cb9-690a-447d-b1d3-54660ef80728 2025-08-06 09:19:56,531 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/ddbcaa8d-fd46-4d37-ad9c-88553138fd53 2025-08-06 09:19:57,759 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.05 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.384 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.384/1.714/3.045/1.330 ms') 2025-08-06 09:19:57,759 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-94572681-82640263 passed 2025-08-06 09:19:57,882 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:19:57,882 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-82640263, IP 79.212.188.196, Port 22 2025-08-06 09:19:57,941 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 09:19:58,039 - DEBUG - VM ctest-TestMtuProbe-94572681-82640263 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 09:20:03,040 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:20:03,040 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-94572681-82640263, IP 79.212.188.196, Port 22 2025-08-06 09:20:03,208 - DEBUG - VM ctest-TestMtuProbe-94572681-82640263 is ready for SSH connections 2025-08-06 09:20:03,208 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:20:03,208 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:20:45,936 - DEBUG - None 2025-08-06 09:20:45,936 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:20:45,936 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:21:19,620 - DEBUG - None 2025-08-06 09:21:19,620 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:21:19,620 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:21:19,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:21:19,621 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 79.212.188.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:19,621 - DEBUG - ping -s 56 -c 3 -W 1 79.212.188.196 2025-08-06 09:21:22,072 - DEBUG - PING 79.212.188.196 (79.212.188.196) 56(84) bytes of data. 64 bytes from 79.212.188.196: icmp_req=1 ttl=64 time=10.5 ms 64 bytes from 79.212.188.196: icmp_req=2 ttl=64 time=0.890 ms 64 bytes from 79.212.188.196: icmp_req=3 ttl=64 time=0.774 ms --- 79.212.188.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.774/4.082/10.584/4.597 ms 2025-08-06 09:21:22,072 - INFO - Ping to IP 79.212.188.196 from VM ctest-TestMtuProbe-94572681-06387378 passed 2025-08-06 09:21:22,072 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:21:22,072 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:22,072 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 09:21:22,601 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 09:21:22,601 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:22,601 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 09:21:23,029 - DEBUG - None 2025-08-06 09:21:23,030 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 79.212.188.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:23,030 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 79.212.188.196 5201 < testfile 2025-08-06 09:21:25,536 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000718468 s, 139 kB/s 2025-08-06 09:21:25,536 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:25,536 - DEBUG - ls -l testfile 2025-08-06 09:21:25,849 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 09:21 testfile 2025-08-06 09:21:25,849 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-94572681-82640263 2025-08-06 09:21:25,850 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:25,850 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:21:26,243 - DEBUG - None 2025-08-06 09:21:26,244 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:26,244 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:21:26,633 - DEBUG - None 2025-08-06 09:21:26,633 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:21:26,633 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:21:26,633 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:21:26,633 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 79.212.188.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:26,633 - DEBUG - ping -s 56 -c 3 -W 1 79.212.188.196 2025-08-06 09:21:29,069 - DEBUG - PING 79.212.188.196 (79.212.188.196) 56(84) bytes of data. 64 bytes from 79.212.188.196: icmp_req=1 ttl=64 time=2.35 ms 64 bytes from 79.212.188.196: icmp_req=2 ttl=64 time=0.760 ms 64 bytes from 79.212.188.196: icmp_req=3 ttl=64 time=0.701 ms --- 79.212.188.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.701/1.271/2.353/0.765 ms 2025-08-06 09:21:29,069 - INFO - Ping to IP 79.212.188.196 from VM ctest-TestMtuProbe-94572681-06387378 passed 2025-08-06 09:21:29,069 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:21:29,069 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:29,069 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 09:21:29,599 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 09:21 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 09:21:29,599 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:29,600 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 09:21:30,020 - DEBUG - None 2025-08-06 09:21:30,021 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 79.212.188.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:30,021 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 79.212.188.196 5201 < testfile 2025-08-06 09:21:32,537 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000977612 s, 102 kB/s 2025-08-06 09:21:32,538 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:32,538 - DEBUG - ls -l testfile 2025-08-06 09:21:32,846 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 09:21 testfile 2025-08-06 09:21:32,846 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-94572681-82640263 2025-08-06 09:21:32,847 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:32,847 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:21:33,238 - DEBUG - None 2025-08-06 09:21:33,238 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:33,238 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing 2025-08-06 09:21:33,655 - DEBUG - None 2025-08-06 09:21:33,656 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:21:33,656 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None} 2025-08-06 09:21:33,656 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:21:33,656 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 79.212.188.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:33,656 - DEBUG - ping -s 56 -c 3 -W 1 79.212.188.196 2025-08-06 09:21:36,085 - DEBUG - PING 79.212.188.196 (79.212.188.196) 56(84) bytes of data. 64 bytes from 79.212.188.196: icmp_req=1 ttl=64 time=1.99 ms 64 bytes from 79.212.188.196: icmp_req=2 ttl=64 time=0.787 ms 64 bytes from 79.212.188.196: icmp_req=3 ttl=64 time=0.751 ms --- 79.212.188.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.751/1.178/1.997/0.579 ms 2025-08-06 09:21:36,085 - INFO - Ping to IP 79.212.188.196 from VM ctest-TestMtuProbe-94572681-06387378 passed 2025-08-06 09:21:36,086 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 09:21:36,086 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:36,086 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile & 2025-08-06 09:21:36,616 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 6 09:21 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-08-06 09:21:36,616 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:36,616 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile & 2025-08-06 09:21:37,021 - DEBUG - None 2025-08-06 09:21:37,021 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 79.212.188.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:37,021 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 79.212.188.196 5201 < testfile 2025-08-06 09:21:39,519 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.000969076 s, 103 kB/s 2025-08-06 09:21:39,519 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 09:21:39,519 - DEBUG - ls -l testfile 2025-08-06 09:21:39,900 - DEBUG - -rw-r--r-- 1 root root 100 Aug 6 09:21 testfile 2025-08-06 09:21:39,901 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-94572681-82640263 2025-08-06 09:21:39,901 - INFO - Deleting VM ctest-TestMtuProbe-94572681-82640263 2025-08-06 09:21:40,035 - INFO - Deleting VM ctest-TestMtuProbe-94572681-06387378 2025-08-06 09:21:40,130 - INFO - Deleting VN ctest-vn-97181863 2025-08-06 09:21:40,244 - DEBUG - VN 69c954a9-ba7a-4b56-b2f4-43c7497d9d07 still in use: Unable to complete operation on network 69c954a9-ba7a-4b56-b2f4-43c7497d9d07. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c9dfe584-f8e7-4a18-b7b4-3b0c4154f6db'] 2025-08-06 09:21:40,245 - WARNING - Deleting VN ctest-vn-97181863 failed..Will retry 2025-08-06 09:21:42,437 - DEBUG - Response for deleting network () 2025-08-06 09:21:42,437 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/cfc8155b-6262-48bd-bc06-b003eab96ebf 2025-08-06 09:21:42,486 - DEBUG - Response Code: 404 2025-08-06 09:21:42,486 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-06 09:21:42,495 - DEBUG - Requesting: http://10.0.0.48:8082/domain/e3e88518-0617-4e53-bc15-162decab76e0 2025-08-06 09:21:42,512 - DEBUG - Requesting: http://10.0.0.48:8082/project/04af5bc3-7700-4099-8f5f-a378c248de4c 2025-08-06 09:21:42,614 - INFO - Validated that VN ctest-vn-97181863 is not found in API Server 2025-08-06 09:21:42,632 - DEBUG - VN ctest-vn-97181863 is not present in Agent 10.0.0.49 2025-08-06 09:21:42,648 - DEBUG - VN ctest-vn-97181863 is not present in Agent 10.0.0.57 2025-08-06 09:21:42,648 - INFO - Validated that VN ctest-vn-97181863 is not in any agent 2025-08-06 09:21:42,696 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-97181863 info 2025-08-06 09:21:43,989 - DEBUG - No XMPP flaps were noticed during the test
2025-08-06 09:21:43,989 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:58]
2025-08-06 09:21:43,989 - INFO - -------------------------------------------------------------------------------- 2025-08-06 09:21:44,754 - INFO - Deleted project: ctest-TestMtuProbe-94572681, ID : 04af5bc3-7700-4099-8f5f-a378c248de4c