2025-07-24 04:56:01,505 - INFO - Domain Default found not creating
2025-07-24 04:56:01,786 - INFO - Project ctest-TestMtuProbe-48136577 not found, creating it
2025-07-24 04:56:02,736 - INFO - Created Project:ctest-TestMtuProbe-48136577, ID : 5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 04:56:04,676 - INFO - ================================================================================
2025-07-24 04:56:04,676 - INFO - STARTING TEST : test_mtu_probe_inter_node
2025-07-24 04:56:04,676 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs across compute node
2. client and server VMs across compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2025-07-24 04:56:06,016 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with
2025-07-24 04:56:06,017 - INFO - Initial checks done. Running the testcase now
2025-07-24 04:56:06,017 - INFO -
2025-07-24 04:56:06,051 - DEBUG - Services list from nova: [, , , ]
2025-07-24 04:56:06,051 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:56:06,804 - DEBUG - Response for create_network : {'network': {'id': '24bdd9fc-94e1-401a-b61a-6421fbffda03', 'name': 'ctest-vn-85066687', 'tenant_id': '5d2468325b4c4046bc41a59d3314b29c', 'project_id': '5d2468325b4c4046bc41a59d3314b29c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-48136577', 'ctest-vn-85066687'], 'port_security_enabled': True, 'description': ''}}
2025-07-24 04:56:07,166 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b90760ac-3d59-4b4d-af5a-9bd8a4884360', 'name': '', 'tenant_id': '5d2468325b4c4046bc41a59d3314b29c', 'network_id': '24bdd9fc-94e1-401a-b61a-6421fbffda03', 'ip_version': 4, 'cidr': '17.39.2.192/26', 'allocation_pools': [{'start': '17.39.2.194', 'end': '17.39.2.254'}], 'gateway_ip': '17.39.2.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '17.39.2.194', 'tags': [], 'project_id': '5d2468325b4c4046bc41a59d3314b29c'}}
2025-07-24 04:56:07,194 - INFO - Created VN ctest-vn-85066687
2025-07-24 04:56:07,213 - DEBUG - VN ctest-vn-85066687 UUID is 24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:07,313 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 04:56:07,638 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 04:56:07,679 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2
2025-07-24 04:56:07,701 - DEBUG - Requesting: http://10.0.0.19:8082/project/5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 04:56:07,815 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:07,837 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:07,850 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ca8b2bb1-2196-459d-aa78-4c1af49128ee
2025-07-24 04:56:07,860 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ca8b2bb1-2196-459d-aa78-4c1af49128ee
2025-07-24 04:56:07,875 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b09c5962-0123-459c-b591-60ad0db7c400
2025-07-24 04:56:07,885 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:56:07,885 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:07,899 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ca8b2bb1-2196-459d-aa78-4c1af49128ee
2025-07-24 04:56:07,921 - INFO - Verified VN network id 11 for VN 24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:07,921 - INFO - Verifications in API Server for VN ctest-vn-85066687 passed
2025-07-24 04:56:07,921 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:07,935 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ca8b2bb1-2196-459d-aa78-4c1af49128ee
2025-07-24 04:56:07,946 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ca8b2bb1-2196-459d-aa78-4c1af49128ee
2025-07-24 04:56:07,957 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b09c5962-0123-459c-b591-60ad0db7c400
2025-07-24 04:56:07,975 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-48136577', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2647511834816495642', 'uuid-lslong': '13121910561421908483'}, 'enable': 'true', 'created': '2025-07-24T04:56:06', 'last-modified': '2025-07-24T04:56:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.900176'}
2025-07-24 04:56:07,984 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:56:07,991 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-48136577', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2647511834816495642', 'uuid-lslong': '13121910561421908483'}, 'enable': 'true', 'created': '2025-07-24T04:56:06', 'last-modified': '2025-07-24T04:56:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.923222'}
2025-07-24 04:56:07,999 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:56:08,007 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-48136577', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2647511834816495642', 'uuid-lslong': '13121910561421908483'}, 'enable': 'true', 'created': '2025-07-24T04:56:06', 'last-modified': '2025-07-24T04:56:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.945678'}
2025-07-24 04:56:08,015 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:56:08,015 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-85066687 passed
2025-07-24 04:56:08,016 - DEBUG - ====Verifying policy data for ctest-vn-85066687 in API_Server ======
2025-07-24 04:56:08,016 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 04:56:08,024 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2
2025-07-24 04:56:08,042 - DEBUG - Requesting: http://10.0.0.19:8082/project/5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 04:56:08,153 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/24bdd9fc-94e1-401a-b61a-6421fbffda03
2025-07-24 04:56:08,167 - DEBUG - =>VN ctest-vn-85066687 has no policy to be verified
2025-07-24 04:56:08,167 - DEBUG - Verifying the vn in opserver
2025-07-24 04:56:08,167 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 virtual network link through opserver 10.0.0.19
2025-07-24 04:56:08,167 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2025-07-24 04:56:08,482 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2025-07-24 04:56:08,559 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687?flat'}
2025-07-24 04:56:08,559 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 virtual network link through opserver 10.0.0.38
2025-07-24 04:56:08,559 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-07-24 04:56:08,865 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-07-24 04:56:08,936 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687?flat'}
2025-07-24 04:56:08,936 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 virtual network link through opserver 10.0.0.41
2025-07-24 04:56:08,936 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks
2025-07-24 04:56:09,268 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks
2025-07-24 04:56:09,354 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687?flat'}
2025-07-24 04:56:09,354 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is found in opserver
2025-07-24 04:56:09,386 - DEBUG - Do not have enough data to verify VN in agent
2025-07-24 04:56:09,408 - DEBUG - VRF ids for VN ctest-vn-85066687: {}
2025-07-24 04:56:09,409 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:56:09,409 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:56:10,669 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1)
2025-07-24 04:56:10,669 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:56:12,405 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-2)
2025-07-24 04:56:12,405 - INFO - Waiting for VM ctest-TestMtuProbe-48136577-47499640 to be up..
2025-07-24 04:56:12,513 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-07-24 04:56:17,654 - DEBUG - VM is in ACTIVE state now
2025-07-24 04:56:17,654 - INFO - VM name : ctest-TestMtuProbe-48136577-47499640
2025-07-24 04:56:17,761 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 ID is 7f0cd935-c674-4950-8316-2dcae99b4209
2025-07-24 04:56:17,800 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 launched on Node an-jenkins-deploy-platform-ansible-os-3712-1
2025-07-24 04:56:17,917 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f0cd935-c674-4950-8316-2dcae99b4209
2025-07-24 04:56:18,243 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f0cd935-c674-4950-8316-2dcae99b4209
2025-07-24 04:56:18,285 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/5beca788-0c6d-486c-975a-b0cdd0699659
2025-07-24 04:56:21,541 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms')
2025-07-24 04:56:21,541 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:21,561 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:25,640 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms')
2025-07-24 04:56:25,640 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:25,661 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:29,736 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-07-24 04:56:29,736 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:29,757 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:33,831 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-07-24 04:56:33,831 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:33,851 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:37,960 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms')
2025-07-24 04:56:37,961 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:37,981 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:42,088 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms')
2025-07-24 04:56:42,088 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:42,108 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:46,186 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-07-24 04:56:46,186 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:46,205 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:50,279 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms')
2025-07-24 04:56:50,279 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:50,299 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:54,383 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms')
2025-07-24 04:56:54,383 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:54,423 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:56:58,506 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-07-24 04:56:58,506 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:56:58,524 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:57:02,602 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-07-24 04:57:02,603 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 failed!
2025-07-24 04:57:02,623 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-85066687 is 17.39.2.193 and allocation pool is NOT set
2025-07-24 04:57:04,696 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=16.0 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.84 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.840/9.933/16.026/6.093 ms')
2025-07-24 04:57:04,696 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-47499640 passed
2025-07-24 04:57:04,824 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:04,824 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-47499640, IP 17.39.2.195, Port 22
2025-07-24 04:57:04,894 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 04:57:04,999 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 04:57:10,000 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:10,000 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-47499640, IP 17.39.2.195, Port 22
2025-07-24 04:57:10,069 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 04:57:10,176 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 04:57:15,177 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:15,177 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-47499640, IP 17.39.2.195, Port 22
2025-07-24 04:57:15,245 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 04:57:15,360 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 04:57:20,361 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:20,361 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-47499640, IP 17.39.2.195, Port 22
2025-07-24 04:57:20,429 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 04:57:20,536 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 04:57:25,537 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:25,537 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-47499640, IP 17.39.2.195, Port 22
2025-07-24 04:57:25,607 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 04:57:25,718 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 04:57:30,718 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:30,719 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-47499640, IP 17.39.2.195, Port 22
2025-07-24 04:57:30,898 - DEBUG - VM ctest-TestMtuProbe-48136577-47499640 is ready for SSH connections
2025-07-24 04:57:30,898 - INFO - Waiting for VM ctest-TestMtuProbe-48136577-76161629 to be up..
2025-07-24 04:57:30,999 - DEBUG - VM is in ACTIVE state now
2025-07-24 04:57:30,999 - INFO - VM name : ctest-TestMtuProbe-48136577-76161629
2025-07-24 04:57:31,097 - DEBUG - VM ctest-TestMtuProbe-48136577-76161629 ID is 35ef7f8a-0020-4c55-8a2d-6267b3c774c0
2025-07-24 04:57:31,097 - DEBUG - VM ctest-TestMtuProbe-48136577-76161629 launched on Node an-jenkins-deploy-platform-ansible-os-3712-2
2025-07-24 04:57:31,196 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/35ef7f8a-0020-4c55-8a2d-6267b3c774c0
2025-07-24 04:57:31,211 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/53753407-cbd8-4a72-b8f5-5be26f242cb3
2025-07-24 04:57:32,450 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.29 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.68 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 5.681/5.985/6.290/0.304 ms')
2025-07-24 04:57:32,450 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-76161629 passed
2025-07-24 04:57:32,575 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:57:32,575 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-76161629, IP 17.39.2.196, Port 22
2025-07-24 04:57:32,749 - DEBUG - VM ctest-TestMtuProbe-48136577-76161629 is ready for SSH connections
2025-07-24 04:57:32,750 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:57:32,750 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 04:57:58,930 - DEBUG - None
2025-07-24 04:57:58,930 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:57:58,930 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 04:58:45,129 - DEBUG - None
2025-07-24 04:58:45,129 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 04:58:45,129 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 04:58:45,129 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:58:45,129 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 17.39.2.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:58:45,129 - DEBUG - ping -s 56 -c 3 -W 1 17.39.2.196
2025-07-24 04:58:47,735 - DEBUG - PING 17.39.2.196 (17.39.2.196) 56(84) bytes of data.
64 bytes from 17.39.2.196: icmp_req=1 ttl=64 time=14.1 ms
64 bytes from 17.39.2.196: icmp_req=2 ttl=64 time=1.41 ms
64 bytes from 17.39.2.196: icmp_req=3 ttl=64 time=1.16 ms
--- 17.39.2.196 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.165/5.559/14.103/6.042 ms
2025-07-24 04:58:47,735 - INFO - Ping to IP 17.39.2.196 from VM ctest-TestMtuProbe-48136577-47499640 passed
2025-07-24 04:58:47,735 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:58:47,735 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:47,736 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-07-24 04:58:48,464 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-07-24 04:58:48,464 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:48,464 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-07-24 04:58:48,985 - DEBUG - None
2025-07-24 04:58:48,986 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 17.39.2.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:58:48,986 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 17.39.2.196 5201 < testfile
2025-07-24 04:58:51,775 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00173255 s, 57.7 kB/s
2025-07-24 04:58:51,776 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:51,776 - DEBUG - ls -l testfile
2025-07-24 04:58:52,162 - DEBUG - -rw-r--r-- 1 root root 100 Jul 24 04:58 testfile
2025-07-24 04:58:52,162 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-48136577-76161629
2025-07-24 04:58:52,162 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:58:52,163 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 04:58:52,666 - DEBUG - None
2025-07-24 04:58:52,666 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:52,666 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 04:58:53,138 - DEBUG - None
2025-07-24 04:58:53,139 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 04:58:53,139 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 04:58:53,140 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:58:53,140 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 17.39.2.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:58:53,140 - DEBUG - ping -s 56 -c 3 -W 1 17.39.2.196
2025-07-24 04:58:55,716 - DEBUG - PING 17.39.2.196 (17.39.2.196) 56(84) bytes of data.
64 bytes from 17.39.2.196: icmp_req=1 ttl=64 time=5.64 ms
64 bytes from 17.39.2.196: icmp_req=2 ttl=64 time=1.33 ms
64 bytes from 17.39.2.196: icmp_req=3 ttl=64 time=1.43 ms
--- 17.39.2.196 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.338/2.805/5.642/2.006 ms
2025-07-24 04:58:55,716 - INFO - Ping to IP 17.39.2.196 from VM ctest-TestMtuProbe-48136577-47499640 passed
2025-07-24 04:58:55,716 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:58:55,716 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:55,716 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-07-24 04:58:56,468 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jul 24 04:58 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-07-24 04:58:56,469 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:56,469 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-07-24 04:58:57,007 - DEBUG - None
2025-07-24 04:58:57,007 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 17.39.2.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:58:57,007 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 17.39.2.196 5201 < testfile
2025-07-24 04:58:59,704 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00117672 s, 85.0 kB/s
2025-07-24 04:58:59,705 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:58:59,705 - DEBUG - ls -l testfile
2025-07-24 04:59:00,163 - DEBUG - -rw-r--r-- 1 root root 100 Jul 24 04:58 testfile
2025-07-24 04:59:00,164 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-48136577-76161629
2025-07-24 04:59:00,164 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:59:00,164 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 04:59:00,763 - DEBUG - None
2025-07-24 04:59:00,763 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:59:00,763 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 04:59:01,282 - DEBUG - None
2025-07-24 04:59:01,282 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 04:59:01,282 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 04:59:01,283 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:59:01,283 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 17.39.2.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:59:01,283 - DEBUG - ping -s 56 -c 3 -W 1 17.39.2.196
2025-07-24 04:59:03,850 - DEBUG - PING 17.39.2.196 (17.39.2.196) 56(84) bytes of data.
64 bytes from 17.39.2.196: icmp_req=1 ttl=64 time=3.50 ms
64 bytes from 17.39.2.196: icmp_req=2 ttl=64 time=1.53 ms
64 bytes from 17.39.2.196: icmp_req=3 ttl=64 time=1.70 ms
--- 17.39.2.196 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.536/2.247/3.502/0.891 ms
2025-07-24 04:59:03,850 - INFO - Ping to IP 17.39.2.196 from VM ctest-TestMtuProbe-48136577-47499640 passed
2025-07-24 04:59:03,850 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 04:59:03,850 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:59:03,851 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-07-24 04:59:04,551 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jul 24 04:59 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-07-24 04:59:04,551 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:59:04,552 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-07-24 04:59:05,075 - DEBUG - None
2025-07-24 04:59:05,075 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 17.39.2.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 04:59:05,075 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 17.39.2.196 5201 < testfile
2025-07-24 04:59:07,761 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00118294 s, 84.5 kB/s
2025-07-24 04:59:07,761 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.23, gateway password: c0ntrail123
2025-07-24 04:59:07,761 - DEBUG - ls -l testfile
2025-07-24 04:59:08,134 - DEBUG - -rw-r--r-- 1 root root 100 Jul 24 04:59 testfile
2025-07-24 04:59:08,134 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-48136577-76161629
2025-07-24 04:59:08,134 - INFO - Deleting VM ctest-TestMtuProbe-48136577-76161629
2025-07-24 04:59:08,217 - INFO - Deleting VM ctest-TestMtuProbe-48136577-47499640
2025-07-24 04:59:08,295 - INFO - Deleting VN ctest-vn-85066687
2025-07-24 04:59:08,352 - DEBUG - VN 24bdd9fc-94e1-401a-b61a-6421fbffda03 still in use: Unable to complete operation on network 24bdd9fc-94e1-401a-b61a-6421fbffda03. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d79bbd68-a4df-4b65-bc01-ad589def43c3']
2025-07-24 04:59:08,352 - WARNING - Deleting VN ctest-vn-85066687 failed..Will retry
2025-07-24 04:59:10,526 - DEBUG - Response for deleting network ()
2025-07-24 04:59:10,526 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ca8b2bb1-2196-459d-aa78-4c1af49128ee
2025-07-24 04:59:10,534 - DEBUG - Response Code: 404
2025-07-24 04:59:10,534 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 04:59:10,547 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2
2025-07-24 04:59:10,584 - DEBUG - Requesting: http://10.0.0.19:8082/project/5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 04:59:10,700 - INFO - Validated that VN ctest-vn-85066687 is not found in API Server
2025-07-24 04:59:10,716 - DEBUG - VN ctest-vn-85066687 is not present in Agent 10.0.0.57
2025-07-24 04:59:10,731 - DEBUG - VN ctest-vn-85066687 is not present in Agent 10.0.0.23
2025-07-24 04:59:10,731 - INFO - Validated that VN ctest-vn-85066687 is not in any agent
2025-07-24 04:59:10,777 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-85066687 info
2025-07-24 04:59:12,131 - DEBUG - No XMPP flaps were noticed during the test
2025-07-24 04:59:12,131 - INFO - END TEST : test_mtu_probe_inter_node : PASSED[0:03:08]
2025-07-24 04:59:12,131 - INFO - --------------------------------------------------------------------------------
2025-07-24 04:59:12,138 - INFO - ================================================================================
2025-07-24 04:59:12,138 - INFO - STARTING TEST : test_mtu_probe_intra_node
2025-07-24 04:59:12,138 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs in same compute node
2. client and server VMs in same compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2025-07-24 04:59:13,461 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with
2025-07-24 04:59:13,461 - INFO - Initial checks done. Running the testcase now
2025-07-24 04:59:13,461 - INFO -
2025-07-24 04:59:13,788 - DEBUG - Response for create_network : {'network': {'id': '56d97aa5-85f9-4a61-bf90-a671aa900c01', 'name': 'ctest-vn-60822278', 'tenant_id': '5d2468325b4c4046bc41a59d3314b29c', 'project_id': '5d2468325b4c4046bc41a59d3314b29c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-48136577', 'ctest-vn-60822278'], 'port_security_enabled': True, 'description': ''}}
2025-07-24 04:59:14,044 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a98e471-cac3-422a-bebf-06afaf3b1143', 'name': '', 'tenant_id': '5d2468325b4c4046bc41a59d3314b29c', 'network_id': '56d97aa5-85f9-4a61-bf90-a671aa900c01', 'ip_version': 4, 'cidr': '139.71.244.128/26', 'allocation_pools': [{'start': '139.71.244.130', 'end': '139.71.244.190'}], 'gateway_ip': '139.71.244.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.71.244.130', 'tags': [], 'project_id': '5d2468325b4c4046bc41a59d3314b29c'}}
2025-07-24 04:59:14,072 - INFO - Created VN ctest-vn-60822278
2025-07-24 04:59:14,091 - DEBUG - VN ctest-vn-60822278 UUID is 56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,181 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 04:59:14,190 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2
2025-07-24 04:59:14,205 - DEBUG - Requesting: http://10.0.0.19:8082/project/5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 04:59:14,316 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,334 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,349 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/dc558371-3c15-431c-8ff8-f8d326e27e32
2025-07-24 04:59:14,358 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/dc558371-3c15-431c-8ff8-f8d326e27e32
2025-07-24 04:59:14,368 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/246cde9f-5da3-488f-be5f-07cb2e9bf417
2025-07-24 04:59:14,376 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:59:14,376 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,389 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/dc558371-3c15-431c-8ff8-f8d326e27e32
2025-07-24 04:59:14,413 - INFO - Verified VN network id 11 for VN 56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,414 - INFO - Verifications in API Server for VN ctest-vn-60822278 passed
2025-07-24 04:59:14,414 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,435 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/dc558371-3c15-431c-8ff8-f8d326e27e32
2025-07-24 04:59:14,446 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/dc558371-3c15-431c-8ff8-f8d326e27e32
2025-07-24 04:59:14,457 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/246cde9f-5da3-488f-be5f-07cb2e9bf417
2025-07-24 04:59:14,476 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-48136577', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6258168008543914593', 'uuid-lslong': '13803715865013652481'}, 'enable': 'true', 'created': '2025-07-24T04:59:13', 'last-modified': '2025-07-24T04:59:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.480868'}
2025-07-24 04:59:14,484 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:59:14,494 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-48136577', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6258168008543914593', 'uuid-lslong': '13803715865013652481'}, 'enable': 'true', 'created': '2025-07-24T04:59:13', 'last-modified': '2025-07-24T04:59:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506438'}
2025-07-24 04:59:14,503 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:59:14,513 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-48136577', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6258168008543914593', 'uuid-lslong': '13803715865013652481'}, 'enable': 'true', 'created': '2025-07-24T04:59:13', 'last-modified': '2025-07-24T04:59:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527839'}
2025-07-24 04:59:14,523 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-24 04:59:14,523 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-60822278 passed
2025-07-24 04:59:14,524 - DEBUG - ====Verifying policy data for ctest-vn-60822278 in API_Server ======
2025-07-24 04:59:14,524 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 04:59:14,532 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2
2025-07-24 04:59:14,548 - DEBUG - Requesting: http://10.0.0.19:8082/project/5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 04:59:14,665 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/56d97aa5-85f9-4a61-bf90-a671aa900c01
2025-07-24 04:59:14,688 - DEBUG - =>VN ctest-vn-60822278 has no policy to be verified
2025-07-24 04:59:14,688 - DEBUG - Verifying the vn in opserver
2025-07-24 04:59:14,688 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 virtual network link through opserver 10.0.0.19
2025-07-24 04:59:14,688 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks
2025-07-24 04:59:14,705 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278?flat'}
2025-07-24 04:59:14,705 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 virtual network link through opserver 10.0.0.38
2025-07-24 04:59:14,705 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-07-24 04:59:14,724 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278?flat'}
2025-07-24 04:59:14,724 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 virtual network link through opserver 10.0.0.41
2025-07-24 04:59:14,724 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks
2025-07-24 04:59:14,741 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278?flat'}
2025-07-24 04:59:14,741 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is found in opserver
2025-07-24 04:59:14,771 - DEBUG - Do not have enough data to verify VN in agent
2025-07-24 04:59:14,795 - DEBUG - VRF ids for VN ctest-vn-60822278: {}
2025-07-24 04:59:14,795 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:59:14,795 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:59:16,127 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1)
2025-07-24 04:59:16,127 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3712-1', 'an-jenkins-deploy-platform-ansible-os-3712-2']}
2025-07-24 04:59:17,677 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1)
2025-07-24 04:59:17,677 - INFO - Waiting for VM ctest-TestMtuProbe-48136577-37734990 to be up..
2025-07-24 04:59:17,817 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-07-24 04:59:22,926 - DEBUG - VM is in ACTIVE state now
2025-07-24 04:59:22,926 - INFO - VM name : ctest-TestMtuProbe-48136577-37734990
2025-07-24 04:59:23,023 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 ID is cfcaf5f2-ca09-467e-b908-25bc26ee4e32
2025-07-24 04:59:23,023 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 launched on Node an-jenkins-deploy-platform-ansible-os-3712-1
2025-07-24 04:59:23,121 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/cfcaf5f2-ca09-467e-b908-25bc26ee4e32
2025-07-24 04:59:23,137 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/309f6391-16c3-4e95-91d3-cf2af8349863
2025-07-24 04:59:26,375 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-07-24 04:59:26,375 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:26,398 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:30,474 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms')
2025-07-24 04:59:30,474 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:30,494 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:34,571 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-07-24 04:59:34,571 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:34,593 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:38,660 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-07-24 04:59:38,660 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:38,679 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:42,763 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-07-24 04:59:42,763 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:42,783 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:46,858 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms')
2025-07-24 04:59:46,858 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:46,877 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:50,948 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms')
2025-07-24 04:59:50,949 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:50,968 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:55,048 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2025-07-24 04:59:55,048 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:55,067 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 04:59:59,143 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms')
2025-07-24 04:59:59,143 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 04:59:59,170 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 05:00:03,232 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms')
2025-07-24 05:00:03,233 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 05:00:03,255 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 05:00:07,342 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-07-24 05:00:07,343 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 05:00:07,368 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 05:00:11,459 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2025-07-24 05:00:11,459 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 05:00:11,481 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 05:00:15,590 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms')
2025-07-24 05:00:15,590 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 failed!
2025-07-24 05:00:15,609 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-48136577:ctest-vn-60822278 is 139.71.244.129 and allocation pool is NOT set
2025-07-24 05:00:17,681 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=25.9 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.02 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.024/13.437/25.851/12.413 ms')
2025-07-24 05:00:17,682 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-48136577-37734990 passed
2025-07-24 05:00:17,815 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:17,815 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:17,883 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 05:00:18,000 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 05:00:23,000 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:23,001 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:23,069 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 05:00:23,163 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 05:00:28,163 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:28,164 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:28,234 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 05:00:28,358 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 05:00:33,359 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:33,359 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:33,441 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 05:00:33,537 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 05:00:38,538 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:38,538 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:38,606 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 05:00:38,703 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 05:00:43,704 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:43,704 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:43,774 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-07-24 05:00:43,880 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is NOT ready for SSH connections, VM status: ACTIVE
2025-07-24 05:00:48,881 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:48,881 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-37734990, IP 139.71.244.131, Port 22
2025-07-24 05:00:49,058 - DEBUG - VM ctest-TestMtuProbe-48136577-37734990 is ready for SSH connections
2025-07-24 05:00:49,058 - INFO - Waiting for VM ctest-TestMtuProbe-48136577-84317063 to be up..
2025-07-24 05:00:49,162 - DEBUG - VM is in ACTIVE state now
2025-07-24 05:00:49,162 - INFO - VM name : ctest-TestMtuProbe-48136577-84317063
2025-07-24 05:00:49,267 - DEBUG - VM ctest-TestMtuProbe-48136577-84317063 ID is 6b9e9b94-5b7d-43ab-9f44-d058e0c62f37
2025-07-24 05:00:49,267 - DEBUG - VM ctest-TestMtuProbe-48136577-84317063 launched on Node an-jenkins-deploy-platform-ansible-os-3712-1
2025-07-24 05:00:49,379 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/6b9e9b94-5b7d-43ab-9f44-d058e0c62f37
2025-07-24 05:00:49,398 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/55b04f6e-33e3-439f-8b49-a2134dfd2dd5
2025-07-24 05:00:50,637 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.38 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.567 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.567/2.471/4.375/1.904 ms')
2025-07-24 05:00:50,637 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-48136577-84317063 passed
2025-07-24 05:00:50,765 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:00:50,765 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-48136577-84317063, IP 139.71.244.132, Port 22
2025-07-24 05:00:50,938 - DEBUG - VM ctest-TestMtuProbe-48136577-84317063 is ready for SSH connections
2025-07-24 05:00:50,938 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:00:50,938 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 05:01:21,131 - DEBUG - None
2025-07-24 05:01:21,131 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:01:21,131 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 05:02:12,230 - DEBUG - None
2025-07-24 05:02:12,230 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 05:02:12,230 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 05:02:12,230 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:02:12,230 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 139.71.244.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:12,230 - DEBUG - ping -s 56 -c 3 -W 1 139.71.244.132
2025-07-24 05:02:14,919 - DEBUG - PING 139.71.244.132 (139.71.244.132) 56(84) bytes of data.
64 bytes from 139.71.244.132: icmp_req=1 ttl=64 time=11.2 ms
64 bytes from 139.71.244.132: icmp_req=2 ttl=64 time=1.00 ms
64 bytes from 139.71.244.132: icmp_req=3 ttl=64 time=1.08 ms
--- 139.71.244.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2005ms
rtt min/avg/max/mdev = 1.007/4.461/11.289/4.828 ms
2025-07-24 05:02:14,919 - INFO - Ping to IP 139.71.244.132 from VM ctest-TestMtuProbe-48136577-37734990 passed
2025-07-24 05:02:14,919 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:02:14,919 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:14,920 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-07-24 05:02:15,812 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-07-24 05:02:15,812 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:15,812 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-07-24 05:02:16,444 - DEBUG - None
2025-07-24 05:02:16,444 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 139.71.244.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:16,444 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 139.71.244.132 5201 < testfile
2025-07-24 05:02:19,336 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00155634 s, 64.3 kB/s
2025-07-24 05:02:19,336 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:19,337 - DEBUG - ls -l testfile
2025-07-24 05:02:19,814 - DEBUG - -rw-r--r-- 1 root root 100 Jul 24 05:02 testfile
2025-07-24 05:02:19,815 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-48136577-84317063
2025-07-24 05:02:19,815 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:19,815 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 05:02:20,452 - DEBUG - None
2025-07-24 05:02:20,452 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:20,452 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 05:02:21,010 - DEBUG - None
2025-07-24 05:02:21,010 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 05:02:21,010 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 05:02:21,010 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:02:21,010 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 139.71.244.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:21,010 - DEBUG - ping -s 56 -c 3 -W 1 139.71.244.132
2025-07-24 05:02:23,648 - DEBUG - PING 139.71.244.132 (139.71.244.132) 56(84) bytes of data.
64 bytes from 139.71.244.132: icmp_req=1 ttl=64 time=3.79 ms
64 bytes from 139.71.244.132: icmp_req=2 ttl=64 time=0.934 ms
64 bytes from 139.71.244.132: icmp_req=3 ttl=64 time=1.28 ms
--- 139.71.244.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.934/2.002/3.793/1.274 ms
2025-07-24 05:02:23,648 - INFO - Ping to IP 139.71.244.132 from VM ctest-TestMtuProbe-48136577-37734990 passed
2025-07-24 05:02:23,648 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:02:23,649 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:23,649 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-07-24 05:02:24,551 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jul 24 05:02 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-07-24 05:02:24,551 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:24,552 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-07-24 05:02:25,141 - DEBUG - None
2025-07-24 05:02:25,141 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 139.71.244.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:25,141 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 139.71.244.132 5201 < testfile
2025-07-24 05:02:27,870 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00111929 s, 89.3 kB/s
2025-07-24 05:02:27,870 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:27,870 - DEBUG - ls -l testfile
2025-07-24 05:02:28,303 - DEBUG - -rw-r--r-- 1 root root 100 Jul 24 05:02 testfile
2025-07-24 05:02:28,303 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-48136577-84317063
2025-07-24 05:02:28,303 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:28,303 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 05:02:28,839 - DEBUG - None
2025-07-24 05:02:28,839 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:28,839 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-07-24 05:02:29,444 - DEBUG - None
2025-07-24 05:02:29,444 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 05:02:29,444 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-07-24 05:02:29,444 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:02:29,444 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 139.71.244.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:29,445 - DEBUG - ping -s 56 -c 3 -W 1 139.71.244.132
2025-07-24 05:02:32,060 - DEBUG - PING 139.71.244.132 (139.71.244.132) 56(84) bytes of data.
64 bytes from 139.71.244.132: icmp_req=1 ttl=64 time=3.21 ms
64 bytes from 139.71.244.132: icmp_req=2 ttl=64 time=1.45 ms
64 bytes from 139.71.244.132: icmp_req=3 ttl=64 time=0.903 ms
--- 139.71.244.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.903/1.859/3.216/0.985 ms
2025-07-24 05:02:32,060 - INFO - Ping to IP 139.71.244.132 from VM ctest-TestMtuProbe-48136577-37734990 passed
2025-07-24 05:02:32,060 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-24 05:02:32,060 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:32,060 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-07-24 05:02:32,827 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jul 24 05:02 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-07-24 05:02:32,827 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:32,827 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-07-24 05:02:33,439 - DEBUG - None
2025-07-24 05:02:33,439 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 139.71.244.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:33,440 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 139.71.244.132 5201 < testfile
2025-07-24 05:02:36,172 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00197449 s, 50.6 kB/s
2025-07-24 05:02:36,172 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-07-24 05:02:36,172 - DEBUG - ls -l testfile
2025-07-24 05:02:36,569 - DEBUG - -rw-r--r-- 1 root root 100 Jul 24 05:02 testfile
2025-07-24 05:02:36,569 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-48136577-84317063
2025-07-24 05:02:36,569 - INFO - Deleting VM ctest-TestMtuProbe-48136577-84317063
2025-07-24 05:02:36,692 - INFO - Deleting VM ctest-TestMtuProbe-48136577-37734990
2025-07-24 05:02:36,783 - INFO - Deleting VN ctest-vn-60822278
2025-07-24 05:02:36,907 - DEBUG - VN 56d97aa5-85f9-4a61-bf90-a671aa900c01 still in use: Unable to complete operation on network 56d97aa5-85f9-4a61-bf90-a671aa900c01. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-4c374b63-6d05-4482-ac40-27720044f8f0']
2025-07-24 05:02:36,907 - WARNING - Deleting VN ctest-vn-60822278 failed..Will retry
2025-07-24 05:02:39,217 - DEBUG - Response for deleting network ()
2025-07-24 05:02:39,218 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/dc558371-3c15-431c-8ff8-f8d326e27e32
2025-07-24 05:02:39,324 - DEBUG - Response Code: 404
2025-07-24 05:02:39,325 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2025-07-24 05:02:39,332 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2
2025-07-24 05:02:39,363 - DEBUG - Requesting: http://10.0.0.19:8082/project/5d246832-5b4c-4046-bc41-a59d3314b29c
2025-07-24 05:02:39,458 - INFO - Validated that VN ctest-vn-60822278 is not found in API Server
2025-07-24 05:02:39,474 - DEBUG - VN ctest-vn-60822278 is not present in Agent 10.0.0.57
2025-07-24 05:02:39,491 - DEBUG - VN ctest-vn-60822278 is not present in Agent 10.0.0.23
2025-07-24 05:02:39,491 - INFO - Validated that VN ctest-vn-60822278 is not in any agent
2025-07-24 05:02:39,550 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-60822278 info
2025-07-24 05:02:40,867 - DEBUG - No XMPP flaps were noticed during the test
2025-07-24 05:02:40,867 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:03:28]
2025-07-24 05:02:40,868 - INFO - --------------------------------------------------------------------------------
2025-07-24 05:02:41,733 - INFO - Deleted project: ctest-TestMtuProbe-48136577, ID : 5d246832-5b4c-4046-bc41-a59d3314b29c