is in ACTIVE state now
2025-08-04 03:50:03,881 - INFO - VM name : ctest-TestMtuProbe-73314110-48398757
2025-08-04 03:50:03,968 - DEBUG - VM ctest-TestMtuProbe-73314110-48398757 ID is d355b75e-7513-4e72-a0da-51a68ee5c71b
2025-08-04 03:50:03,968 - DEBUG - VM ctest-TestMtuProbe-73314110-48398757 launched on Node an-jenkins-deploy-platform-ansible-os-3750-1
2025-08-04 03:50:04,058 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/d355b75e-7513-4e72-a0da-51a68ee5c71b
2025-08-04 03:50:04,074 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/016a980d-3335-4bd6-983c-fd786457b47c
2025-08-04 03:50:05,308 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.56 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.706 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.706/2.132/3.559/1.426 ms')
2025-08-04 03:50:05,308 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-48398757 passed
2025-08-04 03:50:05,424 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:50:05,424 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-48398757, IP 79.8.74.196, Port 22
2025-08-04 03:50:05,615 - DEBUG - VM ctest-TestMtuProbe-73314110-48398757 is ready for SSH connections
2025-08-04 03:50:05,615 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:50:05,616 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:50:21,726 - DEBUG - None
2025-08-04 03:50:21,726 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:50:21,726 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:51:05,805 - DEBUG - None
2025-08-04 03:51:05,805 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:51:05,805 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:51:05,805 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:51:05,805 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 79.8.74.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:05,805 - DEBUG - ping -s 56 -c 3 -W 1 79.8.74.196
2025-08-04 03:51:08,266 - DEBUG - PING 79.8.74.196 (79.8.74.196) 56(84) bytes of data.
64 bytes from 79.8.74.196: icmp_req=1 ttl=64 time=13.7 ms
64 bytes from 79.8.74.196: icmp_req=2 ttl=64 time=1.28 ms
64 bytes from 79.8.74.196: icmp_req=3 ttl=64 time=1.09 ms
--- 79.8.74.196 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 1.098/5.388/13.777/5.932 ms
2025-08-04 03:51:08,266 - INFO - Ping to IP 79.8.74.196 from VM ctest-TestMtuProbe-73314110-94710610 passed
2025-08-04 03:51:08,266 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:51:08,266 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:08,266 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-04 03:51:08,884 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-04 03:51:08,884 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:08,884 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-04 03:51:09,396 - DEBUG - None
2025-08-04 03:51:09,397 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 79.8.74.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:09,397 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 79.8.74.196 5201 < testfile
2025-08-04 03:51:11,937 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000796282 s, 126 kB/s
2025-08-04 03:51:11,937 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:11,937 - DEBUG - ls -l testfile
2025-08-04 03:51:12,313 - DEBUG - -rw-r--r-- 1 root root 100 Aug 4 03:51 testfile
2025-08-04 03:51:12,313 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73314110-48398757
2025-08-04 03:51:12,313 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:12,313 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:51:12,716 - DEBUG - None
2025-08-04 03:51:12,716 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:12,716 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:51:13,184 - DEBUG - None
2025-08-04 03:51:13,185 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:51:13,185 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:51:13,185 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:51:13,185 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 79.8.74.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:13,185 - DEBUG - ping -s 56 -c 3 -W 1 79.8.74.196
2025-08-04 03:51:15,667 - DEBUG - PING 79.8.74.196 (79.8.74.196) 56(84) bytes of data.
64 bytes from 79.8.74.196: icmp_req=1 ttl=64 time=2.47 ms
64 bytes from 79.8.74.196: icmp_req=2 ttl=64 time=1.61 ms
64 bytes from 79.8.74.196: icmp_req=3 ttl=64 time=1.05 ms
--- 79.8.74.196 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 1.058/1.716/2.478/0.585 ms
2025-08-04 03:51:15,667 - INFO - Ping to IP 79.8.74.196 from VM ctest-TestMtuProbe-73314110-94710610 passed
2025-08-04 03:51:15,667 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:51:15,667 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:15,667 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-04 03:51:16,293 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 4 03:51 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-04 03:51:16,293 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:16,293 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-04 03:51:16,800 - DEBUG - None
2025-08-04 03:51:16,800 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 79.8.74.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:16,800 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 79.8.74.196 5201 < testfile
2025-08-04 03:51:19,320 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000935356 s, 107 kB/s
2025-08-04 03:51:19,320 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:19,320 - DEBUG - ls -l testfile
2025-08-04 03:51:19,706 - DEBUG - -rw-r--r-- 1 root root 100 Aug 4 03:51 testfile
2025-08-04 03:51:19,707 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73314110-48398757
2025-08-04 03:51:19,707 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:19,707 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:51:20,135 - DEBUG - None
2025-08-04 03:51:20,136 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:20,136 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:51:20,578 - DEBUG - None
2025-08-04 03:51:20,578 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:51:20,578 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:51:20,578 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:51:20,578 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 79.8.74.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:20,578 - DEBUG - ping -s 56 -c 3 -W 1 79.8.74.196
2025-08-04 03:51:23,044 - DEBUG - PING 79.8.74.196 (79.8.74.196) 56(84) bytes of data.
64 bytes from 79.8.74.196: icmp_req=1 ttl=64 time=2.90 ms
64 bytes from 79.8.74.196: icmp_req=2 ttl=64 time=0.991 ms
64 bytes from 79.8.74.196: icmp_req=3 ttl=64 time=1.05 ms
--- 79.8.74.196 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.991/1.650/2.909/0.890 ms
2025-08-04 03:51:23,044 - INFO - Ping to IP 79.8.74.196 from VM ctest-TestMtuProbe-73314110-94710610 passed
2025-08-04 03:51:23,044 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:51:23,044 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:23,044 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-04 03:51:23,670 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 4 03:51 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-04 03:51:23,670 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:23,670 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-04 03:51:24,146 - DEBUG - None
2025-08-04 03:51:24,146 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 79.8.74.196 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:51:24,146 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 79.8.74.196 5201 < testfile
2025-08-04 03:51:26,662 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000955754 s, 105 kB/s
2025-08-04 03:51:26,662 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123
2025-08-04 03:51:26,662 - DEBUG - ls -l testfile
2025-08-04 03:51:27,058 - DEBUG - -rw-r--r-- 1 root root 100 Aug 4 03:51 testfile
2025-08-04 03:51:27,058 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73314110-48398757
2025-08-04 03:51:27,058 - INFO - Deleting VM ctest-TestMtuProbe-73314110-48398757
2025-08-04 03:51:27,137 - INFO - Deleting VM ctest-TestMtuProbe-73314110-94710610
2025-08-04 03:51:27,211 - INFO - Deleting VN ctest-vn-16782226
2025-08-04 03:51:27,259 - DEBUG - VN 4dc8bd9a-109a-402a-8e1f-8fc4dd47f064 still in use: Unable to complete operation on network 4dc8bd9a-109a-402a-8e1f-8fc4dd47f064. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-7f0f72b4-3b0a-49a8-8617-c0cfc9d7b2df']
2025-08-04 03:51:27,259 - WARNING - Deleting VN ctest-vn-16782226 failed..Will retry
2025-08-04 03:51:29,544 - DEBUG - Response for deleting network ()
2025-08-04 03:51:29,544 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d3ae1413-cbdf-4778-a5cd-75b2d3a3fb46
2025-08-04 03:51:29,566 - DEBUG - Response Code: 404
2025-08-04 03:51:29,566 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:51:29,605 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:51:29,629 - DEBUG - Requesting: http://10.0.0.27:8082/project/d62055d5-d93a-42f6-a22c-c1504d39a2a1
2025-08-04 03:51:29,744 - INFO - Validated that VN ctest-vn-16782226 is not found in API Server
2025-08-04 03:51:29,759 - DEBUG - VN ctest-vn-16782226 is not present in Agent 10.0.0.41
2025-08-04 03:51:29,770 - DEBUG - VN ctest-vn-16782226 is not present in Agent 10.0.0.57
2025-08-04 03:51:29,771 - INFO - Validated that VN ctest-vn-16782226 is not in any agent
2025-08-04 03:51:29,815 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-16782226 info
2025-08-04 03:51:31,105 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:51:31,106 - INFO - END TEST : test_mtu_probe_inter_node : PASSED[0:02:38]
2025-08-04 03:51:31,106 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:51:31,113 - INFO - ================================================================================
2025-08-04 03:51:31,113 - INFO - STARTING TEST : test_mtu_probe_intra_node
2025-08-04 03:51:31,113 - INFO - TEST DESCRIPTION :
Description:
check traffic configuring different tcp_mtu_probe vlaues on vm
MTU probing values: 0, 1, 2
0 - Disabled (default)
1 - Disabled by default, Enabled only when ICMP black hole detected
2 - Always enabled, using the initial MSS value of tcp_base_mss
system internally enables bit values for point 1&2
For test purpose,
Idea is to check traffic works fine on configuring values
Vm's across compute node
steps:
1. create 1 VN and launch 2 VMs in same compute node
2. client and server VMs in same compute node
3. configure tcp_mtu_probe to 0, 1, 2
4. send icmp traffic assert if ping fails
5. send tcp traffic assert if tcp traffic fails
Pass criteria:
1. If icmp/tcp traffic work fine configuring tcp_mtu_probe values
2025-08-04 03:51:32,430 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with
2025-08-04 03:51:32,430 - INFO - Initial checks done. Running the testcase now
2025-08-04 03:51:32,430 - INFO -
2025-08-04 03:51:32,788 - DEBUG - Response for create_network : {'network': {'id': '5ee954e5-dd43-4657-959e-6cd839fd7cb2', 'name': 'ctest-vn-13505385', 'tenant_id': 'd62055d5d93a42f6a22cc1504d39a2a1', 'project_id': 'd62055d5d93a42f6a22cc1504d39a2a1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestMtuProbe-73314110', 'ctest-vn-13505385'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 03:51:33,050 - DEBUG - Response for create_subnet : {'subnet': {'id': '1d04981e-ef69-433b-9c0c-d1ecaa25288c', 'name': '', 'tenant_id': 'd62055d5d93a42f6a22cc1504d39a2a1', 'network_id': '5ee954e5-dd43-4657-959e-6cd839fd7cb2', 'ip_version': 4, 'cidr': '166.109.176.128/26', 'allocation_pools': [{'start': '166.109.176.130', 'end': '166.109.176.190'}], 'gateway_ip': '166.109.176.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '166.109.176.130', 'tags': [], 'project_id': 'd62055d5d93a42f6a22cc1504d39a2a1'}}
2025-08-04 03:51:33,073 - INFO - Created VN ctest-vn-13505385
2025-08-04 03:51:33,092 - DEBUG - VN ctest-vn-13505385 UUID is 5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,193 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:51:33,204 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:51:33,226 - DEBUG - Requesting: http://10.0.0.27:8082/project/d62055d5-d93a-42f6-a22c-c1504d39a2a1
2025-08-04 03:51:33,335 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,356 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,370 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/21164f53-3553-4801-b5f7-aed03b21c78f
2025-08-04 03:51:33,382 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/21164f53-3553-4801-b5f7-aed03b21c78f
2025-08-04 03:51:33,392 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c01f767c-7c1f-4087-8009-c71d1da0427b
2025-08-04 03:51:33,401 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:51:33,401 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,413 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/21164f53-3553-4801-b5f7-aed03b21c78f
2025-08-04 03:51:33,434 - INFO - Verified VN network id 13 for VN 5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,434 - INFO - Verifications in API Server for VN ctest-vn-13505385 passed
2025-08-04 03:51:33,435 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,446 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/21164f53-3553-4801-b5f7-aed03b21c78f
2025-08-04 03:51:33,454 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/21164f53-3553-4801-b5f7-aed03b21c78f
2025-08-04 03:51:33,463 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/c01f767c-7c1f-4087-8009-c71d1da0427b
2025-08-04 03:51:33,478 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73314110', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6839090855375226455', 'uuid-lslong': '10781174233913195698'}, 'enable': 'true', 'created': '2025-08-04T03:51:32', 'last-modified': '2025-08-04T03:51:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487515'}
2025-08-04 03:51:33,484 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:51:33,492 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73314110', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6839090855375226455', 'uuid-lslong': '10781174233913195698'}, 'enable': 'true', 'created': '2025-08-04T03:51:32', 'last-modified': '2025-08-04T03:51:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495633'}
2025-08-04 03:51:33,499 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:51:33,507 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestMtuProbe-73314110', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6839090855375226455', 'uuid-lslong': '10781174233913195698'}, 'enable': 'true', 'created': '2025-08-04T03:51:32', 'last-modified': '2025-08-04T03:51:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.514675'}
2025-08-04 03:51:33,518 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 03:51:33,518 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-13505385 passed
2025-08-04 03:51:33,519 - DEBUG - ====Verifying policy data for ctest-vn-13505385 in API_Server ======
2025-08-04 03:51:33,519 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:51:33,528 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:51:33,543 - DEBUG - Requesting: http://10.0.0.27:8082/project/d62055d5-d93a-42f6-a22c-c1504d39a2a1
2025-08-04 03:51:33,643 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5ee954e5-dd43-4657-959e-6cd839fd7cb2
2025-08-04 03:51:33,659 - DEBUG - =>VN ctest-vn-13505385 has no policy to be verified
2025-08-04 03:51:33,659 - DEBUG - Verifying the vn in opserver
2025-08-04 03:51:33,659 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 virtual network link through opserver 10.0.0.27
2025-08-04 03:51:33,659 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 03:51:33,733 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385?flat'}
2025-08-04 03:51:33,733 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 virtual network link through opserver 10.0.0.38
2025-08-04 03:51:33,733 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 03:51:33,799 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385?flat'}
2025-08-04 03:51:33,799 - DEBUG - Verifying the default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 virtual network link through opserver 10.0.0.61
2025-08-04 03:51:33,799 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 03:51:33,819 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385?flat'}
2025-08-04 03:51:33,819 - INFO - Validated that VN default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is found in opserver
2025-08-04 03:51:33,846 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 03:51:33,860 - DEBUG - VRF ids for VN ctest-vn-13505385: {}
2025-08-04 03:51:33,860 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']}
2025-08-04 03:51:33,860 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']}
2025-08-04 03:51:35,200 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:51:35,200 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']}
2025-08-04 03:51:36,833 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2)
2025-08-04 03:51:36,833 - INFO - Waiting for VM ctest-TestMtuProbe-73314110-67116579 to be up..
2025-08-04 03:51:36,954 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-04 03:51:42,047 - DEBUG - VM is in ACTIVE state now
2025-08-04 03:51:42,047 - INFO - VM name : ctest-TestMtuProbe-73314110-67116579
2025-08-04 03:51:42,150 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 ID is 98e03a8e-d9c0-4fb7-bc03-9e4bf608265f
2025-08-04 03:51:42,150 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 launched on Node an-jenkins-deploy-platform-ansible-os-3750-2
2025-08-04 03:51:42,234 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/98e03a8e-d9c0-4fb7-bc03-9e4bf608265f
2025-08-04 03:51:42,246 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/c1553d3b-de51-433c-9f98-fcf7721a68cd
2025-08-04 03:51:45,467 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-08-04 03:51:45,467 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:51:45,486 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:51:49,567 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-08-04 03:51:49,568 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:51:49,584 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:51:53,665 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-08-04 03:51:53,665 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:51:53,686 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:51:57,754 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-08-04 03:51:57,754 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:51:57,773 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:52:01,855 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms')
2025-08-04 03:52:01,855 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:52:01,875 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:52:05,951 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-08-04 03:52:05,952 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:52:05,969 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:52:10,046 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-08-04 03:52:10,046 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:52:10,064 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:52:14,148 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2025-08-04 03:52:14,148 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:52:14,166 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:52:18,248 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2025-08-04 03:52:18,248 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 failed!
2025-08-04 03:52:18,267 - DEBUG - Gateway for vn default-domain:ctest-TestMtuProbe-73314110:ctest-vn-13505385 is 166.109.176.129 and allocation pool is NOT set
2025-08-04 03:52:20,333 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.24 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.67 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.674/4.955/8.236/3.281 ms')
2025-08-04 03:52:20,334 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestMtuProbe-73314110-67116579 passed
2025-08-04 03:52:20,450 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:52:20,450 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-67116579, IP 166.109.176.131, Port 22
2025-08-04 03:52:20,509 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-04 03:52:20,608 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-04 03:52:25,609 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:52:25,609 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-67116579, IP 166.109.176.131, Port 22
2025-08-04 03:52:25,678 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-04 03:52:25,774 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-04 03:52:30,775 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:52:30,775 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-67116579, IP 166.109.176.131, Port 22
2025-08-04 03:52:30,842 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-04 03:52:30,952 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-04 03:52:35,953 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:52:35,953 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-67116579, IP 166.109.176.131, Port 22
2025-08-04 03:52:36,024 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-04 03:52:36,128 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-04 03:52:41,129 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:52:41,130 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-67116579, IP 166.109.176.131, Port 22
2025-08-04 03:52:41,298 - DEBUG - VM ctest-TestMtuProbe-73314110-67116579 is ready for SSH connections
2025-08-04 03:52:41,298 - INFO - Waiting for VM ctest-TestMtuProbe-73314110-81976131 to be up..
2025-08-04 03:52:41,394 - DEBUG - VM is in ACTIVE state now
2025-08-04 03:52:41,394 - INFO - VM name : ctest-TestMtuProbe-73314110-81976131
2025-08-04 03:52:41,481 - DEBUG - VM ctest-TestMtuProbe-73314110-81976131 ID is d70b2d6d-4e53-4487-bc66-8d733afc21ee
2025-08-04 03:52:41,481 - DEBUG - VM ctest-TestMtuProbe-73314110-81976131 launched on Node an-jenkins-deploy-platform-ansible-os-3750-2
2025-08-04 03:52:41,570 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/d70b2d6d-4e53-4487-bc66-8d733afc21ee
2025-08-04 03:52:41,584 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/3a4e081a-7024-4464-b49c-30bed5089609
2025-08-04 03:52:42,814 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.54 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=6.13 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 5.542/5.837/6.132/0.295 ms')
2025-08-04 03:52:42,814 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestMtuProbe-73314110-81976131 passed
2025-08-04 03:52:42,931 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:52:42,931 - DEBUG - Waiting to SSH to VM ctest-TestMtuProbe-73314110-81976131, IP 166.109.176.132, Port 22
2025-08-04 03:52:43,099 - DEBUG - VM ctest-TestMtuProbe-73314110-81976131 is ready for SSH connections
2025-08-04 03:52:43,099 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:52:43,099 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:53:02,333 - DEBUG - None
2025-08-04 03:53:02,333 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:02,333 - DEBUG - echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:53:38,719 - DEBUG - None
2025-08-04 03:53:38,719 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:53:38,719 - INFO - {'echo 0 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:53:38,719 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:53:38,720 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 166.109.176.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:38,720 - DEBUG - ping -s 56 -c 3 -W 1 166.109.176.132
2025-08-04 03:53:41,186 - DEBUG - PING 166.109.176.132 (166.109.176.132) 56(84) bytes of data.
64 bytes from 166.109.176.132: icmp_req=1 ttl=64 time=12.2 ms
64 bytes from 166.109.176.132: icmp_req=2 ttl=64 time=0.735 ms
64 bytes from 166.109.176.132: icmp_req=3 ttl=64 time=1.00 ms
--- 166.109.176.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.735/4.668/12.268/5.375 ms
2025-08-04 03:53:41,186 - INFO - Ping to IP 166.109.176.132 from VM ctest-TestMtuProbe-73314110-67116579 passed
2025-08-04 03:53:41,186 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:53:41,186 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:41,186 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-04 03:53:41,772 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-04 03:53:41,772 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:41,772 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-04 03:53:42,197 - DEBUG - None
2025-08-04 03:53:42,198 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 166.109.176.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:42,198 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10001 166.109.176.132 5201 < testfile
2025-08-04 03:53:44,753 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000895848 s, 112 kB/s
2025-08-04 03:53:44,753 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:44,753 - DEBUG - ls -l testfile
2025-08-04 03:53:45,082 - DEBUG - -rw-r--r-- 1 root root 100 Aug 4 03:53 testfile
2025-08-04 03:53:45,082 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73314110-81976131
2025-08-04 03:53:45,082 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:45,082 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:53:45,500 - DEBUG - None
2025-08-04 03:53:45,500 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:45,501 - DEBUG - echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:53:45,919 - DEBUG - None
2025-08-04 03:53:45,919 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:53:45,920 - INFO - {'echo 1 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:53:45,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:53:45,920 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 166.109.176.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:45,920 - DEBUG - ping -s 56 -c 3 -W 1 166.109.176.132
2025-08-04 03:53:48,361 - DEBUG - PING 166.109.176.132 (166.109.176.132) 56(84) bytes of data.
64 bytes from 166.109.176.132: icmp_req=1 ttl=64 time=2.83 ms
64 bytes from 166.109.176.132: icmp_req=2 ttl=64 time=0.633 ms
64 bytes from 166.109.176.132: icmp_req=3 ttl=64 time=0.685 ms
--- 166.109.176.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 0.633/1.384/2.834/1.025 ms
2025-08-04 03:53:48,361 - INFO - Ping to IP 166.109.176.132 from VM ctest-TestMtuProbe-73314110-67116579 passed
2025-08-04 03:53:48,361 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:53:48,361 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:48,361 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-04 03:53:48,943 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 4 03:53 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-04 03:53:48,944 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:48,944 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-04 03:53:49,375 - DEBUG - None
2025-08-04 03:53:49,376 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 166.109.176.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:49,376 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10002 166.109.176.132 5201 < testfile
2025-08-04 03:53:51,910 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000948226 s, 105 kB/s
2025-08-04 03:53:51,910 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:51,910 - DEBUG - ls -l testfile
2025-08-04 03:53:52,232 - DEBUG - -rw-r--r-- 1 root root 100 Aug 4 03:53 testfile
2025-08-04 03:53:52,232 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73314110-81976131
2025-08-04 03:53:52,232 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:52,233 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:53:52,685 - DEBUG - None
2025-08-04 03:53:52,685 - DEBUG - Running remote_cmd, Cmd : echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:52,685 - DEBUG - echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing
2025-08-04 03:53:53,087 - DEBUG - None
2025-08-04 03:53:53,087 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:53:53,087 - INFO - {'echo 2 > /proc/sys/net/ipv4/tcp_mtu_probing': None}
2025-08-04 03:53:53,087 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:53:53,088 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 166.109.176.132, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:53,088 - DEBUG - ping -s 56 -c 3 -W 1 166.109.176.132
2025-08-04 03:53:55,545 - DEBUG - PING 166.109.176.132 (166.109.176.132) 56(84) bytes of data.
64 bytes from 166.109.176.132: icmp_req=1 ttl=64 time=2.28 ms
64 bytes from 166.109.176.132: icmp_req=2 ttl=64 time=1.02 ms
64 bytes from 166.109.176.132: icmp_req=3 ttl=64 time=0.668 ms
--- 166.109.176.132 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms
rtt min/avg/max/mdev = 0.668/1.326/2.286/0.694 ms
2025-08-04 03:53:55,545 - INFO - Ping to IP 166.109.176.132 from VM ctest-TestMtuProbe-73314110-67116579 passed
2025-08-04 03:53:55,545 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-04 03:53:55,545 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:55,546 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -ll -p 5201 > testfile &
2025-08-04 03:53:56,091 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Aug 4 03:53 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2025-08-04 03:53:56,091 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -ll 5201 > testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:56,091 - DEBUG - nohup nc -4 -q 2 -w 5 -ll 5201 > testfile &
2025-08-04 03:53:56,515 - DEBUG - None
2025-08-04 03:53:56,515 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 166.109.176.132 5201 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:56,515 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -p 10003 166.109.176.132 5201 < testfile
2025-08-04 03:53:59,036 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00087458 s, 114 kB/s
2025-08-04 03:53:59,037 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-04 03:53:59,037 - DEBUG - ls -l testfile
2025-08-04 03:53:59,366 - DEBUG - -rw-r--r-- 1 root root 100 Aug 4 03:53 testfile
2025-08-04 03:53:59,367 - INFO - File transfer verification for file size 100 passed on the VM ctest-TestMtuProbe-73314110-81976131
2025-08-04 03:53:59,367 - INFO - Deleting VM ctest-TestMtuProbe-73314110-81976131
2025-08-04 03:53:59,471 - INFO - Deleting VM ctest-TestMtuProbe-73314110-67116579
2025-08-04 03:53:59,552 - INFO - Deleting VN ctest-vn-13505385
2025-08-04 03:53:59,674 - DEBUG - VN 5ee954e5-dd43-4657-959e-6cd839fd7cb2 still in use: Unable to complete operation on network 5ee954e5-dd43-4657-959e-6cd839fd7cb2. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-1744966c-5c00-4396-a757-f127e0f8bff0']
2025-08-04 03:53:59,674 - WARNING - Deleting VN ctest-vn-13505385 failed..Will retry
2025-08-04 03:54:01,856 - DEBUG - Response for deleting network ()
2025-08-04 03:54:01,857 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/21164f53-3553-4801-b5f7-aed03b21c78f
2025-08-04 03:54:01,903 - DEBUG - Response Code: 404
2025-08-04 03:54:01,903 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 03:54:01,911 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 03:54:01,930 - DEBUG - Requesting: http://10.0.0.27:8082/project/d62055d5-d93a-42f6-a22c-c1504d39a2a1
2025-08-04 03:54:02,035 - INFO - Validated that VN ctest-vn-13505385 is not found in API Server
2025-08-04 03:54:02,050 - DEBUG - VN ctest-vn-13505385 is not present in Agent 10.0.0.41
2025-08-04 03:54:02,065 - DEBUG - VN ctest-vn-13505385 is not present in Agent 10.0.0.57
2025-08-04 03:54:02,065 - INFO - Validated that VN ctest-vn-13505385 is not in any agent
2025-08-04 03:54:02,109 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-13505385 info
2025-08-04 03:54:03,385 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 03:54:03,385 - INFO - END TEST : test_mtu_probe_intra_node : PASSED[0:02:32]
2025-08-04 03:54:03,385 - INFO - --------------------------------------------------------------------------------
2025-08-04 03:54:04,227 - INFO - Deleted project: ctest-TestMtuProbe-73314110, ID : d62055d5-d93a-42f6-a22c-c1504d39a2a1