is in ACTIVE state now
2025-11-03 03:31:14,714 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-73759714-02706697
2025-11-03 03:31:14,867 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-73759714-02706697 ID is 8e054269-3f02-40bd-a665-dcc27972e332
2025-11-03 03:31:14,867 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-73759714-02706697 launched on Node an-jenkins-deploy-platform-ansible-os-4597-1
2025-11-03 03:31:14,995 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/8e054269-3f02-40bd-a665-dcc27972e332
2025-11-03 03:31:15,051 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/e6b0e1ad-741e-47d6-b597-d0a37cb9646c
2025-11-03 03:31:16,229 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.01 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.411 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.411/1.711/3.012/1.300 ms')
2025-11-03 03:31:16,229 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-73759714-02706697 passed
2025-11-03 03:31:16,300 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-03 03:31:16,300 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-73759714-02706697, IP 331f:5b6c:3d51:ffc2:349f:a700:0:6, Port 22
2025-11-03 03:31:16,471 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-73759714-02706697 is ready for SSH connections
2025-11-03 03:31:16,539 - INFO - Policy DISABLED on VMI e6b0e1ad-741e-47d6-b597-d0a37cb9646c
2025-11-03 03:31:16,539 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-03 03:31:16,539 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 331f:5b6c:3d51:ffc2:349f:a700:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2025-11-03 03:31:16,539 - DEBUG - ifconfig -a| grep 331f:5b6c:3d51:ffc2:349f:a700:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-11-03 03:31:55,207 - DEBUG - eth0
2025-11-03 03:31:55,208 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2025-11-03 03:31:55,208 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0
2025-11-03 03:31:55,732 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0
2025-11-03 03:31:55,963 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-73759714', 'ctest-intf-rtb-65813558'](UUID abc15f4c-9e4b-4dee-9516-1e9fa478179b), prefixes : ['23f4:15a1:bd93:6029:6f75:b071::/96']
2025-11-03 03:31:56,039 - INFO - Added intf route table abc15f4c-9e4b-4dee-9516-1e9fa478179b to port e6b0e1ad-741e-47d6-b597-d0a37cb9646c
2025-11-03 03:31:56,039 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2025-11-03 03:31:56,039 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-11-03 03:31:56,455 - DEBUG - eth0
2025-11-03 03:31:56,455 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2025-11-03 03:31:56,455 - DEBUG - ifconfig eth0 inet6 add 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b
2025-11-03 03:31:56,939 - DEBUG - None
2025-11-03 03:31:56,940 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2025-11-03 03:31:56,940 - DEBUG - ifconfig -a
2025-11-03 03:31:57,465 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:e6:b0:e1:ad:74
inet addr:113.48.50.6 Bcast:113.48.50.63 Mask:255.255.255.192
inet6 addr: 331f:5b6c:3d51:ffc2:349f:a700:0:6/64 Scope:Global
inet6 addr: fe80::e6:b0ff:fee1:ad74/64 Scope:Link
inet6 addr: 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b/128 Scope:Global
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:648 errors:0 dropped:0 overruns:0 frame:0
TX packets:580 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:56034 (56.0 KB) TX bytes:47812 (47.8 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
2025-11-03 03:31:57,465 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-73759714-59533439
2025-11-03 03:31:57,631 - INFO - Removed intf route table f8a05f20-749c-4411-a75d-437cbf33cbbb from port 7c7e4228-f654-4467-91a8-f5f3ed46b1d7
2025-11-03 03:31:57,676 - INFO - Deleted Interface route table f8a05f20-749c-4411-a75d-437cbf33cbbb
2025-11-03 03:31:57,697 - INFO - ECMP routes found in agent 10.0.0.33, for prefix 23f4:15a1:bd93:6029:6f75:b071::/96
2025-11-03 03:31:57,697 - INFO - Tap interface tap2809d7f5-a8 found in ecmp routes in agent 10.0.0.33
2025-11-03 03:31:57,709 - INFO - ECMP routes found in agent 10.0.0.73, for prefix 23f4:15a1:bd93:6029:6f75:b071::/96
2025-11-03 03:31:57,709 - INFO - Tap interface tape6b0e1ad-74 found in ecmp routes in agent 10.0.0.73
2025-11-03 03:31:57,799 - DEBUG - Executing command: sudo tcpdump -nni tap2809d7f5-a8 -U '(udp and src host 331f:5b6c:3d51:ffc2:349f:a700:0:3 and dst host 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b and dst port 11000)' -w /tmp/tap2809d7f5-a8_ctest-random-57057225.pcap
2025-11-03 03:31:58,253 - DEBUG - Executing command: sudo tcpdump -nni tape6b0e1ad-74 -U '(udp and src host 331f:5b6c:3d51:ffc2:349f:a700:0:3 and dst host 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b and dst port 11000)' -w /tmp/tape6b0e1ad-74_ctest-random-85568715.pcap
2025-11-03 03:31:58,340 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 32364 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123
2025-11-03 03:31:58,341 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 32364 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b 11000 < icmp_error
2025-11-03 03:32:00,852 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000982431 s, 102 kB/s
2025-11-03 03:32:00,852 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap2809d7f5-a8_ctest-random-57057225.pcap | grep -c length
2025-11-03 03:32:00,870 - DEBUG - STDOUT: 1
2025-11-03 03:32:00,870 - DEBUG - STDERR: reading from file /tmp/tap2809d7f5-a8_ctest-random-57057225.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-11-03 03:32:00,870 - INFO - 1 packets are found in tcpdump output as expected
2025-11-03 03:32:00,871 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-11-03 03:32:02,917 - INFO - Tcpdump verification on VM 331f:5b6c:3d51:ffc2:349f:a700:0:5 passed
2025-11-03 03:32:03,165 - DEBUG - Forward and reverse flows for match {'sip': '331f:5b6c:3d51:ffc2:349f:a700:0:3', 'dip': '23f4:15a1:bd93:6029:6f75:b071:2a10:e50b', 'sport': '32364', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-11-03 03:32:03,165 - DEBUG - Flow verification PASSED on node: 10.0.0.33 for VMs - Sender: 331f:5b6c:3d51:ffc2:349f:a700:0:3, Receiver: 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b, Flow count expected: 0 0, got: 0 0
2025-11-03 03:32:03,165 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-11-03 03:32:05,174 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-11-03 03:32:07,439 - DEBUG - Forward and reverse flows for match {'sip': '331f:5b6c:3d51:ffc2:349f:a700:0:3', 'dip': '23f4:15a1:bd93:6029:6f75:b071:2a10:e50b', 'sport': '32364', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-11-03 03:32:07,440 - DEBUG - Flow verification PASSED on node: 10.0.0.73 for VMs - Sender: 331f:5b6c:3d51:ffc2:349f:a700:0:3, Receiver: 23f4:15a1:bd93:6029:6f75:b071:2a10:e50b, Flow count expected: 0 0, got: 0 0
2025-11-03 03:32:07,440 - INFO - Traffic verification for ECMP passed
2025-11-03 03:32:07,440 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-73759714-02706697
2025-11-03 03:32:07,591 - INFO - Removed intf route table abc15f4c-9e4b-4dee-9516-1e9fa478179b from port e6b0e1ad-741e-47d6-b597-d0a37cb9646c
2025-11-03 03:32:07,625 - INFO - Deleted Interface route table abc15f4c-9e4b-4dee-9516-1e9fa478179b
2025-11-03 03:32:07,625 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-73759714-96791426
2025-11-03 03:32:07,759 - INFO - Removed intf route table 3ce9b5a0-2d3b-4dd0-9e31-93366b3a1919 from port 2809d7f5-a8e6-43e9-b5d1-505d42db7bbd
2025-11-03 03:32:07,796 - INFO - Deleted Interface route table 3ce9b5a0-2d3b-4dd0-9e31-93366b3a1919
2025-11-03 03:32:07,796 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-73759714-39374068
2025-11-03 03:32:07,871 - INFO - Deleting VN ctest-vn-06046387
2025-11-03 03:32:07,911 - DEBUG - VN d2c132ff-8e52-42ac-a3a2-37e82ac02f6b still in use: Unable to complete operation on network d2c132ff-8e52-42ac-a3a2-37e82ac02f6b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f67e8157-8abc-4b8c-a3be-854fe87ce0e3']
2025-11-03 03:32:07,912 - WARNING - Deleting VN ctest-vn-06046387 failed..Will retry
2025-11-03 03:32:10,096 - DEBUG - Response for deleting network ()
2025-11-03 03:32:10,097 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ef64f96b-a0cc-4e49-bf48-fd6eb8ecf63f
2025-11-03 03:32:10,148 - DEBUG - Response Code: 404
2025-11-03 03:32:10,148 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2025-11-03 03:32:10,158 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1
2025-11-03 03:32:10,238 - DEBUG - Requesting: http://10.0.0.249:8082/project/0b995e1e-d426-4bed-bbcb-6bccaff7adbc
2025-11-03 03:32:10,345 - INFO - Validated that VN ctest-vn-06046387 is not found in API Server
2025-11-03 03:32:10,356 - DEBUG - VN ctest-vn-06046387 is not present in Agent 10.0.0.73
2025-11-03 03:32:10,368 - DEBUG - VN ctest-vn-06046387 is not present in Agent 10.0.0.33
2025-11-03 03:32:10,368 - INFO - Validated that VN ctest-vn-06046387 is not in any agent
2025-11-03 03:32:10,398 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-06046387 info
2025-11-03 03:32:11,686 - DEBUG - No XMPP flaps were noticed during the test
2025-11-03 03:32:11,687 - INFO - END TEST : test_ecmp_with_static_routes : PASSED[0:06:30]
2025-11-03 03:32:11,687 - INFO - --------------------------------------------------------------------------------
2025-11-03 03:32:12,422 - INFO - Deleted project: ctest-DisablePolicyEcmpIpv6-73759714, ID : 0b995e1e-d426-4bed-bbcb-6bccaff7adbc