2025-12-04 03:40:58,303 - INFO - Domain Default found not creating 2025-12-04 03:40:58,478 - INFO - Project ctest-DisablePolicyEcmpIpv6-90962625 not found, creating it 2025-12-04 03:40:59,050 - INFO - Created Project:ctest-DisablePolicyEcmpIpv6-90962625, ID : f5b23be0-2267-4f0b-a3a0-96f88cf6670a 2025-12-04 03:41:00,827 - INFO - ================================================================================ 2025-12-04 03:41:00,827 - INFO - STARTING TEST : test_ecmp_with_static_routes 2025-12-04 03:41:00,827 - INFO - TEST DESCRIPTION : Description: Verify disabling policy for ECMP routes with static routes on VM Steps: 1. launch 1 VN and launch 3 VMs in it. 2. create a static route for a new subnet prefix and add this on 2 VMIs. this will create 2 ECMP routes. 3. Disable the policy on all VMIs. 4. Now from 3rd VM send traffic to an IP from static route prefix 5. add new ECMP destinations and verify load is distributed to new destinations too 6. remove ECMP destinations and verify load is distributed to remaining destinations Pass criteria: 1. traffic should go through fine 2. flows should not be created 3. load should be distributed among ecmp routes. 2025-12-04 03:41:02,139 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.209': '0', '10.20.0.254': '0'}, '10.0.0.130': {'10.20.0.192': '0', '10.20.0.209': '0'}} with 2025-12-04 03:41:02,139 - INFO - Address family configured is dual 2025-12-04 03:41:02,140 - INFO - we are setting address family as v6 2025-12-04 03:41:02,140 - INFO - we are setting address family as v6 2025-12-04 03:41:02,140 - INFO - Initial checks done. Running the testcase now 2025-12-04 03:41:02,140 - INFO - 2025-12-04 03:41:02,171 - DEBUG - Services list from nova: [, , , ] 2025-12-04 03:41:02,171 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4840-1', 'an-jenkins-deploy-platform-ansible-os-4840-2']} 2025-12-04 03:41:02,973 - DEBUG - Response for create_network : {'network': {'id': 'b9fb2ea5-a930-4797-a63c-48d77d72c4b1', 'name': 'ctest-vn-26029671', 'tenant_id': 'f5b23be022674f0ba3a096f88cf6670a', 'project_id': 'f5b23be022674f0ba3a096f88cf6670a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-DisablePolicyEcmpIpv6-90962625', 'ctest-vn-26029671'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:41:03,249 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b982d221-653d-403f-a324-7334dfb5f666', 'name': '', 'tenant_id': 'f5b23be022674f0ba3a096f88cf6670a', 'network_id': 'b9fb2ea5-a930-4797-a63c-48d77d72c4b1', 'ip_version': 6, 'cidr': '24ed:dcf4:393f:acfe:2b32:7727::/96', 'allocation_pools': [{'start': '24ed:dcf4:393f:acfe:2b32:7727:0:2', 'end': '24ed:dcf4:393f:acfe:2b32:7727:ffff:fffe'}], 'gateway_ip': '24ed:dcf4:393f:acfe:2b32:7727:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '24ed:dcf4:393f:acfe:2b32:7727:0:2', 'tags': [], 'project_id': 'f5b23be022674f0ba3a096f88cf6670a'}} 2025-12-04 03:41:03,466 - DEBUG - Response for create_subnet : {'subnet': {'id': '869d811f-2d8e-46fc-b3de-f7290de080a8', 'name': '', 'tenant_id': 'f5b23be022674f0ba3a096f88cf6670a', 'network_id': 'b9fb2ea5-a930-4797-a63c-48d77d72c4b1', 'ip_version': 4, 'cidr': '54.183.36.64/26', 'allocation_pools': [{'start': '54.183.36.66', 'end': '54.183.36.126'}], 'gateway_ip': '54.183.36.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '54.183.36.66', 'tags': [], 'project_id': 'f5b23be022674f0ba3a096f88cf6670a'}} 2025-12-04 03:41:03,495 - INFO - Created VN ctest-vn-26029671 2025-12-04 03:41:03,508 - DEBUG - VN ctest-vn-26029671 UUID is b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:03,625 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:41:03,924 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:41:03,957 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:41:03,973 - DEBUG - Requesting: http://10.0.0.27:8082/project/f5b23be0-2267-4f0b-a3a0-96f88cf6670a 2025-12-04 03:41:04,075 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:04,089 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:04,101 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9cd7f145-f834-4106-8fbe-6b404bcc3c0b 2025-12-04 03:41:04,110 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9cd7f145-f834-4106-8fbe-6b404bcc3c0b 2025-12-04 03:41:04,121 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa3713de-4a38-402a-a112-f9d1b03d7ca5 2025-12-04 03:41:04,129 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:41:04,129 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:04,140 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9cd7f145-f834-4106-8fbe-6b404bcc3c0b 2025-12-04 03:41:04,159 - INFO - Verified VN network id 13 for VN b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:04,159 - INFO - Verifications in API Server for VN ctest-vn-26029671 passed 2025-12-04 03:41:04,159 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:04,172 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9cd7f145-f834-4106-8fbe-6b404bcc3c0b 2025-12-04 03:41:04,181 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9cd7f145-f834-4106-8fbe-6b404bcc3c0b 2025-12-04 03:41:04,189 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa3713de-4a38-402a-a112-f9d1b03d7ca5 2025-12-04 03:41:04,205 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-DisablePolicyEcmpIpv6-90962625', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13401356405214037911', 'uuid-lslong': '11978529199258518705'}, 'enable': 'true', 'created': '2025-12-04T03:41:02', 'last-modified': '2025-12-04T03:41:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.801765'} 2025-12-04 03:41:04,212 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:41:04,218 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-DisablePolicyEcmpIpv6-90962625', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13401356405214037911', 'uuid-lslong': '11978529199258518705'}, 'enable': 'true', 'created': '2025-12-04T03:41:02', 'last-modified': '2025-12-04T03:41:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.819967'} 2025-12-04 03:41:04,225 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:41:04,231 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-DisablePolicyEcmpIpv6-90962625', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13401356405214037911', 'uuid-lslong': '11978529199258518705'}, 'enable': 'true', 'created': '2025-12-04T03:41:02', 'last-modified': '2025-12-04T03:41:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.832200'} 2025-12-04 03:41:04,237 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:41:04,238 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-26029671 passed 2025-12-04 03:41:04,238 - DEBUG - ====Verifying policy data for ctest-vn-26029671 in API_Server ====== 2025-12-04 03:41:04,238 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:41:04,245 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:41:04,257 - DEBUG - Requesting: http://10.0.0.27:8082/project/f5b23be0-2267-4f0b-a3a0-96f88cf6670a 2025-12-04 03:41:04,359 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b9fb2ea5-a930-4797-a63c-48d77d72c4b1 2025-12-04 03:41:04,370 - DEBUG - =>VN ctest-vn-26029671 has no policy to be verified 2025-12-04 03:41:04,371 - DEBUG - Verifying the vn in opserver 2025-12-04 03:41:04,371 - DEBUG - Verifying the default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 virtual network link through opserver 10.0.0.27 2025-12-04 03:41:04,371 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:41:04,670 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:41:04,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671?flat'} 2025-12-04 03:41:04,755 - DEBUG - Verifying the default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 virtual network link through opserver 10.0.0.33 2025-12-04 03:41:04,755 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:41:05,058 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:41:05,138 - DEBUG - vn link and name as {'name': 'default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671?flat'} 2025-12-04 03:41:05,138 - DEBUG - Verifying the default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 virtual network link through opserver 10.0.0.23 2025-12-04 03:41:05,138 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:41:05,463 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:41:05,544 - DEBUG - vn link and name as {'name': 'default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671?flat'} 2025-12-04 03:41:05,544 - INFO - Validated that VN default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is found in opserver 2025-12-04 03:41:05,570 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:41:05,591 - DEBUG - VRF ids for VN ctest-vn-26029671: {} 2025-12-04 03:41:05,591 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4840-1', 'an-jenkins-deploy-platform-ansible-os-4840-2']} 2025-12-04 03:41:06,783 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-1) 2025-12-04 03:41:06,783 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4840-1', 'an-jenkins-deploy-platform-ansible-os-4840-2']} 2025-12-04 03:41:08,346 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-2) 2025-12-04 03:41:10,216 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-2) 2025-12-04 03:41:10,216 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4840-1', 'an-jenkins-deploy-platform-ansible-os-4840-2']} 2025-12-04 03:41:12,072 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-1) 2025-12-04 03:41:12,072 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 to be up.. 2025-12-04 03:41:12,187 - DEBUG - VM is in ACTIVE state now 2025-12-04 03:41:12,187 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-90962625-67696173 2025-12-04 03:41:12,307 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 ID is 4f5aaa89-222f-4403-a542-7dba15c65b3b 2025-12-04 03:41:12,307 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 launched on Node an-jenkins-deploy-platform-ansible-os-4840-2 2025-12-04 03:41:12,428 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4f5aaa89-222f-4403-a542-7dba15c65b3b 2025-12-04 03:41:12,968 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4f5aaa89-222f-4403-a542-7dba15c65b3b 2025-12-04 03:41:13,035 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/fd08f1d7-28aa-448e-96c0-de6727f71082 2025-12-04 03:41:16,221 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-04 03:41:16,222 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:16,236 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:16,236 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:20,315 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-04 03:41:20,315 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:20,330 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:20,330 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:24,416 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-12-04 03:41:24,416 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:24,432 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:24,433 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:28,511 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-12-04 03:41:28,511 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:28,526 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:28,526 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:32,607 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-12-04 03:41:32,607 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:32,624 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:32,624 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:36,703 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-04 03:41:36,703 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:36,719 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:36,719 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:40,795 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-12-04 03:41:40,795 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:40,810 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:40,810 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:44,894 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-04 03:41:44,894 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:44,911 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:44,911 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:48,991 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-12-04 03:41:48,991 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:49,007 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:49,007 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:53,087 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-12-04 03:41:53,087 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:53,108 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:53,108 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:41:57,183 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-04 03:41:57,183 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:41:57,197 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:41:57,197 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:42:01,271 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-12-04 03:42:01,271 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:42:01,288 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:42:01,288 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:42:05,373 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-12-04 03:42:05,373 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:42:05,389 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:42:05,389 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:42:09,464 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-12-04 03:42:09,464 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 failed! 2025-12-04 03:42:09,480 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 24ed:dcf4:393f:acfe:2b32:7727:0:1 and allocation pool is NOT set 2025-12-04 03:42:09,480 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-90962625:ctest-vn-26029671 is 54.183.36.65 and allocation pool is NOT set 2025-12-04 03:42:11,546 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.27 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.25 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.250/4.258/7.266/3.008 ms') 2025-12-04 03:42:11,546 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 passed 2025-12-04 03:42:11,615 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:11,615 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-67696173, IP 24ed:dcf4:393f:acfe:2b32:7727:0:4, Port 22 2025-12-04 03:42:11,687 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 03:42:11,850 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 03:42:16,851 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:16,851 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-67696173, IP 24ed:dcf4:393f:acfe:2b32:7727:0:4, Port 22 2025-12-04 03:42:16,920 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 03:42:17,009 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 03:42:22,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:22,009 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-67696173, IP 24ed:dcf4:393f:acfe:2b32:7727:0:4, Port 22 2025-12-04 03:42:22,109 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 03:42:22,208 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 03:42:27,208 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:27,208 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-67696173, IP 24ed:dcf4:393f:acfe:2b32:7727:0:4, Port 22 2025-12-04 03:42:27,276 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 03:42:27,361 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 03:42:32,363 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:32,363 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-67696173, IP 24ed:dcf4:393f:acfe:2b32:7727:0:4, Port 22 2025-12-04 03:42:32,421 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 03:42:32,529 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 03:42:37,531 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:37,531 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-67696173, IP 24ed:dcf4:393f:acfe:2b32:7727:0:4, Port 22 2025-12-04 03:42:37,699 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 is ready for SSH connections 2025-12-04 03:42:37,699 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 to be up.. 2025-12-04 03:42:37,783 - DEBUG - VM is in ACTIVE state now 2025-12-04 03:42:37,783 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-90962625-62811649 2025-12-04 03:42:37,866 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 ID is 096ae0b5-a6ff-4710-a12a-708d9498fd94 2025-12-04 03:42:37,866 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 launched on Node an-jenkins-deploy-platform-ansible-os-4840-2 2025-12-04 03:42:37,959 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/096ae0b5-a6ff-4710-a12a-708d9498fd94 2025-12-04 03:42:37,970 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/e58d02c8-ef9c-4511-8300-3d18633d3a2d 2025-12-04 03:42:39,138 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=5.02 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.97 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.966/3.494/5.023/1.528 ms') 2025-12-04 03:42:39,138 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 passed 2025-12-04 03:42:39,209 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:39,209 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-62811649, IP 24ed:dcf4:393f:acfe:2b32:7727:0:5, Port 22 2025-12-04 03:42:39,279 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 03:42:39,369 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 03:42:44,370 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:44,370 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-62811649, IP 24ed:dcf4:393f:acfe:2b32:7727:0:5, Port 22 2025-12-04 03:42:44,554 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 is ready for SSH connections 2025-12-04 03:42:44,555 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-90962625-81104308 to be up.. 2025-12-04 03:42:44,653 - DEBUG - VM is in ACTIVE state now 2025-12-04 03:42:44,653 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-90962625-81104308 2025-12-04 03:42:44,785 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-81104308 ID is 33e441ba-5aef-4bac-9058-90d5a7c1e049 2025-12-04 03:42:44,785 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-81104308 launched on Node an-jenkins-deploy-platform-ansible-os-4840-1 2025-12-04 03:42:44,879 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/33e441ba-5aef-4bac-9058-90d5a7c1e049 2025-12-04 03:42:44,889 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/0a966431-c603-4abe-9d06-dd584c29c4b8 2025-12-04 03:42:46,062 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=13.5 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.46 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.456/7.464/13.472/6.008 ms') 2025-12-04 03:42:46,063 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-90962625-81104308 passed 2025-12-04 03:42:46,134 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:46,134 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-81104308, IP 24ed:dcf4:393f:acfe:2b32:7727:0:3, Port 22 2025-12-04 03:42:46,303 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-81104308 is ready for SSH connections 2025-12-04 03:42:46,304 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:42:46,304 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 24ed:dcf4:393f:acfe:2b32:7727:0:4 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:42:46,304 - DEBUG - ifconfig -a| grep 24ed:dcf4:393f:acfe:2b32:7727:0:4 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1 2025-12-04 03:43:07,861 - DEBUG - eth0 2025-12-04 03:43:07,861 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:07,861 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0 2025-12-04 03:43:08,493 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0 2025-12-04 03:43:08,721 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-90962625', 'ctest-intf-rtb-02294346'](UUID 0d17a338-02d6-46f0-b6b1-833db7be5d57), prefixes : ['3937:b1ae:bcf5:95cc:26c8:234a::/96'] 2025-12-04 03:43:08,797 - INFO - Added intf route table 0d17a338-02d6-46f0-b6b1-833db7be5d57 to port fd08f1d7-28aa-448e-96c0-de6727f71082 2025-12-04 03:43:08,797 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:08,797 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1 2025-12-04 03:43:09,299 - DEBUG - eth0 2025-12-04 03:43:09,299 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:09,299 - DEBUG - ifconfig eth0 inet6 add 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 2025-12-04 03:43:09,849 - DEBUG - None 2025-12-04 03:43:09,849 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:09,849 - DEBUG - ifconfig -a 2025-12-04 03:43:10,468 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:fd:08:f1:d7:28 inet addr:54.183.36.68 Bcast:54.183.36.127 Mask:255.255.255.192 inet6 addr: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0/128 Scope:Global inet6 addr: fe80::fd:8ff:fef1:d728/64 Scope:Link inet6 addr: 24ed:dcf4:393f:acfe:2b32:7727:0:4/64 Scope:Global UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:475 errors:0 dropped:0 overruns:0 frame:0 TX packets:372 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:46427 (46.4 KB) TX bytes:34996 (34.9 KB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) 2025-12-04 03:43:10,468 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:43:10,468 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 24ed:dcf4:393f:acfe:2b32:7727:0:5 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:10,468 - DEBUG - ifconfig -a| grep 24ed:dcf4:393f:acfe:2b32:7727:0:5 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1 2025-12-04 03:43:57,094 - DEBUG - eth0 2025-12-04 03:43:57,094 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:57,094 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0 2025-12-04 03:43:57,713 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0 2025-12-04 03:43:57,973 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-90962625', 'ctest-intf-rtb-69041506'](UUID 92f1f793-59f6-494c-a75d-97cadea331a6), prefixes : ['3937:b1ae:bcf5:95cc:26c8:234a::/96'] 2025-12-04 03:43:58,041 - INFO - Added intf route table 92f1f793-59f6-494c-a75d-97cadea331a6 to port e58d02c8-ef9c-4511-8300-3d18633d3a2d 2025-12-04 03:43:58,041 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:58,041 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1 2025-12-04 03:43:58,543 - DEBUG - eth0 2025-12-04 03:43:58,543 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:58,543 - DEBUG - ifconfig eth0 inet6 add 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 2025-12-04 03:43:59,118 - DEBUG - None 2025-12-04 03:43:59,118 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-12-04 03:43:59,118 - DEBUG - ifconfig -a 2025-12-04 03:43:59,743 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:e5:8d:02:c8:ef inet addr:54.183.36.69 Bcast:54.183.36.127 Mask:255.255.255.192 inet6 addr: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0/128 Scope:Global inet6 addr: 24ed:dcf4:393f:acfe:2b32:7727:0:5/64 Scope:Global inet6 addr: fe80::e5:8dff:fe02:c8ef/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:481 errors:0 dropped:0 overruns:0 frame:0 TX packets:420 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:45797 (45.7 KB) TX bytes:38010 (38.0 KB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) 2025-12-04 03:43:59,813 - INFO - Policy DISABLED on VMI 0a966431-c603-4abe-9d06-dd584c29c4b8 2025-12-04 03:43:59,885 - INFO - Policy DISABLED on VMI fd08f1d7-28aa-448e-96c0-de6727f71082 2025-12-04 03:43:59,953 - INFO - Policy DISABLED on VMI e58d02c8-ef9c-4511-8300-3d18633d3a2d 2025-12-04 03:43:59,977 - INFO - ECMP routes found in agent 10.0.0.130, for prefix 3937:b1ae:bcf5:95cc:26c8:234a::/96 2025-12-04 03:43:59,977 - INFO - Tap interface tapfd08f1d7-28 found in ecmp routes in agent 10.0.0.130 2025-12-04 03:43:59,978 - INFO - Tap interface tape58d02c8-ef found in ecmp routes in agent 10.0.0.130 2025-12-04 03:43:59,996 - INFO - ECMP routes found in agent 10.0.0.130, for prefix 3937:b1ae:bcf5:95cc:26c8:234a::/96 2025-12-04 03:44:00,088 - DEBUG - Executing command: sudo tcpdump -nni tapfd08f1d7-28 -U '(udp and src host 24ed:dcf4:393f:acfe:2b32:7727:0:3 and dst host 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 and dst port 11000)' -w /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap 2025-12-04 03:44:00,285 - DEBUG - Executing command: sudo tcpdump -nni tape58d02c8-ef -U '(udp and src host 24ed:dcf4:393f:acfe:2b32:7727:0:3 and dst host 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 and dst port 11000)' -w /tmp/tape58d02c8-ef_ctest-random-64715138.pcap 2025-12-04 03:44:00,391 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 21297 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:44:00,391 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 21297 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 11000 < icmp_error 2025-12-04 03:44:46,550 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.0010672 s, 93.7 kB/s 2025-12-04 03:44:46,550 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:46,568 - DEBUG - STDOUT: 0 2025-12-04 03:44:46,568 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:46,568 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:48,569 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:48,587 - DEBUG - STDOUT: 0 2025-12-04 03:44:48,587 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:48,587 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:50,587 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:50,605 - DEBUG - STDOUT: 0 2025-12-04 03:44:50,605 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:50,605 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:52,606 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:52,624 - DEBUG - STDOUT: 0 2025-12-04 03:44:52,624 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:52,624 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:54,625 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:54,641 - DEBUG - STDOUT: 0 2025-12-04 03:44:54,641 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:54,641 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:56,642 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:56,662 - DEBUG - STDOUT: 0 2025-12-04 03:44:56,662 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:56,662 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:58,663 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap | grep -c length 2025-12-04 03:44:58,681 - DEBUG - STDOUT: 0 2025-12-04 03:44:58,681 - DEBUG - STDERR: reading from file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:58,681 - WARNING - No packets are found in tcpdump output file /tmp/tapfd08f1d7-28_ctest-random-30647377.pcap but expected some packets 2025-12-04 03:44:58,682 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-64715138.pcap | grep -c length 2025-12-04 03:44:58,701 - DEBUG - STDOUT: 1 2025-12-04 03:44:58,701 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-64715138.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:44:58,701 - INFO - 1 packets are found in tcpdump output as expected 2025-12-04 03:44:58,701 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-04 03:45:00,747 - INFO - Tcpdump verification on VM 24ed:dcf4:393f:acfe:2b32:7727:0:5 passed 2025-12-04 03:45:01,023 - DEBUG - Forward and reverse flows for match {'sip': '24ed:dcf4:393f:acfe:2b32:7727:0:3', 'dip': '3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0', 'sport': '21297', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0 2025-12-04 03:45:01,025 - DEBUG - Flow verification PASSED on node: 10.0.0.130 for VMs - Sender: 24ed:dcf4:393f:acfe:2b32:7727:0:3, Receiver: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, Flow count expected: 0 0, got: 0 0 2025-12-04 03:45:01,025 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-04 03:45:03,035 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-04 03:45:05,381 - DEBUG - Forward and reverse flows for match {'sip': '24ed:dcf4:393f:acfe:2b32:7727:0:3', 'dip': '3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0', 'sport': '21297', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0 2025-12-04 03:45:05,383 - DEBUG - Flow verification PASSED on node: 10.0.0.22 for VMs - Sender: 24ed:dcf4:393f:acfe:2b32:7727:0:3, Receiver: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, Flow count expected: 0 0, got: 0 0 2025-12-04 03:45:05,383 - INFO - Traffic verification for ECMP passed 2025-12-04 03:45:05,383 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-90962625-22832518 to be up.. 2025-12-04 03:45:05,480 - DEBUG - VM is in ACTIVE state now 2025-12-04 03:45:05,480 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-90962625-22832518 2025-12-04 03:45:05,579 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-22832518 ID is 53055728-24b2-4065-9963-58149ed8039e 2025-12-04 03:45:05,580 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-22832518 launched on Node an-jenkins-deploy-platform-ansible-os-4840-1 2025-12-04 03:45:05,678 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/53055728-24b2-4065-9963-58149ed8039e 2025-12-04 03:45:05,690 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/714b95cc-00c7-4967-b6a6-5e0c11ee2d3f 2025-12-04 03:45:06,865 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.23 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.600 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.600/1.915/3.231/1.315 ms') 2025-12-04 03:45:06,865 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-90962625-22832518 passed 2025-12-04 03:45:06,942 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:45:06,942 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-90962625-22832518, IP 24ed:dcf4:393f:acfe:2b32:7727:0:6, Port 22 2025-12-04 03:45:07,110 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-90962625-22832518 is ready for SSH connections 2025-12-04 03:45:07,181 - INFO - Policy DISABLED on VMI 714b95cc-00c7-4967-b6a6-5e0c11ee2d3f 2025-12-04 03:45:07,181 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 03:45:07,181 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 24ed:dcf4:393f:acfe:2b32:7727:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:45:07,182 - DEBUG - ifconfig -a| grep 24ed:dcf4:393f:acfe:2b32:7727:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1 2025-12-04 03:45:52,200 - DEBUG - eth0 2025-12-04 03:45:52,200 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:45:52,200 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0 2025-12-04 03:45:52,801 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0 2025-12-04 03:45:53,033 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-90962625', 'ctest-intf-rtb-55271698'](UUID 80924a55-e939-4e60-8c08-7e2511f785a7), prefixes : ['3937:b1ae:bcf5:95cc:26c8:234a::/96'] 2025-12-04 03:45:53,105 - INFO - Added intf route table 80924a55-e939-4e60-8c08-7e2511f785a7 to port 714b95cc-00c7-4967-b6a6-5e0c11ee2d3f 2025-12-04 03:45:53,105 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:45:53,105 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1 2025-12-04 03:45:53,582 - DEBUG - eth0 2025-12-04 03:45:53,582 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:45:53,582 - DEBUG - ifconfig eth0 inet6 add 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 2025-12-04 03:45:54,191 - DEBUG - None 2025-12-04 03:45:54,191 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:45:54,191 - DEBUG - ifconfig -a 2025-12-04 03:45:54,827 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:71:4b:95:cc:00 inet addr:54.183.36.70 Bcast:54.183.36.127 Mask:255.255.255.192 inet6 addr: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0/128 Scope:Global inet6 addr: 24ed:dcf4:393f:acfe:2b32:7727:0:6/64 Scope:Global inet6 addr: fe80::71:4bff:fe95:cc00/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:597 errors:0 dropped:0 overruns:0 frame:0 TX packets:526 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:53237 (53.2 KB) TX bytes:44781 (44.7 KB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:16436 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) 2025-12-04 03:45:54,827 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-90962625-67696173 2025-12-04 03:45:54,997 - INFO - Removed intf route table 0d17a338-02d6-46f0-b6b1-833db7be5d57 from port fd08f1d7-28aa-448e-96c0-de6727f71082 2025-12-04 03:45:55,029 - INFO - Deleted Interface route table 0d17a338-02d6-46f0-b6b1-833db7be5d57 2025-12-04 03:45:55,048 - INFO - ECMP routes found in agent 10.0.0.130, for prefix 3937:b1ae:bcf5:95cc:26c8:234a::/96 2025-12-04 03:45:55,050 - INFO - Tap interface tape58d02c8-ef found in ecmp routes in agent 10.0.0.130 2025-12-04 03:45:55,067 - INFO - ECMP routes found in agent 10.0.0.22, for prefix 3937:b1ae:bcf5:95cc:26c8:234a::/96 2025-12-04 03:45:55,067 - INFO - Tap interface tap714b95cc-00 found in ecmp routes in agent 10.0.0.22 2025-12-04 03:45:55,176 - DEBUG - Executing command: sudo tcpdump -nni tape58d02c8-ef -U '(udp and src host 24ed:dcf4:393f:acfe:2b32:7727:0:3 and dst host 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 and dst port 11000)' -w /tmp/tape58d02c8-ef_ctest-random-37204140.pcap 2025-12-04 03:45:55,773 - DEBUG - Executing command: sudo tcpdump -nni tap714b95cc-00 -U '(udp and src host 24ed:dcf4:393f:acfe:2b32:7727:0:3 and dst host 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 and dst port 11000)' -w /tmp/tap714b95cc-00_ctest-random-42346731.pcap 2025-12-04 03:45:55,867 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 59239 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 03:45:55,867 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 59239 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0 11000 < icmp_error 2025-12-04 03:45:58,572 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00123994 s, 80.6 kB/s 2025-12-04 03:45:58,572 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:45:58,588 - DEBUG - STDOUT: 0 2025-12-04 03:45:58,588 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:45:58,589 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:00,589 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:46:00,606 - DEBUG - STDOUT: 0 2025-12-04 03:46:00,606 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:00,606 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:02,606 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:46:02,623 - DEBUG - STDOUT: 0 2025-12-04 03:46:02,624 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:02,624 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:04,625 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:46:04,641 - DEBUG - STDOUT: 0 2025-12-04 03:46:04,641 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:04,641 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:06,642 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:46:06,659 - DEBUG - STDOUT: 0 2025-12-04 03:46:06,659 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:06,659 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:08,659 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:46:08,676 - DEBUG - STDOUT: 0 2025-12-04 03:46:08,676 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:08,676 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:10,677 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tape58d02c8-ef_ctest-random-37204140.pcap | grep -c length 2025-12-04 03:46:10,694 - DEBUG - STDOUT: 0 2025-12-04 03:46:10,694 - DEBUG - STDERR: reading from file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:10,694 - WARNING - No packets are found in tcpdump output file /tmp/tape58d02c8-ef_ctest-random-37204140.pcap but expected some packets 2025-12-04 03:46:10,694 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap714b95cc-00_ctest-random-42346731.pcap | grep -c length 2025-12-04 03:46:10,708 - DEBUG - STDOUT: 1 2025-12-04 03:46:10,708 - DEBUG - STDERR: reading from file /tmp/tap714b95cc-00_ctest-random-42346731.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-12-04 03:46:10,709 - INFO - 1 packets are found in tcpdump output as expected 2025-12-04 03:46:10,709 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-04 03:46:12,754 - INFO - Tcpdump verification on VM 24ed:dcf4:393f:acfe:2b32:7727:0:6 passed 2025-12-04 03:46:13,086 - DEBUG - Forward and reverse flows for match {'sip': '24ed:dcf4:393f:acfe:2b32:7727:0:3', 'dip': '3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0', 'sport': '59239', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0 2025-12-04 03:46:13,087 - DEBUG - Flow verification PASSED on node: 10.0.0.22 for VMs - Sender: 24ed:dcf4:393f:acfe:2b32:7727:0:3, Receiver: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, Flow count expected: 0 0, got: 0 0 2025-12-04 03:46:13,087 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-04 03:46:15,096 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2025-12-04 03:46:17,418 - DEBUG - Forward and reverse flows for match {'sip': '24ed:dcf4:393f:acfe:2b32:7727:0:3', 'dip': '3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0', 'sport': '59239', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0 2025-12-04 03:46:17,418 - DEBUG - Flow verification PASSED on node: 10.0.0.22 for VMs - Sender: 24ed:dcf4:393f:acfe:2b32:7727:0:3, Receiver: 3937:b1ae:bcf5:95cc:26c8:234a:9d3:84a0, Flow count expected: 0 0, got: 0 0 2025-12-04 03:46:17,418 - INFO - Traffic verification for ECMP passed 2025-12-04 03:46:17,418 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-90962625-22832518 2025-12-04 03:46:17,621 - INFO - Removed intf route table 80924a55-e939-4e60-8c08-7e2511f785a7 from port 714b95cc-00c7-4967-b6a6-5e0c11ee2d3f 2025-12-04 03:46:17,691 - INFO - Deleted Interface route table 80924a55-e939-4e60-8c08-7e2511f785a7 2025-12-04 03:46:17,691 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-90962625-62811649 2025-12-04 03:46:17,857 - INFO - Removed intf route table 92f1f793-59f6-494c-a75d-97cadea331a6 from port e58d02c8-ef9c-4511-8300-3d18633d3a2d 2025-12-04 03:46:17,893 - INFO - Deleted Interface route table 92f1f793-59f6-494c-a75d-97cadea331a6 2025-12-04 03:46:17,893 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-90962625-81104308 2025-12-04 03:46:18,020 - INFO - Deleting VN ctest-vn-26029671 2025-12-04 03:46:18,166 - DEBUG - VN b9fb2ea5-a930-4797-a63c-48d77d72c4b1 still in use: Unable to complete operation on network b9fb2ea5-a930-4797-a63c-48d77d72c4b1. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-65984ddb-f030-4cb2-9cd3-394ed090cb92'] 2025-12-04 03:46:18,166 - WARNING - Deleting VN ctest-vn-26029671 failed..Will retry 2025-12-04 03:46:20,422 - DEBUG - Response for deleting network () 2025-12-04 03:46:20,422 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9cd7f145-f834-4106-8fbe-6b404bcc3c0b 2025-12-04 03:46:20,496 - DEBUG - Response Code: 404 2025-12-04 03:46:20,496 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:46:20,503 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:46:20,565 - DEBUG - Requesting: http://10.0.0.27:8082/project/f5b23be0-2267-4f0b-a3a0-96f88cf6670a 2025-12-04 03:46:20,676 - INFO - Validated that VN ctest-vn-26029671 is not found in API Server 2025-12-04 03:46:20,687 - DEBUG - VN ctest-vn-26029671 is not present in Agent 10.0.0.22 2025-12-04 03:46:20,700 - DEBUG - VN ctest-vn-26029671 is not present in Agent 10.0.0.130 2025-12-04 03:46:20,700 - INFO - Validated that VN ctest-vn-26029671 is not in any agent 2025-12-04 03:46:20,731 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-26029671 info 2025-12-04 03:46:22,002 - DEBUG - No XMPP flaps were noticed during the test
2025-12-04 03:46:22,002 - INFO - END TEST : test_ecmp_with_static_routes : PASSED[0:05:22]
2025-12-04 03:46:22,002 - INFO - -------------------------------------------------------------------------------- 2025-12-04 03:46:22,842 - INFO - Deleted project: ctest-DisablePolicyEcmpIpv6-90962625, ID : f5b23be0-2267-4f0b-a3a0-96f88cf6670a