2025-08-06 14:32:57,477 - INFO - Domain Default found not creating 2025-08-06 14:32:57,613 - INFO - Project ctest-TestDSNAT-51340794 not found, creating it 2025-08-06 14:32:58,236 - INFO - Created Project:ctest-TestDSNAT-51340794, ID : 54706761-a629-49a2-8947-d6f192911fba 2025-08-06 14:32:59,686 - INFO - ================================================================================ 2025-08-06 14:32:59,686 - INFO - STARTING TEST : test_dsnat_basic 2025-08-06 14:32:59,686 - INFO - TEST DESCRIPTION : create a VN and enable fabric SNAT launch two VMs in that VN verify ping between the VN and ping to the external IP disable fabric SNAT verify that the ping the external IP fails 2025-08-06 14:33:01,002 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2025-08-06 14:33:01,002 - INFO - Initial checks done. Running the testcase now 2025-08-06 14:33:01,002 - INFO - 2025-08-06 14:33:01,002 - INFO - Create VN, enable FABRIC SNAT and verify its routing instance 2025-08-06 14:33:01,717 - DEBUG - Response for create_network : {'network': {'id': '1d43bc46-7f48-4c3b-8829-3c6467466ae5', 'name': 'ctest-dsnat_vn-23404593', 'tenant_id': '54706761a62949a28947d6f192911fba', 'project_id': '54706761a62949a28947d6f192911fba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDSNAT-51340794', 'ctest-dsnat_vn-23404593'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 14:33:01,973 - DEBUG - Response for create_subnet : {'subnet': {'id': '2d7ab6fc-1dbb-4758-9f05-507bc870daaa', 'name': '', 'tenant_id': '54706761a62949a28947d6f192911fba', 'network_id': '1d43bc46-7f48-4c3b-8829-3c6467466ae5', 'ip_version': 4, 'cidr': '190.223.98.0/26', 'allocation_pools': [{'start': '190.223.98.2', 'end': '190.223.98.62'}], 'gateway_ip': '190.223.98.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.223.98.2', 'tags': [], 'project_id': '54706761a62949a28947d6f192911fba'}} 2025-08-06 14:33:01,995 - INFO - Created VN ctest-dsnat_vn-23404593 2025-08-06 14:33:02,008 - DEBUG - VN ctest-dsnat_vn-23404593 UUID is 1d43bc46-7f48-4c3b-8829-3c6467466ae5 2025-08-06 14:33:02,190 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1d43bc46-7f48-4c3b-8829-3c6467466ae5 2025-08-06 14:33:02,493 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/1d43bc46-7f48-4c3b-8829-3c6467466ae5 2025-08-06 14:33:02,535 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0e255af6-6970-410d-b071-b0f5e4c11926 2025-08-06 14:33:02,676 - DEBUG - Services list from nova: [, , , ] 2025-08-06 14:33:02,699 - DEBUG - Image by name ubuntu not found 2025-08-06 14:33:02,699 - DEBUG - Installing image ubuntu 2025-08-06 14:33:02,699 - DEBUG - Image info {'name': 'ubuntu-traffic.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_small', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'ubuntu-traffic-docker', 'vmdk': 'ubuntu-traffic-disk1.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-06 14:33:02,700 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz 2025-08-06 14:33:02,700 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz 2025-08-06 14:33:02,709 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz -O /contrail-test/images/ubuntu-traffic.vmdk.gz 2025-08-06 14:33:07,910 - DEBUG - Image has been downloaded to /contrail-test/images/ubuntu-traffic.vmdk.gz 2025-08-06 14:33:07,937 - DEBUG - Unzip image 2025-08-06 14:33:07,937 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu-traffic.vmdk.gz 2025-08-06 14:33:25,715 - DEBUG - Try to create image in user context 2025-08-06 14:33:36,270 - DEBUG - Image has been created in user context 2025-08-06 14:33:36,270 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/ubuntu-traffic.vmdk 2025-08-06 14:33:36,462 - DEBUG - Downloaded image has been removed 2025-08-06 14:33:36,476 - DEBUG - Uploaded image status = active 2025-08-06 14:33:37,606 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-1) 2025-08-06 14:33:39,007 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-2) 2025-08-06 14:33:39,008 - INFO - Waiting for VM ctest-test_vm1-47224939 to be up.. 2025-08-06 14:33:39,118 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:33:44,243 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:33:49,352 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:33:54,432 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:33:59,517 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:34:04,602 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:34:09,687 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:34:14,778 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:34:19,885 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:34:24,961 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:34:30,050 - DEBUG - VM is in ACTIVE state now 2025-08-06 14:34:30,051 - INFO - VM name : ctest-test_vm1-47224939 2025-08-06 14:34:30,127 - DEBUG - VM ctest-test_vm1-47224939 ID is 9620914c-b3b6-44ed-abc8-00950860bd03 2025-08-06 14:34:30,156 - DEBUG - VM ctest-test_vm1-47224939 launched on Node an-jenkins-deploy-platform-ansible-os-3763-1 2025-08-06 14:34:30,241 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/9620914c-b3b6-44ed-abc8-00950860bd03 2025-08-06 14:34:30,619 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/9620914c-b3b6-44ed-abc8-00950860bd03 2025-08-06 14:34:30,675 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/7d9e1779-5879-4caa-af37-9bb882f1305a 2025-08-06 14:34:33,904 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-06 14:34:33,904 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:33,919 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:34:37,993 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 14:34:37,993 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:38,014 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:34:42,091 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-06 14:34:42,091 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:42,108 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:34:46,192 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-06 14:34:46,193 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:46,207 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:34:50,286 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-06 14:34:50,287 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:50,301 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:34:54,383 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-06 14:34:54,384 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:54,399 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:34:58,477 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 14:34:58,478 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:34:58,498 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:35:02,570 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-08-06 14:35:02,570 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:35:02,596 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:35:06,671 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-06 14:35:06,672 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 failed! 2025-08-06 14:35:06,688 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-23404593 is 190.223.98.1 and allocation pool is NOT set 2025-08-06 14:35:08,760 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.678 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.678/4.828/8.979/4.150 ms') 2025-08-06 14:35:08,760 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm1-47224939 passed 2025-08-06 14:35:08,876 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:08,876 - DEBUG - Waiting to SSH to VM ctest-test_vm1-47224939, IP 190.223.98.3, Port 22 2025-08-06 14:35:08,931 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:35:09,025 - DEBUG - VM ctest-test_vm1-47224939 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:35:14,026 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:14,026 - DEBUG - Waiting to SSH to VM ctest-test_vm1-47224939, IP 190.223.98.3, Port 22 2025-08-06 14:35:14,093 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:35:14,214 - DEBUG - VM ctest-test_vm1-47224939 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:35:19,214 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:19,215 - DEBUG - Waiting to SSH to VM ctest-test_vm1-47224939, IP 190.223.98.3, Port 22 2025-08-06 14:35:19,281 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:35:19,363 - DEBUG - VM ctest-test_vm1-47224939 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:35:24,364 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:24,365 - DEBUG - Waiting to SSH to VM ctest-test_vm1-47224939, IP 190.223.98.3, Port 22 2025-08-06 14:35:24,434 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:35:24,522 - DEBUG - VM ctest-test_vm1-47224939 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:35:29,523 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:29,523 - DEBUG - Waiting to SSH to VM ctest-test_vm1-47224939, IP 190.223.98.3, Port 22 2025-08-06 14:35:29,693 - DEBUG - VM ctest-test_vm1-47224939 is ready for SSH connections 2025-08-06 14:35:29,693 - INFO - Waiting for VM ctest-test_vm2-22308631 to be up.. 2025-08-06 14:35:29,803 - DEBUG - VM is in ACTIVE state now 2025-08-06 14:35:29,803 - INFO - VM name : ctest-test_vm2-22308631 2025-08-06 14:35:29,902 - DEBUG - VM ctest-test_vm2-22308631 ID is dbf39e41-a0ed-4171-a950-e8fd88b1164a 2025-08-06 14:35:29,902 - DEBUG - VM ctest-test_vm2-22308631 launched on Node an-jenkins-deploy-platform-ansible-os-3763-2 2025-08-06 14:35:29,993 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/dbf39e41-a0ed-4171-a950-e8fd88b1164a 2025-08-06 14:35:30,004 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/4112df9b-bb6e-4f50-9043-61264a294e3a 2025-08-06 14:35:31,217 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.80 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.43 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 3.426/4.613/5.800/1.187 ms') 2025-08-06 14:35:31,217 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-test_vm2-22308631 passed 2025-08-06 14:35:31,333 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:31,333 - DEBUG - Waiting to SSH to VM ctest-test_vm2-22308631, IP 190.223.98.4, Port 22 2025-08-06 14:35:31,401 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:35:31,485 - DEBUG - VM ctest-test_vm2-22308631 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:35:36,486 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:36,487 - DEBUG - Waiting to SSH to VM ctest-test_vm2-22308631, IP 190.223.98.4, Port 22 2025-08-06 14:35:36,554 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:35:36,651 - DEBUG - VM ctest-test_vm2-22308631 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:35:41,652 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:41,652 - DEBUG - Waiting to SSH to VM ctest-test_vm2-22308631, IP 190.223.98.4, Port 22 2025-08-06 14:35:41,827 - DEBUG - VM ctest-test_vm2-22308631 is ready for SSH connections 2025-08-06 14:35:41,847 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:35:41,848 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 190.223.98.4, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:35:41,848 - DEBUG - ping -s 56 -c 3 -W 1 190.223.98.4 2025-08-06 14:36:31,959 - DEBUG - PING 190.223.98.4 (190.223.98.4) 56(84) bytes of data. 64 bytes from 190.223.98.4: icmp_req=1 ttl=64 time=11.2 ms 64 bytes from 190.223.98.4: icmp_req=2 ttl=64 time=1.41 ms 64 bytes from 190.223.98.4: icmp_req=3 ttl=64 time=1.21 ms --- 190.223.98.4 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.211/4.615/11.226/4.675 ms 2025-08-06 14:36:31,959 - INFO - Ping to IP 190.223.98.4 from VM ctest-test_vm1-47224939 passed 2025-08-06 14:36:31,959 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:31,959 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:36:35,477 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:36:35,477 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:36:36,478 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:36,478 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:36:39,951 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:36:39,951 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:36:40,952 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:40,952 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:36:44,429 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:36:44,429 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:36:45,430 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:45,430 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:36:48,914 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2000ms 2025-08-06 14:36:48,915 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:36:49,915 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:49,915 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:36:53,450 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:36:53,450 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:36:54,451 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:54,451 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:36:57,971 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2000ms 2025-08-06 14:36:57,972 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:36:58,973 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:36:58,973 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:37:02,558 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:37:02,558 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:37:03,559 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:37:03,559 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:37:07,084 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2017ms 2025-08-06 14:37:07,084 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:37:08,085 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:37:08,085 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:37:11,599 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:37:11,599 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:37:12,600 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:37:12,600 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:37:16,106 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:37:16,107 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:37:17,108 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:37:17,108 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:37:20,583 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:37:20,583 - WARNING - Ping to IP 10.20.0.254 from VM ctest-test_vm1-47224939 failed 2025-08-06 14:37:20,585 - INFO - Deleting VM ctest-test_vm2-22308631 2025-08-06 14:37:20,665 - INFO - Deleting VM ctest-test_vm1-47224939 2025-08-06 14:37:20,755 - INFO - Deleting VN ctest-dsnat_vn-23404593 2025-08-06 14:37:20,798 - DEBUG - VN 1d43bc46-7f48-4c3b-8829-3c6467466ae5 still in use: Unable to complete operation on network 1d43bc46-7f48-4c3b-8829-3c6467466ae5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-bc2c2a37-6c8c-4ffb-b84b-9013cb178d45'] 2025-08-06 14:37:20,798 - WARNING - Deleting VN ctest-dsnat_vn-23404593 failed..Will retry 2025-08-06 14:37:22,989 - DEBUG - Response for deleting network () 2025-08-06 14:37:24,260 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Wed Aug 6 14:37:20 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/dsnat/test_dsnat.py in test_dsnat_basic(self=) 35 #with DSNAT enabled on VN, verify the ping to the external IP 36 cfgm_ip = self.inputs.get_host_data_ip(self.inputs.cfgm_names[0]) 37 assert test_vm1.ping_with_certainty(cfgm_ip) 38 39 self.logger.info("disable fabric SNAT, and verify the ping to the external IP and inter VN") test_vm1 = test_vm1.ping_with_certainty = .deco_retry..f_retry of > cfgm_ip = '10.20.0.254' AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/dsnat/test_dsnat.py", line 37, in test_dsnat_basic assert test_vm1.ping_with_certainty(cfgm_ip) AssertionError 2025-08-06 14:37:24,280 - DEBUG - No XMPP flaps were noticed during the test 2025-08-06 14:37:24,280 - INFO -
2025-08-06 14:37:24,280 - INFO - END TEST : test_dsnat_basic : FAILED[0:04:25]
2025-08-06 14:37:24,280 - INFO - -------------------------------------------------------------------------------- 2025-08-06 14:37:24,283 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3763-1', 'an-jenkins-deploy-platform-ansible-os-3763-2']} 2025-08-06 14:37:24,284 - INFO - ================================================================================ 2025-08-06 14:37:24,284 - INFO - STARTING TEST : test_dsnat_bug_1749695 2025-08-06 14:37:24,284 - INFO - TEST DESCRIPTION : Testcase to verify the bug 1749695 create test VN , associate a policy to allow all traffic between VN and ip fabric associate the policy to the test VN and fabric VN set the test VN fabric mode as l3 verify the ping succeeds for intra VN and to the fabric IP 2025-08-06 14:37:25,550 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2025-08-06 14:37:25,550 - INFO - Initial checks done. Running the testcase now 2025-08-06 14:37:25,551 - INFO - 2025-08-06 14:37:25,551 - INFO - Create VN, enable FABRIC SNAT and verify its routing instance 2025-08-06 14:37:25,862 - DEBUG - Response for create_network : {'network': {'id': '2ba8f1bb-bd47-47a1-b883-f2e51ce3727b', 'name': 'ctest-dsnat_vn-40206168', 'tenant_id': '54706761a62949a28947d6f192911fba', 'project_id': '54706761a62949a28947d6f192911fba', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDSNAT-51340794', 'ctest-dsnat_vn-40206168'], 'port_security_enabled': True, 'description': ''}} 2025-08-06 14:37:26,084 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a6f279e-49a9-4e2b-a3bd-976addad15ad', 'name': '', 'tenant_id': '54706761a62949a28947d6f192911fba', 'network_id': '2ba8f1bb-bd47-47a1-b883-f2e51ce3727b', 'ip_version': 4, 'cidr': '5.219.11.0/26', 'allocation_pools': [{'start': '5.219.11.2', 'end': '5.219.11.62'}], 'gateway_ip': '5.219.11.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.219.11.2', 'tags': [], 'project_id': '54706761a62949a28947d6f192911fba'}} 2025-08-06 14:37:26,121 - INFO - Created VN ctest-dsnat_vn-40206168 2025-08-06 14:37:26,136 - DEBUG - VN ctest-dsnat_vn-40206168 UUID is 2ba8f1bb-bd47-47a1-b883-f2e51ce3727b 2025-08-06 14:37:26,334 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2ba8f1bb-bd47-47a1-b883-f2e51ce3727b 2025-08-06 14:37:26,358 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7129c7b2-7f4a-47a9-b522-f7147d9f2888 2025-08-06 14:37:26,526 - DEBUG - Image by name ubuntu-traffic not found 2025-08-06 14:37:26,526 - DEBUG - Installing image ubuntu-traffic 2025-08-06 14:37:26,526 - DEBUG - Image info {'name': 'ubuntu-traffic.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_small', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'ubuntu-traffic-docker', 'vmdk': 'ubuntu-traffic-disk1.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-06 14:37:26,527 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz 2025-08-06 14:37:26,527 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz 2025-08-06 14:37:26,543 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//ubuntu-traffic.vmdk.gz -O /contrail-test/images/ubuntu-traffic.vmdk.gz 2025-08-06 14:37:31,740 - DEBUG - Image has been downloaded to /contrail-test/images/ubuntu-traffic.vmdk.gz 2025-08-06 14:37:31,741 - DEBUG - Unzip image 2025-08-06 14:37:31,741 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu-traffic.vmdk.gz 2025-08-06 14:37:47,451 - DEBUG - Try to create image in user context 2025-08-06 14:37:58,273 - DEBUG - Image has been created in user context 2025-08-06 14:37:58,273 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/ubuntu-traffic.vmdk 2025-08-06 14:37:58,451 - DEBUG - Downloaded image has been removed 2025-08-06 14:37:58,465 - DEBUG - Uploaded image status = active 2025-08-06 14:37:59,675 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-1) 2025-08-06 14:38:01,320 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3763-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3763-2) 2025-08-06 14:38:01,320 - INFO - Waiting for VM ctest-TestDSNAT-51340794-56179140 to be up.. 2025-08-06 14:38:01,420 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:06,544 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:11,662 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:16,743 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:21,839 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:26,926 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:32,054 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:37,175 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:42,262 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:47,374 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:52,452 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-06 14:38:57,558 - DEBUG - VM is in ACTIVE state now 2025-08-06 14:38:57,558 - INFO - VM name : ctest-TestDSNAT-51340794-56179140 2025-08-06 14:38:57,653 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 ID is 063de639-43a6-4118-9b04-9b0319795f55 2025-08-06 14:38:57,654 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 launched on Node an-jenkins-deploy-platform-ansible-os-3763-1 2025-08-06 14:38:57,731 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/063de639-43a6-4118-9b04-9b0319795f55 2025-08-06 14:38:57,742 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/30bfcb0b-3d73-41a9-bfb2-127d9327d73a 2025-08-06 14:39:01,003 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-06 14:39:01,003 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:01,022 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:05,106 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-06 14:39:05,106 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:05,124 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:09,201 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-08-06 14:39:09,201 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:09,217 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:13,291 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-06 14:39:13,291 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:13,308 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:17,391 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-06 14:39:17,391 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:17,410 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:21,485 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-08-06 14:39:21,485 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:21,501 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:25,586 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-06 14:39:25,586 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:25,601 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:29,674 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-06 14:39:29,675 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:29,689 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:33,768 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-06 14:39:33,768 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 failed! 2025-08-06 14:39:33,787 - DEBUG - Gateway for vn default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168 is 5.219.11.1 and allocation pool is NOT set 2025-08-06 14:39:35,868 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=18.2 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.25 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.254/10.737/18.220/7.483 ms') 2025-08-06 14:39:35,868 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-56179140 passed 2025-08-06 14:39:35,985 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:39:35,985 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-56179140, IP 5.219.11.3, Port 22 2025-08-06 14:39:36,054 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:39:36,140 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:39:41,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:39:41,141 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-56179140, IP 5.219.11.3, Port 22 2025-08-06 14:39:41,209 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:39:41,305 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:39:46,306 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:39:46,306 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-56179140, IP 5.219.11.3, Port 22 2025-08-06 14:39:46,377 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:39:46,462 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:39:51,463 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:39:51,463 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-56179140, IP 5.219.11.3, Port 22 2025-08-06 14:39:51,530 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:39:51,618 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:39:56,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:39:56,620 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-56179140, IP 5.219.11.3, Port 22 2025-08-06 14:39:56,790 - DEBUG - VM ctest-TestDSNAT-51340794-56179140 is ready for SSH connections 2025-08-06 14:39:56,790 - INFO - Waiting for VM ctest-TestDSNAT-51340794-02011663 to be up.. 2025-08-06 14:39:56,878 - DEBUG - VM is in ACTIVE state now 2025-08-06 14:39:56,878 - INFO - VM name : ctest-TestDSNAT-51340794-02011663 2025-08-06 14:39:56,960 - DEBUG - VM ctest-TestDSNAT-51340794-02011663 ID is 211c2762-47f8-40c3-ac14-cd0b0975f807 2025-08-06 14:39:56,960 - DEBUG - VM ctest-TestDSNAT-51340794-02011663 launched on Node an-jenkins-deploy-platform-ansible-os-3763-2 2025-08-06 14:39:57,040 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine/211c2762-47f8-40c3-ac14-cd0b0975f807 2025-08-06 14:39:57,071 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-machine-interface/03c84f9b-62c3-40af-af00-047e06be3c29 2025-08-06 14:39:58,287 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.10 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.17 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.167/3.631/6.096/2.464 ms') 2025-08-06 14:39:58,288 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestDSNAT-51340794-02011663 passed 2025-08-06 14:39:58,401 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:39:58,401 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-02011663, IP 5.219.11.4, Port 22 2025-08-06 14:39:58,470 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:39:58,553 - DEBUG - VM ctest-TestDSNAT-51340794-02011663 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:40:03,554 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:40:03,554 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-02011663, IP 5.219.11.4, Port 22 2025-08-06 14:40:03,621 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-06 14:40:03,703 - DEBUG - VM ctest-TestDSNAT-51340794-02011663 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-06 14:40:08,705 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-06 14:40:08,705 - DEBUG - Waiting to SSH to VM ctest-TestDSNAT-51340794-02011663, IP 5.219.11.4, Port 22 2025-08-06 14:40:08,874 - DEBUG - VM ctest-TestDSNAT-51340794-02011663 is ready for SSH connections 2025-08-06 14:40:09,026 - DEBUG - Fetched VN: default-domain:default-project:ip-fabric(d79d1393-3b5a-4e52-903a-07ed259164dc) with subnets None 2025-08-06 14:40:09,074 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestDSNAT-51340794:ctest-dsnat_vn-40206168, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:default-project:ip-fabric, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-06 14:40:09,414 - INFO - Attaching policy ctest-test-dsnat-04037555 to vn ctest-dsnat_vn-40206168 2025-08-06 14:40:09,966 - INFO - Attaching policy ctest-test-dsnat-04037555 to vn ip-fabric 2025-08-06 14:40:10,234 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:40:10,234 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:40:59,815 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2001ms 2025-08-06 14:40:59,815 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:00,815 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:00,816 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:04,376 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2000ms 2025-08-06 14:41:04,376 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:05,376 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:05,377 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:08,891 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:41:08,891 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:09,892 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:09,892 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:13,395 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2015ms 2025-08-06 14:41:13,395 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:14,396 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:14,396 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:17,893 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:41:17,893 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:18,894 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:18,894 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:22,417 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:41:22,417 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:23,418 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:23,419 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:26,910 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:41:26,910 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:27,911 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:27,912 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:31,423 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2016ms 2025-08-06 14:41:31,423 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:32,424 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:32,424 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:35,926 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2000ms 2025-08-06 14:41:35,927 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:36,927 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:36,928 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:40,388 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2000ms 2025-08-06 14:41:40,388 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:41,388 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 10.20.0.254, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-08-06 14:41:41,389 - DEBUG - ping -s 56 -c 3 -W 1 10.20.0.254 2025-08-06 14:41:44,911 - DEBUG - PING 10.20.0.254 (10.20.0.254) 56(84) bytes of data. --- 10.20.0.254 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 1999ms 2025-08-06 14:41:44,911 - WARNING - Ping to IP 10.20.0.254 from VM ctest-TestDSNAT-51340794-56179140 failed 2025-08-06 14:41:44,913 - INFO - Dettaching policy ctest-test-dsnat-04037555 from vn ip-fabric 2025-08-06 14:41:45,141 - INFO - Dettaching policy ctest-test-dsnat-04037555 from vn ctest-dsnat_vn-40206168 2025-08-06 14:41:45,478 - INFO - Deleted policy ctest-test-dsnat-04037555 2025-08-06 14:41:45,479 - INFO - Deleting VM ctest-TestDSNAT-51340794-02011663 2025-08-06 14:41:45,626 - INFO - Deleting VM ctest-TestDSNAT-51340794-56179140 2025-08-06 14:41:45,741 - INFO - Deleting VN ctest-dsnat_vn-40206168 2025-08-06 14:41:45,792 - DEBUG - VN 2ba8f1bb-bd47-47a1-b883-f2e51ce3727b still in use: Unable to complete operation on network 2ba8f1bb-bd47-47a1-b883-f2e51ce3727b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1be30740-a93f-4a9d-a8fc-f3aff1dfe337'] 2025-08-06 14:41:45,792 - WARNING - Deleting VN ctest-dsnat_vn-40206168 failed..Will retry 2025-08-06 14:41:48,017 - DEBUG - Response for deleting network () 2025-08-06 14:41:49,310 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Wed Aug 6 14:41:44 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/dsnat/test_dsnat.py in test_dsnat_bug_1749695(self=) 319 self.attach_policy_to_vn(policy_fix, fabric_vn) 320 assert vm1_fixture.ping_with_certainty(cfgm_ip), ( 321 'Ping to external IP failed with allow-any-policy') 322 323 #set VN forwarding mode as l3 and verify AssertionError: Ping to external IP failed with allow-any-policy __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('Ping to external IP failed with allow-any-policy',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/dsnat/test_dsnat.py", line 321, in test_dsnat_bug_1749695 'Ping to external IP failed with allow-any-policy') AssertionError: Ping to external IP failed with allow-any-policy 2025-08-06 14:41:49,325 - DEBUG - No XMPP flaps were noticed during the test 2025-08-06 14:41:49,325 - INFO -
2025-08-06 14:41:49,325 - INFO - END TEST : test_dsnat_bug_1749695 : FAILED[0:04:25]
2025-08-06 14:41:49,326 - INFO - -------------------------------------------------------------------------------- 2025-08-06 14:41:50,219 - INFO - Deleted project: ctest-TestDSNAT-51340794, ID : 54706761-a629-49a2-8947-d6f192911fba