The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/static_route_table/test_static_tables.py", line 37, in test_interface_static_table
self.left_vm_fixture, self.right_vm_fixture, 'udp', sport=sport, dport=dport)
File "/contrail-test/common/base.py", line 814, in verify_traffic
return self.stop_traffic(traffic_obj, expectation)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 213.17.24.67 and 49.160.6.195, proto udp sport 8001 and dport 9001
2025-08-06 08:37:10,333 - DEBUG - No XMPP flaps were noticed during the test
2025-08-06 08:37:10,333 - INFO -
2025-08-06 08:37:10,333 - INFO - END TEST : test_interface_static_table : FAILED[0:04:08]
2025-08-06 08:37:10,333 - INFO - --------------------------------------------------------------------------------
2025-08-06 08:37:10,339 - INFO - ================================================================================
2025-08-06 08:37:10,339 - INFO - STARTING TEST : test_network_route_table
2025-08-06 08:37:10,340 - INFO - TEST DESCRIPTION :
Description: Validate network static table
Test steps:
1. Creating vm's - vm1 and vm2 and middle vm in networks vn1 and vn2.
2. Creating network static table betn left and right vm
3. Apply static table to the middle ports.
4. Checking for ping and tcp traffic between vm1 and vm2.
Pass criteria: Ping between the VMs should be successful and route should be in the agent
2025-08-06 08:37:11,609 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.57': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-08-06 08:37:11,609 - INFO - Initial checks done. Running the testcase now
2025-08-06 08:37:11,610 - INFO -
2025-08-06 08:37:11,905 - DEBUG - Response for create_network : {'network': {'id': 'ee7ee68d-a823-4a6b-9334-13186ef22927', 'name': 'ctest-vn-11825774', 'tenant_id': '3732fbac4ac8402a9373cde9ee3ed5d0', 'project_id': '3732fbac4ac8402a9373cde9ee3ed5d0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestStaticRouteTables-49553622', 'ctest-vn-11825774'], 'port_security_enabled': True, 'description': ''}}
2025-08-06 08:37:12,178 - DEBUG - Response for create_subnet : {'subnet': {'id': '617e489e-f115-4778-8597-4f56a84c1dd9', 'name': '', 'tenant_id': '3732fbac4ac8402a9373cde9ee3ed5d0', 'network_id': 'ee7ee68d-a823-4a6b-9334-13186ef22927', 'ip_version': 4, 'cidr': '176.211.163.64/26', 'allocation_pools': [{'start': '176.211.163.66', 'end': '176.211.163.126'}], 'gateway_ip': '176.211.163.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '176.211.163.66', 'tags': [], 'project_id': '3732fbac4ac8402a9373cde9ee3ed5d0'}}
2025-08-06 08:37:12,202 - INFO - Created VN ctest-vn-11825774
2025-08-06 08:37:12,215 - DEBUG - VN ctest-vn-11825774 UUID is ee7ee68d-a823-4a6b-9334-13186ef22927
2025-08-06 08:37:12,682 - DEBUG - Response for create_network : {'network': {'id': '5aeadaa8-d936-40d3-90d1-6fc723e251b3', 'name': 'ctest-vn-29752053', 'tenant_id': '3732fbac4ac8402a9373cde9ee3ed5d0', 'project_id': '3732fbac4ac8402a9373cde9ee3ed5d0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestStaticRouteTables-49553622', 'ctest-vn-29752053'], 'port_security_enabled': True, 'description': ''}}
2025-08-06 08:37:12,911 - DEBUG - Response for create_subnet : {'subnet': {'id': '7065707e-c7f9-466c-bf28-a379defb4a69', 'name': '', 'tenant_id': '3732fbac4ac8402a9373cde9ee3ed5d0', 'network_id': '5aeadaa8-d936-40d3-90d1-6fc723e251b3', 'ip_version': 4, 'cidr': '199.78.217.64/26', 'allocation_pools': [{'start': '199.78.217.66', 'end': '199.78.217.126'}], 'gateway_ip': '199.78.217.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '199.78.217.66', 'tags': [], 'project_id': '3732fbac4ac8402a9373cde9ee3ed5d0'}}
2025-08-06 08:37:12,950 - INFO - Created VN ctest-vn-29752053
2025-08-06 08:37:12,966 - DEBUG - VN ctest-vn-29752053 UUID is 5aeadaa8-d936-40d3-90d1-6fc723e251b3
2025-08-06 08:37:14,415 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-2)
2025-08-06 08:37:16,171 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-1)
2025-08-06 08:37:16,172 - INFO - Waiting for VM ctest-TestStaticRouteTables-49553622-37541348 to be up..
2025-08-06 08:37:16,303 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-06 08:37:21,396 - DEBUG - VM is in ACTIVE state now
2025-08-06 08:37:21,397 - INFO - VM name : ctest-TestStaticRouteTables-49553622-37541348
2025-08-06 08:37:21,497 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 ID is 12c5884e-fbfa-4f5e-acb7-e9a963e093fb
2025-08-06 08:37:21,497 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 launched on Node an-jenkins-deploy-platform-ansible-os-3761-2
2025-08-06 08:37:21,591 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/12c5884e-fbfa-4f5e-acb7-e9a963e093fb
2025-08-06 08:37:21,604 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f1497ce5-46ed-4aa7-887e-bfef76a6ac23
2025-08-06 08:37:24,862 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms')
2025-08-06 08:37:24,862 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:24,880 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:28,962 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-08-06 08:37:28,963 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:28,982 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:33,055 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms')
2025-08-06 08:37:33,055 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:33,073 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:37,158 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms')
2025-08-06 08:37:37,158 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:37,180 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:41,251 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2025-08-06 08:37:41,251 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:41,269 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:45,344 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-08-06 08:37:45,345 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:45,361 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:49,444 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-08-06 08:37:49,444 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:49,463 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:53,535 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-08-06 08:37:53,535 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 failed!
2025-08-06 08:37:53,555 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:37:55,624 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=13.6 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.51 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.507/8.544/13.582/5.037 ms')
2025-08-06 08:37:55,624 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-37541348 passed
2025-08-06 08:37:55,745 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:37:55,745 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-49553622-37541348, IP 176.211.163.67, Port 22
2025-08-06 08:37:55,813 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:37:55,929 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:38:00,930 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:38:00,930 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-49553622-37541348, IP 176.211.163.67, Port 22
2025-08-06 08:38:01,001 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:38:01,091 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:38:06,093 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:38:06,093 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-49553622-37541348, IP 176.211.163.67, Port 22
2025-08-06 08:38:06,161 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:38:06,362 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:38:11,363 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:38:11,363 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-49553622-37541348, IP 176.211.163.67, Port 22
2025-08-06 08:38:11,419 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:38:11,538 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:38:16,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:38:16,540 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-49553622-37541348, IP 176.211.163.67, Port 22
2025-08-06 08:38:16,703 - DEBUG - VM ctest-TestStaticRouteTables-49553622-37541348 is ready for SSH connections
2025-08-06 08:38:16,703 - INFO - Waiting for VM ctest-TestStaticRouteTables-49553622-43515137 to be up..
2025-08-06 08:38:16,816 - DEBUG - VM is in ACTIVE state now
2025-08-06 08:38:16,817 - INFO - VM name : ctest-TestStaticRouteTables-49553622-43515137
2025-08-06 08:38:16,923 - DEBUG - VM ctest-TestStaticRouteTables-49553622-43515137 ID is 822e5474-f1c1-4f0e-b34a-19bd203bea56
2025-08-06 08:38:16,923 - DEBUG - VM ctest-TestStaticRouteTables-49553622-43515137 launched on Node an-jenkins-deploy-platform-ansible-os-3761-1
2025-08-06 08:38:17,060 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/822e5474-f1c1-4f0e-b34a-19bd203bea56
2025-08-06 08:38:17,103 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/c5fc94ca-7443-4234-9276-f451c9195ec3
2025-08-06 08:38:18,353 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.51 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.60 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.511/2.554/2.597/0.043 ms')
2025-08-06 08:38:18,353 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-49553622-43515137 passed
2025-08-06 08:38:18,471 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:38:18,471 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-49553622-43515137, IP 199.78.217.67, Port 22
2025-08-06 08:38:18,639 - DEBUG - VM ctest-TestStaticRouteTables-49553622-43515137 is ready for SSH connections
2025-08-06 08:38:20,454 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3761-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3761-2)
2025-08-06 08:38:20,454 - INFO - Waiting for VM middle_vm1 to be up..
2025-08-06 08:38:20,515 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-08-06 08:38:25,624 - DEBUG - VM is in ACTIVE state now
2025-08-06 08:38:25,624 - INFO - VM name : middle_vm1
2025-08-06 08:38:25,717 - DEBUG - VM middle_vm1 ID is 3fb69b3e-3ad7-4c60-b9c2-361654d3d92a
2025-08-06 08:38:25,717 - DEBUG - VM middle_vm1 launched on Node an-jenkins-deploy-platform-ansible-os-3761-2
2025-08-06 08:38:25,919 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/3fb69b3e-3ad7-4c60-b9c2-361654d3d92a
2025-08-06 08:38:25,932 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/56e7b9f6-f4bf-4b31-b3e0-c781fd4c29e8
2025-08-06 08:38:25,945 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/f45c9ea7-4b6f-443b-a8f0-e9bc0e9b4002
2025-08-06 08:38:29,216 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms')
2025-08-06 08:38:29,216 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:29,234 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:33,316 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-08-06 08:38:33,316 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:33,333 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:37,411 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-08-06 08:38:37,411 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:37,430 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:41,503 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-08-06 08:38:41,503 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:41,520 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:45,605 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2025-08-06 08:38:45,605 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:45,625 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:49,699 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms')
2025-08-06 08:38:49,699 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:49,723 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:53,795 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2025-08-06 08:38:53,795 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:53,811 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:38:57,891 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2025-08-06 08:38:57,892 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:38:57,909 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:39:01,981 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2025-08-06 08:39:01,981 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:39:01,999 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:39:06,079 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-08-06 08:39:06,079 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 failed!
2025-08-06 08:39:06,098 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-49553622:ctest-vn-11825774 is 176.211.163.65 and allocation pool is NOT set
2025-08-06 08:39:10,180 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=8.50 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1015ms\r\nrtt min/avg/max/mdev = 8.498/8.498/8.498/0.000 ms')
2025-08-06 08:39:10,180 - INFO - Ping to Metadata IP 169.254.0.4 of VM middle_vm1 passed
2025-08-06 08:39:10,299 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:10,299 - DEBUG - Waiting to SSH to VM middle_vm1, IP 176.211.163.68, Port 22
2025-08-06 08:39:10,365 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:39:10,474 - DEBUG - VM middle_vm1 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:39:15,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:15,475 - DEBUG - Waiting to SSH to VM middle_vm1, IP 176.211.163.68, Port 22
2025-08-06 08:39:15,541 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:39:15,642 - DEBUG - VM middle_vm1 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:39:20,643 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:20,643 - DEBUG - Waiting to SSH to VM middle_vm1, IP 176.211.163.68, Port 22
2025-08-06 08:39:20,709 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:39:20,811 - DEBUG - VM middle_vm1 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:39:25,811 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:25,812 - DEBUG - Waiting to SSH to VM middle_vm1, IP 176.211.163.68, Port 22
2025-08-06 08:39:25,882 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-06 08:39:26,002 - DEBUG - VM middle_vm1 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-06 08:39:31,004 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:31,004 - DEBUG - Waiting to SSH to VM middle_vm1, IP 176.211.163.68, Port 22
2025-08-06 08:39:31,181 - DEBUG - VM middle_vm1 is ready for SSH connections
2025-08-06 08:39:31,305 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:31,305 - DEBUG - Waiting to SSH to VM middle_vm1, IP 176.211.163.68, Port 22
2025-08-06 08:39:31,473 - DEBUG - VM middle_vm1 is ready for SSH connections
2025-08-06 08:39:31,473 - DEBUG - Running remote_cmd, Cmd : echo 1 > /proc/sys/net/ipv4/ip_forward, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 08:39:31,474 - DEBUG - echo 1 > /proc/sys/net/ipv4/ip_forward
2025-08-06 08:39:53,740 - DEBUG - None
2025-08-06 08:39:53,740 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:53,834 - INFO - Created NetworkRouteTable ['default-domain', 'ctest-TestStaticRouteTables-49553622', 'ctest-network_table_left_to_right-09417288'](UUID 5b5c7dfc-dbc5-46ff-a0da-9d8e8e5832b0), prefixes : ['199.78.217.64/26']
2025-08-06 08:39:53,946 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:39:54,074 - INFO - Created NetworkRouteTable ['default-domain', 'ctest-TestStaticRouteTables-49553622', 'ctest-network_table_right_to_left-80847840'](UUID 067281c3-6c74-4967-95f6-ffca932c7a6a), prefixes : ['176.211.163.64/26']
2025-08-06 08:39:57,198 - DEBUG - file copy failed retrying
2025-08-06 08:40:00,199 - DEBUG - file copy failed retrying
2025-08-06 08:40:38,467 - DEBUG - file transfer done ['/tmp/udpechoserver.py']
2025-08-06 08:40:38,467 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:40:38,467 - DEBUG - Copied file /contrail-test/tcutils/traffic_utils/../udpechoserver.py to 199.78.217.67
2025-08-06 08:40:38,467 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-48625700.pid --stats_file /tmp/server-ctest-random-48625700.stats 0<&- &> /tmp/server-ctest-random-48625700.log, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-06 08:40:38,467 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-48625700.pid --stats_file /tmp/server-ctest-random-48625700.stats 0<&- &> /tmp/server-ctest-random-48625700.log &
2025-08-06 08:40:38,976 - DEBUG - None
2025-08-06 08:41:20,837 - DEBUG - file transfer done ['/tmp/udpechoclient.py']
2025-08-06 08:41:20,837 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-06 08:41:20,837 - DEBUG - Copied file /contrail-test/tcutils/traffic_utils/../udpechoclient.py to 176.211.163.67
2025-08-06 08:41:20,837 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 199.78.217.67 --sport 8001 --dports 9001 --retry --pid_file /tmp/client-ctest-random-48625700.pid --stats_file /tmp/client-ctest-random-48625700.stats 0<&- &> /tmp/client-ctest-random-48625700.log, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 08:41:20,837 - DEBUG - nohup python /tmp/udpechoclient.py --servers 199.78.217.67 --sport 8001 --dports 9001 --retry --pid_file /tmp/client-ctest-random-48625700.pid --stats_file /tmp/client-ctest-random-48625700.stats 0<&- &> /tmp/client-ctest-random-48625700.log &
2025-08-06 08:41:21,378 - DEBUG - None
2025-08-06 08:41:21,379 - DEBUG - Sleeping for 7 seconds..
2025-08-06 08:41:28,379 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/client-ctest-random-48625700.pid); sync; cat /tmp/client-ctest-random-48625700.stats, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-06 08:41:28,379 - DEBUG - kill $(cat /tmp/client-ctest-random-48625700.pid); sync; cat /tmp/client-ctest-random-48625700.stats
2025-08-06 08:41:29,259 - DEBUG - dport: 9001 - dst ip: 199.78.217.67 - sent: 2 - recv: 0
2025-08-06 08:41:29,259 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/server-ctest-random-48625700.pid); sync; cat /tmp/server-ctest-random-48625700.stats, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-06 08:41:29,259 - DEBUG - kill $(cat /tmp/server-ctest-random-48625700.pid); sync; cat /tmp/server-ctest-random-48625700.stats
2025-08-06 08:41:29,912 - DEBUG - cat: /tmp/server-ctest-random-48625700.pid: No such file or directory
kill: usage: kill [-s sigspec | -n signum | -sigspec] pid | jobspec ... or kill -l [sigspec]
cat: /tmp/server-ctest-random-48625700.stats: No such file or directory
2025-08-06 08:41:29,912 - INFO - Client - Sent: 2, Received: 0
2025-08-06 08:41:29,912 - INFO - Server - Sent: 0, Received: 0
2025-08-06 08:41:30,030 - INFO - Removed network route table 5b5c7dfc-dbc5-46ff-a0da-9d8e8e5832b0 from network ee7ee68d-a823-4a6b-9334-13186ef22927
2025-08-06 08:41:30,174 - INFO - Removed network route table 067281c3-6c74-4967-95f6-ffca932c7a6a from network 5aeadaa8-d936-40d3-90d1-6fc723e251b3
2025-08-06 08:41:30,217 - INFO - Deleted Network route table 5b5c7dfc-dbc5-46ff-a0da-9d8e8e5832b0
2025-08-06 08:41:30,255 - INFO - Deleted Network route table 067281c3-6c74-4967-95f6-ffca932c7a6a
2025-08-06 08:41:30,255 - INFO - Deleting VM middle_vm1
2025-08-06 08:41:30,334 - INFO - Deleting VM ctest-TestStaticRouteTables-49553622-43515137
2025-08-06 08:41:30,403 - INFO - Deleting VM ctest-TestStaticRouteTables-49553622-37541348
2025-08-06 08:41:30,480 - INFO - Deleting VN ctest-vn-29752053
2025-08-06 08:41:30,538 - DEBUG - VN 5aeadaa8-d936-40d3-90d1-6fc723e251b3 still in use: Unable to complete operation on network 5aeadaa8-d936-40d3-90d1-6fc723e251b3. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-f7702403-57bd-4500-885e-345203d8cc51']
2025-08-06 08:41:30,538 - WARNING - Deleting VN ctest-vn-29752053 failed..Will retry
2025-08-06 08:41:32,745 - DEBUG - Response for deleting network ()
2025-08-06 08:41:32,746 - INFO - Deleting VN ctest-vn-11825774
2025-08-06 08:41:32,958 - DEBUG - Response for deleting network ()
2025-08-06 08:41:35,690 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Wed Aug 6 08:41:29 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/static_route_table/test_static_tables.py in test_network_route_table(self=)
172 self.addCleanup(self.del_nw_route_table)
173 self.verify_traffic(
174 self.left_vm_fixture, self.right_vm_fixture, 'udp', sport=sport, dport=dport)
175 self.check_route_in_agent(expected_next_hops = 1)
176 self.unbind_network_table(self.vn1_fixture, self.vn2_fixture)
self =
self.left_vm_fixture =
self.right_vm_fixture =
sport = 8001
dport = 9001
/contrail-test/common/base.py in verify_traffic(self=, src_vm_fixture=, dst_vm_fixture=, proto='udp', sport=8001, dport=9001, src_vn_fqname=None, dst_vn_fqname=None, af=None, fip_ip=None, expectation=True)
812 fip_ip=fip_ip)
813 self.sleep(7)
814 return self.stop_traffic(traffic_obj, expectation)
815
816 @classmethod
self =
self.stop_traffic = >
traffic_obj =
expectation = True
/contrail-test/common/base.py in stop_traffic(self=, traffic_obj=, expectation=True, unidirection=False, partial=False)
796 assert False, "No drops observed in packets %s"%msg
797 elif expectation:
798 assert sent and recv, "Packets not %s"%msg
799 if recv*100/float(sent) < 90:
800 assert False, "Packets not %s"%msg
sent = 2
recv = 0
msg = 'transferred between 176.211.163.67 and 199.78.217.67, proto udp sport 8001 and dport 9001'
AssertionError: Packets not transferred between 176.211.163.67 and 199.78.217.67, proto udp sport 8001 and dport 9001
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('Packets not transferred between 176.211.163.67 a...99.78.217.67, proto udp sport 8001 and dport 9001',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/static_route_table/test_static_tables.py", line 174, in test_network_route_table
self.left_vm_fixture, self.right_vm_fixture, 'udp', sport=sport, dport=dport)
File "/contrail-test/common/base.py", line 814, in verify_traffic
return self.stop_traffic(traffic_obj, expectation)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 176.211.163.67 and 199.78.217.67, proto udp sport 8001 and dport 9001
2025-08-06 08:41:35,707 - DEBUG - No XMPP flaps were noticed during the test
2025-08-06 08:41:35,707 - INFO -
2025-08-06 08:41:35,707 - INFO - END TEST : test_network_route_table : FAILED[0:04:25]
2025-08-06 08:41:35,708 - INFO - --------------------------------------------------------------------------------
2025-08-06 08:41:36,795 - INFO - Deleted project: ctest-TestStaticRouteTables-49553622, ID : 3732fbac-4ac8-402a-9373-cde9ee3ed5d0