2025-07-31 04:11:54,896 - INFO - Domain Default found not creating 2025-07-31 04:11:55,297 - INFO - Project ctest-TestStaticRouteTables-64953612 not found, creating it 2025-07-31 04:11:56,017 - INFO - Created Project:ctest-TestStaticRouteTables-64953612, ID : 9cc07b31-3284-4c41-9d5d-e69dfa011f21 2025-07-31 04:11:57,575 - INFO - ================================================================================ 2025-07-31 04:11:57,575 - INFO - STARTING TEST : test_interface_static_table 2025-07-31 04:11:57,575 - INFO - TEST DESCRIPTION : Description: Validate interface static table Test steps: 1. Creating vm's - vm1 and vm2 and middle vm in networks vn1 and vn2. 2. Creating interface static table betn left and right vm 3. Apply static table to the middle ports. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and route should be in the agent 2025-07-31 04:11:58,884 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 04:11:58,884 - INFO - Initial checks done. Running the testcase now 2025-07-31 04:11:58,884 - INFO - 2025-07-31 04:11:59,615 - DEBUG - Response for create_network : {'network': {'id': '8697fc01-f679-422f-8d55-e3d4cbf91fe6', 'name': 'ctest-vn-93598515', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'project_id': '9cc07b3132844c419d5de69dfa011f21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestStaticRouteTables-64953612', 'ctest-vn-93598515'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:11:59,950 - DEBUG - Response for create_subnet : {'subnet': {'id': '423b5fa6-fabe-4bf8-b59b-7c448556fbbf', 'name': '', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'network_id': '8697fc01-f679-422f-8d55-e3d4cbf91fe6', 'ip_version': 4, 'cidr': '180.30.229.128/26', 'allocation_pools': [{'start': '180.30.229.130', 'end': '180.30.229.190'}], 'gateway_ip': '180.30.229.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '180.30.229.130', 'tags': [], 'project_id': '9cc07b3132844c419d5de69dfa011f21'}} 2025-07-31 04:11:59,994 - INFO - Created VN ctest-vn-93598515 2025-07-31 04:12:00,010 - DEBUG - VN ctest-vn-93598515 UUID is 8697fc01-f679-422f-8d55-e3d4cbf91fe6 2025-07-31 04:12:00,421 - DEBUG - Response for create_network : {'network': {'id': 'd6615ec7-1973-41fd-a748-614ad1034aff', 'name': 'ctest-vn-59575752', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'project_id': '9cc07b3132844c419d5de69dfa011f21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestStaticRouteTables-64953612', 'ctest-vn-59575752'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:12:00,731 - DEBUG - Response for create_subnet : {'subnet': {'id': '631c3d07-2b38-4bef-a004-b3b613c27945', 'name': '', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'network_id': 'd6615ec7-1973-41fd-a748-614ad1034aff', 'ip_version': 4, 'cidr': '158.138.182.0/26', 'allocation_pools': [{'start': '158.138.182.2', 'end': '158.138.182.62'}], 'gateway_ip': '158.138.182.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '158.138.182.2', 'tags': [], 'project_id': '9cc07b3132844c419d5de69dfa011f21'}} 2025-07-31 04:12:00,757 - INFO - Created VN ctest-vn-59575752 2025-07-31 04:12:00,768 - DEBUG - VN ctest-vn-59575752 UUID is d6615ec7-1973-41fd-a748-614ad1034aff 2025-07-31 04:12:00,965 - DEBUG - Services list from nova: [, , , ] 2025-07-31 04:12:02,517 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-1) 2025-07-31 04:12:04,476 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-2) 2025-07-31 04:12:04,477 - INFO - Waiting for VM ctest-TestStaticRouteTables-64953612-18972218 to be up.. 2025-07-31 04:12:04,596 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-31 04:12:09,783 - DEBUG - VM is in ACTIVE state now 2025-07-31 04:12:09,783 - INFO - VM name : ctest-TestStaticRouteTables-64953612-18972218 2025-07-31 04:12:09,951 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 ID is ef256e5b-9047-48c2-aff9-a5649858b145 2025-07-31 04:12:09,982 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 launched on Node an-jenkins-deploy-platform-ansible-os-3732-1 2025-07-31 04:12:10,092 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/ef256e5b-9047-48c2-aff9-a5649858b145 2025-07-31 04:12:10,404 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/ef256e5b-9047-48c2-aff9-a5649858b145 2025-07-31 04:12:10,439 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/b94852b6-541d-4836-88b7-05146a0d9572 2025-07-31 04:12:13,676 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-07-31 04:12:13,677 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:13,699 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:17,779 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-07-31 04:12:17,779 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:17,805 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:21,900 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-07-31 04:12:21,900 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:21,928 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:25,992 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-07-31 04:12:25,993 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:26,021 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:30,090 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-07-31 04:12:30,091 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:30,115 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:34,185 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-07-31 04:12:34,186 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:34,220 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:38,311 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-07-31 04:12:38,311 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:38,328 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:42,414 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-07-31 04:12:42,414 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 failed! 2025-07-31 04:12:42,442 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-93598515 is 180.30.229.129 and allocation pool is NOT set 2025-07-31 04:12:44,520 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.69 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.80 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.795/4.244/6.694/2.449 ms') 2025-07-31 04:12:44,520 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-18972218 passed 2025-07-31 04:12:44,652 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:12:44,652 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-18972218, IP 180.30.229.131, Port 22 2025-07-31 04:12:44,717 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:12:44,876 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:12:49,876 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:12:49,877 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-18972218, IP 180.30.229.131, Port 22 2025-07-31 04:12:49,938 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:12:50,125 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:12:55,126 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:12:55,126 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-18972218, IP 180.30.229.131, Port 22 2025-07-31 04:12:55,194 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:12:55,367 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:13:00,369 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:13:00,369 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-18972218, IP 180.30.229.131, Port 22 2025-07-31 04:13:00,437 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:13:00,551 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:13:05,551 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:13:05,551 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-18972218, IP 180.30.229.131, Port 22 2025-07-31 04:13:05,726 - DEBUG - VM ctest-TestStaticRouteTables-64953612-18972218 is ready for SSH connections 2025-07-31 04:13:05,726 - INFO - Waiting for VM ctest-TestStaticRouteTables-64953612-85440098 to be up.. 2025-07-31 04:13:05,852 - DEBUG - VM is in ACTIVE state now 2025-07-31 04:13:05,852 - INFO - VM name : ctest-TestStaticRouteTables-64953612-85440098 2025-07-31 04:13:05,944 - DEBUG - VM ctest-TestStaticRouteTables-64953612-85440098 ID is e257b4ee-5b09-44d5-9a0f-d1f35d44ecc6 2025-07-31 04:13:05,944 - DEBUG - VM ctest-TestStaticRouteTables-64953612-85440098 launched on Node an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 04:13:06,048 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/e257b4ee-5b09-44d5-9a0f-d1f35d44ecc6 2025-07-31 04:13:06,062 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/4377eb82-9c8a-424f-94c9-c6a6903dd200 2025-07-31 04:13:07,338 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.68 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.15 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.152/4.415/7.679/3.263 ms') 2025-07-31 04:13:07,338 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-85440098 passed 2025-07-31 04:13:07,463 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:13:07,463 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-85440098, IP 158.138.182.3, Port 22 2025-07-31 04:13:07,536 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:13:07,672 - DEBUG - VM ctest-TestStaticRouteTables-64953612-85440098 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:13:12,673 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:13:12,673 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-85440098, IP 158.138.182.3, Port 22 2025-07-31 04:13:12,837 - DEBUG - VM ctest-TestStaticRouteTables-64953612-85440098 is ready for SSH connections 2025-07-31 04:14:53,962 - DEBUG - Installing image ubuntu 2025-07-31 04:14:53,962 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 04:14:53,964 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:14:53,964 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:14:53,964 - DEBUG - Unzip image 2025-07-31 04:14:53,964 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:14:53,986 - DEBUG - Try to create image in user context 2025-07-31 04:14:54,056 - INFO - Deleting VM ctest-TestStaticRouteTables-64953612-85440098 2025-07-31 04:14:54,171 - INFO - Deleting VM ctest-TestStaticRouteTables-64953612-18972218 2025-07-31 04:14:54,244 - INFO - Deleting VN ctest-vn-59575752 2025-07-31 04:14:54,291 - DEBUG - VN d6615ec7-1973-41fd-a748-614ad1034aff still in use: Unable to complete operation on network d6615ec7-1973-41fd-a748-614ad1034aff. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-16cc11d9-072d-4684-bcb4-124bfa2a0e9f'] 2025-07-31 04:14:54,291 - WARNING - Deleting VN ctest-vn-59575752 failed..Will retry 2025-07-31 04:14:56,621 - DEBUG - Response for deleting network () 2025-07-31 04:14:56,621 - INFO - Deleting VN ctest-vn-93598515 2025-07-31 04:14:56,823 - DEBUG - Response for deleting network () 2025-07-31 04:14:58,145 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/static_route_table/test_static_tables.py", line 30, in test_interface_static_table
    self.config_basic()
  File "/contrail-test/common/static_route_table/base.py", line 52, in config_basic
    image_name='ubuntu', flavor='m1.tiny'))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 04:14:58,172 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 04:14:58,172 - INFO - 2025-07-31 04:14:58,172 - INFO - END TEST : test_interface_static_table : FAILED[0:03:01] 2025-07-31 04:14:58,172 - INFO - -------------------------------------------------------------------------------- 2025-07-31 04:14:58,180 - INFO - ================================================================================ 2025-07-31 04:14:58,180 - INFO - STARTING TEST : test_network_route_table 2025-07-31 04:14:58,181 - INFO - TEST DESCRIPTION : Description: Validate network static table Test steps: 1. Creating vm's - vm1 and vm2 and middle vm in networks vn1 and vn2. 2. Creating network static table betn left and right vm 3. Apply static table to the middle ports. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and route should be in the agent 2025-07-31 04:14:59,529 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 04:14:59,529 - INFO - Initial checks done. Running the testcase now 2025-07-31 04:14:59,529 - INFO - 2025-07-31 04:14:59,878 - DEBUG - Response for create_network : {'network': {'id': '3c9c09d6-0fe8-4242-8c5d-aafde2d39255', 'name': 'ctest-vn-18099484', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'project_id': '9cc07b3132844c419d5de69dfa011f21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestStaticRouteTables-64953612', 'ctest-vn-18099484'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:15:00,152 - DEBUG - Response for create_subnet : {'subnet': {'id': '15f75922-343b-428d-bdad-2f59611c14b0', 'name': '', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'network_id': '3c9c09d6-0fe8-4242-8c5d-aafde2d39255', 'ip_version': 4, 'cidr': '197.117.12.0/26', 'allocation_pools': [{'start': '197.117.12.2', 'end': '197.117.12.62'}], 'gateway_ip': '197.117.12.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.117.12.2', 'tags': [], 'project_id': '9cc07b3132844c419d5de69dfa011f21'}} 2025-07-31 04:15:00,178 - INFO - Created VN ctest-vn-18099484 2025-07-31 04:15:00,190 - DEBUG - VN ctest-vn-18099484 UUID is 3c9c09d6-0fe8-4242-8c5d-aafde2d39255 2025-07-31 04:15:00,584 - DEBUG - Response for create_network : {'network': {'id': '714b8e5b-cd0a-4c07-a32d-4b2ad17e4657', 'name': 'ctest-vn-49608640', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'project_id': '9cc07b3132844c419d5de69dfa011f21', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestStaticRouteTables-64953612', 'ctest-vn-49608640'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 04:15:00,858 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ce5e7677-1f29-4d65-a2c6-c0d280b1f792', 'name': '', 'tenant_id': '9cc07b3132844c419d5de69dfa011f21', 'network_id': '714b8e5b-cd0a-4c07-a32d-4b2ad17e4657', 'ip_version': 4, 'cidr': '218.197.253.128/26', 'allocation_pools': [{'start': '218.197.253.130', 'end': '218.197.253.190'}], 'gateway_ip': '218.197.253.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.197.253.130', 'tags': [], 'project_id': '9cc07b3132844c419d5de69dfa011f21'}} 2025-07-31 04:15:00,882 - INFO - Created VN ctest-vn-49608640 2025-07-31 04:15:00,899 - DEBUG - VN ctest-vn-49608640 UUID is 714b8e5b-cd0a-4c07-a32d-4b2ad17e4657 2025-07-31 04:15:02,178 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-2) 2025-07-31 04:15:03,801 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-1) 2025-07-31 04:15:03,801 - INFO - Waiting for VM ctest-TestStaticRouteTables-64953612-41468724 to be up.. 2025-07-31 04:15:03,914 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-31 04:15:09,099 - DEBUG - VM is in ACTIVE state now 2025-07-31 04:15:09,100 - INFO - VM name : ctest-TestStaticRouteTables-64953612-41468724 2025-07-31 04:15:09,316 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 ID is 2113bc55-978e-4747-830c-a203a51b4c34 2025-07-31 04:15:09,317 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 launched on Node an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 04:15:09,449 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/2113bc55-978e-4747-830c-a203a51b4c34 2025-07-31 04:15:09,464 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/fcd23dc0-76fa-4493-9fda-e5fdb1a865bc 2025-07-31 04:15:12,718 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-07-31 04:15:12,718 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:12,740 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:16,815 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-07-31 04:15:16,815 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:16,833 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:20,907 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-07-31 04:15:20,907 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:20,936 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:25,009 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-07-31 04:15:25,009 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:25,043 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:29,139 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-07-31 04:15:29,139 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:29,165 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:33,269 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-07-31 04:15:33,269 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:33,303 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:37,395 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-07-31 04:15:37,396 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:37,423 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:41,520 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-07-31 04:15:41,520 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:41,546 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:45,613 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-07-31 04:15:45,614 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 failed! 2025-07-31 04:15:45,644 - DEBUG - Gateway for vn default-domain:ctest-TestStaticRouteTables-64953612:ctest-vn-18099484 is 197.117.12.1 and allocation pool is NOT set 2025-07-31 04:15:47,711 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.50 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.31 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.305/5.402/9.499/4.097 ms') 2025-07-31 04:15:47,711 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-41468724 passed 2025-07-31 04:15:47,830 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:15:47,830 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-41468724, IP 197.117.12.3, Port 22 2025-07-31 04:15:47,890 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:15:48,079 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:15:53,080 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:15:53,081 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-41468724, IP 197.117.12.3, Port 22 2025-07-31 04:15:53,149 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:15:53,407 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:15:58,408 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:15:58,408 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-41468724, IP 197.117.12.3, Port 22 2025-07-31 04:15:58,478 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:15:58,592 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:16:03,593 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:16:03,593 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-41468724, IP 197.117.12.3, Port 22 2025-07-31 04:16:03,665 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-31 04:16:03,763 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-31 04:16:08,764 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:16:08,764 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-41468724, IP 197.117.12.3, Port 22 2025-07-31 04:16:08,942 - DEBUG - VM ctest-TestStaticRouteTables-64953612-41468724 is ready for SSH connections 2025-07-31 04:16:08,942 - INFO - Waiting for VM ctest-TestStaticRouteTables-64953612-43355656 to be up.. 2025-07-31 04:16:09,067 - DEBUG - VM is in ACTIVE state now 2025-07-31 04:16:09,067 - INFO - VM name : ctest-TestStaticRouteTables-64953612-43355656 2025-07-31 04:16:09,212 - DEBUG - VM ctest-TestStaticRouteTables-64953612-43355656 ID is 6854328d-b21e-4952-9cde-70534c3c129f 2025-07-31 04:16:09,213 - DEBUG - VM ctest-TestStaticRouteTables-64953612-43355656 launched on Node an-jenkins-deploy-platform-ansible-os-3732-1 2025-07-31 04:16:09,322 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/6854328d-b21e-4952-9cde-70534c3c129f 2025-07-31 04:16:09,333 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/5af2a41d-642e-48af-8476-ec22a62637e6 2025-07-31 04:16:10,550 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.57 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.456 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.456/2.510/4.565/2.054 ms') 2025-07-31 04:16:10,550 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestStaticRouteTables-64953612-43355656 passed 2025-07-31 04:16:10,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 04:16:10,677 - DEBUG - Waiting to SSH to VM ctest-TestStaticRouteTables-64953612-43355656, IP 218.197.253.131, Port 22 2025-07-31 04:16:10,837 - DEBUG - VM ctest-TestStaticRouteTables-64953612-43355656 is ready for SSH connections 2025-07-31 04:17:51,775 - DEBUG - Installing image ubuntu 2025-07-31 04:17:51,775 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 04:17:51,776 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:17:51,776 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:17:51,776 - DEBUG - Unzip image 2025-07-31 04:17:51,776 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 04:17:51,808 - DEBUG - Try to create image in user context 2025-07-31 04:17:51,917 - INFO - Deleting VM ctest-TestStaticRouteTables-64953612-43355656 2025-07-31 04:17:52,093 - INFO - Deleting VM ctest-TestStaticRouteTables-64953612-41468724 2025-07-31 04:17:52,214 - INFO - Deleting VN ctest-vn-49608640 2025-07-31 04:17:52,336 - DEBUG - VN 714b8e5b-cd0a-4c07-a32d-4b2ad17e4657 still in use: Unable to complete operation on network 714b8e5b-cd0a-4c07-a32d-4b2ad17e4657. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e7cd7a33-de7f-4551-a569-d56f457f7145'] 2025-07-31 04:17:52,336 - WARNING - Deleting VN ctest-vn-49608640 failed..Will retry 2025-07-31 04:17:54,587 - DEBUG - Response for deleting network () 2025-07-31 04:17:54,587 - INFO - Deleting VN ctest-vn-18099484 2025-07-31 04:17:54,784 - DEBUG - Response for deleting network () 2025-07-31 04:17:56,139 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/static_route_table/test_static_tables.py", line 170, in test_network_route_table
    self.config_basic()
  File "/contrail-test/common/static_route_table/base.py", line 52, in config_basic
    image_name='ubuntu', flavor='m1.tiny'))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 04:17:56,168 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 04:17:56,168 - INFO - 2025-07-31 04:17:56,169 - INFO - END TEST : test_network_route_table : FAILED[0:02:58] 2025-07-31 04:17:56,169 - INFO - -------------------------------------------------------------------------------- 2025-07-31 04:17:57,038 - INFO - Deleted project: ctest-TestStaticRouteTables-64953612, ID : 9cc07b31-3284-4c41-9d5d-e69dfa011f21