2025-08-04 02:53:21,820 - INFO - Domain Default found not creating 2025-08-04 02:53:22,022 - INFO - Project ctest-TestRouters-17637872 not found, creating it 2025-08-04 02:53:22,763 - INFO - Created Project:ctest-TestRouters-17637872, ID : bee38468-790a-481c-b9ae-33715af85117 2025-08-04 02:53:24,348 - INFO - ================================================================================ 2025-08-04 02:53:24,349 - INFO - STARTING TEST : test_basic_router_behavior 2025-08-04 02:53:24,349 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs Create a router Create 2 VNs, and a VM in each Add router port from each VN Ping between VMs 2025-08-04 02:53:25,640 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with 2025-08-04 02:53:25,640 - INFO - Initial checks done. Running the testcase now 2025-08-04 02:53:25,640 - INFO - 2025-08-04 02:53:26,352 - DEBUG - Response for create_network : {'network': {'id': '88394097-a9dd-454d-9faf-3611a05f9dba', 'name': 'ctest-vn1-06630792', 'tenant_id': 'bee38468790a481cb9ae33715af85117', 'project_id': 'bee38468790a481cb9ae33715af85117', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-17637872', 'ctest-vn1-06630792'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 02:53:26,655 - DEBUG - Response for create_subnet : {'subnet': {'id': '51632b49-b6ee-4ef1-8433-c7aeed539c97', 'name': '', 'tenant_id': 'bee38468790a481cb9ae33715af85117', 'network_id': '88394097-a9dd-454d-9faf-3611a05f9dba', 'ip_version': 4, 'cidr': '22.67.124.64/26', 'allocation_pools': [{'start': '22.67.124.66', 'end': '22.67.124.126'}], 'gateway_ip': '22.67.124.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.67.124.66', 'tags': [], 'project_id': 'bee38468790a481cb9ae33715af85117'}} 2025-08-04 02:53:26,687 - INFO - Created VN ctest-vn1-06630792 2025-08-04 02:53:26,708 - DEBUG - VN ctest-vn1-06630792 UUID is 88394097-a9dd-454d-9faf-3611a05f9dba 2025-08-04 02:53:27,102 - DEBUG - Response for create_network : {'network': {'id': '4f830d6f-4460-4f2e-8aca-05c928e73f4a', 'name': 'ctest-vn2-83917461', 'tenant_id': 'bee38468790a481cb9ae33715af85117', 'project_id': 'bee38468790a481cb9ae33715af85117', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-17637872', 'ctest-vn2-83917461'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 02:53:27,356 - DEBUG - Response for create_subnet : {'subnet': {'id': '44d19ca7-96cc-42f8-aa0f-aa5ec44166c7', 'name': '', 'tenant_id': 'bee38468790a481cb9ae33715af85117', 'network_id': '4f830d6f-4460-4f2e-8aca-05c928e73f4a', 'ip_version': 4, 'cidr': '170.184.138.128/26', 'allocation_pools': [{'start': '170.184.138.130', 'end': '170.184.138.190'}], 'gateway_ip': '170.184.138.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '170.184.138.130', 'tags': [], 'project_id': 'bee38468790a481cb9ae33715af85117'}} 2025-08-04 02:53:27,382 - INFO - Created VN ctest-vn2-83917461 2025-08-04 02:53:27,396 - DEBUG - VN ctest-vn2-83917461 UUID is 4f830d6f-4460-4f2e-8aca-05c928e73f4a 2025-08-04 02:53:27,560 - DEBUG - Services list from nova: [, , , ] 2025-08-04 02:53:28,776 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2) 2025-08-04 02:53:30,524 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1) 2025-08-04 02:53:30,669 - INFO - Adding interface with subnet_id 51632b49-b6ee-4ef1-8433-c7aeed539c97, port_id None to router 2751de26-6c38-44dd-9957-c61a04b9d828 2025-08-04 02:53:31,163 - INFO - Waiting for VM ctest-vn1-vm1-75473037 to be up.. 2025-08-04 02:53:31,333 - DEBUG - VM is in ACTIVE state now 2025-08-04 02:53:31,333 - INFO - VM name : ctest-vn1-vm1-75473037 2025-08-04 02:53:31,466 - DEBUG - VM ctest-vn1-vm1-75473037 ID is 698ed95f-24be-462a-be24-b9246a0a571e 2025-08-04 02:53:31,499 - DEBUG - VM ctest-vn1-vm1-75473037 launched on Node an-jenkins-deploy-platform-ansible-os-3750-2 2025-08-04 02:53:31,646 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/698ed95f-24be-462a-be24-b9246a0a571e 2025-08-04 02:53:32,026 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/698ed95f-24be-462a-be24-b9246a0a571e 2025-08-04 02:53:32,064 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/63047363-f449-4211-ad15-96552e0f9a6a 2025-08-04 02:53:35,297 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-04 02:53:35,297 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-75473037 failed! 2025-08-04 02:53:35,314 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-17637872:ctest-vn1-06630792 is 22.67.124.65 and allocation pool is NOT set 2025-08-04 02:53:39,393 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-08-04 02:53:39,393 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-75473037 failed! 2025-08-04 02:53:39,410 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-17637872:ctest-vn1-06630792 is 22.67.124.65 and allocation pool is NOT set 2025-08-04 02:53:41,472 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.60 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.417 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.417/4.006/7.596/3.589 ms') 2025-08-04 02:53:41,472 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-75473037 passed 2025-08-04 02:53:41,591 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:53:41,591 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-75473037, IP 22.67.124.67, Port 22 2025-08-04 02:53:41,658 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-04 02:53:41,761 - DEBUG - VM ctest-vn1-vm1-75473037 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-04 02:53:46,762 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:53:46,762 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-75473037, IP 22.67.124.67, Port 22 2025-08-04 02:53:46,931 - DEBUG - VM ctest-vn1-vm1-75473037 is ready for SSH connections 2025-08-04 02:53:46,931 - INFO - Waiting for VM ctest-vn2-vm1-16407758 to be up.. 2025-08-04 02:53:47,025 - DEBUG - VM is in ACTIVE state now 2025-08-04 02:53:47,025 - INFO - VM name : ctest-vn2-vm1-16407758 2025-08-04 02:53:47,118 - DEBUG - VM ctest-vn2-vm1-16407758 ID is e6e91e04-c595-403e-8e97-fc105ddeee8e 2025-08-04 02:53:47,118 - DEBUG - VM ctest-vn2-vm1-16407758 launched on Node an-jenkins-deploy-platform-ansible-os-3750-1 2025-08-04 02:53:47,201 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/e6e91e04-c595-403e-8e97-fc105ddeee8e 2025-08-04 02:53:47,213 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/24c80897-6401-4f75-ab4c-18028ed56c6b 2025-08-04 02:53:48,429 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.15 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.456 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.456/1.802/3.148/1.346 ms') 2025-08-04 02:53:48,429 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-16407758 passed 2025-08-04 02:53:48,546 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:53:48,546 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-16407758, IP 170.184.138.131, Port 22 2025-08-04 02:53:48,720 - DEBUG - VM ctest-vn2-vm1-16407758 is ready for SSH connections 2025-08-04 02:53:48,720 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:53:48,720 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.184.138.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-04 02:53:48,720 - DEBUG - ping -s 56 -c 3 -W 1 170.184.138.131 2025-08-04 02:53:53,428 - DEBUG - PING 170.184.138.131 (170.184.138.131): 56 data bytes --- 170.184.138.131 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-04 02:53:53,428 - WARNING - Ping to IP 170.184.138.131 from VM ctest-vn1-vm1-75473037 failed 2025-08-04 02:53:53,428 - INFO - Adding interface with subnet_id 44d19ca7-96cc-42f8-aa0f-aa5ec44166c7, port_id None to router 2751de26-6c38-44dd-9957-c61a04b9d828 2025-08-04 02:53:53,908 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:53:53,908 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.184.138.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-04 02:53:53,908 - DEBUG - ping -s 56 -c 3 -W 1 170.184.138.131 2025-08-04 02:53:57,123 - DEBUG - PING 170.184.138.131 (170.184.138.131): 56 data bytes 64 bytes from 170.184.138.131: seq=1 ttl=63 time=5.575 ms 64 bytes from 170.184.138.131: seq=2 ttl=63 time=1.329 ms --- 170.184.138.131 ping statistics --- 3 packets transmitted, 2 packets received, 33% packet loss round-trip min/avg/max = 1.329/3.452/5.575 ms 2025-08-04 02:53:57,123 - WARNING - Ping to IP 170.184.138.131 from VM ctest-vn1-vm1-75473037 failed 2025-08-04 02:53:58,124 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.184.138.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-04 02:53:58,124 - DEBUG - ping -s 56 -c 3 -W 1 170.184.138.131 2025-08-04 02:54:00,321 - DEBUG - PING 170.184.138.131 (170.184.138.131): 56 data bytes 64 bytes from 170.184.138.131: seq=0 ttl=63 time=3.689 ms 64 bytes from 170.184.138.131: seq=1 ttl=63 time=1.057 ms 64 bytes from 170.184.138.131: seq=2 ttl=63 time=1.135 ms --- 170.184.138.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.057/1.960/3.689 ms 2025-08-04 02:54:00,321 - INFO - Ping to IP 170.184.138.131 from VM ctest-vn1-vm1-75473037 passed 2025-08-04 02:54:00,321 - INFO - Deleting interface with subnet_id 51632b49-b6ee-4ef1-8433-c7aeed539c97, port_id None from router 2751de26-6c38-44dd-9957-c61a04b9d828 2025-08-04 02:54:00,602 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:54:00,602 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.184.138.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-04 02:54:00,602 - DEBUG - ping -s 56 -c 3 -W 1 170.184.138.131 2025-08-04 02:54:03,819 - DEBUG - PING 170.184.138.131 (170.184.138.131): 56 data bytes --- 170.184.138.131 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-08-04 02:54:03,819 - WARNING - Ping to IP 170.184.138.131 from VM ctest-vn1-vm1-75473037 failed 2025-08-04 02:54:03,819 - INFO - Adding interface with subnet_id 51632b49-b6ee-4ef1-8433-c7aeed539c97, port_id None to router 2751de26-6c38-44dd-9957-c61a04b9d828 2025-08-04 02:54:04,194 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-04 02:54:04,194 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 170.184.138.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.57, gateway password: c0ntrail123 2025-08-04 02:54:04,195 - DEBUG - ping -s 56 -c 3 -W 1 170.184.138.131 2025-08-04 02:54:06,396 - DEBUG - PING 170.184.138.131 (170.184.138.131): 56 data bytes 64 bytes from 170.184.138.131: seq=0 ttl=63 time=2.915 ms 64 bytes from 170.184.138.131: seq=1 ttl=63 time=0.965 ms 64 bytes from 170.184.138.131: seq=2 ttl=63 time=0.920 ms --- 170.184.138.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.920/1.600/2.915 ms 2025-08-04 02:54:06,396 - INFO - Ping to IP 170.184.138.131 from VM ctest-vn1-vm1-75473037 passed 2025-08-04 02:54:06,396 - INFO - Deleting interface with subnet_id 44d19ca7-96cc-42f8-aa0f-aa5ec44166c7, port_id None from router 2751de26-6c38-44dd-9957-c61a04b9d828 2025-08-04 02:54:06,668 - INFO - Deleting interface with subnet_id 51632b49-b6ee-4ef1-8433-c7aeed539c97, port_id None from router 2751de26-6c38-44dd-9957-c61a04b9d828 2025-08-04 02:54:07,033 - INFO - Deleting VM ctest-vn2-vm1-16407758 2025-08-04 02:54:07,119 - INFO - Deleting VM ctest-vn1-vm1-75473037 2025-08-04 02:54:07,185 - INFO - Deleting VN ctest-vn2-83917461 2025-08-04 02:54:07,233 - DEBUG - VN 4f830d6f-4460-4f2e-8aca-05c928e73f4a still in use: Unable to complete operation on network 4f830d6f-4460-4f2e-8aca-05c928e73f4a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-639795c3-728e-456a-9e1a-74c7880b805e'] 2025-08-04 02:54:07,233 - WARNING - Deleting VN ctest-vn2-83917461 failed..Will retry 2025-08-04 02:54:09,400 - DEBUG - Response for deleting network () 2025-08-04 02:54:09,400 - INFO - Deleting VN ctest-vn1-06630792 2025-08-04 02:54:09,561 - DEBUG - Response for deleting network () 2025-08-04 02:54:10,848 - DEBUG - No XMPP flaps were noticed during the test 2025-08-04 02:54:10,848 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:46] 2025-08-04 02:54:10,848 - INFO - -------------------------------------------------------------------------------- 2025-08-04 02:54:11,570 - INFO - Deleted project: ctest-TestRouters-17637872, ID : bee38468-790a-481c-b9ae-33715af85117