2026-10-26 02:46:34,455 - INFO - Domain Default found not creating
2026-10-26 02:46:34,758 - INFO - Project ctest-TestRouters-67889562 not found, creating it
2026-10-26 02:46:35,343 - INFO - Created Project:ctest-TestRouters-67889562, ID : f6c1f3e7-5b5b-4da6-b588-10c27b804db8
2026-10-26 02:46:37,465 - INFO - ================================================================================
2026-10-26 02:46:37,465 - INFO - STARTING TEST : test_basic_router_behavior
2026-10-26 02:46:37,466 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-10-26 02:46:38,761 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.30': '0', '10.20.0.254': '0'}, '10.0.0.38': {'10.20.0.254': '0', '10.20.0.30': '0'}} with
2026-10-26 02:46:38,761 - INFO - Initial checks done. Running the testcase now
2026-10-26 02:46:38,761 - INFO -
2026-10-26 02:46:39,585 - DEBUG - Response for create_network : {'network': {'id': 'f54ca102-05e6-47fe-9e27-1d8040e01255', 'name': 'ctest-vn1-53457565', 'tenant_id': 'f6c1f3e75b5b4da6b58810c27b804db8', 'project_id': 'f6c1f3e75b5b4da6b58810c27b804db8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-67889562', 'ctest-vn1-53457565'], 'port_security_enabled': True, 'description': ''}}
2026-10-26 02:46:39,904 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a6da918-6129-4613-b07a-f56c063a2122', 'name': '', 'tenant_id': 'f6c1f3e75b5b4da6b58810c27b804db8', 'network_id': 'f54ca102-05e6-47fe-9e27-1d8040e01255', 'ip_version': 4, 'cidr': '128.197.233.64/26', 'allocation_pools': [{'start': '128.197.233.66', 'end': '128.197.233.126'}], 'gateway_ip': '128.197.233.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '128.197.233.66', 'tags': [], 'project_id': 'f6c1f3e75b5b4da6b58810c27b804db8'}}
2026-10-26 02:46:39,934 - INFO - Created VN ctest-vn1-53457565
2026-10-26 02:46:39,947 - DEBUG - VN ctest-vn1-53457565 UUID is f54ca102-05e6-47fe-9e27-1d8040e01255
2026-10-26 02:46:40,372 - DEBUG - Response for create_network : {'network': {'id': '5b3bd419-8228-4a45-8ca2-cd22df5c14c9', 'name': 'ctest-vn2-52561900', 'tenant_id': 'f6c1f3e75b5b4da6b58810c27b804db8', 'project_id': 'f6c1f3e75b5b4da6b58810c27b804db8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-67889562', 'ctest-vn2-52561900'], 'port_security_enabled': True, 'description': ''}}
2026-10-26 02:46:40,631 - DEBUG - Response for create_subnet : {'subnet': {'id': '9130ef6b-b310-4dfc-a7e0-fdb07ebb3e3d', 'name': '', 'tenant_id': 'f6c1f3e75b5b4da6b58810c27b804db8', 'network_id': '5b3bd419-8228-4a45-8ca2-cd22df5c14c9', 'ip_version': 4, 'cidr': '146.191.127.128/26', 'allocation_pools': [{'start': '146.191.127.130', 'end': '146.191.127.190'}], 'gateway_ip': '146.191.127.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '146.191.127.130', 'tags': [], 'project_id': 'f6c1f3e75b5b4da6b58810c27b804db8'}}
2026-10-26 02:46:40,654 - INFO - Created VN ctest-vn2-52561900
2026-10-26 02:46:40,667 - DEBUG - VN ctest-vn2-52561900 UUID is 5b3bd419-8228-4a45-8ca2-cd22df5c14c9
2026-10-26 02:46:40,864 - DEBUG - Services list from nova: [, , , ]
2026-10-26 02:46:41,482 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6403-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6403-1)
2026-10-26 02:46:42,157 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6403-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6403-2)
2026-10-26 02:46:42,280 - INFO - Adding interface with subnet_id 3a6da918-6129-4613-b07a-f56c063a2122, port_id None to router 9e11e144-f10c-4be4-aafb-2ed1cd2cb67e
2026-10-26 02:46:42,730 - INFO - Waiting for VM ctest-vn1-vm1-19796338 to be up..
2026-10-26 02:46:42,800 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-10-26 02:46:47,929 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-10-26 02:46:53,021 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-10-26 02:46:58,108 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-10-26 02:47:03,211 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-10-26 02:47:08,299 - DEBUG - VM is in ACTIVE state now
2026-10-26 02:47:08,299 - INFO - VM name : ctest-vn1-vm1-19796338
2026-10-26 02:47:08,416 - DEBUG - VM ctest-vn1-vm1-19796338 ID is 6127751a-4ed4-471d-a750-76c9e719ff1a
2026-10-26 02:47:08,452 - DEBUG - VM ctest-vn1-vm1-19796338 launched on Node an-jenkins-deploy-platform-ansible-os-6403-1
2026-10-26 02:47:08,565 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-machine/6127751a-4ed4-471d-a750-76c9e719ff1a
2026-10-26 02:47:08,954 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-machine/6127751a-4ed4-471d-a750-76c9e719ff1a
2026-10-26 02:47:09,008 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-machine-interface/bf470534-8bcc-4353-b0d7-698a81b33f07
2026-10-26 02:47:12,173 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms')
2026-10-26 02:47:12,173 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-19796338 failed!
2026-10-26 02:47:12,191 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-67889562:ctest-vn1-53457565 is 128.197.233.65 and allocation pool is NOT set
2026-10-26 02:47:14,255 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.38 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.67 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.668/4.525/7.383/2.857 ms')
2026-10-26 02:47:14,255 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-19796338 passed
2026-10-26 02:47:14,326 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:14,326 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-19796338, IP 128.197.233.67, Port 22
2026-10-26 02:47:14,500 - DEBUG - VM ctest-vn1-vm1-19796338 is ready for SSH connections
2026-10-26 02:47:14,500 - INFO - Waiting for VM ctest-vn2-vm1-14413167 to be up..
2026-10-26 02:47:14,585 - DEBUG - VM is in ACTIVE state now
2026-10-26 02:47:14,585 - INFO - VM name : ctest-vn2-vm1-14413167
2026-10-26 02:47:14,673 - DEBUG - VM ctest-vn2-vm1-14413167 ID is 8b3fbd9f-9358-41bf-8b2f-9c45aa87326d
2026-10-26 02:47:14,673 - DEBUG - VM ctest-vn2-vm1-14413167 launched on Node an-jenkins-deploy-platform-ansible-os-6403-2
2026-10-26 02:47:14,761 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-machine/8b3fbd9f-9358-41bf-8b2f-9c45aa87326d
2026-10-26 02:47:14,773 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-machine-interface/dc147636-63fb-4044-ad34-6789137aeaef
2026-10-26 02:47:15,944 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.14 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.68 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.675/3.406/5.137/1.731 ms')
2026-10-26 02:47:15,944 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-14413167 passed
2026-10-26 02:47:16,016 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:16,016 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-14413167, IP 146.191.127.131, Port 22
2026-10-26 02:47:16,085 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-10-26 02:47:16,177 - DEBUG - VM ctest-vn2-vm1-14413167 is NOT ready for SSH connections, VM status: ACTIVE
2026-10-26 02:47:21,178 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:21,178 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-14413167, IP 146.191.127.131, Port 22
2026-10-26 02:47:21,353 - DEBUG - VM ctest-vn2-vm1-14413167 is ready for SSH connections
2026-10-26 02:47:21,354 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:21,354 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 146.191.127.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2026-10-26 02:47:21,354 - DEBUG - ping -s 56 -c 3 -W 1 146.191.127.131
2026-10-26 02:47:25,260 - DEBUG - PING 146.191.127.131 (146.191.127.131): 56 data bytes
--- 146.191.127.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-10-26 02:47:25,260 - WARNING - Ping to IP 146.191.127.131 from VM ctest-vn1-vm1-19796338 failed
2026-10-26 02:47:25,260 - INFO - Adding interface with subnet_id 9130ef6b-b310-4dfc-a7e0-fdb07ebb3e3d, port_id None to router 9e11e144-f10c-4be4-aafb-2ed1cd2cb67e
2026-10-26 02:47:25,699 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:25,699 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 146.191.127.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2026-10-26 02:47:25,699 - DEBUG - ping -s 56 -c 3 -W 1 146.191.127.131
2026-10-26 02:47:27,829 - DEBUG - PING 146.191.127.131 (146.191.127.131): 56 data bytes
64 bytes from 146.191.127.131: seq=0 ttl=63 time=4.667 ms
64 bytes from 146.191.127.131: seq=1 ttl=63 time=1.479 ms
64 bytes from 146.191.127.131: seq=2 ttl=63 time=1.233 ms
--- 146.191.127.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.233/2.459/4.667 ms
2026-10-26 02:47:27,829 - INFO - Ping to IP 146.191.127.131 from VM ctest-vn1-vm1-19796338 passed
2026-10-26 02:47:27,829 - INFO - Deleting interface with subnet_id 3a6da918-6129-4613-b07a-f56c063a2122, port_id None from router 9e11e144-f10c-4be4-aafb-2ed1cd2cb67e
2026-10-26 02:47:28,137 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:28,137 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 146.191.127.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2026-10-26 02:47:28,137 - DEBUG - ping -s 56 -c 3 -W 1 146.191.127.131
2026-10-26 02:47:31,264 - DEBUG - PING 146.191.127.131 (146.191.127.131): 56 data bytes
--- 146.191.127.131 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-10-26 02:47:31,264 - WARNING - Ping to IP 146.191.127.131 from VM ctest-vn1-vm1-19796338 failed
2026-10-26 02:47:31,264 - INFO - Adding interface with subnet_id 3a6da918-6129-4613-b07a-f56c063a2122, port_id None to router 9e11e144-f10c-4be4-aafb-2ed1cd2cb67e
2026-10-26 02:47:31,638 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-10-26 02:47:31,638 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 146.191.127.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2026-10-26 02:47:31,638 - DEBUG - ping -s 56 -c 3 -W 1 146.191.127.131
2026-10-26 02:47:34,759 - DEBUG - PING 146.191.127.131 (146.191.127.131): 56 data bytes
64 bytes from 146.191.127.131: seq=1 ttl=63 time=2.644 ms
64 bytes from 146.191.127.131: seq=2 ttl=63 time=1.297 ms
--- 146.191.127.131 ping statistics ---
3 packets transmitted, 2 packets received, 33% packet loss
round-trip min/avg/max = 1.297/1.970/2.644 ms
2026-10-26 02:47:34,759 - WARNING - Ping to IP 146.191.127.131 from VM ctest-vn1-vm1-19796338 failed
2026-10-26 02:47:35,760 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 146.191.127.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2026-10-26 02:47:35,760 - DEBUG - ping -s 56 -c 3 -W 1 146.191.127.131
2026-10-26 02:47:37,884 - DEBUG - PING 146.191.127.131 (146.191.127.131): 56 data bytes
64 bytes from 146.191.127.131: seq=0 ttl=63 time=4.718 ms
64 bytes from 146.191.127.131: seq=1 ttl=63 time=1.224 ms
64 bytes from 146.191.127.131: seq=2 ttl=63 time=1.237 ms
--- 146.191.127.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.224/2.393/4.718 ms
2026-10-26 02:47:37,885 - INFO - Ping to IP 146.191.127.131 from VM ctest-vn1-vm1-19796338 passed
2026-10-26 02:47:37,885 - INFO - Deleting interface with subnet_id 9130ef6b-b310-4dfc-a7e0-fdb07ebb3e3d, port_id None from router 9e11e144-f10c-4be4-aafb-2ed1cd2cb67e
2026-10-26 02:47:38,110 - INFO - Deleting interface with subnet_id 3a6da918-6129-4613-b07a-f56c063a2122, port_id None from router 9e11e144-f10c-4be4-aafb-2ed1cd2cb67e
2026-10-26 02:47:38,439 - INFO - Deleting VM ctest-vn2-vm1-14413167
2026-10-26 02:47:38,548 - INFO - Deleting VM ctest-vn1-vm1-19796338
2026-10-26 02:47:38,640 - INFO - Deleting VN ctest-vn2-52561900
2026-10-26 02:47:38,685 - DEBUG - VN 5b3bd419-8228-4a45-8ca2-cd22df5c14c9 still in use: Unable to complete operation on network 5b3bd419-8228-4a45-8ca2-cd22df5c14c9. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-c9e04c2f-c92b-48e3-9d2c-6d0743a9e23f']
2026-10-26 02:47:38,686 - WARNING - Deleting VN ctest-vn2-52561900 failed..Will retry
2026-10-26 02:47:40,726 - DEBUG - VN 5b3bd419-8228-4a45-8ca2-cd22df5c14c9 still in use: Unable to complete operation on network 5b3bd419-8228-4a45-8ca2-cd22df5c14c9. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-c1b37a5f-79ee-4100-9d61-71e23d5c937e']
2026-10-26 02:47:40,726 - WARNING - Deleting VN ctest-vn2-52561900 failed..Will retry
2026-10-26 02:47:42,890 - DEBUG - Response for deleting network ()
2026-10-26 02:47:42,890 - INFO - Deleting VN ctest-vn1-53457565
2026-10-26 02:47:43,079 - DEBUG - Response for deleting network ()
2026-10-26 02:47:44,370 - DEBUG - No XMPP flaps were noticed during the test
2026-10-26 02:47:44,370 - INFO - END TEST : test_basic_router_behavior : PASSED[0:01:07]
2026-10-26 02:47:44,370 - INFO - --------------------------------------------------------------------------------
2026-10-26 02:47:45,210 - INFO - Deleted project: ctest-TestRouters-67889562, ID : f6c1f3e7-5b5b-4da6-b588-10c27b804db8