2026-03-30 04:15:57,043 - INFO - Domain Default found not creating
2026-03-30 04:15:57,261 - INFO - Project ctest-TestRouters-43037736 not found, creating it
2026-03-30 04:15:57,870 - INFO - Created Project:ctest-TestRouters-43037736, ID : 84d2a65b-d43b-49dc-9c44-807a979ae053
2026-03-30 04:16:00,803 - INFO - ================================================================================
2026-03-30 04:16:00,803 - INFO - STARTING TEST : test_basic_router_behavior
2026-03-30 04:16:00,805 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs
Create a router
Create 2 VNs, and a VM in each
Add router port from each VN
Ping between VMs
2026-03-30 04:16:02,131 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with
2026-03-30 04:16:02,131 - INFO - Initial checks done. Running the testcase now
2026-03-30 04:16:02,131 - INFO -
2026-03-30 04:16:02,909 - DEBUG - Response for create_network : {'network': {'id': 'ab21abd6-355a-4cde-8a6d-48a0835dbd9c', 'name': 'ctest-vn1-80971222', 'tenant_id': '84d2a65bd43b49dc9c44807a979ae053', 'project_id': '84d2a65bd43b49dc9c44807a979ae053', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-43037736', 'ctest-vn1-80971222'], 'port_security_enabled': True, 'description': ''}}
2026-03-30 04:16:03,216 - DEBUG - Response for create_subnet : {'subnet': {'id': '659e3982-7fea-4a8d-b426-c260eba125db', 'name': '', 'tenant_id': '84d2a65bd43b49dc9c44807a979ae053', 'network_id': 'ab21abd6-355a-4cde-8a6d-48a0835dbd9c', 'ip_version': 4, 'cidr': '216.156.175.192/26', 'allocation_pools': [{'start': '216.156.175.194', 'end': '216.156.175.254'}], 'gateway_ip': '216.156.175.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '216.156.175.194', 'tags': [], 'project_id': '84d2a65bd43b49dc9c44807a979ae053'}}
2026-03-30 04:16:03,243 - INFO - Created VN ctest-vn1-80971222
2026-03-30 04:16:03,263 - DEBUG - VN ctest-vn1-80971222 UUID is ab21abd6-355a-4cde-8a6d-48a0835dbd9c
2026-03-30 04:16:03,716 - DEBUG - Response for create_network : {'network': {'id': '707d0841-6626-463b-9f8a-6e16e00ea680', 'name': 'ctest-vn2-81727376', 'tenant_id': '84d2a65bd43b49dc9c44807a979ae053', 'project_id': '84d2a65bd43b49dc9c44807a979ae053', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-43037736', 'ctest-vn2-81727376'], 'port_security_enabled': True, 'description': ''}}
2026-03-30 04:16:04,025 - DEBUG - Response for create_subnet : {'subnet': {'id': '9cfbf36a-1b42-41ed-81f6-eb2facbe2150', 'name': '', 'tenant_id': '84d2a65bd43b49dc9c44807a979ae053', 'network_id': '707d0841-6626-463b-9f8a-6e16e00ea680', 'ip_version': 4, 'cidr': '27.235.11.64/26', 'allocation_pools': [{'start': '27.235.11.66', 'end': '27.235.11.126'}], 'gateway_ip': '27.235.11.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.235.11.66', 'tags': [], 'project_id': '84d2a65bd43b49dc9c44807a979ae053'}}
2026-03-30 04:16:04,052 - INFO - Created VN ctest-vn2-81727376
2026-03-30 04:16:04,066 - DEBUG - VN ctest-vn2-81727376 UUID is 707d0841-6626-463b-9f8a-6e16e00ea680
2026-03-30 04:16:04,228 - DEBUG - Services list from nova: [, , , ]
2026-03-30 04:16:05,506 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5563-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5563-1)
2026-03-30 04:16:07,093 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5563-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5563-2)
2026-03-30 04:16:07,220 - INFO - Adding interface with subnet_id 659e3982-7fea-4a8d-b426-c260eba125db, port_id None to router 8dc3b2f8-d6b5-4f45-a873-0fb2f088ce15
2026-03-30 04:16:07,684 - INFO - Waiting for VM ctest-vn1-vm1-36670832 to be up..
2026-03-30 04:16:07,861 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-30 04:16:12,965 - DEBUG - VM is in ACTIVE state now
2026-03-30 04:16:12,965 - INFO - VM name : ctest-vn1-vm1-36670832
2026-03-30 04:16:13,066 - DEBUG - VM ctest-vn1-vm1-36670832 ID is 02d5be58-324e-4e8a-873f-a70947e92e03
2026-03-30 04:16:13,104 - DEBUG - VM ctest-vn1-vm1-36670832 launched on Node an-jenkins-deploy-platform-ansible-os-5563-1
2026-03-30 04:16:13,245 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/02d5be58-324e-4e8a-873f-a70947e92e03
2026-03-30 04:16:13,559 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/02d5be58-324e-4e8a-873f-a70947e92e03
2026-03-30 04:16:13,619 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/34338928-9a85-4cfb-8737-62766f7a2a35
2026-03-30 04:16:16,865 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-03-30 04:16:16,865 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-36670832 failed!
2026-03-30 04:16:16,881 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-43037736:ctest-vn1-80971222 is 216.156.175.193 and allocation pool is NOT set
2026-03-30 04:16:18,954 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.42 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.293 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.293/2.355/4.417/2.062 ms')
2026-03-30 04:16:18,954 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-36670832 passed
2026-03-30 04:16:19,085 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:16:19,085 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-36670832, IP 216.156.175.195, Port 22
2026-03-30 04:16:19,267 - DEBUG - VM ctest-vn1-vm1-36670832 is ready for SSH connections
2026-03-30 04:16:19,267 - INFO - Waiting for VM ctest-vn2-vm1-17336244 to be up..
2026-03-30 04:16:19,379 - DEBUG - VM is in ACTIVE state now
2026-03-30 04:16:19,379 - INFO - VM name : ctest-vn2-vm1-17336244
2026-03-30 04:16:19,479 - DEBUG - VM ctest-vn2-vm1-17336244 ID is f57b5761-fa55-48a0-a5e8-6b01f4c0dca2
2026-03-30 04:16:19,479 - DEBUG - VM ctest-vn2-vm1-17336244 launched on Node an-jenkins-deploy-platform-ansible-os-5563-2
2026-03-30 04:16:19,589 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/f57b5761-fa55-48a0-a5e8-6b01f4c0dca2
2026-03-30 04:16:19,602 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/6a936aeb-2e79-4045-8c41-fd6907df541c
2026-03-30 04:16:20,819 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.78 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.614 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.614/2.197/3.781/1.583 ms')
2026-03-30 04:16:20,819 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-17336244 passed
2026-03-30 04:16:20,934 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:16:20,934 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-17336244, IP 27.235.11.67, Port 22
2026-03-30 04:16:21,110 - DEBUG - VM ctest-vn2-vm1-17336244 is ready for SSH connections
2026-03-30 04:16:21,110 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:16:21,110 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 27.235.11.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2026-03-30 04:16:21,110 - DEBUG - ping -s 56 -c 3 -W 1 27.235.11.67
2026-03-30 04:16:26,162 - DEBUG - PING 27.235.11.67 (27.235.11.67): 56 data bytes
--- 27.235.11.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-03-30 04:16:26,162 - WARNING - Ping to IP 27.235.11.67 from VM ctest-vn1-vm1-36670832 failed
2026-03-30 04:16:26,162 - INFO - Adding interface with subnet_id 9cfbf36a-1b42-41ed-81f6-eb2facbe2150, port_id None to router 8dc3b2f8-d6b5-4f45-a873-0fb2f088ce15
2026-03-30 04:16:26,746 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:16:26,746 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 27.235.11.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2026-03-30 04:16:26,746 - DEBUG - ping -s 56 -c 3 -W 1 27.235.11.67
2026-03-30 04:16:28,982 - DEBUG - PING 27.235.11.67 (27.235.11.67): 56 data bytes
64 bytes from 27.235.11.67: seq=0 ttl=63 time=4.248 ms
64 bytes from 27.235.11.67: seq=1 ttl=63 time=1.336 ms
64 bytes from 27.235.11.67: seq=2 ttl=63 time=1.769 ms
--- 27.235.11.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.336/2.451/4.248 ms
2026-03-30 04:16:28,982 - INFO - Ping to IP 27.235.11.67 from VM ctest-vn1-vm1-36670832 passed
2026-03-30 04:16:28,983 - INFO - Deleting interface with subnet_id 659e3982-7fea-4a8d-b426-c260eba125db, port_id None from router 8dc3b2f8-d6b5-4f45-a873-0fb2f088ce15
2026-03-30 04:16:29,288 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:16:29,288 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 27.235.11.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2026-03-30 04:16:29,288 - DEBUG - ping -s 56 -c 3 -W 1 27.235.11.67
2026-03-30 04:16:32,496 - DEBUG - PING 27.235.11.67 (27.235.11.67): 56 data bytes
--- 27.235.11.67 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
2026-03-30 04:16:32,497 - WARNING - Ping to IP 27.235.11.67 from VM ctest-vn1-vm1-36670832 failed
2026-03-30 04:16:32,497 - INFO - Adding interface with subnet_id 659e3982-7fea-4a8d-b426-c260eba125db, port_id None to router 8dc3b2f8-d6b5-4f45-a873-0fb2f088ce15
2026-03-30 04:16:32,911 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:16:32,911 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 27.235.11.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2026-03-30 04:16:32,912 - DEBUG - ping -s 56 -c 3 -W 1 27.235.11.67
2026-03-30 04:16:35,133 - DEBUG - PING 27.235.11.67 (27.235.11.67): 56 data bytes
64 bytes from 27.235.11.67: seq=0 ttl=63 time=3.188 ms
64 bytes from 27.235.11.67: seq=1 ttl=63 time=1.234 ms
64 bytes from 27.235.11.67: seq=2 ttl=63 time=1.051 ms
--- 27.235.11.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.051/1.824/3.188 ms
2026-03-30 04:16:35,133 - INFO - Ping to IP 27.235.11.67 from VM ctest-vn1-vm1-36670832 passed
2026-03-30 04:16:35,134 - INFO - Deleting interface with subnet_id 9cfbf36a-1b42-41ed-81f6-eb2facbe2150, port_id None from router 8dc3b2f8-d6b5-4f45-a873-0fb2f088ce15
2026-03-30 04:16:35,416 - INFO - Deleting interface with subnet_id 659e3982-7fea-4a8d-b426-c260eba125db, port_id None from router 8dc3b2f8-d6b5-4f45-a873-0fb2f088ce15
2026-03-30 04:16:35,745 - INFO - Deleting VM ctest-vn2-vm1-17336244
2026-03-30 04:16:35,857 - INFO - Deleting VM ctest-vn1-vm1-36670832
2026-03-30 04:16:35,971 - INFO - Deleting VN ctest-vn2-81727376
2026-03-30 04:16:36,020 - DEBUG - VN 707d0841-6626-463b-9f8a-6e16e00ea680 still in use: Unable to complete operation on network 707d0841-6626-463b-9f8a-6e16e00ea680. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d0319fbd-1383-4dc7-a028-77930bf4600d']
2026-03-30 04:16:36,020 - WARNING - Deleting VN ctest-vn2-81727376 failed..Will retry
2026-03-30 04:16:38,239 - DEBUG - Response for deleting network ()
2026-03-30 04:16:38,239 - INFO - Deleting VN ctest-vn1-80971222
2026-03-30 04:16:38,422 - DEBUG - Response for deleting network ()
2026-03-30 04:16:39,753 - DEBUG - No XMPP flaps were noticed during the test
2026-03-30 04:16:39,753 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:39]
2026-03-30 04:16:39,753 - INFO - --------------------------------------------------------------------------------
2026-03-30 04:16:40,569 - INFO - Deleted project: ctest-TestRouters-43037736, ID : 84d2a65b-d43b-49dc-9c44-807a979ae053