2025-12-04 02:34:47,159 - INFO - Domain Default found not creating 2025-12-04 02:34:47,391 - INFO - Project ctest-TestRouters-64680255 not found, creating it 2025-12-04 02:34:47,964 - INFO - Created Project:ctest-TestRouters-64680255, ID : 6c4d0824-673d-4572-9d41-fe4147caf35c 2025-12-04 02:34:49,650 - INFO - ================================================================================ 2025-12-04 02:34:49,650 - INFO - STARTING TEST : test_basic_router_behavior 2025-12-04 02:34:49,650 - INFO - TEST DESCRIPTION : Validate a router is able to route packets between two VNs Create a router Create 2 VNs, and a VM in each Add router port from each VN Ping between VMs 2025-12-04 02:34:50,930 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.209': '0', '10.20.0.254': '0'}, '10.0.0.130': {'10.20.0.192': '0', '10.20.0.209': '0'}} with 2025-12-04 02:34:50,930 - INFO - Initial checks done. Running the testcase now 2025-12-04 02:34:50,930 - INFO - 2025-12-04 02:34:51,633 - DEBUG - Response for create_network : {'network': {'id': 'cb7e86ec-91b0-4a34-96f2-92a4c58acfc7', 'name': 'ctest-vn1-93292322', 'tenant_id': '6c4d0824673d45729d41fe4147caf35c', 'project_id': '6c4d0824673d45729d41fe4147caf35c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-64680255', 'ctest-vn1-93292322'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 02:34:51,957 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b798eff1-b6f8-446b-baf6-bd556c127686', 'name': '', 'tenant_id': '6c4d0824673d45729d41fe4147caf35c', 'network_id': 'cb7e86ec-91b0-4a34-96f2-92a4c58acfc7', 'ip_version': 4, 'cidr': '13.224.246.128/26', 'allocation_pools': [{'start': '13.224.246.130', 'end': '13.224.246.190'}], 'gateway_ip': '13.224.246.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '13.224.246.130', 'tags': [], 'project_id': '6c4d0824673d45729d41fe4147caf35c'}} 2025-12-04 02:34:52,003 - INFO - Created VN ctest-vn1-93292322 2025-12-04 02:34:52,016 - DEBUG - VN ctest-vn1-93292322 UUID is cb7e86ec-91b0-4a34-96f2-92a4c58acfc7 2025-12-04 02:34:52,445 - DEBUG - Response for create_network : {'network': {'id': '9c0d5cb8-0b27-4073-a0de-5f312287d1d5', 'name': 'ctest-vn2-90374241', 'tenant_id': '6c4d0824673d45729d41fe4147caf35c', 'project_id': '6c4d0824673d45729d41fe4147caf35c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRouters-64680255', 'ctest-vn2-90374241'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 02:34:52,734 - DEBUG - Response for create_subnet : {'subnet': {'id': '702da9c3-c5b7-410e-b900-3b4d8015e3de', 'name': '', 'tenant_id': '6c4d0824673d45729d41fe4147caf35c', 'network_id': '9c0d5cb8-0b27-4073-a0de-5f312287d1d5', 'ip_version': 4, 'cidr': '201.244.104.0/26', 'allocation_pools': [{'start': '201.244.104.2', 'end': '201.244.104.62'}], 'gateway_ip': '201.244.104.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '201.244.104.2', 'tags': [], 'project_id': '6c4d0824673d45729d41fe4147caf35c'}} 2025-12-04 02:34:52,759 - INFO - Created VN ctest-vn2-90374241 2025-12-04 02:34:52,771 - DEBUG - VN ctest-vn2-90374241 UUID is 9c0d5cb8-0b27-4073-a0de-5f312287d1d5 2025-12-04 02:34:52,915 - DEBUG - Services list from nova: [, , , ] 2025-12-04 02:34:54,070 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-1) 2025-12-04 02:34:55,560 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-2) 2025-12-04 02:34:55,698 - INFO - Adding interface with subnet_id b798eff1-b6f8-446b-baf6-bd556c127686, port_id None to router 24e70b8e-f3a0-410f-9033-f9823d8b516a 2025-12-04 02:34:56,164 - INFO - Waiting for VM ctest-vn1-vm1-76719979 to be up.. 2025-12-04 02:34:56,339 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-12-04 02:35:01,428 - DEBUG - VM is in ACTIVE state now 2025-12-04 02:35:01,428 - INFO - VM name : ctest-vn1-vm1-76719979 2025-12-04 02:35:01,517 - DEBUG - VM ctest-vn1-vm1-76719979 ID is 50ffc61c-cd34-4e62-8f7a-f1a54811fff1 2025-12-04 02:35:01,549 - DEBUG - VM ctest-vn1-vm1-76719979 launched on Node an-jenkins-deploy-platform-ansible-os-4840-1 2025-12-04 02:35:01,637 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/50ffc61c-cd34-4e62-8f7a-f1a54811fff1 2025-12-04 02:35:01,943 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/50ffc61c-cd34-4e62-8f7a-f1a54811fff1 2025-12-04 02:35:01,983 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/7ccb1aad-cbcb-460a-ab5b-5837f905a2ec 2025-12-04 02:35:05,157 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-12-04 02:35:05,157 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-76719979 failed! 2025-12-04 02:35:05,175 - DEBUG - Gateway for vn default-domain:ctest-TestRouters-64680255:ctest-vn1-93292322 is 13.224.246.129 and allocation pool is NOT set 2025-12-04 02:35:09,247 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=9.58 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1014ms\r\nrtt min/avg/max/mdev = 9.584/9.584/9.584/0.000 ms') 2025-12-04 02:35:09,247 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1-vm1-76719979 passed 2025-12-04 02:35:09,319 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:09,319 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-76719979, IP 13.224.246.131, Port 22 2025-12-04 02:35:09,397 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-12-04 02:35:09,493 - DEBUG - VM ctest-vn1-vm1-76719979 is NOT ready for SSH connections, VM status: ACTIVE 2025-12-04 02:35:14,494 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:14,494 - DEBUG - Waiting to SSH to VM ctest-vn1-vm1-76719979, IP 13.224.246.131, Port 22 2025-12-04 02:35:14,662 - DEBUG - VM ctest-vn1-vm1-76719979 is ready for SSH connections 2025-12-04 02:35:14,662 - INFO - Waiting for VM ctest-vn2-vm1-94747248 to be up.. 2025-12-04 02:35:14,753 - DEBUG - VM is in ACTIVE state now 2025-12-04 02:35:14,753 - INFO - VM name : ctest-vn2-vm1-94747248 2025-12-04 02:35:14,844 - DEBUG - VM ctest-vn2-vm1-94747248 ID is c7766d0d-f5bd-413c-8502-a0b286250a54 2025-12-04 02:35:14,844 - DEBUG - VM ctest-vn2-vm1-94747248 launched on Node an-jenkins-deploy-platform-ansible-os-4840-2 2025-12-04 02:35:14,929 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/c7766d0d-f5bd-413c-8502-a0b286250a54 2025-12-04 02:35:14,949 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/209e37fa-d58d-4071-b85b-4ede5ac4957d 2025-12-04 02:35:16,104 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.23 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.437 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.437/2.331/4.226/1.894 ms') 2025-12-04 02:35:16,104 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2-vm1-94747248 passed 2025-12-04 02:35:16,174 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:16,174 - DEBUG - Waiting to SSH to VM ctest-vn2-vm1-94747248, IP 201.244.104.3, Port 22 2025-12-04 02:35:16,349 - DEBUG - VM ctest-vn2-vm1-94747248 is ready for SSH connections 2025-12-04 02:35:16,349 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:16,349 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 201.244.104.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 02:35:16,350 - DEBUG - ping -s 56 -c 3 -W 1 201.244.104.3 2025-12-04 02:35:20,455 - DEBUG - PING 201.244.104.3 (201.244.104.3): 56 data bytes --- 201.244.104.3 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-12-04 02:35:20,455 - WARNING - Ping to IP 201.244.104.3 from VM ctest-vn1-vm1-76719979 failed 2025-12-04 02:35:20,455 - INFO - Adding interface with subnet_id 702da9c3-c5b7-410e-b900-3b4d8015e3de, port_id None to router 24e70b8e-f3a0-410f-9033-f9823d8b516a 2025-12-04 02:35:21,008 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:21,008 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 201.244.104.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 02:35:21,008 - DEBUG - ping -s 56 -c 3 -W 1 201.244.104.3 2025-12-04 02:35:23,256 - DEBUG - PING 201.244.104.3 (201.244.104.3): 56 data bytes 64 bytes from 201.244.104.3: seq=0 ttl=63 time=4.754 ms 64 bytes from 201.244.104.3: seq=1 ttl=63 time=1.471 ms 64 bytes from 201.244.104.3: seq=2 ttl=63 time=1.285 ms --- 201.244.104.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.285/2.503/4.754 ms 2025-12-04 02:35:23,256 - INFO - Ping to IP 201.244.104.3 from VM ctest-vn1-vm1-76719979 passed 2025-12-04 02:35:23,257 - INFO - Deleting interface with subnet_id b798eff1-b6f8-446b-baf6-bd556c127686, port_id None from router 24e70b8e-f3a0-410f-9033-f9823d8b516a 2025-12-04 02:35:23,490 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:23,490 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 201.244.104.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 02:35:23,490 - DEBUG - ping -s 56 -c 3 -W 1 201.244.104.3 2025-12-04 02:35:26,708 - DEBUG - PING 201.244.104.3 (201.244.104.3): 56 data bytes --- 201.244.104.3 ping statistics --- 3 packets transmitted, 0 packets received, 100% packet loss 2025-12-04 02:35:26,708 - WARNING - Ping to IP 201.244.104.3 from VM ctest-vn1-vm1-76719979 failed 2025-12-04 02:35:26,708 - INFO - Adding interface with subnet_id b798eff1-b6f8-446b-baf6-bd556c127686, port_id None to router 24e70b8e-f3a0-410f-9033-f9823d8b516a 2025-12-04 02:35:27,066 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-12-04 02:35:27,066 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 201.244.104.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.22, gateway password: c0ntrail123 2025-12-04 02:35:27,066 - DEBUG - ping -s 56 -c 3 -W 1 201.244.104.3 2025-12-04 02:35:29,299 - DEBUG - PING 201.244.104.3 (201.244.104.3): 56 data bytes 64 bytes from 201.244.104.3: seq=0 ttl=63 time=3.401 ms 64 bytes from 201.244.104.3: seq=1 ttl=63 time=1.342 ms 64 bytes from 201.244.104.3: seq=2 ttl=63 time=1.762 ms --- 201.244.104.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.342/2.168/3.401 ms 2025-12-04 02:35:29,299 - INFO - Ping to IP 201.244.104.3 from VM ctest-vn1-vm1-76719979 passed 2025-12-04 02:35:29,299 - INFO - Deleting interface with subnet_id 702da9c3-c5b7-410e-b900-3b4d8015e3de, port_id None from router 24e70b8e-f3a0-410f-9033-f9823d8b516a 2025-12-04 02:35:29,527 - INFO - Deleting interface with subnet_id b798eff1-b6f8-446b-baf6-bd556c127686, port_id None from router 24e70b8e-f3a0-410f-9033-f9823d8b516a 2025-12-04 02:35:29,857 - INFO - Deleting VM ctest-vn2-vm1-94747248 2025-12-04 02:35:29,980 - INFO - Deleting VM ctest-vn1-vm1-76719979 2025-12-04 02:35:30,063 - INFO - Deleting VN ctest-vn2-90374241 2025-12-04 02:35:30,108 - DEBUG - VN 9c0d5cb8-0b27-4073-a0de-5f312287d1d5 still in use: Unable to complete operation on network 9c0d5cb8-0b27-4073-a0de-5f312287d1d5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-26790585-8e9f-4e56-b489-e07ec4c4cd6a'] 2025-12-04 02:35:30,108 - WARNING - Deleting VN ctest-vn2-90374241 failed..Will retry 2025-12-04 02:35:32,298 - DEBUG - Response for deleting network () 2025-12-04 02:35:32,298 - INFO - Deleting VN ctest-vn1-93292322 2025-12-04 02:35:32,491 - DEBUG - Response for deleting network () 2025-12-04 02:35:33,796 - DEBUG - No XMPP flaps were noticed during the test 2025-12-04 02:35:33,797 - INFO - END TEST : test_basic_router_behavior : PASSED[0:00:44] 2025-12-04 02:35:33,797 - INFO - -------------------------------------------------------------------------------- 2025-12-04 02:35:34,712 - INFO - Deleted project: ctest-TestRouters-64680255, ID : 6c4d0824-673d-4572-9d41-fe4147caf35c