2026-04-06 03:18:10,536 - INFO - Domain Default found not creating 2026-04-06 03:18:10,695 - INFO - Project ctest-TestRP-02593412 not found, creating it 2026-04-06 03:18:11,300 - INFO - Created Project:ctest-TestRP-02593412, ID : f270859f-76d0-4df7-b1c9-2c8f1cbc6c86 2026-04-06 03:18:12,752 - DEBUG - Services list from nova: [, , , ] 2026-04-06 03:18:12,752 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5596-2', 'an-jenkins-deploy-platform-ansible-os-5596-1']} 2026-04-06 03:18:12,754 - INFO - ================================================================================ 2026-04-06 03:18:12,755 - INFO - STARTING TEST : test_rp_interface 2026-04-06 03:18:12,755 - INFO - TEST DESCRIPTION : 1. Create a routing policy with interface match. 2. Launch VMs. 3. Attach policy to VN and confirm if policy takes hold. 2026-04-06 03:18:14,059 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.241': {'10.20.0.18': '0', '10.20.0.129': '0'}} with 2026-04-06 03:18:14,059 - INFO - Initial checks done. Running the testcase now 2026-04-06 03:18:14,059 - INFO - 2026-04-06 03:18:14,774 - DEBUG - Response for create_network : {'network': {'id': '10aef0e9-7990-4619-bc12-83f8f5a33d4e', 'name': 'ctest-bgpaas_vn-75459119', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRP-02593412', 'ctest-bgpaas_vn-75459119'], 'port_security_enabled': True, 'description': ''}} 2026-04-06 03:18:15,098 - DEBUG - Response for create_subnet : {'subnet': {'id': '532c3b8c-16bd-457e-9df3-1b46e66bdbef', 'name': '', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'network_id': '10aef0e9-7990-4619-bc12-83f8f5a33d4e', 'ip_version': 4, 'cidr': '75.84.73.192/26', 'allocation_pools': [{'start': '75.84.73.194', 'end': '75.84.73.254'}], 'gateway_ip': '75.84.73.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '75.84.73.194', 'tags': [], 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86'}} 2026-04-06 03:18:15,121 - INFO - Created VN ctest-bgpaas_vn-75459119 2026-04-06 03:18:15,133 - DEBUG - VN ctest-bgpaas_vn-75459119 UUID is 10aef0e9-7990-4619-bc12-83f8f5a33d4e 2026-04-06 03:18:15,737 - DEBUG - Response for create_network : {'network': {'id': 'a12d04c8-b2c1-458f-a7f6-5b1800b95b9b', 'name': 'ctest-bgpaas_vn-42877947', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRP-02593412', 'ctest-bgpaas_vn-42877947'], 'port_security_enabled': True, 'description': ''}} 2026-04-06 03:18:15,992 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c3d84c52-8723-482b-a81c-e3d09c07813a', 'name': '', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'network_id': 'a12d04c8-b2c1-458f-a7f6-5b1800b95b9b', 'ip_version': 4, 'cidr': '29.31.198.64/26', 'allocation_pools': [{'start': '29.31.198.66', 'end': '29.31.198.126'}], 'gateway_ip': '29.31.198.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '29.31.198.66', 'tags': [], 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86'}} 2026-04-06 03:18:16,018 - INFO - Created VN ctest-bgpaas_vn-42877947 2026-04-06 03:18:16,028 - DEBUG - VN ctest-bgpaas_vn-42877947 UUID is a12d04c8-b2c1-458f-a7f6-5b1800b95b9b 2026-04-06 03:18:17,414 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-2) 2026-04-06 03:18:18,755 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-1) 2026-04-06 03:18:18,755 - INFO - Waiting for VM test_vm to be up.. 2026-04-06 03:18:18,852 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-04-06 03:18:23,926 - DEBUG - VM is in ACTIVE state now 2026-04-06 03:18:23,927 - INFO - VM name : test_vm 2026-04-06 03:18:24,004 - DEBUG - VM test_vm ID is 54bc190c-7771-4f67-9e98-938eb74407eb 2026-04-06 03:18:24,026 - DEBUG - VM test_vm launched on Node an-jenkins-deploy-platform-ansible-os-5596-2 2026-04-06 03:18:24,109 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/54bc190c-7771-4f67-9e98-938eb74407eb 2026-04-06 03:18:24,414 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/54bc190c-7771-4f67-9e98-938eb74407eb 2026-04-06 03:18:24,447 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/f44bb9cc-3dc6-431f-aa7a-90bf0553aa1d 2026-04-06 03:18:27,613 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2026-04-06 03:18:27,613 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM test_vm failed! 2026-04-06 03:18:27,631 - DEBUG - Gateway for vn default-domain:ctest-TestRP-02593412:ctest-bgpaas_vn-75459119 is 75.84.73.193 and allocation pool is NOT set 2026-04-06 03:18:29,692 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.83 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.669 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.669/2.249/3.829/1.580 ms') 2026-04-06 03:18:29,692 - INFO - Ping to Metadata IP 169.254.0.3 of VM test_vm passed 2026-04-06 03:18:29,761 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-06 03:18:29,761 - DEBUG - Waiting to SSH to VM test_vm, IP 75.84.73.195, Port 22 2026-04-06 03:18:29,922 - DEBUG - VM test_vm is ready for SSH connections 2026-04-06 03:18:29,922 - INFO - Waiting for VM test2_vm to be up.. 2026-04-06 03:18:30,004 - DEBUG - VM is in ACTIVE state now 2026-04-06 03:18:30,005 - INFO - VM name : test2_vm 2026-04-06 03:18:30,086 - DEBUG - VM test2_vm ID is 7ddcf10c-d193-440c-aae4-addcd82bd993 2026-04-06 03:18:30,087 - DEBUG - VM test2_vm launched on Node an-jenkins-deploy-platform-ansible-os-5596-1 2026-04-06 03:18:30,157 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/7ddcf10c-d193-440c-aae4-addcd82bd993 2026-04-06 03:18:30,168 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/8c25c465-008e-4fb8-b0ac-bf87f0bd5a7d 2026-04-06 03:18:31,334 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.15 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.17 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.171/3.160/5.149/1.989 ms') 2026-04-06 03:18:31,334 - INFO - Ping to Metadata IP 169.254.0.3 of VM test2_vm passed 2026-04-06 03:18:31,404 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-06 03:18:31,404 - DEBUG - Waiting to SSH to VM test2_vm, IP 29.31.198.67, Port 22 2026-04-06 03:18:31,577 - DEBUG - VM test2_vm is ready for SSH connections 2026-04-06 03:18:31,743 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-06 03:18:31,757 - DEBUG - Requesting: http://10.20.0.18:8083/Snh_ShowRouteReq?x=default-domain:ctest-TestRP-02593412:ctest-bgpaas_vn-75459119:ctest-bgpaas_vn-75459119.inet.0 2026-04-06 03:18:31,776 - DEBUG - Requesting: http://10.20.0.129:8083/Snh_ShowRouteReq?x=default-domain:ctest-TestRP-02593412:ctest-bgpaas_vn-75459119:ctest-bgpaas_vn-75459119.inet.0 2026-04-06 03:18:31,792 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-06 03:18:31,792 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 29.31.198.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2026-04-06 03:18:31,792 - DEBUG - ping -s 56 -c 3 -W 1 29.31.198.67 2026-04-06 03:18:35,709 - DEBUG - PING 29.31.198.67 (29.31.198.67): 56 data bytes 64 bytes from 29.31.198.67: seq=0 ttl=63 time=7.050 ms 64 bytes from 29.31.198.67: seq=1 ttl=63 time=1.339 ms 64 bytes from 29.31.198.67: seq=2 ttl=63 time=1.493 ms --- 29.31.198.67 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.339/3.294/7.050 ms 2026-04-06 03:18:35,709 - INFO - Ping to IP 29.31.198.67 from VM test_vm passed 2026-04-06 03:18:35,818 - INFO - Deleting VM test2_vm 2026-04-06 03:18:35,885 - INFO - Deleting VM test_vm 2026-04-06 03:18:35,948 - INFO - Deleting VN ctest-bgpaas_vn-42877947 2026-04-06 03:18:35,992 - DEBUG - VN a12d04c8-b2c1-458f-a7f6-5b1800b95b9b still in use: Unable to complete operation on network a12d04c8-b2c1-458f-a7f6-5b1800b95b9b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ba0675c7-276d-4d70-87db-c3c897610fc7'] 2026-04-06 03:18:35,992 - WARNING - Deleting VN ctest-bgpaas_vn-42877947 failed..Will retry 2026-04-06 03:18:38,146 - DEBUG - Response for deleting network () 2026-04-06 03:18:38,146 - INFO - Deleting VN ctest-bgpaas_vn-75459119 2026-04-06 03:18:38,308 - DEBUG - Response for deleting network () 2026-04-06 03:18:39,600 - DEBUG - No XMPP flaps were noticed during the test
2026-04-06 03:18:39,600 - INFO - END TEST : test_rp_interface : PASSED[0:00:27]
2026-04-06 03:18:39,600 - INFO - -------------------------------------------------------------------------------- 2026-04-06 03:18:39,604 - INFO - ================================================================================ 2026-04-06 03:18:39,604 - INFO - STARTING TEST : test_rp_interface_ext_community 2026-04-06 03:18:39,605 - INFO - TEST DESCRIPTION : 1. Create a routing policy with interface match. 2. Launch VMs. 3. Attach policy to VN and confirm if policy takes hold. 2026-04-06 03:18:40,870 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.241': {'10.20.0.18': '0', '10.20.0.129': '0'}} with 2026-04-06 03:18:40,870 - INFO - Initial checks done. Running the testcase now 2026-04-06 03:18:40,870 - INFO - 2026-04-06 03:18:41,125 - DEBUG - Response for create_network : {'network': {'id': '4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae', 'name': 'ctest-bgpaas_vn-28997837', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRP-02593412', 'ctest-bgpaas_vn-28997837'], 'port_security_enabled': True, 'description': ''}} 2026-04-06 03:18:41,373 - DEBUG - Response for create_subnet : {'subnet': {'id': '88e6255d-2437-4c9f-a1ec-75c2fbce014e', 'name': '', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'network_id': '4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae', 'ip_version': 4, 'cidr': '136.129.72.192/26', 'allocation_pools': [{'start': '136.129.72.194', 'end': '136.129.72.254'}], 'gateway_ip': '136.129.72.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.129.72.194', 'tags': [], 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86'}} 2026-04-06 03:18:41,395 - INFO - Created VN ctest-bgpaas_vn-28997837 2026-04-06 03:18:41,405 - DEBUG - VN ctest-bgpaas_vn-28997837 UUID is 4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae 2026-04-06 03:18:41,989 - DEBUG - Response for create_network : {'network': {'id': 'eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29', 'name': 'ctest-bgpaas_vn-66020486', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRP-02593412', 'ctest-bgpaas_vn-66020486'], 'port_security_enabled': True, 'description': ''}} 2026-04-06 03:18:42,190 - DEBUG - Response for create_subnet : {'subnet': {'id': '79030cbf-aa98-4fd1-a52b-e7b622885b98', 'name': '', 'tenant_id': 'f270859f76d04df7b1c92c8f1cbc6c86', 'network_id': 'eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29', 'ip_version': 4, 'cidr': '1.47.30.192/26', 'allocation_pools': [{'start': '1.47.30.194', 'end': '1.47.30.254'}], 'gateway_ip': '1.47.30.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '1.47.30.194', 'tags': [], 'project_id': 'f270859f76d04df7b1c92c8f1cbc6c86'}} 2026-04-06 03:18:42,208 - INFO - Created VN ctest-bgpaas_vn-66020486 2026-04-06 03:18:42,222 - DEBUG - VN ctest-bgpaas_vn-66020486 UUID is eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29 2026-04-06 03:18:43,497 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-2) 2026-04-06 03:18:44,746 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-1) 2026-04-06 03:18:44,746 - INFO - Waiting for VM test_vm to be up.. 2026-04-06 03:18:44,852 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-04-06 03:18:49,943 - DEBUG - VM is in ACTIVE state now 2026-04-06 03:18:49,944 - INFO - VM name : test_vm 2026-04-06 03:18:50,025 - DEBUG - VM test_vm ID is e807b1b8-1b0b-4179-92a6-b94fb18fe2e0 2026-04-06 03:18:50,025 - DEBUG - VM test_vm launched on Node an-jenkins-deploy-platform-ansible-os-5596-2 2026-04-06 03:18:50,120 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/e807b1b8-1b0b-4179-92a6-b94fb18fe2e0 2026-04-06 03:18:50,132 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/8e43d08f-4771-469b-a341-1bf4285e4a04 2026-04-06 03:18:53,315 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2026-04-06 03:18:53,315 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM test_vm failed! 2026-04-06 03:18:53,329 - DEBUG - Gateway for vn default-domain:ctest-TestRP-02593412:ctest-bgpaas_vn-28997837 is 136.129.72.193 and allocation pool is NOT set 2026-04-06 03:18:55,396 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.94 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.27 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.267/3.102/4.938/1.835 ms') 2026-04-06 03:18:55,396 - INFO - Ping to Metadata IP 169.254.0.3 of VM test_vm passed 2026-04-06 03:18:55,479 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-06 03:18:55,479 - DEBUG - Waiting to SSH to VM test_vm, IP 136.129.72.195, Port 22 2026-04-06 03:18:55,645 - DEBUG - VM test_vm is ready for SSH connections 2026-04-06 03:18:55,645 - INFO - Waiting for VM test2_vm to be up.. 2026-04-06 03:18:55,749 - DEBUG - VM is in ACTIVE state now 2026-04-06 03:18:55,749 - INFO - VM name : test2_vm 2026-04-06 03:19:00,857 - DEBUG - VM test2_vm ID is dedc25ed-2334-4601-ac4a-55bca7ce1f30 2026-04-06 03:19:00,857 - DEBUG - VM test2_vm launched on Node an-jenkins-deploy-platform-ansible-os-5596-1 2026-04-06 03:19:00,943 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/dedc25ed-2334-4601-ac4a-55bca7ce1f30 2026-04-06 03:19:00,956 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/e61a7467-534b-4439-80f2-cf09fb6e5ac6 2026-04-06 03:19:02,117 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.437 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.437/2.041/3.646/1.604 ms') 2026-04-06 03:19:02,117 - INFO - Ping to Metadata IP 169.254.0.3 of VM test2_vm passed 2026-04-06 03:19:02,190 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-06 03:19:02,190 - DEBUG - Waiting to SSH to VM test2_vm, IP 1.47.30.195, Port 22 2026-04-06 03:19:02,346 - DEBUG - VM test2_vm is ready for SSH connections 2026-04-06 03:19:06,535 - INFO - Deleting VM test2_vm 2026-04-06 03:19:06,600 - INFO - Deleting VM test_vm 2026-04-06 03:19:06,665 - INFO - Deleting VN ctest-bgpaas_vn-66020486 2026-04-06 03:19:06,710 - DEBUG - VN eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29 still in use: Unable to complete operation on network eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-17c8017a-6b06-423a-82ad-432c473453b0'] 2026-04-06 03:19:06,710 - WARNING - Deleting VN ctest-bgpaas_vn-66020486 failed..Will retry 2026-04-06 03:19:08,748 - DEBUG - VN eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29 still in use: Unable to complete operation on network eb88e2f0-6dd8-4001-9b4b-f8534cb6dd29. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-998c01da-2f27-482f-af68-6e6a50d3dbf6'] 2026-04-06 03:19:08,749 - WARNING - Deleting VN ctest-bgpaas_vn-66020486 failed..Will retry 2026-04-06 03:19:12,815 - DEBUG - Response for deleting network () 2026-04-06 03:19:12,815 - INFO - Deleting VN ctest-bgpaas_vn-28997837 2026-04-06 03:19:16,880 - DEBUG - Response for deleting network () 2026-04-06 03:19:18,140 - ERROR - HttpError Python 3.9.25: /usr/bin/python3 Mon Apr 6 03:19:04 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/routing_policy/test_routing_policy.py in test_rp_interface_ext_community(self=) 254 test2_vm = ret_dict['test2_vm'] 255 config_dicts = {'vn_fixture':vn_fixture, 'from_term':'protocol', 'sub_from':'interface', 'to_term':'add_ext_community', 'sub_to':'target:64512:44444'} 256 rp = self.configure_term_routing_policy(config_dicts) 257 assert self.verify_policy_in_control(vn_fixture, test_vm, search_value = 'target:64512:44444'), 'Search term not found in introspect' 258 assert test_vm.ping_with_certainty(test2_vm.vm_ip) rp undefined self = self.configure_term_routing_policy = > config_dicts = {'from_term': 'protocol', 'sub_from': 'interface', 'sub_to': 'target:64512:44444', 'to_term': 'add_ext_community', 'vn_fixture': } /contrail-test/scripts/routing_policy/base.py in configure_term_routing_policy(self=, config_dicts={'from_term': 'protocol', 'sub_from': 'interface', 'sub_to': 'target:64512:44444', 'to_term': 'add_ext_community', 'vn_fixture': }) 119 fix_vn = self.vnc_lib.virtual_network_read(id = config_dicts['vn_fixture'].uuid) 120 fix_vn.set_routing_policy(rp) 121 self.vnc_lib.virtual_network_update(fix_vn) 122 self.addCleanup(self.delete_rp_refs_from_vn, rp, fix_vn) 123 return rp self = self.vnc_lib = self.vnc_lib.virtual_network_update = functools.partial(>, 'virtual-network') fix_vn = /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in wrapper(self=, *args=('virtual-network', ), **kwargs={}) 50 retry_on_error=False) 51 self._parse_homepage(homepage) 52 return func(self, *args, **kwargs) 53 return wrapper 54 func = self = args = ('virtual-network', ) kwargs = {} /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _object_update(self=, res_type='virtual-network', obj=) 787 json_body = '{"%s":%s}' % (res_type, obj_json_param) 788 uri = obj_cls.resource_uri_base[res_type] + '/' + obj.uuid 789 content = self._request_server( 790 OP_PUT, uri, data=json_body) 791 content = None self = self._request_server = > global OP_PUT = 3 uri = '/virtual-network/4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae' data undefined json_body = '{"virtual-network":{"uuid": "4d8dd37a-faa3-40a5-...uuid": "f4bb57dc-4344-4a45-8f07-2a440ab5a1cf"}]}}' /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _request_server(self=, op=3, url='/virtual-network/4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae', data='{"virtual-network":{"uuid": "4d8dd37a-faa3-40a5-...uuid": "f4bb57dc-4344-4a45-8f07-2a440ab5a1cf"}]}}', retry_on_error=True, retry_after_authn=False, retry_count=30) 1124 raise ConnectionError("Unable to retrive the api server root url.") 1125 1126 return self._request( 1127 op, url, data=data, retry_on_error=retry_on_error, 1128 retry_after_authn=retry_after_authn, retry_count=retry_count) self = self._request = > op = 3 url = '/virtual-network/4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae' data = '{"virtual-network":{"uuid": "4d8dd37a-faa3-40a5-...uuid": "f4bb57dc-4344-4a45-8f07-2a440ab5a1cf"}]}}' retry_on_error = True retry_after_authn = False retry_count = 30 /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _request(self=, op=3, url='/virtual-network/4d8dd37a-faa3-40a5-bc3e-e24fe19bc6ae', data='{"virtual-network":{"uuid": "4d8dd37a-faa3-40a5-...uuid": "f4bb57dc-4344-4a45-8f07-2a440ab5a1cf"}]}}', retry_on_error=True, retry_after_authn=False, retry_count=30) 1206 raise AuthFailed(status, content) 1207 else: # Unknown Error 1208 raise HttpError(status, content) 1209 # end while True 1210 global HttpError = status = 500 content = "cassandra.ReadTimeout: Error from server: code=1...'required_responses': 3, 'received_responses': 2}" HttpError: HTTP Status: 500 Content: cassandra.ReadTimeout: Error from server: code=1200 [Coordinator node timed out waiting for replica nodes' responses] message="Operation timed out - received only 2 responses." info={'consistency': 'ALL', 'required_responses': 3, 'received_responses': 2} __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'content': "cassandra.ReadTimeout: Error from server: code=1...'required_responses': 3, 'received_responses': 2}", 'status_code': 500} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'vnc_api.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = (500, "cassandra.ReadTimeout: Error from server: code=1...'required_responses': 3, 'received_responses': 2}") content = "cassandra.ReadTimeout: Error from server: code=1...'required_responses': 3, 'received_responses': 2}" status_code = 500 with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/routing_policy/test_routing_policy.py", line 256, in test_rp_interface_ext_community rp = self.configure_term_routing_policy(config_dicts) File "/contrail-test/scripts/routing_policy/base.py", line 121, in configure_term_routing_policy self.vnc_lib.virtual_network_update(fix_vn) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 52, in wrapper return func(self, *args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 789, in _object_update content = self._request_server( File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 1126, in _request_server return self._request( File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 1208, in _request raise HttpError(status, content) vnc_api.exceptions.HttpError: HTTP Status: 500 Content: cassandra.ReadTimeout: Error from server: code=1200 [Coordinator node timed out waiting for replica nodes' responses] message="Operation timed out - received only 2 responses." info={'consistency': 'ALL', 'required_responses': 3, 'received_responses': 2} 2026-04-06 03:19:18,155 - DEBUG - No XMPP flaps were noticed during the test 2026-04-06 03:19:18,155 - INFO -
2026-04-06 03:19:18,156 - INFO - END TEST : test_rp_interface_ext_community : FAILED[0:00:39]
2026-04-06 03:19:18,156 - INFO - -------------------------------------------------------------------------------- 2026-04-06 03:19:18,158 - INFO - ================================================================================ 2026-04-06 03:19:18,158 - INFO - STARTING TEST : test_rp_interface_static 2026-04-06 03:19:18,159 - INFO - TEST DESCRIPTION : 1. Create a routing policy with interface-static match. 2. Launch VMs. 3. Attach policy to VN and confirm if policy takes hold. 2026-04-06 03:19:19,438 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.241': {'10.20.0.18': '0', '10.20.0.129': '0'}} with 2026-04-06 03:19:19,438 - INFO - Initial checks done. Running the testcase now 2026-04-06 03:19:19,438 - INFO - 2026-04-06 03:19:22,798 - ERROR - HttpError Python 3.9.25: /usr/bin/python3 Mon Apr 6 03:19:21 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/routing_policy/test_routing_policy.py in test_rp_interface_static(self=) 56 ''' 57 58 ret_dict,random_cidr = self.create_interface_static_routes() 59 config_dicts = {'vn_fixture':ret_dict['vn_fixture'], 'from_term':'protocol', 'sub_from':'interface-static', 'to_term':'community', 'sub_to':'64512:55555'} 60 rp = self.configure_term_routing_policy(config_dicts) ret_dict undefined random_cidr undefined self = self.create_interface_static_routes = > /contrail-test/scripts/routing_policy/test_routing_policy.py in create_interface_static_routes(self=) 576 577 def create_interface_static_routes(self): 578 ret_dict = self.config_basic() 579 self.static_table_handle = ContrailVncApi(self.vnc_lib, self.logger) 580 random_cidr = get_random_cidr() ret_dict undefined self = self.config_basic = > /contrail-test/scripts/routing_policy/base.py in config_basic(self=) 35 vn_subnets = [get_random_cidr()] 36 vn2_subnets = [get_random_cidr()] 37 vn_fixture = self.create_vn(vn_name, vn_subnets) 38 rt_value = randint(50000, 60000) 39 vn_fixture.add_route_target(vn_fixture.ri_name, self.inputs.router_asn, rt_value) vn_fixture undefined self = self.create_vn = > vn_name = 'ctest-bgpaas_vn-00851210' vn_subnets = ['128.20.130.64/26'] /contrail-test/common/base.py in create_vn(self=, vn_name='ctest-bgpaas_vn-00851210', vn_subnets=['128.20.130.64/26'], cleanup=True, **kwargs={}) 189 190 def create_vn(self, vn_name=None, vn_subnets=None, cleanup=True, **kwargs): 191 vn_fixture = self.create_only_vn(vn_name=vn_name, 192 vn_subnets=vn_subnets, 193 **kwargs) vn_fixture undefined self = self.create_only_vn = > vn_name = 'ctest-bgpaas_vn-00851210' vn_subnets = ['128.20.130.64/26'] kwargs = {} /contrail-test/common/base.py in create_only_vn(cls=, vn_name='ctest-bgpaas_vn-00851210', vn_subnets=['128.20.130.64/26'], **kwargs={}) 184 subnets=vn_subnets, 185 **kwargs) 186 vn_fixture.setUp() 187 return vn_fixture 188 # end create_only_vn vn_fixture = vn_fixture.setUp = > /contrail-test/fixtures/vn_test.py in setUp(self=) 437 def setUp(self): 438 super(VNFixture, self).setUp() 439 self.create() 440 441 def create(self): self = self.create = > /contrail-test/fixtures/vn_test.py in create(self=) 441 def create(self): 442 project_fqname = [self.domain_name, self.project_name] 443 self.project_obj = self.connections.vnc_lib_fixture.get_project_obj( 444 project_fqname) 445 if self.uuid: self = self.project_obj = None self.connections = self.connections.vnc_lib_fixture = self.connections.vnc_lib_fixture.get_project_obj = > project_fqname = ['default-domain', 'ctest-TestRP-02593412'] /contrail-test/fixtures/vnc_api_test.py in get_project_obj(self=, project_fqname=['default-domain', 'ctest-TestRP-02593412']) 259 def get_project_obj(self, project_fqname=None): 260 if project_fqname: 261 return self.vnc_api_h.project_read(fq_name=project_fqname) 262 elif self.connections: 263 project_id = self.connections.project_id self = self.vnc_api_h = self.vnc_api_h.project_read = functools.partial(>, 'project') fq_name undefined project_fqname = ['default-domain', 'ctest-TestRP-02593412'] /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in wrapper(self=, *args=('project',), **kwargs={'fq_name': ['default-domain', 'ctest-TestRP-02593412']}) 50 retry_on_error=False) 51 self._parse_homepage(homepage) 52 return func(self, *args, **kwargs) 53 return wrapper 54 func = self = args = ('project',) kwargs = {'fq_name': ['default-domain', 'ctest-TestRP-02593412']} /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _object_read(self=, res_type='project', fq_name=['default-domain', 'ctest-TestRP-02593412'], fq_name_str=None, id='f270859f-76d0-4df7-b1c9-2c8f1cbc6c86', ifmap_id=None, fields=set(), exclude_back_refs=True, exclude_children=True) 726 query_params['exclude_hrefs'] = True 727 728 response = self._request_server(OP_GET, uri, query_params) 729 730 obj_dict = response[res_type] response undefined self = self._request_server = > global OP_GET = 2 uri = '/project/f270859f-76d0-4df7-b1c9-2c8f1cbc6c86' query_params = {'exclude_back_refs': True, 'exclude_children': True} /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _request_server(self=, op=2, url='/project/f270859f-76d0-4df7-b1c9-2c8f1cbc6c86', data={'exclude_back_refs': True, 'exclude_children': True}, retry_on_error=True, retry_after_authn=False, retry_count=30) 1124 raise ConnectionError("Unable to retrive the api server root url.") 1125 1126 return self._request( 1127 op, url, data=data, retry_on_error=retry_on_error, 1128 retry_after_authn=retry_after_authn, retry_count=retry_count) self = self._request = > op = 2 url = '/project/f270859f-76d0-4df7-b1c9-2c8f1cbc6c86' data = {'exclude_back_refs': True, 'exclude_children': True} retry_on_error = True retry_after_authn = False retry_count = 30 /usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py in _request(self=, op=2, url='/project/f270859f-76d0-4df7-b1c9-2c8f1cbc6c86', data={'exclude_back_refs': True, 'exclude_children': True}, retry_on_error=True, retry_after_authn=False, retry_count=30) 1206 raise AuthFailed(status, content) 1207 else: # Unknown Error 1208 raise HttpError(status, content) 1209 # end while True 1210 global HttpError = status = 500 content = 'Internal Server Error' HttpError: HTTP Status: 500 Content: Internal Server Error __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'content': 'Internal Server Error', 'status_code': 500} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'vnc_api.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = (500, 'Internal Server Error') content = 'Internal Server Error' status_code = 500 with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/routing_policy/test_routing_policy.py", line 58, in test_rp_interface_static ret_dict,random_cidr = self.create_interface_static_routes() File "/contrail-test/scripts/routing_policy/test_routing_policy.py", line 578, in create_interface_static_routes ret_dict = self.config_basic() File "/contrail-test/scripts/routing_policy/base.py", line 37, in config_basic vn_fixture = self.create_vn(vn_name, vn_subnets) File "/contrail-test/common/base.py", line 191, in create_vn vn_fixture = self.create_only_vn(vn_name=vn_name, File "/contrail-test/common/base.py", line 186, in create_only_vn vn_fixture.setUp() File "/contrail-test/fixtures/vn_test.py", line 439, in setUp self.create() File "/contrail-test/fixtures/vn_test.py", line 443, in create self.project_obj = self.connections.vnc_lib_fixture.get_project_obj( File "/contrail-test/fixtures/vnc_api_test.py", line 261, in get_project_obj return self.vnc_api_h.project_read(fq_name=project_fqname) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 52, in wrapper return func(self, *args, **kwargs) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 728, in _object_read response = self._request_server(OP_GET, uri, query_params) File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 1126, in _request_server return self._request( File "/usr/local/lib/python3.9/site-packages/vnc_api/vnc_api.py", line 1208, in _request raise HttpError(status, content) vnc_api.exceptions.HttpError: HTTP Status: 500 Content: Internal Server Error 2026-04-06 03:19:22,810 - DEBUG - No XMPP flaps were noticed during the test 2026-04-06 03:19:22,810 - INFO -
2026-04-06 03:19:22,810 - INFO - END TEST : test_rp_interface_static : FAILED[0:00:04]
2026-04-06 03:19:22,810 - INFO - --------------------------------------------------------------------------------