2026-05-27 17:37:12,652 - INFO - Domain Default found not creating 2026-05-27 17:37:12,864 - INFO - Project ctest-TestRoutes-02632486 not found, creating it 2026-05-27 17:37:13,478 - INFO - Created Project:ctest-TestRoutes-02632486, ID : 37fe9e13-0642-4ce3-9533-789bd1d02dec 2026-05-27 17:37:15,150 - INFO - ================================================================================ 2026-05-27 17:37:15,151 - INFO - STARTING TEST : test_rt_table_scenario_1 2026-05-27 17:37:15,151 - INFO - TEST DESCRIPTION : In a VN, launch a VM each on two computes Add a shorter prefix intf static route to VM2 Delete the VMs. The route table on compute1 should be removed 2026-05-27 17:37:16,459 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.254': '0', '10.20.0.25': '0'}, '10.0.0.242': {'10.20.0.254': '1', '10.20.0.25': '0'}} with 2026-05-27 17:37:16,459 - INFO - Initial checks done. Running the testcase now 2026-05-27 17:37:16,460 - INFO - 2026-05-27 17:37:17,197 - DEBUG - Response for create_network : {'network': {'id': 'eca98cff-b738-47d9-b2e5-41b66480adf9', 'name': 'ctest-random-67766724', 'tenant_id': '37fe9e1306424ce39533789bd1d02dec', 'project_id': '37fe9e1306424ce39533789bd1d02dec', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutes-02632486', 'ctest-random-67766724'], 'port_security_enabled': True, 'description': ''}} 2026-05-27 17:37:17,528 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a0f06bb8-6948-4c14-8112-b369d98ee83f', 'name': '', 'tenant_id': '37fe9e1306424ce39533789bd1d02dec', 'network_id': 'eca98cff-b738-47d9-b2e5-41b66480adf9', 'ip_version': 4, 'cidr': '214.147.141.64/26', 'allocation_pools': [{'start': '214.147.141.66', 'end': '214.147.141.126'}], 'gateway_ip': '214.147.141.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '214.147.141.66', 'tags': [], 'project_id': '37fe9e1306424ce39533789bd1d02dec'}} 2026-05-27 17:37:17,558 - INFO - Created VN ctest-random-67766724 2026-05-27 17:37:17,571 - DEBUG - VN ctest-random-67766724 UUID is eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:17,655 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestRoutes-02632486', 'ctest-vmi-37585696']} 2026-05-27 17:37:17,945 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-37585696', 'id': 'd976f9fe-a53a-499e-8ccf-983fbdbb59bc', 'tenant_id': '37fe9e1306424ce39533789bd1d02dec', 'network_id': 'eca98cff-b738-47d9-b2e5-41b66480adf9', 'mac_address': '02:d9:76:f9:fe:a5', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '214.147.141.67', 'subnet_id': 'a0f06bb8-6948-4c14-8112-b369d98ee83f'}], 'security_groups': ['0ae91f3d-388e-4062-a98b-3f126a07737a'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '37fe9e1306424ce39533789bd1d02dec'}} 2026-05-27 17:37:17,945 - DEBUG - Created port d976f9fe-a53a-499e-8ccf-983fbdbb59bc 2026-05-27 17:37:18,047 - DEBUG - Services list from nova: [, , , ] 2026-05-27 17:37:18,047 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5832-2', 'an-jenkins-deploy-platform-ansible-os-5832-1']} 2026-05-27 17:37:18,047 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5832-2', 'an-jenkins-deploy-platform-ansible-os-5832-1']} 2026-05-27 17:37:19,319 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5832-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5832-2) 2026-05-27 17:37:19,998 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5832-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5832-1) 2026-05-27 17:37:20,286 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-TestRoutes-02632486', 'ctest-irtb-01965484'](UUID 9c8420f6-e2dd-49f4-b455-771911a0b71e), prefixes : ['0.0.0.0/0'] 2026-05-27 17:37:20,287 - DEBUG - Sleeping for 1 seconds.. 2026-05-27 17:37:21,366 - INFO - Added intf route table 9c8420f6-e2dd-49f4-b455-771911a0b71e to port d976f9fe-a53a-499e-8ccf-983fbdbb59bc 2026-05-27 17:37:21,465 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-05-27 17:37:26,564 - DEBUG - VM is in ACTIVE state now 2026-05-27 17:37:26,564 - INFO - VM name : ctest-TestRoutes-02632486-99187440 2026-05-27 17:37:26,671 - DEBUG - VM ctest-TestRoutes-02632486-99187440 ID is 2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:26,796 - DEBUG - VM is in ACTIVE state now 2026-05-27 17:37:26,830 - DEBUG - VM ctest-TestRoutes-02632486-99187440 launched on Node an-jenkins-deploy-platform-ansible-os-5832-2 2026-05-27 17:37:26,937 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:27,246 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:27,288 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:27,297 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/1b29bd1b-ef35-482c-a7b0-b3c06283a25f 2026-05-27 17:37:27,308 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:27,320 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/1b29bd1b-ef35-482c-a7b0-b3c06283a25f 2026-05-27 17:37:27,333 - DEBUG - Requesting: http://10.0.0.129:8082/instance-ip/a047dc9e-3681-4eae-a085-37f0e0c6c5ed 2026-05-27 17:37:27,346 - DEBUG - Verifying in api server 10.0.0.129 2026-05-27 17:37:27,346 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:27,356 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/1b29bd1b-ef35-482c-a7b0-b3c06283a25f 2026-05-27 17:37:27,370 - DEBUG - Requesting: http://10.0.0.129:8082/instance-ip/a047dc9e-3681-4eae-a085-37f0e0c6c5ed 2026-05-27 17:37:27,382 - INFO - VM ctest-TestRoutes-02632486-99187440 verfication in all API Servers passed 2026-05-27 17:37:27,404 - DEBUG - VM ctest-TestRoutes-02632486-99187440 Tap interface: {'index': '3', 'name': 'tap1b29bd1b-ef', 'uuid': '1b29bd1b-ef35-482c-a7b0-b3c06283a25f', 'vrf_name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724:ctest-random-67766724', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'vm_uuid': '2ca61723-7f07-460b-95ae-8c263451d68d', 'vm_name': 'ctest-TestRoutes-02632486-99187440', 'ip_addr': '214.147.141.68', 'mac_addr': '02:1b:29:bd:1b:ef', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '116', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f', 'sg_uuid_list': ['0ae91f3d-388e-4062-a98b-3f126a07737a'], 'static_route_list': None, 'vm_project_uuid': '37fe9e13-0642-4ce3-9533-789bd1d02dec', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-27 17:37:27,404 - DEBUG - Agent 10.0.0.242 vrf name: default-domain:ctest-TestRoutes-02632486:ctest-random-67766724:ctest-random-67766724 2026-05-27 17:37:27,420 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724:ctest-random-67766724', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-05-27 17:37:27,516 - DEBUG - VM ctest-TestRoutes-02632486-99187440 : Tap interface tap1b29bd1b-ef is set to Active 2026-05-27 17:37:27,516 - DEBUG - Tap interface tap1b29bd1b-ef detail : {'index': '3', 'name': 'tap1b29bd1b-ef', 'uuid': '1b29bd1b-ef35-482c-a7b0-b3c06283a25f', 'vrf_name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724:ctest-random-67766724', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'vm_uuid': '2ca61723-7f07-460b-95ae-8c263451d68d', 'vm_name': 'ctest-TestRoutes-02632486-99187440', 'ip_addr': '214.147.141.68', 'mac_addr': '02:1b:29:bd:1b:ef', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '116', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f', 'sg_uuid_list': ['0ae91f3d-388e-4062-a98b-3f126a07737a'], 'static_route_list': None, 'vm_project_uuid': '37fe9e13-0642-4ce3-9533-789bd1d02dec', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-27 17:37:27,634 - DEBUG - Starting Layer 2 verification in Agent 2026-05-27 17:37:27,654 - DEBUG - Layer 2 path is seen for VM MAC 02:1b:29:bd:1b:ef in agent 10.0.0.242 2026-05-27 17:37:27,655 - DEBUG - Active layer 2 route in agent is present for VMI tap1b29bd1b-ef 2026-05-27 17:37:27,655 - DEBUG - L2 label(29) matches bw route table and interface table 2026-05-27 17:37:27,662 - DEBUG - VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 is found in Agent of node 10.0.0.241 2026-05-27 17:37:27,797 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 is consistent in agent 10.0.0.241 2026-05-27 17:37:27,798 - DEBUG - Route for VM IP ['214.147.141.68'] is consistent in agent 10.0.0.241 2026-05-27 17:37:27,798 - DEBUG - VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 verification for VM ctest-TestRoutes-02632486-99187440 in Agent 10.0.0.241 passed 2026-05-27 17:37:27,913 - DEBUG - Starting all layer 2 verification in agent 10.0.0.241 2026-05-27 17:37:27,925 - DEBUG - Route for VM MAC 02:1b:29:bd:1b:ef is consistent in agent 10.0.0.241 2026-05-27 17:37:27,934 - DEBUG - VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 is found in Agent of node 10.0.0.242 2026-05-27 17:37:28,083 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 is consistent in agent 10.0.0.242 2026-05-27 17:37:28,083 - DEBUG - Route for VM IP ['214.147.141.68'] is consistent in agent 10.0.0.242 2026-05-27 17:37:28,083 - DEBUG - VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 verification for VM ctest-TestRoutes-02632486-99187440 in Agent 10.0.0.242 passed 2026-05-27 17:37:28,200 - DEBUG - Starting all layer 2 verification in agent 10.0.0.242 2026-05-27 17:37:28,218 - DEBUG - Route for VM MAC 02:1b:29:bd:1b:ef is consistent in agent 10.0.0.242 2026-05-27 17:37:31,421 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-05-27 17:37:31,421 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-02632486-99187440 failed! 2026-05-27 17:37:31,443 - DEBUG - Gateway for vn default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 is 214.147.141.65 and allocation pool is NOT set 2026-05-27 17:37:33,511 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=10.1 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.33 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.325/6.723/10.121/3.398 ms') 2026-05-27 17:37:33,511 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-02632486-99187440 passed 2026-05-27 17:37:33,511 - INFO - VM ctest-TestRoutes-02632486-99187440 verifications in Compute nodes passed 2026-05-27 17:37:33,703 - DEBUG - Validated VM route 214.147.141.68 in vrouter of 10.0.0.241 2026-05-27 17:37:33,709 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.129, 25; Got 10.20.0.129,25 2026-05-27 17:37:33,709 - DEBUG - Validated VM route 214.147.141.68 in vrouter of 10.0.0.241 2026-05-27 17:37:33,845 - DEBUG - Validated VM route 214.147.141.68 in vrouter of 10.0.0.242 2026-05-27 17:37:33,850 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-05-27 17:37:33,851 - INFO - Validated routes of VM ctest-TestRoutes-02632486-99187440 in all vrouters 2026-05-27 17:37:34,374 - DEBUG - Starting all layer2 verification in 10.0.0.129 Control Node 2026-05-27 17:37:34,509 - DEBUG - Layer2 route found for VM MAC 02:1b:29:bd:1b:ef in Control-node 10.0.0.129 2026-05-27 17:37:34,509 - DEBUG - L2 Label for VM ctest-TestRoutes-02632486-99187440 same between Control-node 10.0.0.129 and Agent, Expected: 29, Seen: 29 2026-05-27 17:37:34,509 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2026-05-27 17:37:34,643 - DEBUG - Layer2 route found for VM MAC 02:1b:29:bd:1b:ef in Control-node 10.0.0.50 2026-05-27 17:37:34,643 - DEBUG - L2 Label for VM ctest-TestRoutes-02632486-99187440 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2026-05-27 17:37:34,643 - INFO - Verification in Control-nodes for VM ctest-TestRoutes-02632486-99187440 passed 2026-05-27 17:37:34,644 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:34,644 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:34,644 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:34,953 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:35,022 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:37,023 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:37,023 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:37,023 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:37,143 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:39,144 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:39,144 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:39,144 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:39,219 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:41,220 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:41,220 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:41,220 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:41,237 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:43,238 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:43,238 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:43,238 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:43,254 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:45,255 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:45,255 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:45,256 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:45,272 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:47,272 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:47,272 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:47,272 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:47,288 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:49,289 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:49,289 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:49,289 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:49,305 - DEBUG - Failed to get VM ctest-TestRoutes-02632486-99187440, ID 2ca61723-7f07-460b-95ae-8c263451d68d info from Opserver 2026-05-27 17:37:51,306 - DEBUG - Verifying the vm in opserver 2026-05-27 17:37:51,306 - DEBUG - Verifying in collector 10.0.0.129 ... 2026-05-27 17:37:51,306 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:51,325 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f?flat 2026-05-27 17:37:51,640 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f?flat 2026-05-27 17:37:52,043 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f?flat 2026-05-27 17:37:52,422 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:52,441 - DEBUG - Verifying vm in vn uve 2026-05-27 17:37:52,441 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f?flat 2026-05-27 17:37:52,464 - DEBUG - VM uve shows interface as {'admin_state': True, 'vm_name': 'ctest-TestRoutes-02632486-99187440', 'fixed_ip4_list': ['214.147.141.68'], 'tx_vlan': 65535, 'label': 25, 'active': True, '__T': 1779903470780582, 'virtual_network': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'gateway': '214.147.141.65', 'ip4_active': True, 'l2_active': True, 'ip6_address': '::', 'ip_address': '214.147.141.68', 'vm_uuid': '2ca61723-7f07-460b-95ae-8c263451d68d', 'rx_vlan': 65535, 'ip6_active': False, 'uuid': '1b29bd1b-ef35-482c-a7b0-b3c06283a25f', 'port_mirror_enabled': False, 'vn_uuid': 'eca98cff-b738-47d9-b2e5-41b66480adf9', 'is_health_check_active': True, 'mac_address': '02:1b:29:bd:1b:ef', 'vhostuser_mode': 0} 2026-05-27 17:37:52,464 - DEBUG - VM uve shows ip address as ['214.147.141.68', '::'] 2026-05-27 17:37:52,464 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:37:52,464 - INFO - Verifying through opserver in 10.0.0.50 2026-05-27 17:37:52,464 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-02632486:ctest-random-67766724?flat 2026-05-27 17:37:52,550 - DEBUG - expected vm list 2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:52,550 - DEBUG - Extracted vm list ['2ca61723-7f07-460b-95ae-8c263451d68d'] 2026-05-27 17:37:52,550 - INFO - VM 2ca61723-7f07-460b-95ae-8c263451d68d is present in default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:37:52,550 - DEBUG - Verifying vm in vrouter uve 2026-05-27 17:37:52,550 - DEBUG - Getting info from collector 10.0.0.129.. 2026-05-27 17:37:52,550 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat 2026-05-27 17:37:52,568 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-5832-2'] 2026-05-27 17:37:52,568 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:37:52,603 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:37:52,632 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:37:52,632 - DEBUG - Validated that VM ctest-TestRoutes-02632486-99187440 is in Vrouter an-jenkins-deploy-platform-ansible-os-5832-2 UVE 2026-05-27 17:37:52,632 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-05-27 17:37:52,640 - DEBUG - Expected tap interface of VM uuid 2ca61723-7f07-460b-95ae-8c263451d68d is default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f 2026-05-27 17:37:52,640 - DEBUG - Expected VN of VM uuid 2ca61723-7f07-460b-95ae-8c263451d68d is default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:37:52,640 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:37:52,679 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:37:52,709 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:37:52,709 - INFO - tap interface default-domain:ctest-TestRoutes-02632486:1b29bd1b-ef35-482c-a7b0-b3c06283a25f of vm 2ca61723-7f07-460b-95ae-8c263451d68d is present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:37:52,709 - DEBUG - Connected network default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 of vm 2ca61723-7f07-460b-95ae-8c263451d68d is present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:37:52,709 - DEBUG - Verifying the 2ca61723-7f07-460b-95ae-8c263451d68d virtual network link through opserver 10.0.0.50 2026-05-27 17:37:52,709 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-05-27 17:37:52,726 - DEBUG - VM link and name as {'name': '2ca61723-7f07-460b-95ae-8c263451d68d', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat'} 2026-05-27 17:37:52,726 - DEBUG - Verifying the 2ca61723-7f07-460b-95ae-8c263451d68d virtual network link through opserver 10.0.0.22 2026-05-27 17:37:52,727 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2026-05-27 17:37:53,074 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2026-05-27 17:37:53,147 - DEBUG - VM link and name as {'name': '2ca61723-7f07-460b-95ae-8c263451d68d', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat'} 2026-05-27 17:37:53,147 - DEBUG - Verifying the 2ca61723-7f07-460b-95ae-8c263451d68d virtual network link through opserver 10.0.0.129 2026-05-27 17:37:53,148 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machines 2026-05-27 17:37:53,162 - DEBUG - VM link and name as {'name': '2ca61723-7f07-460b-95ae-8c263451d68d', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d?flat'} 2026-05-27 17:37:53,162 - INFO - VM ctest-TestRoutes-02632486-99187440 validations in Opserver passed 2026-05-27 17:37:53,163 - INFO - Waiting for VM ctest-TestRoutes-02632486-04087628 to be up.. 2026-05-27 17:37:53,272 - DEBUG - VM is in ACTIVE state now 2026-05-27 17:37:53,273 - INFO - VM name : ctest-TestRoutes-02632486-04087628 2026-05-27 17:37:53,382 - DEBUG - VM ctest-TestRoutes-02632486-04087628 ID is 9b810c1a-c740-4514-b1ef-105dfd9fd5b9 2026-05-27 17:37:53,382 - DEBUG - VM ctest-TestRoutes-02632486-04087628 launched on Node an-jenkins-deploy-platform-ansible-os-5832-1 2026-05-27 17:37:53,486 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/9b810c1a-c740-4514-b1ef-105dfd9fd5b9 2026-05-27 17:37:53,498 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/d976f9fe-a53a-499e-8ccf-983fbdbb59bc 2026-05-27 17:37:54,665 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.26 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.564 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.564/1.911/3.259/1.347 ms') 2026-05-27 17:37:54,665 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-02632486-04087628 passed 2026-05-27 17:37:54,742 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-27 17:37:54,743 - DEBUG - Waiting to SSH to VM ctest-TestRoutes-02632486-04087628, IP 214.147.141.67, Port 22 2026-05-27 17:37:54,908 - DEBUG - VM ctest-TestRoutes-02632486-04087628 is ready for SSH connections 2026-05-27 17:37:54,908 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-05-27 17:37:55,232 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-05-27 17:37:55,267 - DEBUG - Requesting: http://10.0.0.50:8082/domain/dd011215-fca5-4e74-b1da-d431e9fe9325 2026-05-27 17:37:55,282 - DEBUG - Requesting: http://10.0.0.50:8082/project/37fe9e13-0642-4ce3-9533-789bd1d02dec 2026-05-27 17:37:55,378 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:55,392 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:55,403 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/5d356160-c9c6-4471-970c-de5a1517828f 2026-05-27 17:37:55,417 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/5d356160-c9c6-4471-970c-de5a1517828f 2026-05-27 17:37:55,426 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/0353be35-8ff1-4ffa-a803-4d0876895885 2026-05-27 17:37:55,442 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-05-27 17:37:55,442 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:55,452 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/5d356160-c9c6-4471-970c-de5a1517828f 2026-05-27 17:37:55,472 - INFO - Verified VN network id 13 for VN eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:55,472 - INFO - Verifications in API Server for VN ctest-random-67766724 passed 2026-05-27 17:37:55,472 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:55,483 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/5d356160-c9c6-4471-970c-de5a1517828f 2026-05-27 17:37:55,492 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/5d356160-c9c6-4471-970c-de5a1517828f 2026-05-27 17:37:55,503 - DEBUG - Requesting: http://10.0.0.50:8082/route-target/0353be35-8ff1-4ffa-a803-4d0876895885 2026-05-27 17:37:55,519 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-02632486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17053316493933561817', 'uuid-lslong': '12890781760043920889'}, 'enable': 'true', 'created': '2026-05-27T17:37:17', 'last-modified': '2026-05-27T17:37:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:38.048137'} 2026-05-27 17:37:55,532 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-05-27 17:37:55,540 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-02632486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17053316493933561817', 'uuid-lslong': '12890781760043920889'}, 'enable': 'true', 'created': '2026-05-27T17:37:17', 'last-modified': '2026-05-27T17:37:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:38.074701'} 2026-05-27 17:37:55,547 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-05-27 17:37:55,553 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-02632486', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17053316493933561817', 'uuid-lslong': '12890781760043920889'}, 'enable': 'true', 'created': '2026-05-27T17:37:17', 'last-modified': '2026-05-27T17:37:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:38.085344'} 2026-05-27 17:37:55,560 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-05-27 17:37:55,561 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-random-67766724 passed 2026-05-27 17:37:55,561 - DEBUG - ====Verifying policy data for ctest-random-67766724 in API_Server ====== 2026-05-27 17:37:55,561 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-05-27 17:37:55,568 - DEBUG - Requesting: http://10.0.0.50:8082/domain/dd011215-fca5-4e74-b1da-d431e9fe9325 2026-05-27 17:37:55,582 - DEBUG - Requesting: http://10.0.0.50:8082/project/37fe9e13-0642-4ce3-9533-789bd1d02dec 2026-05-27 17:37:55,685 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-network/eca98cff-b738-47d9-b2e5-41b66480adf9 2026-05-27 17:37:55,696 - DEBUG - =>VN ctest-random-67766724 has no policy to be verified 2026-05-27 17:37:55,696 - DEBUG - Verifying the vn in opserver 2026-05-27 17:37:55,696 - DEBUG - Verifying the default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 virtual network link through opserver 10.0.0.50 2026-05-27 17:37:55,696 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-05-27 17:37:55,710 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-02632486:ctest-random-67766724?flat'} 2026-05-27 17:37:55,710 - DEBUG - Verifying the default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 virtual network link through opserver 10.0.0.22 2026-05-27 17:37:55,710 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-27 17:37:55,788 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-02632486:ctest-random-67766724?flat'} 2026-05-27 17:37:55,788 - DEBUG - Verifying the default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 virtual network link through opserver 10.0.0.129 2026-05-27 17:37:55,788 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-05-27 17:37:55,805 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-02632486:ctest-random-67766724', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-02632486:ctest-random-67766724?flat'} 2026-05-27 17:37:55,805 - INFO - Validated that VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 is found in opserver 2026-05-27 17:37:55,817 - DEBUG - VRF ids for VN ctest-random-67766724: {'10.0.0.241': '2', '10.0.0.242': '2'} 2026-05-27 17:37:55,817 - INFO - Deleting VM ctest-TestRoutes-02632486-99187440 2026-05-27 17:37:55,919 - DEBUG - Verifying in api server 10.0.0.129 2026-05-27 17:37:55,919 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:55,930 - DEBUG - VM ID 2ca61723-7f07-460b-95ae-8c263451d68d of VM ctest-TestRoutes-02632486-99187440 is still found in API Server 2026-05-27 17:37:57,930 - DEBUG - Verifying in api server 10.0.0.129 2026-05-27 17:37:57,930 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:57,937 - DEBUG - Response Code: 404 2026-05-27 17:37:57,937 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:57,944 - DEBUG - Response Code: 404 2026-05-27 17:37:57,944 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/2ca61723-7f07-460b-95ae-8c263451d68d 2026-05-27 17:37:57,950 - DEBUG - Response Code: 404 2026-05-27 17:37:57,950 - INFO - VM ctest-TestRoutes-02632486-99187440 is fully removed in API-Server 2026-05-27 17:37:58,113 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-05-27 17:37:58,285 - DEBUG - VM route 214.147.141.68 has been marked for discard in VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 of compute 10.0.0.241 2026-05-27 17:37:58,293 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:37:58,293 - DEBUG - Validated that vrouter 10.0.0.242 does not have VMs route for VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:37:58,293 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:37:58,293 - INFO - VM ctest-TestRoutes-02632486-99187440 is removed in Compute, and routes are removed in all compute nodes 2026-05-27 17:37:58,575 - INFO - Routes for VM ctest-TestRoutes-02632486-99187440 is removed in all control-nodes 2026-05-27 17:37:58,576 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:37:58,611 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:37:58,642 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:37:58,642 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:37:58,642 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:37:58,642 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:01,643 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:01,678 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:01,709 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:01,709 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:01,709 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:01,709 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:04,710 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:04,749 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:04,781 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:04,782 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:04,782 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:04,782 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:07,782 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:07,819 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:07,848 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:07,848 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:07,849 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:07,849 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:10,850 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:10,888 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:10,924 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:10,924 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:10,924 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:10,924 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:13,925 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:13,960 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:13,989 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:13,989 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:13,989 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:13,989 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:16,990 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:17,025 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:17,055 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:17,055 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:17,055 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:17,055 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:20,056 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:20,090 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:20,123 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is still present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:20,123 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:20,123 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:20,123 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:23,124 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5832-2:Compute:contrail-vrouter-agent:0?flat 2026-05-27 17:38:23,157 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5832-2?flat 2026-05-27 17:38:23,192 - DEBUG - VM 2ca61723-7f07-460b-95ae-8c263451d68d is not present in vrouter an-jenkins-deploy-platform-ansible-os-5832-2 uve 2026-05-27 17:38:23,192 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-05-27 17:38:23,193 - DEBUG - interface for vm 2ca61723-7f07-460b-95ae-8c263451d68d deleted from vrouter uve ... 2026-05-27 17:38:23,193 - DEBUG - Deleted interface not in error interface list ... 2026-05-27 17:38:23,193 - DEBUG - Validated that VM 2ca61723-7f07-460b-95ae-8c263451d68d is removed in Vrouter UVE 2026-05-27 17:38:23,193 - DEBUG - Verifying through opserver in 10.0.0.50 2026-05-27 17:38:23,193 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-02632486:ctest-random-67766724?flat 2026-05-27 17:38:23,217 - DEBUG - 2ca61723-7f07-460b-95ae-8c263451d68d BM not in default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 uve 2026-05-27 17:38:23,217 - DEBUG - Validated that VM 2ca61723-7f07-460b-95ae-8c263451d68d is not present in the VN UVE 2026-05-27 17:38:23,217 - DEBUG - Verifying the 2ca61723-7f07-460b-95ae-8c263451d68d virtual network link through opserver 10.0.0.50 2026-05-27 17:38:23,217 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-05-27 17:38:23,230 - INFO - 2ca61723-7f07-460b-95ae-8c263451d68d vm uve deleted from opserver 2026-05-27 17:38:23,230 - DEBUG - Verifying the 2ca61723-7f07-460b-95ae-8c263451d68d virtual network link through opserver 10.0.0.22 2026-05-27 17:38:23,230 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2026-05-27 17:38:23,325 - INFO - 2ca61723-7f07-460b-95ae-8c263451d68d vm uve deleted from opserver 2026-05-27 17:38:23,325 - DEBUG - Verifying the 2ca61723-7f07-460b-95ae-8c263451d68d virtual network link through opserver 10.0.0.129 2026-05-27 17:38:23,325 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-machines 2026-05-27 17:38:23,339 - INFO - 2ca61723-7f07-460b-95ae-8c263451d68d vm uve deleted from opserver 2026-05-27 17:38:23,340 - INFO - Validated that VM 2ca61723-7f07-460b-95ae-8c263451d68d is removed from Opserver 2026-05-27 17:38:23,340 - INFO - Validate that Vrouter Route table does get cleared 2026-05-27 17:38:23,422 - INFO - Removed intf route table 9c8420f6-e2dd-49f4-b455-771911a0b71e from port d976f9fe-a53a-499e-8ccf-983fbdbb59bc 2026-05-27 17:38:23,462 - INFO - Deleted Interface route table 9c8420f6-e2dd-49f4-b455-771911a0b71e 2026-05-27 17:38:23,462 - INFO - Detaching port d976f9fe-a53a-499e-8ccf-983fbdbb59bc from VM ctest-TestRoutes-02632486-04087628 2026-05-27 17:38:23,501 - INFO - Deleting VM ctest-TestRoutes-02632486-04087628 2026-05-27 17:38:23,836 - DEBUG - Response for delete_port : () 2026-05-27 17:38:23,836 - INFO - Deleted port d976f9fe-a53a-499e-8ccf-983fbdbb59bc 2026-05-27 17:38:23,836 - INFO - Deleting VN ctest-random-67766724 2026-05-27 17:38:24,000 - DEBUG - Response for deleting network () 2026-05-27 17:38:24,001 - DEBUG - Requesting: http://10.0.0.50:8082/routing-instance/5d356160-c9c6-4471-970c-de5a1517828f 2026-05-27 17:38:24,008 - DEBUG - Response Code: 404 2026-05-27 17:38:24,008 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2026-05-27 17:38:24,015 - DEBUG - Requesting: http://10.0.0.50:8082/domain/dd011215-fca5-4e74-b1da-d431e9fe9325 2026-05-27 17:38:24,028 - DEBUG - Requesting: http://10.0.0.50:8082/project/37fe9e13-0642-4ce3-9533-789bd1d02dec 2026-05-27 17:38:24,125 - INFO - Validated that VN ctest-random-67766724 is not found in API Server 2026-05-27 17:38:24,138 - DEBUG - VN ctest-random-67766724 is not present in Agent 10.0.0.241 2026-05-27 17:38:24,152 - DEBUG - VN ctest-random-67766724 is not present in Agent 10.0.0.242 2026-05-27 17:38:24,152 - INFO - Validated that VN ctest-random-67766724 is not in any agent 2026-05-27 17:38:24,158 - DEBUG - VRF 2 is not seen in agent 10.0.0.241 2026-05-27 17:38:24,164 - DEBUG - Vrouter 10.0.0.241 does not have vrf 2 for VN ctest-random-67766724 2026-05-27 17:38:24,169 - DEBUG - VRF 2 is not seen in agent 10.0.0.242 2026-05-27 17:38:24,175 - DEBUG - Vrouter 10.0.0.242 does not have vrf 2 for VN ctest-random-67766724 2026-05-27 17:38:24,175 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestRoutes-02632486:ctest-random-67766724 2026-05-27 17:38:24,206 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-random-67766724 info 2026-05-27 17:38:25,510 - DEBUG - No XMPP flaps were noticed during the test
2026-05-27 17:38:25,510 - INFO - END TEST : test_rt_table_scenario_1 : PASSED[0:01:10]
2026-05-27 17:38:25,510 - INFO - -------------------------------------------------------------------------------- 2026-05-27 17:38:26,266 - INFO - Deleted project: ctest-TestRoutes-02632486, ID : 37fe9e13-0642-4ce3-9533-789bd1d02dec