2025-10-14 12:50:23,723 - INFO - Domain Default found not creating 2025-10-14 12:50:24,284 - INFO - Project ctest-TestRoutes-45916114 not found, creating it 2025-10-14 12:50:24,891 - INFO - Created Project:ctest-TestRoutes-45916114, ID : 1caaa214-6c08-427d-868b-0c4755c7076e 2025-10-14 12:50:26,373 - INFO - ================================================================================ 2025-10-14 12:50:26,373 - INFO - STARTING TEST : test_rt_table_scenario_1 2025-10-14 12:50:26,373 - INFO - TEST DESCRIPTION : In a VN, launch a VM each on two computes Add a shorter prefix intf static route to VM2 Delete the VMs. The route table on compute1 should be removed 2025-10-14 12:50:27,661 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0', '10.20.0.210': '0'}, '10.0.0.22': {'10.20.0.210': '0', '10.20.0.14': '0'}} with 2025-10-14 12:50:27,661 - INFO - Initial checks done. Running the testcase now 2025-10-14 12:50:27,661 - INFO - 2025-10-14 12:50:28,376 - DEBUG - Response for create_network : {'network': {'id': '2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491', 'name': 'ctest-random-79067696', 'tenant_id': '1caaa2146c08427d868b0c4755c7076e', 'project_id': '1caaa2146c08427d868b0c4755c7076e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestRoutes-45916114', 'ctest-random-79067696'], 'port_security_enabled': True, 'description': ''}} 2025-10-14 12:50:28,715 - DEBUG - Response for create_subnet : {'subnet': {'id': '1386e164-015a-4ff4-8d71-d7398dcdcf89', 'name': '', 'tenant_id': '1caaa2146c08427d868b0c4755c7076e', 'network_id': '2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491', 'ip_version': 4, 'cidr': '2.62.60.128/26', 'allocation_pools': [{'start': '2.62.60.130', 'end': '2.62.60.190'}], 'gateway_ip': '2.62.60.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2.62.60.130', 'tags': [], 'project_id': '1caaa2146c08427d868b0c4755c7076e'}} 2025-10-14 12:50:28,738 - INFO - Created VN ctest-random-79067696 2025-10-14 12:50:28,750 - DEBUG - VN ctest-random-79067696 UUID is 2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:28,832 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestRoutes-45916114', 'ctest-vmi-37486856']} 2025-10-14 12:50:29,189 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-37486856', 'id': '9062cfff-8eef-4f12-ad22-c33127b46cbe', 'tenant_id': '1caaa2146c08427d868b0c4755c7076e', 'network_id': '2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491', 'mac_address': '02:90:62:cf:ff:8e', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '2.62.60.131', 'subnet_id': '1386e164-015a-4ff4-8d71-d7398dcdcf89'}], 'security_groups': ['445780f5-3ac3-4421-a153-efa5ad74642d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '1caaa2146c08427d868b0c4755c7076e'}} 2025-10-14 12:50:29,189 - DEBUG - Created port 9062cfff-8eef-4f12-ad22-c33127b46cbe 2025-10-14 12:50:29,305 - DEBUG - Services list from nova: [, , , ] 2025-10-14 12:50:29,305 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4312-30', 'an-jenkins-deploy-platform-ansible-os-4312-1']} 2025-10-14 12:50:29,305 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4312-30', 'an-jenkins-deploy-platform-ansible-os-4312-1']} 2025-10-14 12:50:30,601 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-30), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-30) 2025-10-14 12:50:31,346 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4312-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4312-1) 2025-10-14 12:50:31,610 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-TestRoutes-45916114', 'ctest-irtb-63827493'](UUID f7565c3f-9ae3-4428-b145-3078b5eea7c7), prefixes : ['0.0.0.0/0'] 2025-10-14 12:50:31,611 - DEBUG - Sleeping for 1 seconds.. 2025-10-14 12:50:32,690 - INFO - Added intf route table f7565c3f-9ae3-4428-b145-3078b5eea7c7 to port 9062cfff-8eef-4f12-ad22-c33127b46cbe 2025-10-14 12:50:32,787 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-14 12:50:37,876 - DEBUG - VM is in ACTIVE state now 2025-10-14 12:50:37,876 - INFO - VM name : ctest-TestRoutes-45916114-39914070 2025-10-14 12:50:37,976 - DEBUG - VM ctest-TestRoutes-45916114-39914070 ID is 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:38,076 - DEBUG - VM is in ACTIVE state now 2025-10-14 12:50:38,104 - DEBUG - VM ctest-TestRoutes-45916114-39914070 launched on Node an-jenkins-deploy-platform-ansible-os-4312-30 2025-10-14 12:50:38,198 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:38,504 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:38,544 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:38,553 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/43a4d24a-2b2b-4fad-8abe-337655798ddb 2025-10-14 12:50:38,566 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:38,579 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/43a4d24a-2b2b-4fad-8abe-337655798ddb 2025-10-14 12:50:38,590 - DEBUG - Requesting: http://10.0.0.33:8082/instance-ip/33d06ab8-a552-40bd-ac77-e3412b783692 2025-10-14 12:50:38,603 - DEBUG - Verifying in api server 10.0.0.33 2025-10-14 12:50:38,603 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:38,612 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/43a4d24a-2b2b-4fad-8abe-337655798ddb 2025-10-14 12:50:38,626 - DEBUG - Requesting: http://10.0.0.33:8082/instance-ip/33d06ab8-a552-40bd-ac77-e3412b783692 2025-10-14 12:50:38,638 - INFO - VM ctest-TestRoutes-45916114-39914070 verfication in all API Servers passed 2025-10-14 12:50:38,657 - DEBUG - VM ctest-TestRoutes-45916114-39914070 Tap interface: {'index': '3', 'name': 'tap43a4d24a-2b', 'uuid': '43a4d24a-2b2b-4fad-8abe-337655798ddb', 'vrf_name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696:ctest-random-79067696', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'vm_uuid': '8cf7b96a-f528-4ec5-93ba-5aa47e706c6e', 'vm_name': 'ctest-TestRoutes-45916114-39914070', 'ip_addr': '2.62.60.132', 'mac_addr': '02:43:a4:d2:4a:2b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '116', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb', 'sg_uuid_list': ['445780f5-3ac3-4421-a153-efa5ad74642d'], 'static_route_list': None, 'vm_project_uuid': '1caaa214-6c08-427d-868b-0c4755c7076e', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-14 12:50:38,658 - DEBUG - Agent 10.0.0.22 vrf name: default-domain:ctest-TestRoutes-45916114:ctest-random-79067696:ctest-random-79067696 2025-10-14 12:50:38,663 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696:ctest-random-79067696', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.25:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-14 12:50:38,748 - DEBUG - VM ctest-TestRoutes-45916114-39914070 : Tap interface tap43a4d24a-2b is set to Active 2025-10-14 12:50:38,748 - DEBUG - Tap interface tap43a4d24a-2b detail : {'index': '3', 'name': 'tap43a4d24a-2b', 'uuid': '43a4d24a-2b2b-4fad-8abe-337655798ddb', 'vrf_name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696:ctest-random-79067696', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'vm_uuid': '8cf7b96a-f528-4ec5-93ba-5aa47e706c6e', 'vm_name': 'ctest-TestRoutes-45916114-39914070', 'ip_addr': '2.62.60.132', 'mac_addr': '02:43:a4:d2:4a:2b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '116', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb', 'sg_uuid_list': ['445780f5-3ac3-4421-a153-efa5ad74642d'], 'static_route_list': None, 'vm_project_uuid': '1caaa214-6c08-427d-868b-0c4755c7076e', 'admin_state': 'Enabled', 'flow_key_idx': '29', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-14 12:50:38,869 - DEBUG - Starting Layer 2 verification in Agent 2025-10-14 12:50:38,886 - DEBUG - Layer 2 path is seen for VM MAC 02:43:a4:d2:4a:2b in agent 10.0.0.22 2025-10-14 12:50:38,886 - DEBUG - Active layer 2 route in agent is present for VMI tap43a4d24a-2b 2025-10-14 12:50:38,886 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-14 12:50:38,892 - DEBUG - VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 is found in Agent of node 10.0.0.65 2025-10-14 12:50:39,036 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 is consistent in agent 10.0.0.65 2025-10-14 12:50:39,036 - DEBUG - Route for VM IP ['2.62.60.132'] is consistent in agent 10.0.0.65 2025-10-14 12:50:39,037 - DEBUG - VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 verification for VM ctest-TestRoutes-45916114-39914070 in Agent 10.0.0.65 passed 2025-10-14 12:50:39,155 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-10-14 12:50:39,169 - DEBUG - Route for VM MAC 02:43:a4:d2:4a:2b is consistent in agent 10.0.0.65 2025-10-14 12:50:39,182 - DEBUG - VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 is found in Agent of node 10.0.0.22 2025-10-14 12:50:39,292 - DEBUG - VRF IDs of VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 is consistent in agent 10.0.0.22 2025-10-14 12:50:39,292 - DEBUG - Route for VM IP ['2.62.60.132'] is consistent in agent 10.0.0.22 2025-10-14 12:50:39,292 - DEBUG - VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 verification for VM ctest-TestRoutes-45916114-39914070 in Agent 10.0.0.22 passed 2025-10-14 12:50:39,409 - DEBUG - Starting all layer 2 verification in agent 10.0.0.22 2025-10-14 12:50:39,422 - DEBUG - Route for VM MAC 02:43:a4:d2:4a:2b is consistent in agent 10.0.0.22 2025-10-14 12:50:42,611 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2025-10-14 12:50:42,611 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-45916114-39914070 failed! 2025-10-14 12:50:42,632 - DEBUG - Gateway for vn default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 is 2.62.60.129 and allocation pool is NOT set 2025-10-14 12:50:44,709 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.324 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.324/3.985/7.646/3.661 ms') 2025-10-14 12:50:44,709 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-45916114-39914070 passed 2025-10-14 12:50:44,710 - INFO - VM ctest-TestRoutes-45916114-39914070 verifications in Compute nodes passed 2025-10-14 12:50:44,910 - DEBUG - Validated VM route 2.62.60.132 in vrouter of 10.0.0.65 2025-10-14 12:50:44,916 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.25, 25; Got 10.20.0.25,25 2025-10-14 12:50:44,916 - DEBUG - Validated VM route 2.62.60.132 in vrouter of 10.0.0.65 2025-10-14 12:50:45,094 - DEBUG - Validated VM route 2.62.60.132 in vrouter of 10.0.0.22 2025-10-14 12:50:45,100 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-14 12:50:45,100 - INFO - Validated routes of VM ctest-TestRoutes-45916114-39914070 in all vrouters 2025-10-14 12:50:45,635 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2025-10-14 12:50:45,766 - DEBUG - Layer2 route found for VM MAC 02:43:a4:d2:4a:2b in Control-node 10.0.0.50 2025-10-14 12:50:45,767 - DEBUG - L2 Label for VM ctest-TestRoutes-45916114-39914070 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2025-10-14 12:50:45,767 - DEBUG - Starting all layer2 verification in 10.0.0.254 Control Node 2025-10-14 12:50:45,912 - DEBUG - Layer2 route found for VM MAC 02:43:a4:d2:4a:2b in Control-node 10.0.0.254 2025-10-14 12:50:45,912 - DEBUG - L2 Label for VM ctest-TestRoutes-45916114-39914070 same between Control-node 10.0.0.254 and Agent, Expected: 29, Seen: 29 2025-10-14 12:50:45,912 - DEBUG - Starting all layer2 verification in 10.0.0.33 Control Node 2025-10-14 12:50:46,046 - DEBUG - Layer2 route found for VM MAC 02:43:a4:d2:4a:2b in Control-node 10.0.0.33 2025-10-14 12:50:46,047 - DEBUG - L2 Label for VM ctest-TestRoutes-45916114-39914070 same between Control-node 10.0.0.33 and Agent, Expected: 29, Seen: 29 2025-10-14 12:50:46,047 - INFO - Verification in Control-nodes for VM ctest-TestRoutes-45916114-39914070 passed 2025-10-14 12:50:46,047 - DEBUG - Verifying the vm in opserver 2025-10-14 12:50:46,047 - DEBUG - Verifying in collector 10.0.0.33 ... 2025-10-14 12:50:46,047 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat 2025-10-14 12:50:46,347 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat 2025-10-14 12:50:46,421 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb?flat 2025-10-14 12:50:46,721 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb?flat 2025-10-14 12:50:46,792 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb?flat 2025-10-14 12:50:46,860 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat 2025-10-14 12:50:46,923 - DEBUG - Verifying vm in vn uve 2025-10-14 12:50:46,923 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb?flat 2025-10-14 12:50:46,995 - DEBUG - VM uve shows interface as {'ip4_active': True, 'vm_uuid': '8cf7b96a-f528-4ec5-93ba-5aa47e706c6e', 'l2_active': True, 'gateway': '2.62.60.129', 'virtual_network': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'mac_address': '02:43:a4:d2:4a:2b', 'tx_vlan': 65535, 'fixed_ip4_list': ['2.62.60.132'], 'ip6_active': False, 'uuid': '43a4d24a-2b2b-4fad-8abe-337655798ddb', 'ip_address': '2.62.60.132', 'label': 25, 'vn_uuid': '2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491', '__T': 1760446241997822, 'vm_name': 'ctest-TestRoutes-45916114-39914070', 'rx_vlan': 65535, 'vhostuser_mode': 0, 'admin_state': True, 'active': True, 'port_mirror_enabled': False, 'ip6_address': '::', 'is_health_check_active': True} 2025-10-14 12:50:46,995 - DEBUG - VM uve shows ip address as ['2.62.60.132', '::'] 2025-10-14 12:50:46,995 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:50:46,995 - INFO - Verifying through opserver in 10.0.0.254 2025-10-14 12:50:46,995 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-45916114:ctest-random-79067696?flat 2025-10-14 12:50:47,023 - DEBUG - expected vm list 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:47,023 - DEBUG - Extracted vm list ['8cf7b96a-f528-4ec5-93ba-5aa47e706c6e'] 2025-10-14 12:50:47,023 - INFO - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is present in default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:50:47,023 - DEBUG - Verifying vm in vrouter uve 2025-10-14 12:50:47,023 - DEBUG - Getting info from collector 10.0.0.33.. 2025-10-14 12:50:47,023 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat 2025-10-14 12:50:47,087 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4312-30'] 2025-10-14 12:50:47,087 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:50:47,129 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:50:47,444 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:50:47,519 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:47,519 - DEBUG - Validated that VM ctest-TestRoutes-45916114-39914070 is in Vrouter an-jenkins-deploy-platform-ansible-os-4312-30 UVE 2025-10-14 12:50:47,519 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-14 12:50:47,526 - DEBUG - Expected tap interface of VM uuid 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb 2025-10-14 12:50:47,526 - DEBUG - Expected VN of VM uuid 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:50:47,526 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:50:47,562 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:50:47,645 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:47,645 - INFO - tap interface default-domain:ctest-TestRoutes-45916114:43a4d24a-2b2b-4fad-8abe-337655798ddb of vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:47,645 - DEBUG - Connected network default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 of vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:47,645 - DEBUG - Verifying the 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e virtual network link through opserver 10.0.0.254 2025-10-14 12:50:47,645 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-14 12:50:47,660 - DEBUG - VM link and name as {'name': '8cf7b96a-f528-4ec5-93ba-5aa47e706c6e', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat'} 2025-10-14 12:50:47,660 - DEBUG - Verifying the 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e virtual network link through opserver 10.0.0.50 2025-10-14 12:50:47,660 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2025-10-14 12:50:47,728 - DEBUG - VM link and name as {'name': '8cf7b96a-f528-4ec5-93ba-5aa47e706c6e', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat'} 2025-10-14 12:50:47,728 - DEBUG - Verifying the 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e virtual network link through opserver 10.0.0.33 2025-10-14 12:50:47,728 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machines 2025-10-14 12:50:47,743 - DEBUG - VM link and name as {'name': '8cf7b96a-f528-4ec5-93ba-5aa47e706c6e', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e?flat'} 2025-10-14 12:50:47,743 - INFO - VM ctest-TestRoutes-45916114-39914070 validations in Opserver passed 2025-10-14 12:50:47,743 - INFO - Waiting for VM ctest-TestRoutes-45916114-95924353 to be up.. 2025-10-14 12:50:47,839 - DEBUG - VM is in ACTIVE state now 2025-10-14 12:50:47,840 - INFO - VM name : ctest-TestRoutes-45916114-95924353 2025-10-14 12:50:47,940 - DEBUG - VM ctest-TestRoutes-45916114-95924353 ID is 0c649ea6-16d4-44b4-b4be-6f0ca7f8c163 2025-10-14 12:50:47,940 - DEBUG - VM ctest-TestRoutes-45916114-95924353 launched on Node an-jenkins-deploy-platform-ansible-os-4312-1 2025-10-14 12:50:48,029 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/0c649ea6-16d4-44b4-b4be-6f0ca7f8c163 2025-10-14 12:50:48,043 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/9062cfff-8eef-4f12-ad22-c33127b46cbe 2025-10-14 12:50:49,214 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.81 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.371 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.371/2.088/3.806/1.717 ms') 2025-10-14 12:50:49,214 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestRoutes-45916114-95924353 passed 2025-10-14 12:50:49,289 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-14 12:50:49,289 - DEBUG - Waiting to SSH to VM ctest-TestRoutes-45916114-95924353, IP 2.62.60.131, Port 22 2025-10-14 12:50:49,465 - DEBUG - VM ctest-TestRoutes-45916114-95924353 is ready for SSH connections 2025-10-14 12:50:49,465 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:50:49,778 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:50:49,813 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:50:49,829 - DEBUG - Requesting: http://10.0.0.254:8082/project/1caaa214-6c08-427d-868b-0c4755c7076e 2025-10-14 12:50:49,936 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:49,949 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:49,961 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/37e236ea-fced-4125-a88c-4c908729b380 2025-10-14 12:50:49,972 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/37e236ea-fced-4125-a88c-4c908729b380 2025-10-14 12:50:49,985 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a57ef9ad-fed9-4711-bd59-4f14ae4def64 2025-10-14 12:50:49,995 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:50:49,995 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:50,010 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/37e236ea-fced-4125-a88c-4c908729b380 2025-10-14 12:50:50,034 - INFO - Verified VN network id 14 for VN 2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:50,034 - INFO - Verifications in API Server for VN ctest-random-79067696 passed 2025-10-14 12:50:50,034 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:50,048 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/37e236ea-fced-4125-a88c-4c908729b380 2025-10-14 12:50:50,058 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/37e236ea-fced-4125-a88c-4c908729b380 2025-10-14 12:50:50,067 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/a57ef9ad-fed9-4711-bd59-4f14ae4def64 2025-10-14 12:50:50,088 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-45916114', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3047701667829993149', 'uuid-lslong': '12092479462536119441'}, 'enable': 'true', 'created': '2025-10-14T12:50:28', 'last-modified': '2025-10-14T12:50:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:21.422792'} 2025-10-14 12:50:50,096 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:50:50,103 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-45916114', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3047701667829993149', 'uuid-lslong': '12092479462536119441'}, 'enable': 'true', 'created': '2025-10-14T12:50:28', 'last-modified': '2025-10-14T12:50:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:21.434992'} 2025-10-14 12:50:50,110 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:50:50,117 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestRoutes-45916114', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3047701667829993149', 'uuid-lslong': '12092479462536119441'}, 'enable': 'true', 'created': '2025-10-14T12:50:28', 'last-modified': '2025-10-14T12:50:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:21.466417'} 2025-10-14 12:50:50,125 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-14 12:50:50,125 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-random-79067696 passed 2025-10-14 12:50:50,125 - DEBUG - ====Verifying policy data for ctest-random-79067696 in API_Server ====== 2025-10-14 12:50:50,126 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:50:50,134 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:50:50,147 - DEBUG - Requesting: http://10.0.0.254:8082/project/1caaa214-6c08-427d-868b-0c4755c7076e 2025-10-14 12:50:50,245 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/2a4b9c84-fc5f-4ebd-a7d1-1e00a22c0491 2025-10-14 12:50:50,262 - DEBUG - =>VN ctest-random-79067696 has no policy to be verified 2025-10-14 12:50:50,262 - DEBUG - Verifying the vn in opserver 2025-10-14 12:50:50,263 - DEBUG - Verifying the default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 virtual network link through opserver 10.0.0.254 2025-10-14 12:50:50,263 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-10-14 12:50:50,277 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-45916114:ctest-random-79067696?flat'} 2025-10-14 12:50:50,277 - DEBUG - Verifying the default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 virtual network link through opserver 10.0.0.50 2025-10-14 12:50:50,278 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-10-14 12:50:50,294 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-45916114:ctest-random-79067696?flat'} 2025-10-14 12:50:50,294 - DEBUG - Verifying the default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 virtual network link through opserver 10.0.0.33 2025-10-14 12:50:50,294 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-14 12:50:50,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestRoutes-45916114:ctest-random-79067696', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-45916114:ctest-random-79067696?flat'} 2025-10-14 12:50:50,308 - INFO - Validated that VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 is found in opserver 2025-10-14 12:50:50,320 - DEBUG - VRF ids for VN ctest-random-79067696: {'10.0.0.65': '2', '10.0.0.22': '2'} 2025-10-14 12:50:50,320 - INFO - Deleting VM ctest-TestRoutes-45916114-39914070 2025-10-14 12:50:50,394 - DEBUG - Verifying in api server 10.0.0.33 2025-10-14 12:50:50,394 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:50,404 - DEBUG - VM ID 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e of VM ctest-TestRoutes-45916114-39914070 is still found in API Server 2025-10-14 12:50:52,405 - DEBUG - Verifying in api server 10.0.0.33 2025-10-14 12:50:52,405 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:52,414 - DEBUG - Response Code: 404 2025-10-14 12:50:52,414 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:52,423 - DEBUG - Response Code: 404 2025-10-14 12:50:52,423 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/8cf7b96a-f528-4ec5-93ba-5aa47e706c6e 2025-10-14 12:50:52,431 - DEBUG - Response Code: 404 2025-10-14 12:50:52,431 - INFO - VM ctest-TestRoutes-45916114-39914070 is fully removed in API-Server 2025-10-14 12:50:52,586 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-14 12:50:52,740 - DEBUG - VM route 2.62.60.132 has been marked for discard in VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 of compute 10.0.0.65 2025-10-14 12:50:52,747 - DEBUG - Validated that vrouter 10.0.0.65 does not have VMs route for VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:50:52,747 - DEBUG - Validated that vrouter 10.0.0.22 does not have VMs route for VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:50:52,747 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:50:52,747 - INFO - VM ctest-TestRoutes-45916114-39914070 is removed in Compute, and routes are removed in all compute nodes 2025-10-14 12:50:53,012 - INFO - Routes for VM ctest-TestRoutes-45916114-39914070 is removed in all control-nodes 2025-10-14 12:50:53,012 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:50:53,046 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:50:53,080 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:53,080 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:50:53,080 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:50:53,081 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:50:56,081 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:50:56,119 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:50:56,158 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:56,158 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:50:56,158 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:50:56,158 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:50:59,158 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:50:59,198 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:50:59,236 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:50:59,236 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:50:59,236 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:50:59,236 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:51:02,237 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:51:02,293 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:51:02,333 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:51:02,334 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:51:02,334 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:51:02,334 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:51:05,335 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:51:05,373 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:51:05,420 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:51:05,420 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:51:05,420 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:51:05,420 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:51:08,421 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:51:08,461 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:51:08,504 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:51:08,504 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:51:08,504 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:51:08,504 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:51:11,504 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:51:11,546 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:51:11,579 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is still present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:51:11,579 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:51:11,579 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:51:11,579 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:51:14,580 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4312-30:Compute:contrail-vrouter-agent:0?flat 2025-10-14 12:51:14,614 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4312-30?flat 2025-10-14 12:51:14,654 - DEBUG - VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is not present in vrouter an-jenkins-deploy-platform-ansible-os-4312-30 uve 2025-10-14 12:51:14,654 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-14 12:51:14,654 - DEBUG - interface for vm 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e deleted from vrouter uve ... 2025-10-14 12:51:14,654 - DEBUG - Deleted interface not in error interface list ... 2025-10-14 12:51:14,654 - DEBUG - Validated that VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is removed in Vrouter UVE 2025-10-14 12:51:14,654 - DEBUG - Verifying through opserver in 10.0.0.254 2025-10-14 12:51:14,654 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestRoutes-45916114:ctest-random-79067696?flat 2025-10-14 12:51:14,676 - DEBUG - 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e BM not in default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 uve 2025-10-14 12:51:14,676 - DEBUG - Validated that VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is not present in the VN UVE 2025-10-14 12:51:14,676 - DEBUG - Verifying the 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e virtual network link through opserver 10.0.0.254 2025-10-14 12:51:14,676 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-machines 2025-10-14 12:51:14,692 - INFO - 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e vm uve deleted from opserver 2025-10-14 12:51:14,692 - DEBUG - Verifying the 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e virtual network link through opserver 10.0.0.50 2025-10-14 12:51:14,692 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2025-10-14 12:51:14,708 - INFO - 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e vm uve deleted from opserver 2025-10-14 12:51:14,708 - DEBUG - Verifying the 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e virtual network link through opserver 10.0.0.33 2025-10-14 12:51:14,708 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-machines 2025-10-14 12:51:14,724 - INFO - 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e vm uve deleted from opserver 2025-10-14 12:51:14,724 - INFO - Validated that VM 8cf7b96a-f528-4ec5-93ba-5aa47e706c6e is removed from Opserver 2025-10-14 12:51:14,725 - INFO - Validate that Vrouter Route table does get cleared 2025-10-14 12:51:14,814 - INFO - Removed intf route table f7565c3f-9ae3-4428-b145-3078b5eea7c7 from port 9062cfff-8eef-4f12-ad22-c33127b46cbe 2025-10-14 12:51:14,869 - INFO - Deleted Interface route table f7565c3f-9ae3-4428-b145-3078b5eea7c7 2025-10-14 12:51:14,870 - INFO - Detaching port 9062cfff-8eef-4f12-ad22-c33127b46cbe from VM ctest-TestRoutes-45916114-95924353 2025-10-14 12:51:14,911 - INFO - Deleting VM ctest-TestRoutes-45916114-95924353 2025-10-14 12:51:15,223 - DEBUG - Response for delete_port : () 2025-10-14 12:51:15,223 - INFO - Deleted port 9062cfff-8eef-4f12-ad22-c33127b46cbe 2025-10-14 12:51:15,223 - INFO - Deleting VN ctest-random-79067696 2025-10-14 12:51:15,426 - DEBUG - Response for deleting network () 2025-10-14 12:51:15,426 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/37e236ea-fced-4125-a88c-4c908729b380 2025-10-14 12:51:15,433 - DEBUG - Response Code: 404 2025-10-14 12:51:15,433 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-10-14 12:51:15,447 - DEBUG - Requesting: http://10.0.0.254:8082/domain/972a6834-584f-4bae-af8e-4c4518226241 2025-10-14 12:51:15,465 - DEBUG - Requesting: http://10.0.0.254:8082/project/1caaa214-6c08-427d-868b-0c4755c7076e 2025-10-14 12:51:15,572 - INFO - Validated that VN ctest-random-79067696 is not found in API Server 2025-10-14 12:51:15,584 - DEBUG - VN ctest-random-79067696 is not present in Agent 10.0.0.65 2025-10-14 12:51:15,595 - DEBUG - VN ctest-random-79067696 is not present in Agent 10.0.0.22 2025-10-14 12:51:15,595 - INFO - Validated that VN ctest-random-79067696 is not in any agent 2025-10-14 12:51:15,601 - DEBUG - VRF 2 is not seen in agent 10.0.0.65 2025-10-14 12:51:15,606 - DEBUG - Vrouter 10.0.0.65 does not have vrf 2 for VN ctest-random-79067696 2025-10-14 12:51:15,611 - DEBUG - VRF 2 is not seen in agent 10.0.0.22 2025-10-14 12:51:15,617 - DEBUG - Vrouter 10.0.0.22 does not have vrf 2 for VN ctest-random-79067696 2025-10-14 12:51:15,617 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestRoutes-45916114:ctest-random-79067696 2025-10-14 12:51:15,640 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-random-79067696 info 2025-10-14 12:51:16,949 - DEBUG - No XMPP flaps were noticed during the test 2025-10-14 12:51:16,949 - INFO - END TEST : test_rt_table_scenario_1 : PASSED[0:00:50] 2025-10-14 12:51:16,949 - INFO - -------------------------------------------------------------------------------- 2025-10-14 12:51:17,778 - INFO - Deleted project: ctest-TestRoutes-45916114, ID : 1caaa214-6c08-427d-868b-0c4755c7076e