2026-10-12 04:34:25,563 - INFO - Domain Default found not creating 2026-10-12 04:34:25,699 - INFO - Project ctest-TestDropStats-92709071 not found, creating it 2026-10-12 04:34:26,179 - INFO - Created Project:ctest-TestDropStats-92709071, ID : c9d2eac6-1c0c-40af-b52f-7cd34afe94a0 2026-10-12 04:34:28,321 - INFO - ================================================================================ 2026-10-12 04:34:28,321 - INFO - STARTING TEST : test_flow_action_drop_stats 2026-10-12 04:34:28,321 - INFO - TEST DESCRIPTION : Description: Verify flow action drop stats Steps: 1. Create 2 VNs and launch 1 VM in each VN, on different nodes on multi node setup 2. Add policy to deny pkts between VNs. 3. Ping VM2 from VM1 Pass criteria: 1. Verify flow action count gets incremented, get it from introspect 2. Verify flow action count gets incremented for the vmi of VM1, get it from introspect 2026-10-12 04:34:29,578 - DEBUG - Skipping xmpp flap check 2026-10-12 04:34:29,578 - INFO - Initial checks done. Running the testcase now 2026-10-12 04:34:29,578 - INFO - 2026-10-12 04:34:29,600 - DEBUG - Services list from nova: [, , , ] 2026-10-12 04:34:29,601 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-6357-1', 'an-jenkins-deploy-platform-ansible-os-6357-2']} 2026-10-12 04:34:30,235 - DEBUG - Response for create_network : {'network': {'id': '92fdfb61-c76b-402a-bcf8-2a674a0954a8', 'name': 'ctest-vn-93008548', 'tenant_id': 'c9d2eac61c0c40afb52f7cd34afe94a0', 'project_id': 'c9d2eac61c0c40afb52f7cd34afe94a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-92709071', 'ctest-vn-93008548'], 'port_security_enabled': True, 'description': ''}} 2026-10-12 04:34:30,430 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e2100e47-ddae-4510-b1df-cdd152e885d8', 'name': '', 'tenant_id': 'c9d2eac61c0c40afb52f7cd34afe94a0', 'network_id': '92fdfb61-c76b-402a-bcf8-2a674a0954a8', 'ip_version': 4, 'cidr': '55.140.119.0/26', 'allocation_pools': [{'start': '55.140.119.2', 'end': '55.140.119.62'}], 'gateway_ip': '55.140.119.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '55.140.119.2', 'tags': [], 'project_id': 'c9d2eac61c0c40afb52f7cd34afe94a0'}} 2026-10-12 04:34:30,445 - INFO - Created VN ctest-vn-93008548 2026-10-12 04:34:30,454 - DEBUG - VN ctest-vn-93008548 UUID is 92fdfb61-c76b-402a-bcf8-2a674a0954a8 2026-10-12 04:34:30,780 - DEBUG - Response for create_network : {'network': {'id': 'c56b32f3-7ec8-427b-b891-820ee515c0c5', 'name': 'ctest-vn-79327341', 'tenant_id': 'c9d2eac61c0c40afb52f7cd34afe94a0', 'project_id': 'c9d2eac61c0c40afb52f7cd34afe94a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestDropStats-92709071', 'ctest-vn-79327341'], 'port_security_enabled': True, 'description': ''}} 2026-10-12 04:34:30,990 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dbae0fc1-2ec2-48cf-8b37-e1546015c35b', 'name': '', 'tenant_id': 'c9d2eac61c0c40afb52f7cd34afe94a0', 'network_id': 'c56b32f3-7ec8-427b-b891-820ee515c0c5', 'ip_version': 4, 'cidr': '198.223.187.0/26', 'allocation_pools': [{'start': '198.223.187.2', 'end': '198.223.187.62'}], 'gateway_ip': '198.223.187.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.223.187.2', 'tags': [], 'project_id': 'c9d2eac61c0c40afb52f7cd34afe94a0'}} 2026-10-12 04:34:31,010 - INFO - Created VN ctest-vn-79327341 2026-10-12 04:34:31,021 - DEBUG - VN ctest-vn-79327341 UUID is c56b32f3-7ec8-427b-b891-820ee515c0c5 2026-10-12 04:34:31,517 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6357-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6357-1) 2026-10-12 04:34:31,862 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6357-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6357-2) 2026-10-12 04:34:31,862 - INFO - Waiting for VM ctest-vm1-11461221 to be up.. 2026-10-12 04:34:31,894 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-10-12 04:34:37,016 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-10-12 04:34:42,083 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-10-12 04:34:47,151 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-10-12 04:34:52,220 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-10-12 04:34:57,302 - DEBUG - VM is in ACTIVE state now 2026-10-12 04:34:57,303 - INFO - VM name : ctest-vm1-11461221 2026-10-12 04:34:57,378 - DEBUG - VM ctest-vm1-11461221 ID is 043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:34:57,400 - DEBUG - VM ctest-vm1-11461221 launched on Node an-jenkins-deploy-platform-ansible-os-6357-1 2026-10-12 04:34:57,465 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:34:57,825 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:34:57,855 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d2fec49a-4b72-4267-befd-c597b37ec97a 2026-10-12 04:35:01,018 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-10-12 04:35:01,018 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-11461221 failed! 2026-10-12 04:35:01,030 - DEBUG - Gateway for vn default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 is 55.140.119.1 and allocation pool is NOT set 2026-10-12 04:35:03,098 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.18 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.30 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.299/4.739/7.180/2.440 ms') 2026-10-12 04:35:03,098 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-11461221 passed 2026-10-12 04:35:03,165 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-10-12 04:35:03,165 - DEBUG - Waiting to SSH to VM ctest-vm1-11461221, IP 55.140.119.3, Port 22 2026-10-12 04:35:03,335 - DEBUG - VM ctest-vm1-11461221 is ready for SSH connections 2026-10-12 04:35:03,335 - INFO - Waiting for VM ctest-vm2-20335710 to be up.. 2026-10-12 04:35:03,407 - DEBUG - VM is in ACTIVE state now 2026-10-12 04:35:03,407 - INFO - VM name : ctest-vm2-20335710 2026-10-12 04:35:03,473 - DEBUG - VM ctest-vm2-20335710 ID is d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:03,473 - DEBUG - VM ctest-vm2-20335710 launched on Node an-jenkins-deploy-platform-ansible-os-6357-2 2026-10-12 04:35:03,532 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:03,539 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/4889a44a-8a5c-4389-9024-a3a425faf8d6 2026-10-12 04:35:04,685 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.63 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.376 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.376/2.500/4.625/2.124 ms') 2026-10-12 04:35:04,686 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm2-20335710 passed 2026-10-12 04:35:04,749 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-10-12 04:35:04,749 - DEBUG - Waiting to SSH to VM ctest-vm2-20335710, IP 198.223.187.3, Port 22 2026-10-12 04:35:04,921 - DEBUG - VM ctest-vm2-20335710 is ready for SSH connections 2026-10-12 04:35:04,987 - DEBUG - VM is in ACTIVE state now 2026-10-12 04:35:04,987 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-10-12 04:35:04,987 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:04,994 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d2fec49a-4b72-4267-befd-c597b37ec97a 2026-10-12 04:35:05,002 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:05,007 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d2fec49a-4b72-4267-befd-c597b37ec97a 2026-10-12 04:35:05,016 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/01ca6684-58d4-4f2b-9ace-834e87369481 2026-10-12 04:35:05,023 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:05,023 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:05,030 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/d2fec49a-4b72-4267-befd-c597b37ec97a 2026-10-12 04:35:05,045 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/01ca6684-58d4-4f2b-9ace-834e87369481 2026-10-12 04:35:05,051 - INFO - VM ctest-vm1-11461221 verfication in all API Servers passed 2026-10-12 04:35:05,067 - DEBUG - VM ctest-vm1-11461221 Tap interface: {'index': '3', 'name': 'tapd2fec49a-4b', 'uuid': 'd2fec49a-4b72-4267-befd-c597b37ec97a', 'vrf_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548:ctest-vn-93008548', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '5', 'vn_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548', 'vm_uuid': '043cfeaa-ce0b-4f7d-9fdc-52102cff604d', 'vm_name': 'ctest-vm1-11461221', 'ip_addr': '55.140.119.3', 'mac_addr': '02:d2:fe:c4:9a:4b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '140', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a', 'sg_uuid_list': ['169d7e43-e6fe-49b4-ab1d-1280365e5364'], 'static_route_list': None, 'vm_project_uuid': 'c9d2eac6-1c0c-40af-b52f-7cd34afe94a0', 'admin_state': 'Enabled', 'flow_key_idx': '25', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-10-12 04:35:05,067 - DEBUG - Agent 10.0.0.188 vrf name: default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548:ctest-vn-93008548 2026-10-12 04:35:05,072 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548:ctest-vn-93008548', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548', 'table_label': '-1', 'vxlan_id': '5', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.31:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-10-12 04:35:05,142 - DEBUG - VM ctest-vm1-11461221 : Tap interface tapd2fec49a-4b is set to Active 2026-10-12 04:35:05,142 - DEBUG - Tap interface tapd2fec49a-4b detail : {'index': '3', 'name': 'tapd2fec49a-4b', 'uuid': 'd2fec49a-4b72-4267-befd-c597b37ec97a', 'vrf_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548:ctest-vn-93008548', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '5', 'vn_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548', 'vm_uuid': '043cfeaa-ce0b-4f7d-9fdc-52102cff604d', 'vm_name': 'ctest-vm1-11461221', 'ip_addr': '55.140.119.3', 'mac_addr': '02:d2:fe:c4:9a:4b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '140', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a', 'sg_uuid_list': ['169d7e43-e6fe-49b4-ab1d-1280365e5364'], 'static_route_list': None, 'vm_project_uuid': 'c9d2eac6-1c0c-40af-b52f-7cd34afe94a0', 'admin_state': 'Enabled', 'flow_key_idx': '25', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-10-12 04:35:05,245 - DEBUG - Starting Layer 2 verification in Agent 2026-10-12 04:35:05,254 - DEBUG - Layer 2 path is seen for VM MAC 02:d2:fe:c4:9a:4b in agent 10.0.0.188 2026-10-12 04:35:05,254 - DEBUG - Active layer 2 route in agent is present for VMI tapd2fec49a-4b 2026-10-12 04:35:05,255 - DEBUG - L2 label(29) matches bw route table and interface table 2026-10-12 04:35:05,259 - DEBUG - VN default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 is found in Agent of node 10.0.0.188 2026-10-12 04:35:05,377 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 is consistent in agent 10.0.0.188 2026-10-12 04:35:05,377 - DEBUG - Route for VM IP ['55.140.119.3'] is consistent in agent 10.0.0.188 2026-10-12 04:35:05,377 - DEBUG - VN default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 verification for VM ctest-vm1-11461221 in Agent 10.0.0.188 passed 2026-10-12 04:35:05,481 - DEBUG - Starting all layer 2 verification in agent 10.0.0.188 2026-10-12 04:35:05,490 - DEBUG - Route for VM MAC 02:d2:fe:c4:9a:4b is consistent in agent 10.0.0.188 2026-10-12 04:35:05,495 - INFO - VM ctest-vm1-11461221 verifications in Compute nodes passed 2026-10-12 04:35:05,720 - DEBUG - Validated VM route 55.140.119.3 in vrouter of 10.0.0.188 2026-10-12 04:35:05,723 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-10-12 04:35:05,723 - INFO - Validated routes of VM ctest-vm1-11461221 in all vrouters 2026-10-12 04:35:06,233 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2026-10-12 04:35:06,355 - DEBUG - Layer2 route found for VM MAC 02:d2:fe:c4:9a:4b in Control-node 10.0.0.50 2026-10-12 04:35:06,356 - DEBUG - L2 Label for VM ctest-vm1-11461221 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2026-10-12 04:35:06,356 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2026-10-12 04:35:06,470 - DEBUG - Layer2 route found for VM MAC 02:d2:fe:c4:9a:4b in Control-node 10.0.0.38 2026-10-12 04:35:06,470 - DEBUG - L2 Label for VM ctest-vm1-11461221 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2026-10-12 04:35:06,470 - INFO - Verification in Control-nodes for VM ctest-vm1-11461221 passed 2026-10-12 04:35:06,470 - DEBUG - Verifying the vm in opserver 2026-10-12 04:35:06,470 - DEBUG - Verifying in collector 10.0.0.191 ... 2026-10-12 04:35:06,470 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat 2026-10-12 04:35:06,828 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat 2026-10-12 04:35:06,873 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a?flat 2026-10-12 04:35:07,229 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a?flat 2026-10-12 04:35:07,273 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a?flat 2026-10-12 04:35:07,322 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat 2026-10-12 04:35:07,366 - DEBUG - Verifying vm in vn uve 2026-10-12 04:35:07,366 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a?flat 2026-10-12 04:35:07,406 - DEBUG - VM uve shows interface as {'mac_address': '02:d2:fe:c4:9a:4b', 'rx_vlan': 65535, 'ip6_address': '::', '__T': 1791779691458551, 'virtual_network': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548', 'tx_vlan': 65535, 'ip_address': '55.140.119.3', 'admin_state': True, 'fixed_ip4_list': ['55.140.119.3'], 'gateway': '55.140.119.1', 'vn_uuid': '92fdfb61-c76b-402a-bcf8-2a674a0954a8', 'l2_active': False, 'port_mirror_enabled': False, 'ip6_active': False, 'vm_uuid': '043cfeaa-ce0b-4f7d-9fdc-52102cff604d', 'ip4_active': False, 'vm_name': 'ctest-vm1-11461221', 'active': False, 'vhostuser_mode': 0, 'uuid': 'd2fec49a-4b72-4267-befd-c597b37ec97a', 'label': 0, 'is_health_check_active': True} 2026-10-12 04:35:07,406 - DEBUG - VM uve shows ip address as ['55.140.119.3', '::'] 2026-10-12 04:35:07,406 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 2026-10-12 04:35:07,406 - INFO - Verifying through opserver in 10.0.0.38 2026-10-12 04:35:07,406 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548?flat 2026-10-12 04:35:07,428 - DEBUG - expected vm list 043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:07,428 - DEBUG - Extracted vm list ['043cfeaa-ce0b-4f7d-9fdc-52102cff604d'] 2026-10-12 04:35:07,428 - INFO - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is present in default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 2026-10-12 04:35:07,428 - DEBUG - Verifying vm in vrouter uve 2026-10-12 04:35:07,428 - DEBUG - Getting info from collector 10.0.0.191.. 2026-10-12 04:35:07,428 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat 2026-10-12 04:35:07,465 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6357-1'] 2026-10-12 04:35:07,465 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:07,508 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:07,865 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:07,926 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:07,926 - DEBUG - Validated that VM ctest-vm1-11461221 is in Vrouter an-jenkins-deploy-platform-ansible-os-6357-1 UVE 2026-10-12 04:35:07,926 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-10-12 04:35:07,933 - DEBUG - Expected tap interface of VM uuid 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a 2026-10-12 04:35:07,933 - DEBUG - Expected VN of VM uuid 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 2026-10-12 04:35:07,933 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:07,976 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:08,032 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:08,032 - INFO - tap interface default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a of vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:08,032 - DEBUG - Connected network default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 of vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:08,032 - DEBUG - Verifying the 043cfeaa-ce0b-4f7d-9fdc-52102cff604d virtual network link through opserver 10.0.0.38 2026-10-12 04:35:08,032 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-10-12 04:35:08,042 - DEBUG - VM link and name as {'name': '043cfeaa-ce0b-4f7d-9fdc-52102cff604d', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat'} 2026-10-12 04:35:08,042 - DEBUG - Verifying the 043cfeaa-ce0b-4f7d-9fdc-52102cff604d virtual network link through opserver 10.0.0.50 2026-10-12 04:35:08,042 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-10-12 04:35:08,076 - DEBUG - VM link and name as {'name': '043cfeaa-ce0b-4f7d-9fdc-52102cff604d', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat'} 2026-10-12 04:35:08,077 - DEBUG - Verifying the 043cfeaa-ce0b-4f7d-9fdc-52102cff604d virtual network link through opserver 10.0.0.191 2026-10-12 04:35:08,077 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-10-12 04:35:08,087 - DEBUG - VM link and name as {'name': '043cfeaa-ce0b-4f7d-9fdc-52102cff604d', 'href': 'http://10.0.0.191:8081/analytics/uves/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d?flat'} 2026-10-12 04:35:08,087 - INFO - VM ctest-vm1-11461221 validations in Opserver passed 2026-10-12 04:35:08,161 - DEBUG - VM is in ACTIVE state now 2026-10-12 04:35:08,161 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-10-12 04:35:08,161 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:08,168 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/4889a44a-8a5c-4389-9024-a3a425faf8d6 2026-10-12 04:35:08,176 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:08,181 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/4889a44a-8a5c-4389-9024-a3a425faf8d6 2026-10-12 04:35:08,189 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/2219edb9-66cc-41ae-878a-d6b7b2b36ebf 2026-10-12 04:35:08,196 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:08,196 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:08,202 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine-interface/4889a44a-8a5c-4389-9024-a3a425faf8d6 2026-10-12 04:35:08,210 - DEBUG - Requesting: http://10.0.0.191:8082/instance-ip/2219edb9-66cc-41ae-878a-d6b7b2b36ebf 2026-10-12 04:35:08,215 - INFO - VM ctest-vm2-20335710 verfication in all API Servers passed 2026-10-12 04:35:08,233 - DEBUG - VM ctest-vm2-20335710 Tap interface: {'index': '3', 'name': 'tap4889a44a-8a', 'uuid': '4889a44a-8a5c-4389-9024-a3a425faf8d6', 'vrf_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341:ctest-vn-79327341', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341', 'vm_uuid': 'd340a275-07ab-43c8-90e1-e473d1553fb2', 'vm_name': 'ctest-vm2-20335710', 'ip_addr': '198.223.187.3', 'mac_addr': '02:48:89:a4:4a:8a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '110', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6', 'sg_uuid_list': ['169d7e43-e6fe-49b4-ab1d-1280365e5364'], 'static_route_list': None, 'vm_project_uuid': 'c9d2eac6-1c0c-40af-b52f-7cd34afe94a0', 'admin_state': 'Enabled', 'flow_key_idx': '22', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-10-12 04:35:08,233 - DEBUG - Agent 10.0.0.189 vrf name: default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341:ctest-vn-79327341 2026-10-12 04:35:08,237 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341:ctest-vn-79327341', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.254:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-10-12 04:35:08,304 - DEBUG - VM ctest-vm2-20335710 : Tap interface tap4889a44a-8a is set to Active 2026-10-12 04:35:08,305 - DEBUG - Tap interface tap4889a44a-8a detail : {'index': '3', 'name': 'tap4889a44a-8a', 'uuid': '4889a44a-8a5c-4389-9024-a3a425faf8d6', 'vrf_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341:ctest-vn-79327341', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '24', 'l2_label': '29', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341', 'vm_uuid': 'd340a275-07ab-43c8-90e1-e473d1553fb2', 'vm_name': 'ctest-vm2-20335710', 'ip_addr': '198.223.187.3', 'mac_addr': '02:48:89:a4:4a:8a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '110', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6', 'sg_uuid_list': ['169d7e43-e6fe-49b4-ab1d-1280365e5364'], 'static_route_list': None, 'vm_project_uuid': 'c9d2eac6-1c0c-40af-b52f-7cd34afe94a0', 'admin_state': 'Enabled', 'flow_key_idx': '22', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-10-12 04:35:08,409 - DEBUG - Starting Layer 2 verification in Agent 2026-10-12 04:35:08,419 - DEBUG - Layer 2 path is seen for VM MAC 02:48:89:a4:4a:8a in agent 10.0.0.189 2026-10-12 04:35:08,419 - DEBUG - Active layer 2 route in agent is present for VMI tap4889a44a-8a 2026-10-12 04:35:08,419 - DEBUG - L2 label(29) matches bw route table and interface table 2026-10-12 04:35:08,430 - DEBUG - VN default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 is found in Agent of node 10.0.0.189 2026-10-12 04:35:08,553 - DEBUG - VRF IDs of VN default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 is consistent in agent 10.0.0.189 2026-10-12 04:35:08,553 - DEBUG - Route for VM IP ['198.223.187.3'] is consistent in agent 10.0.0.189 2026-10-12 04:35:08,553 - DEBUG - VN default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 verification for VM ctest-vm2-20335710 in Agent 10.0.0.189 passed 2026-10-12 04:35:08,657 - DEBUG - Starting all layer 2 verification in agent 10.0.0.189 2026-10-12 04:35:08,668 - DEBUG - Route for VM MAC 02:48:89:a4:4a:8a is consistent in agent 10.0.0.189 2026-10-12 04:35:08,668 - INFO - VM ctest-vm2-20335710 verifications in Compute nodes passed 2026-10-12 04:35:08,894 - DEBUG - Validated VM route 198.223.187.3 in vrouter of 10.0.0.189 2026-10-12 04:35:08,897 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2026-10-12 04:35:08,897 - INFO - Validated routes of VM ctest-vm2-20335710 in all vrouters 2026-10-12 04:35:09,399 - DEBUG - Starting all layer2 verification in 10.0.0.50 Control Node 2026-10-12 04:35:09,516 - DEBUG - Layer2 route found for VM MAC 02:48:89:a4:4a:8a in Control-node 10.0.0.50 2026-10-12 04:35:09,516 - DEBUG - L2 Label for VM ctest-vm2-20335710 same between Control-node 10.0.0.50 and Agent, Expected: 29, Seen: 29 2026-10-12 04:35:09,516 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2026-10-12 04:35:09,631 - DEBUG - Layer2 route found for VM MAC 02:48:89:a4:4a:8a in Control-node 10.0.0.38 2026-10-12 04:35:09,631 - DEBUG - L2 Label for VM ctest-vm2-20335710 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2026-10-12 04:35:09,631 - INFO - Verification in Control-nodes for VM ctest-vm2-20335710 passed 2026-10-12 04:35:09,631 - DEBUG - Verifying the vm in opserver 2026-10-12 04:35:09,631 - DEBUG - Verifying in collector 10.0.0.191 ... 2026-10-12 04:35:09,631 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2?flat 2026-10-12 04:35:09,644 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6?flat 2026-10-12 04:35:09,661 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6?flat 2026-10-12 04:35:09,677 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2?flat 2026-10-12 04:35:09,688 - DEBUG - Verifying vm in vn uve 2026-10-12 04:35:09,688 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6?flat 2026-10-12 04:35:09,707 - DEBUG - VM uve shows interface as {'mac_address': '02:48:89:a4:4a:8a', 'rx_vlan': 65535, 'ip6_address': '::', '__T': 1791779699871578, 'virtual_network': 'default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341', 'tx_vlan': 65535, 'ip_address': '198.223.187.3', 'admin_state': True, 'fixed_ip4_list': ['198.223.187.3'], 'gateway': '198.223.187.1', 'vn_uuid': 'c56b32f3-7ec8-427b-b891-820ee515c0c5', 'l2_active': True, 'port_mirror_enabled': False, 'ip6_active': False, 'vm_uuid': 'd340a275-07ab-43c8-90e1-e473d1553fb2', 'ip4_active': True, 'vm_name': 'ctest-vm2-20335710', 'active': True, 'vhostuser_mode': 0, 'uuid': '4889a44a-8a5c-4389-9024-a3a425faf8d6', 'label': 24, 'is_health_check_active': True} 2026-10-12 04:35:09,708 - DEBUG - VM uve shows ip address as ['198.223.187.3', '::'] 2026-10-12 04:35:09,708 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 2026-10-12 04:35:09,708 - INFO - Verifying through opserver in 10.0.0.38 2026-10-12 04:35:09,708 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341?flat 2026-10-12 04:35:09,734 - DEBUG - expected vm list d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:09,734 - DEBUG - Extracted vm list ['d340a275-07ab-43c8-90e1-e473d1553fb2'] 2026-10-12 04:35:09,734 - INFO - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is present in default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 2026-10-12 04:35:09,734 - DEBUG - Verifying vm in vrouter uve 2026-10-12 04:35:09,734 - DEBUG - Getting info from collector 10.0.0.191.. 2026-10-12 04:35:09,734 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2?flat 2026-10-12 04:35:09,746 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-6357-2'] 2026-10-12 04:35:09,746 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:09,792 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:09,821 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:09,821 - DEBUG - Validated that VM ctest-vm2-20335710 is in Vrouter an-jenkins-deploy-platform-ansible-os-6357-2 UVE 2026-10-12 04:35:09,821 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2026-10-12 04:35:09,828 - DEBUG - Expected tap interface of VM uuid d340a275-07ab-43c8-90e1-e473d1553fb2 is default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6 2026-10-12 04:35:09,828 - DEBUG - Expected VN of VM uuid d340a275-07ab-43c8-90e1-e473d1553fb2 is default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 2026-10-12 04:35:09,828 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:09,872 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:09,902 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:09,902 - INFO - tap interface default-domain:ctest-TestDropStats-92709071:4889a44a-8a5c-4389-9024-a3a425faf8d6 of vm d340a275-07ab-43c8-90e1-e473d1553fb2 is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:09,902 - DEBUG - Connected network default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 of vm d340a275-07ab-43c8-90e1-e473d1553fb2 is present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:09,902 - DEBUG - Verifying the d340a275-07ab-43c8-90e1-e473d1553fb2 virtual network link through opserver 10.0.0.38 2026-10-12 04:35:09,902 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-10-12 04:35:09,912 - DEBUG - VM link and name as {'name': 'd340a275-07ab-43c8-90e1-e473d1553fb2', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2?flat'} 2026-10-12 04:35:09,913 - DEBUG - Verifying the d340a275-07ab-43c8-90e1-e473d1553fb2 virtual network link through opserver 10.0.0.50 2026-10-12 04:35:09,913 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-10-12 04:35:09,923 - DEBUG - VM link and name as {'name': 'd340a275-07ab-43c8-90e1-e473d1553fb2', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2?flat'} 2026-10-12 04:35:09,923 - DEBUG - Verifying the d340a275-07ab-43c8-90e1-e473d1553fb2 virtual network link through opserver 10.0.0.191 2026-10-12 04:35:09,923 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-10-12 04:35:09,933 - DEBUG - VM link and name as {'name': 'd340a275-07ab-43c8-90e1-e473d1553fb2', 'href': 'http://10.0.0.191:8081/analytics/uves/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2?flat'} 2026-10-12 04:35:09,933 - INFO - VM ctest-vm2-20335710 validations in Opserver passed 2026-10-12 04:35:09,964 - INFO - Deleting VM ctest-vm2-20335710 2026-10-12 04:35:10,026 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:10,026 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:10,034 - DEBUG - VM ID d340a275-07ab-43c8-90e1-e473d1553fb2 of VM ctest-vm2-20335710 is still found in API Server 2026-10-12 04:35:12,034 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:12,035 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:12,041 - DEBUG - VM ID d340a275-07ab-43c8-90e1-e473d1553fb2 of VM ctest-vm2-20335710 is still found in API Server 2026-10-12 04:35:14,042 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:14,042 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:14,048 - DEBUG - Response Code: 404 2026-10-12 04:35:14,048 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:14,053 - DEBUG - Response Code: 404 2026-10-12 04:35:14,053 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/d340a275-07ab-43c8-90e1-e473d1553fb2 2026-10-12 04:35:14,057 - DEBUG - Response Code: 404 2026-10-12 04:35:14,057 - INFO - VM ctest-vm2-20335710 is fully removed in API-Server 2026-10-12 04:35:14,214 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-10-12 04:35:14,246 - DEBUG - Validated that vrouter 10.0.0.188 does not have VMs route for VN default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 2026-10-12 04:35:14,254 - DEBUG - Validated that vrouter 10.0.0.189 does not have VMs route for VN default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 2026-10-12 04:35:14,254 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 2026-10-12 04:35:14,255 - INFO - VM ctest-vm2-20335710 is removed in Compute, and routes are removed in all compute nodes 2026-10-12 04:35:14,478 - INFO - Routes for VM ctest-vm2-20335710 is removed in all control-nodes 2026-10-12 04:35:14,478 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:14,520 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:14,549 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:14,549 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:14,550 - DEBUG - interface for vm d340a275-07ab-43c8-90e1-e473d1553fb2 deleted from vrouter uve ... 2026-10-12 04:35:14,550 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:17,550 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:17,596 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:17,624 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:17,624 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:17,624 - DEBUG - interface for vm d340a275-07ab-43c8-90e1-e473d1553fb2 deleted from vrouter uve ... 2026-10-12 04:35:17,624 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:20,625 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:20,669 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:20,698 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:20,698 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:20,698 - DEBUG - interface for vm d340a275-07ab-43c8-90e1-e473d1553fb2 deleted from vrouter uve ... 2026-10-12 04:35:20,698 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:23,699 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:23,743 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:23,772 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:23,772 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:23,772 - DEBUG - interface for vm d340a275-07ab-43c8-90e1-e473d1553fb2 deleted from vrouter uve ... 2026-10-12 04:35:23,772 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:26,773 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:26,819 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:26,852 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:26,852 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:26,852 - DEBUG - interface for vm d340a275-07ab-43c8-90e1-e473d1553fb2 deleted from vrouter uve ... 2026-10-12 04:35:26,852 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:29,853 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-2:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:29,897 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-2?flat 2026-10-12 04:35:29,926 - DEBUG - VM d340a275-07ab-43c8-90e1-e473d1553fb2 is not present in vrouter an-jenkins-deploy-platform-ansible-os-6357-2 uve 2026-10-12 04:35:29,926 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:29,926 - DEBUG - interface for vm d340a275-07ab-43c8-90e1-e473d1553fb2 deleted from vrouter uve ... 2026-10-12 04:35:29,926 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:29,926 - DEBUG - Validated that VM d340a275-07ab-43c8-90e1-e473d1553fb2 is removed in Vrouter UVE 2026-10-12 04:35:29,926 - DEBUG - Verifying through opserver in 10.0.0.38 2026-10-12 04:35:29,926 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341?flat 2026-10-12 04:35:29,941 - DEBUG - d340a275-07ab-43c8-90e1-e473d1553fb2 BM not in default-domain:ctest-TestDropStats-92709071:ctest-vn-79327341 uve 2026-10-12 04:35:29,941 - DEBUG - Validated that VM d340a275-07ab-43c8-90e1-e473d1553fb2 is not present in the VN UVE 2026-10-12 04:35:29,941 - DEBUG - Verifying the d340a275-07ab-43c8-90e1-e473d1553fb2 virtual network link through opserver 10.0.0.38 2026-10-12 04:35:29,941 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-10-12 04:35:29,951 - INFO - d340a275-07ab-43c8-90e1-e473d1553fb2 vm uve deleted from opserver 2026-10-12 04:35:29,951 - DEBUG - Verifying the d340a275-07ab-43c8-90e1-e473d1553fb2 virtual network link through opserver 10.0.0.50 2026-10-12 04:35:29,951 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-10-12 04:35:29,960 - INFO - d340a275-07ab-43c8-90e1-e473d1553fb2 vm uve deleted from opserver 2026-10-12 04:35:29,960 - DEBUG - Verifying the d340a275-07ab-43c8-90e1-e473d1553fb2 virtual network link through opserver 10.0.0.191 2026-10-12 04:35:29,960 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-10-12 04:35:29,970 - INFO - d340a275-07ab-43c8-90e1-e473d1553fb2 vm uve deleted from opserver 2026-10-12 04:35:29,970 - INFO - Validated that VM d340a275-07ab-43c8-90e1-e473d1553fb2 is removed from Opserver 2026-10-12 04:35:29,970 - INFO - Deleting VM ctest-vm1-11461221 2026-10-12 04:35:30,032 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:30,032 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:30,041 - DEBUG - VM ID 043cfeaa-ce0b-4f7d-9fdc-52102cff604d of VM ctest-vm1-11461221 is still found in API Server 2026-10-12 04:35:32,042 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:32,042 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:32,048 - DEBUG - VM ID 043cfeaa-ce0b-4f7d-9fdc-52102cff604d of VM ctest-vm1-11461221 is still found in API Server 2026-10-12 04:35:34,049 - DEBUG - Verifying in api server 10.0.0.191 2026-10-12 04:35:34,049 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:34,055 - DEBUG - Response Code: 404 2026-10-12 04:35:34,055 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:34,060 - DEBUG - Response Code: 404 2026-10-12 04:35:34,060 - DEBUG - Requesting: http://10.0.0.191:8082/virtual-machine/043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:34,064 - DEBUG - Response Code: 404 2026-10-12 04:35:34,064 - INFO - VM ctest-vm1-11461221 is fully removed in API-Server 2026-10-12 04:35:34,214 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2026-10-12 04:35:34,247 - DEBUG - Validated that vrouter 10.0.0.188 does not have VMs route for VN default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 2026-10-12 04:35:34,256 - DEBUG - Validated that vrouter 10.0.0.189 does not have VMs route for VN default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 2026-10-12 04:35:34,256 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 2026-10-12 04:35:34,256 - INFO - VM ctest-vm1-11461221 is removed in Compute, and routes are removed in all compute nodes 2026-10-12 04:35:34,480 - INFO - Routes for VM ctest-vm1-11461221 is removed in all control-nodes 2026-10-12 04:35:34,480 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:34,522 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:34,551 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:34,551 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:34,552 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:34,552 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:37,553 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:37,628 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:37,657 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:37,657 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:37,657 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:37,657 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:40,658 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:40,703 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:40,732 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:40,732 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:40,732 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:40,732 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:43,733 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:43,778 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:43,806 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:43,806 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:43,806 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:43,806 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:46,807 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:46,852 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:46,880 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:46,880 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:46,880 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:46,880 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:49,881 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:49,929 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:49,958 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is still present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:49,958 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:49,958 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:49,959 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:52,959 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-6357-1:Compute:contrail-vrouter-agent:0?flat 2026-10-12 04:35:53,006 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-6357-1?flat 2026-10-12 04:35:53,033 - DEBUG - VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is not present in vrouter an-jenkins-deploy-platform-ansible-os-6357-1 uve 2026-10-12 04:35:53,033 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2026-10-12 04:35:53,033 - DEBUG - interface for vm 043cfeaa-ce0b-4f7d-9fdc-52102cff604d deleted from vrouter uve ... 2026-10-12 04:35:53,033 - DEBUG - Deleted interface not in error interface list ... 2026-10-12 04:35:53,034 - DEBUG - Validated that VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is removed in Vrouter UVE 2026-10-12 04:35:53,034 - DEBUG - Verifying through opserver in 10.0.0.38 2026-10-12 04:35:53,034 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548?flat 2026-10-12 04:35:53,050 - DEBUG - 043cfeaa-ce0b-4f7d-9fdc-52102cff604d BM not in default-domain:ctest-TestDropStats-92709071:ctest-vn-93008548 uve 2026-10-12 04:35:53,050 - DEBUG - Validated that VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is not present in the VN UVE 2026-10-12 04:35:53,050 - DEBUG - Verifying the 043cfeaa-ce0b-4f7d-9fdc-52102cff604d virtual network link through opserver 10.0.0.38 2026-10-12 04:35:53,050 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2026-10-12 04:35:53,060 - DEBUG - No links retuned for 043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:53,060 - INFO - 043cfeaa-ce0b-4f7d-9fdc-52102cff604d vm uve deleted from opserver 2026-10-12 04:35:53,060 - DEBUG - Verifying the 043cfeaa-ce0b-4f7d-9fdc-52102cff604d virtual network link through opserver 10.0.0.50 2026-10-12 04:35:53,060 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-machines 2026-10-12 04:35:53,069 - DEBUG - No links retuned for 043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:53,069 - INFO - 043cfeaa-ce0b-4f7d-9fdc-52102cff604d vm uve deleted from opserver 2026-10-12 04:35:53,069 - DEBUG - Verifying the 043cfeaa-ce0b-4f7d-9fdc-52102cff604d virtual network link through opserver 10.0.0.191 2026-10-12 04:35:53,069 - DEBUG - Requesting: http://10.0.0.191:8081/analytics/uves/virtual-machines 2026-10-12 04:35:53,079 - DEBUG - No links retuned for 043cfeaa-ce0b-4f7d-9fdc-52102cff604d 2026-10-12 04:35:53,079 - INFO - 043cfeaa-ce0b-4f7d-9fdc-52102cff604d vm uve deleted from opserver 2026-10-12 04:35:53,079 - INFO - Validated that VM 043cfeaa-ce0b-4f7d-9fdc-52102cff604d is removed from Opserver 2026-10-12 04:35:53,079 - INFO - Deleting VN ctest-vn-79327341 2026-10-12 04:35:53,215 - DEBUG - Response for deleting network () 2026-10-12 04:35:53,215 - INFO - Deleting VN ctest-vn-93008548 2026-10-12 04:35:53,371 - DEBUG - Response for deleting network () 2026-10-12 04:35:54,634 - ERROR - IndexError Python 3.9.25: /usr/bin/python3 Mon Oct 12 04:35:09 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/vrouter/test_drop_stats.py in test_flow_action_drop_stats(self=) 36 raise self.skipTest("Skipping test case,this test needs atleast 2 compute nodes") 37 38 assert self.verify_flow_action_drop_stats() 39 return True 40 # end test_drop_stats self = self.verify_flow_action_drop_stats = > /contrail-test/common/vrouter/base_drop_stats.py in verify_flow_action_drop_stats(self=, drop_type='ds_flow_action_drop') 51 fq_name = intf_details[0]['config_name'] 52 53 vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] 54 self.print_drop_stats_dict(vif_dict_before) 55 vif_dict_before undefined self = self.get_drop_stats_dict = .deco_retry....on_drop_stats[dev_reg,sanity] id=0x7f152b747610>> compute0 = '10.0.0.188' fq_name = 'default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a' /contrail-test/tcutils/util.py in f_retry(*args=(, '10.0.0.188', 'default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a'), **kwargs={}) 82 mtries, mdelay = tries, delay # make mutable 83 84 result = f(*args, **kwargs) # first attempt 85 rv = result 86 final = False result undefined f = args = (, '10.0.0.188', 'default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a') kwargs = {} /contrail-test/common/vrouter/base_drop_stats.py in get_drop_stats_dict(self=, compute='10.0.0.188', fq_name='default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a', module='vif') 29 drop_stats_list = self.agent_inspect_h[compute].get_agent_vrouter_drop_stats() 30 else: 31 drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) 32 33 if drop_stats_list is not None: drop_stats_list undefined self = self.agent_inspect_h = {} compute = '10.0.0.188' ].get_agent_vm_interface_drop_stats undefined fq_name = 'default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a' /contrail-test/tcutils/agent/vna_introspect_utils.py in get_agent_vm_interface_drop_stats(self=, fq_name='default-domain:ctest-TestDropStats-92709071:d2fec49a-4b72-4267-befd-c597b37ec97a') 1039 except IndexError: 1040 return None 1041 return l[0] 1042 # end get_agent_vm_interface_drop_stats 1043 l = [] IndexError: list index out of range __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Sequence index out of range.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('list index out of range',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/vrouter/test_drop_stats.py", line 38, in test_flow_action_drop_stats assert self.verify_flow_action_drop_stats() File "/contrail-test/common/vrouter/base_drop_stats.py", line 53, in verify_flow_action_drop_stats vif_dict_before = self.get_drop_stats_dict(compute0, fq_name)[1] File "/contrail-test/tcutils/util.py", line 84, in f_retry result = f(*args, **kwargs) # first attempt File "/contrail-test/common/vrouter/base_drop_stats.py", line 31, in get_drop_stats_dict drop_stats_list = self.agent_inspect_h[compute].get_agent_vm_interface_drop_stats(fq_name) File "/contrail-test/tcutils/agent/vna_introspect_utils.py", line 1041, in get_agent_vm_interface_drop_stats return l[0] IndexError: list index out of range 2026-10-12 04:35:54,635 - DEBUG - Skipping xmpp flap check 2026-10-12 04:35:54,635 - INFO - 2026-10-12 04:35:54,635 - INFO - END TEST : test_flow_action_drop_stats : FAILED[0:01:26] 2026-10-12 04:35:54,635 - INFO - -------------------------------------------------------------------------------- 2026-10-12 04:35:55,411 - INFO - Deleted project: ctest-TestDropStats-92709071, ID : c9d2eac6-1c0c-40af-b52f-7cd34afe94a0