2026-06-05 13:21:16,041 - INFO - Domain Default found not creating 2026-06-05 13:21:16,235 - INFO - Project ctest-AnalyticsTestSanityWithResource-64198127 not found, creating it 2026-06-05 13:21:16,843 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-64198127, ID : 8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:21:19,419 - DEBUG - Response for create_network : {'network': {'id': '99b0fbee-9981-467e-88a6-6e42f7a81e07', 'name': 'ctest-vn1-34912203', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'project_id': '8e82d86472264b809b54e34ce491e59d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'ctest-vn1-34912203'], 'port_security_enabled': True, 'description': ''}} 2026-06-05 13:21:19,702 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b6bf15a2-cb9d-4254-8e81-e62710144a3c', 'name': '', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'network_id': '99b0fbee-9981-467e-88a6-6e42f7a81e07', 'ip_version': 4, 'cidr': '29.67.38.192/26', 'allocation_pools': [{'start': '29.67.38.194', 'end': '29.67.38.254'}], 'gateway_ip': '29.67.38.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '29.67.38.194', 'tags': [], 'project_id': '8e82d86472264b809b54e34ce491e59d'}} 2026-06-05 13:21:19,735 - INFO - Created VN ctest-vn1-34912203 2026-06-05 13:21:19,749 - DEBUG - VN ctest-vn1-34912203 UUID is 99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:19,868 - DEBUG - Services list from nova: [, , , ] 2026-06-05 13:21:19,868 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5895-1', 'an-jenkins-deploy-platform-ansible-os-5895-2']} 2026-06-05 13:21:21,370 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5895-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5895-1) 2026-06-05 13:21:23,046 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5895-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5895-1) 2026-06-05 13:21:23,047 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:21:23,370 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:21:23,411 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:21:23,430 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:21:23,560 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:23,573 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:23,609 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:21:23,626 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:21:23,641 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:21:23,648 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:21:23,648 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:23,660 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:21:23,693 - INFO - Verified VN network id 15 for VN 99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:23,693 - INFO - Verifications in API Server for VN ctest-vn1-34912203 passed 2026-06-05 13:21:23,693 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:23,708 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:21:23,718 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:21:23,725 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:21:23,742 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:21:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.105026'} 2026-06-05 13:21:23,749 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:21:23,757 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:21:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.117978'} 2026-06-05 13:21:23,766 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:21:23,772 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:21:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.131378'} 2026-06-05 13:21:23,779 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:21:23,779 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-34912203 passed 2026-06-05 13:21:23,780 - DEBUG - ====Verifying policy data for ctest-vn1-34912203 in API_Server ====== 2026-06-05 13:21:23,780 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:21:23,792 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:21:23,805 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:21:23,940 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:21:23,966 - DEBUG - =>VN ctest-vn1-34912203 has no policy to be verified 2026-06-05 13:21:23,966 - DEBUG - Verifying the vn in opserver 2026-06-05 13:21:23,966 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.242 2026-06-05 13:21:23,966 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:21:24,349 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:21:24,421 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:21:24,421 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.50 2026-06-05 13:21:24,421 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:21:24,746 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:21:24,823 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:21:24,823 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.129 2026-06-05 13:21:24,823 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:21:25,152 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:21:25,247 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:21:25,247 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is found in opserver 2026-06-05 13:21:25,262 - DEBUG - VRF ids for VN ctest-vn1-34912203: {'10.0.0.41': '5'} 2026-06-05 13:21:25,262 - INFO - Waiting for VM ctest-vn1_vm1-31051863 to be up.. 2026-06-05 13:21:25,372 - DEBUG - VM is in ACTIVE state now 2026-06-05 13:21:25,372 - INFO - VM name : ctest-vn1_vm1-31051863 2026-06-05 13:21:25,480 - DEBUG - VM ctest-vn1_vm1-31051863 ID is 013c33e3-815f-4879-a1bb-6ba22a93815c 2026-06-05 13:21:25,513 - DEBUG - VM ctest-vn1_vm1-31051863 launched on Node an-jenkins-deploy-platform-ansible-os-5895-1 2026-06-05 13:21:25,614 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/013c33e3-815f-4879-a1bb-6ba22a93815c 2026-06-05 13:21:25,941 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/013c33e3-815f-4879-a1bb-6ba22a93815c 2026-06-05 13:21:25,982 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/8539d2b0-c226-4481-935b-0b5a4b3c1931 2026-06-05 13:21:29,188 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2026-06-05 13:21:29,188 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm1-31051863 failed! 2026-06-05 13:21:29,203 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is 29.67.38.193 and allocation pool is NOT set 2026-06-05 13:21:33,282 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-06-05 13:21:33,282 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm1-31051863 failed! 2026-06-05 13:21:33,299 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is 29.67.38.193 and allocation pool is NOT set 2026-06-05 13:21:37,376 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-06-05 13:21:37,377 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm1-31051863 failed! 2026-06-05 13:21:37,393 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is 29.67.38.193 and allocation pool is NOT set 2026-06-05 13:21:41,478 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2026-06-05 13:21:41,479 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm1-31051863 failed! 2026-06-05 13:21:41,496 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is 29.67.38.193 and allocation pool is NOT set 2026-06-05 13:21:43,553 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=3.39 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.530 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.530/1.961/3.393/1.431 ms') 2026-06-05 13:21:43,553 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm1-31051863 passed 2026-06-05 13:21:43,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:21:43,628 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-31051863, IP 29.67.38.195, Port 22 2026-06-05 13:21:43,684 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-06-05 13:21:43,788 - DEBUG - VM ctest-vn1_vm1-31051863 is NOT ready for SSH connections, VM status: ACTIVE 2026-06-05 13:21:48,789 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:21:48,789 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-31051863, IP 29.67.38.195, Port 22 2026-06-05 13:21:48,848 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-06-05 13:21:48,946 - DEBUG - VM ctest-vn1_vm1-31051863 is NOT ready for SSH connections, VM status: ACTIVE 2026-06-05 13:21:53,947 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:21:53,947 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-31051863, IP 29.67.38.195, Port 22 2026-06-05 13:21:54,108 - DEBUG - VM ctest-vn1_vm1-31051863 is ready for SSH connections 2026-06-05 13:21:54,108 - INFO - Waiting for VM ctest-vn1_vm2-73879884 to be up.. 2026-06-05 13:21:54,222 - DEBUG - VM is in ACTIVE state now 2026-06-05 13:21:54,222 - INFO - VM name : ctest-vn1_vm2-73879884 2026-06-05 13:21:54,332 - DEBUG - VM ctest-vn1_vm2-73879884 ID is 3515b278-ed83-41e7-8bf1-40d545dddac1 2026-06-05 13:21:54,332 - DEBUG - VM ctest-vn1_vm2-73879884 launched on Node an-jenkins-deploy-platform-ansible-os-5895-1 2026-06-05 13:21:54,427 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/3515b278-ed83-41e7-8bf1-40d545dddac1 2026-06-05 13:21:54,438 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/12ea0c2a-e68a-434d-a62f-d88cfd7fc9ea 2026-06-05 13:21:55,608 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=2.74 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.420 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.420/1.581/2.742/1.161 ms') 2026-06-05 13:21:55,608 - INFO - Ping to Metadata IP 169.254.0.7 of VM ctest-vn1_vm2-73879884 passed 2026-06-05 13:21:55,679 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:21:55,679 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-73879884, IP 29.67.38.196, Port 22 2026-06-05 13:21:55,846 - DEBUG - VM ctest-vn1_vm2-73879884 is ready for SSH connections 2026-06-05 13:21:56,180 - DEBUG - Response for create_network : {'network': {'id': '053de5cc-af7b-4c33-8769-9a4b3c1e542a', 'name': 'ctest-vn2-83318571', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'project_id': '8e82d86472264b809b54e34ce491e59d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'ctest-vn2-83318571'], 'port_security_enabled': True, 'description': ''}} 2026-06-05 13:21:56,492 - DEBUG - Response for create_subnet : {'subnet': {'id': '3eea973f-ffd3-4806-b273-fbc777c4d7ce', 'name': '', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'network_id': '053de5cc-af7b-4c33-8769-9a4b3c1e542a', 'ip_version': 4, 'cidr': '15.228.143.128/26', 'allocation_pools': [{'start': '15.228.143.130', 'end': '15.228.143.190'}], 'gateway_ip': '15.228.143.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.228.143.130', 'tags': [], 'project_id': '8e82d86472264b809b54e34ce491e59d'}} 2026-06-05 13:21:56,522 - INFO - Created VN ctest-vn2-83318571 2026-06-05 13:21:56,540 - DEBUG - VN ctest-vn2-83318571 UUID is 053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:21:56,966 - DEBUG - Response for create_network : {'network': {'id': 'a22468fa-4a62-4b4b-9ec0-cb7a828358c4', 'name': 'ctest-fip_vn-16923357', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'project_id': '8e82d86472264b809b54e34ce491e59d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'ctest-fip_vn-16923357'], 'port_security_enabled': True, 'description': ''}} 2026-06-05 13:21:57,253 - DEBUG - Response for create_subnet : {'subnet': {'id': '86900535-25fb-4060-b0d5-81a366c1b463', 'name': '', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'network_id': 'a22468fa-4a62-4b4b-9ec0-cb7a828358c4', 'ip_version': 4, 'cidr': '114.74.144.0/26', 'allocation_pools': [{'start': '114.74.144.2', 'end': '114.74.144.62'}], 'gateway_ip': '114.74.144.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '114.74.144.2', 'tags': [], 'project_id': '8e82d86472264b809b54e34ce491e59d'}} 2026-06-05 13:21:57,281 - INFO - Created VN ctest-fip_vn-16923357 2026-06-05 13:21:57,292 - DEBUG - VN ctest-fip_vn-16923357 UUID is a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:21:57,388 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5895-1', 'an-jenkins-deploy-platform-ansible-os-5895-2']} 2026-06-05 13:21:59,114 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5895-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5895-2) 2026-06-05 13:22:01,192 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5895-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5895-2) 2026-06-05 13:22:03,274 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5895-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5895-1) 2026-06-05 13:22:03,274 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:03,282 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:03,299 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:03,404 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:03,425 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:03,443 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:03,454 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:03,466 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:22:03,474 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:03,474 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:03,485 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:03,510 - INFO - Verified VN network id 15 for VN 99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:03,511 - INFO - Verifications in API Server for VN ctest-vn1-34912203 passed 2026-06-05 13:22:03,511 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:03,529 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:03,541 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:03,550 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:22:03,567 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:21:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:43.927577'} 2026-06-05 13:22:03,591 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:03,604 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:21:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:43.960826'} 2026-06-05 13:22:03,620 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:03,633 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:21:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:43.991253'} 2026-06-05 13:22:03,653 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:03,653 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-34912203 passed 2026-06-05 13:22:03,654 - DEBUG - ====Verifying policy data for ctest-vn1-34912203 in API_Server ====== 2026-06-05 13:22:03,654 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:03,674 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:03,695 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:03,826 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:03,840 - DEBUG - =>VN ctest-vn1-34912203 has no policy to be verified 2026-06-05 13:22:03,840 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:03,841 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:03,841 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:03,984 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:03,984 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:03,984 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:04,078 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:04,078 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:04,078 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:04,191 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:04,191 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is found in opserver 2026-06-05 13:22:04,212 - DEBUG - VRF ids for VN ctest-vn1-34912203: {'10.0.0.41': '5'} 2026-06-05 13:22:04,212 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:04,239 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:04,274 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:04,387 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:04,426 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:04,450 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:04,463 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:04,473 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4d7458b4-4696-4c4e-aded-64ced2d8b36a 2026-06-05 13:22:04,483 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:04,483 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:04,497 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:04,515 - INFO - Verified VN network id 16 for VN 053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:04,515 - INFO - Verifications in API Server for VN ctest-vn2-83318571 passed 2026-06-05 13:22:04,515 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:04,543 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:04,558 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:04,567 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4d7458b4-4696-4c4e-aded-64ced2d8b36a 2026-06-05 13:22:04,584 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.174672'} 2026-06-05 13:22:04,593 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:04,600 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.192159'} 2026-06-05 13:22:04,610 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:04,624 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.215901'} 2026-06-05 13:22:04,632 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:04,632 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-83318571 passed 2026-06-05 13:22:04,633 - DEBUG - ====Verifying policy data for ctest-vn2-83318571 in API_Server ====== 2026-06-05 13:22:04,633 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:04,646 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:04,669 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:04,806 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:04,831 - DEBUG - =>VN ctest-vn2-83318571 has no policy to be verified 2026-06-05 13:22:04,831 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:04,832 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:04,832 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:04,939 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:04,939 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:04,939 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:04,956 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:04,956 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:04,956 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:04,970 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:04,970 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 is found in opserver 2026-06-05 13:22:04,991 - DEBUG - VRF ids for VN ctest-vn2-83318571: {'10.0.0.141': '5'} 2026-06-05 13:22:04,991 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:05,004 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:05,023 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:05,184 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:05,214 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:05,232 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:05,244 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:05,253 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/f29997c3-61c4-4666-99c3-3585797c2525 2026-06-05 13:22:05,261 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:05,261 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:05,277 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:05,297 - INFO - Verified VN network id 17 for VN a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:05,297 - INFO - Verifications in API Server for VN ctest-fip_vn-16923357 passed 2026-06-05 13:22:05,297 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:05,311 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:05,321 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:05,328 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/f29997c3-61c4-4666-99c3-3585797c2525 2026-06-05 13:22:05,348 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11683578757504977739', 'uuid-lslong': '11439366780557154500'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.177713'} 2026-06-05 13:22:05,360 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:05,366 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11683578757504977739', 'uuid-lslong': '11439366780557154500'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.198027'} 2026-06-05 13:22:05,373 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:05,378 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11683578757504977739', 'uuid-lslong': '11439366780557154500'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.185522'} 2026-06-05 13:22:05,385 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:05,385 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-16923357 passed 2026-06-05 13:22:05,385 - DEBUG - ====Verifying policy data for ctest-fip_vn-16923357 in API_Server ====== 2026-06-05 13:22:05,385 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:05,390 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:05,411 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:05,523 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:05,540 - DEBUG - =>VN ctest-fip_vn-16923357 has no policy to be verified 2026-06-05 13:22:05,540 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:05,540 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:05,540 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:05,553 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357?flat'} 2026-06-05 13:22:05,553 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:05,554 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:05,620 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357?flat'} 2026-06-05 13:22:05,620 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:05,620 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:05,690 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357?flat'} 2026-06-05 13:22:05,690 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is found in opserver 2026-06-05 13:22:05,710 - DEBUG - VRF ids for VN ctest-fip_vn-16923357: {'10.0.0.141': '6'} 2026-06-05 13:22:05,710 - INFO - Waiting for VM ctest-fvn_vm1-06412158 to be up.. 2026-06-05 13:22:05,820 - DEBUG - VM is in ACTIVE state now 2026-06-05 13:22:05,820 - INFO - VM name : ctest-fvn_vm1-06412158 2026-06-05 13:22:05,930 - DEBUG - VM ctest-fvn_vm1-06412158 ID is aebcd465-4f84-4eb5-b65a-a2f47a9bd625 2026-06-05 13:22:05,930 - DEBUG - VM ctest-fvn_vm1-06412158 launched on Node an-jenkins-deploy-platform-ansible-os-5895-2 2026-06-05 13:22:06,026 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/aebcd465-4f84-4eb5-b65a-a2f47a9bd625 2026-06-05 13:22:06,045 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/8dc8123c-54e0-4cea-9cf2-6515188951d7 2026-06-05 13:22:09,220 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-06-05 13:22:09,220 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM ctest-fvn_vm1-06412158 failed! 2026-06-05 13:22:09,235 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is 114.74.144.1 and allocation pool is NOT set 2026-06-05 13:22:13,308 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-06-05 13:22:13,309 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM ctest-fvn_vm1-06412158 failed! 2026-06-05 13:22:13,324 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is 114.74.144.1 and allocation pool is NOT set 2026-06-05 13:22:17,407 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-06-05 13:22:17,407 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM ctest-fvn_vm1-06412158 failed! 2026-06-05 13:22:17,422 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is 114.74.144.1 and allocation pool is NOT set 2026-06-05 13:22:21,498 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-06-05 13:22:21,498 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM ctest-fvn_vm1-06412158 failed! 2026-06-05 13:22:21,513 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is 114.74.144.1 and allocation pool is NOT set 2026-06-05 13:22:25,595 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2026-06-05 13:22:25,595 - DEBUG - Ping to Metadata IP 169.254.0.7 of VM ctest-fvn_vm1-06412158 failed! 2026-06-05 13:22:25,608 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is 114.74.144.1 and allocation pool is NOT set 2026-06-05 13:22:27,670 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=17.5 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.500 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.500/9.000/17.501/8.500 ms') 2026-06-05 13:22:27,670 - INFO - Ping to Metadata IP 169.254.0.7 of VM ctest-fvn_vm1-06412158 passed 2026-06-05 13:22:27,738 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:22:27,738 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-06412158, IP 114.74.144.3, Port 22 2026-06-05 13:22:27,806 - DEBUG - Error on ssh to cirros@169.254.0.7:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.7/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.7/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.7/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-06-05 13:22:27,927 - DEBUG - VM ctest-fvn_vm1-06412158 is NOT ready for SSH connections, VM status: ACTIVE 2026-06-05 13:22:32,928 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:22:32,928 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-06412158, IP 114.74.144.3, Port 22 2026-06-05 13:22:32,993 - DEBUG - Error on ssh to cirros@169.254.0.7:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.7/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.7/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.7/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-06-05 13:22:33,086 - DEBUG - VM ctest-fvn_vm1-06412158 is NOT ready for SSH connections, VM status: ACTIVE 2026-06-05 13:22:38,087 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:22:38,087 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-06412158, IP 114.74.144.3, Port 22 2026-06-05 13:22:38,262 - DEBUG - VM ctest-fvn_vm1-06412158 is ready for SSH connections 2026-06-05 13:22:38,263 - INFO - Waiting for VM ctest-vn2_vm2-92646870 to be up.. 2026-06-05 13:22:38,358 - DEBUG - VM is in ACTIVE state now 2026-06-05 13:22:38,358 - INFO - VM name : ctest-vn2_vm2-92646870 2026-06-05 13:22:38,447 - DEBUG - VM ctest-vn2_vm2-92646870 ID is 8bb535ac-63c5-4ab3-ab3a-9b11c62d5593 2026-06-05 13:22:38,447 - DEBUG - VM ctest-vn2_vm2-92646870 launched on Node an-jenkins-deploy-platform-ansible-os-5895-2 2026-06-05 13:22:38,540 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/8bb535ac-63c5-4ab3-ab3a-9b11c62d5593 2026-06-05 13:22:38,551 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/9c5afacd-8498-4fb5-82c5-4d3ffa0d04e5 2026-06-05 13:22:39,713 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=2.30 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.382 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.382/1.342/2.303/0.960 ms') 2026-06-05 13:22:39,713 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn2_vm2-92646870 passed 2026-06-05 13:22:39,782 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:22:39,782 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-92646870, IP 15.228.143.131, Port 22 2026-06-05 13:22:39,958 - DEBUG - VM ctest-vn2_vm2-92646870 is ready for SSH connections 2026-06-05 13:22:39,958 - INFO - Waiting for VM mltf_vm to be up.. 2026-06-05 13:22:40,065 - DEBUG - VM is in ACTIVE state now 2026-06-05 13:22:40,065 - INFO - VM name : mltf_vm 2026-06-05 13:22:40,166 - DEBUG - VM mltf_vm ID is 4a8d50e9-61a5-45d2-a974-b337468a3b68 2026-06-05 13:22:40,166 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5895-1 2026-06-05 13:22:40,420 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine/4a8d50e9-61a5-45d2-a974-b337468a3b68 2026-06-05 13:22:40,430 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/0bb971c3-5cb0-481b-a1bc-a5527226d429 2026-06-05 13:22:40,439 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-machine-interface/bc54c9d8-f78d-4ae8-8399-db4f0c456ebf 2026-06-05 13:22:41,680 - DEBUG - (True, 'PING 169.254.0.8 (169.254.0.8) 56(84) bytes of data.\r\n64 bytes from 169.254.0.8: icmp_seq=1 ttl=63 time=10.3 ms\r\n64 bytes from 169.254.0.8: icmp_seq=2 ttl=63 time=0.425 ms\r\n\r\n--- 169.254.0.8 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.425/5.373/10.321/4.948 ms') 2026-06-05 13:22:41,680 - INFO - Ping to Metadata IP 169.254.0.8 of VM mltf_vm passed 2026-06-05 13:22:41,750 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:22:41,750 - DEBUG - Waiting to SSH to VM mltf_vm, IP 29.67.38.197, Port 22 2026-06-05 13:22:41,912 - DEBUG - VM mltf_vm is ready for SSH connections 2026-06-05 13:22:41,984 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-06-05 13:22:41,984 - DEBUG - Waiting to SSH to VM mltf_vm, IP 29.67.38.197, Port 22 2026-06-05 13:22:42,144 - DEBUG - VM mltf_vm is ready for SSH connections 2026-06-05 13:22:42,147 - INFO - ================================================================================ 2026-06-05 13:22:42,147 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2026-06-05 13:22:42,147 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2026-06-05 13:22:43,462 - DEBUG - Skipping xmpp flap check 2026-06-05 13:22:43,462 - INFO - Initial checks done. Running the testcase now 2026-06-05 13:22:43,462 - INFO - 2026-06-05 13:22:43,585 - INFO - Setting flow export rate: 100 2026-06-05 13:22:43,634 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-06-05 13:22:43,998 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '99b0fbee-9981-467e-88a6-6e42f7a81e07', 'name': 'ctest-vn1-34912203', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'project_id': '8e82d86472264b809b54e34ce491e59d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['b6bf15a2-cb9d-4254-8e81-e62710144a3c'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'ctest-vn1-34912203'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '29.67.38.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-06-05 13:22:44,208 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '053de5cc-af7b-4c33-8769-9a4b3c1e542a', 'name': 'ctest-vn2-83318571', 'tenant_id': '8e82d86472264b809b54e34ce491e59d', 'project_id': '8e82d86472264b809b54e34ce491e59d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['3eea973f-ffd3-4806-b273-fbc777c4d7ce'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'ctest-vn2-83318571'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '15.228.143.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-06-05 13:22:44,302 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:44,309 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:44,322 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:44,450 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:44,492 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:44,503 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:44,516 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:44,525 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:22:44,534 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:44,534 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:44,563 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:44,583 - INFO - Verified VN network id 15 for VN 99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:44,584 - INFO - Verifications in API Server for VN ctest-vn1-34912203 passed 2026-06-05 13:22:44,584 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:44,608 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:44,630 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:44,648 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:22:44,663 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:22:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.701551'} 2026-06-05 13:22:44,673 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:44,679 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:22:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.715337'} 2026-06-05 13:22:44,686 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:44,691 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:22:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.727304'} 2026-06-05 13:22:44,699 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:44,699 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-34912203 passed 2026-06-05 13:22:44,699 - DEBUG - ====Verifying policy data for ctest-vn1-34912203 in API_Server ====== 2026-06-05 13:22:44,699 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:44,707 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:44,722 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:44,828 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:44,843 - DEBUG - ==>Verifying data for policy with id: 0dae889d-28a5-45fc-a7d9-1322ca1f4fb8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'policy1'] 2026-06-05 13:22:44,843 - INFO - VN ctest-vn1-34912203 Policy verification: verify_vn_policy_in_api_server, status: True 2026-06-05 13:22:44,843 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:44,843 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:44,844 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:44,858 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:44,858 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:44,858 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:44,872 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:44,872 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:44,872 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:44,887 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:44,887 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is found in opserver 2026-06-05 13:22:44,902 - DEBUG - VRF ids for VN ctest-vn1-34912203: {'10.0.0.41': '5'} 2026-06-05 13:22:44,902 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:44,911 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:44,925 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:45,026 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:45,056 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:45,069 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:45,087 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:45,099 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4d7458b4-4696-4c4e-aded-64ced2d8b36a 2026-06-05 13:22:45,109 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:45,109 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:45,127 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:45,146 - INFO - Verified VN network id 16 for VN 053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:45,147 - INFO - Verifications in API Server for VN ctest-vn2-83318571 passed 2026-06-05 13:22:45,147 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:45,162 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:45,181 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:45,190 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4d7458b4-4696-4c4e-aded-64ced2d8b36a 2026-06-05 13:22:45,205 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.035669'} 2026-06-05 13:22:45,212 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:45,218 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.051839'} 2026-06-05 13:22:45,231 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:45,239 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.072691'} 2026-06-05 13:22:45,247 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:45,248 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-83318571 passed 2026-06-05 13:22:45,248 - DEBUG - ====Verifying policy data for ctest-vn2-83318571 in API_Server ====== 2026-06-05 13:22:45,248 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:45,257 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:45,269 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:45,371 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:45,382 - DEBUG - ==>Verifying data for policy with id: 0dae889d-28a5-45fc-a7d9-1322ca1f4fb8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'policy1'] 2026-06-05 13:22:45,382 - INFO - VN ctest-vn2-83318571 Policy verification: verify_vn_policy_in_api_server, status: True 2026-06-05 13:22:45,382 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:45,382 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:45,382 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:45,397 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:45,397 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:45,397 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:45,412 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:45,412 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:45,412 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:45,427 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:45,427 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 is found in opserver 2026-06-05 13:22:45,440 - DEBUG - VRF ids for VN ctest-vn2-83318571: {'10.0.0.41': '6', '10.0.0.141': '5'} 2026-06-05 13:22:45,440 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:45,447 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:45,465 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:45,578 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:45,591 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:45,607 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:45,618 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:45,628 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:22:45,638 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:45,638 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:45,653 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:45,677 - INFO - Verified VN network id 15 for VN 99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:45,677 - INFO - Verifications in API Server for VN ctest-vn1-34912203 passed 2026-06-05 13:22:45,677 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:45,689 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:45,698 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:22:45,709 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/c1098a90-1f1c-40b6-afe6-4fecbb55eaad 2026-06-05 13:22:45,728 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:22:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.763645'} 2026-06-05 13:22:45,739 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:45,753 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:22:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.782607'} 2026-06-05 13:22:45,764 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:45,770 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11074628485900224126', 'uuid-lslong': '9846678869194055175'}, 'enable': 'true', 'created': '2026-06-05T13:21:19', 'last-modified': '2026-06-05T13:22:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.805802'} 2026-06-05 13:22:45,777 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-06-05 13:22:45,777 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-34912203 passed 2026-06-05 13:22:45,778 - DEBUG - ====Verifying policy data for ctest-vn1-34912203 in API_Server ====== 2026-06-05 13:22:45,778 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:45,786 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:45,800 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:45,909 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/99b0fbee-9981-467e-88a6-6e42f7a81e07 2026-06-05 13:22:45,944 - DEBUG - ==>Verifying data for policy with id: 0dae889d-28a5-45fc-a7d9-1322ca1f4fb8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'policy1'] 2026-06-05 13:22:45,944 - INFO - VN ctest-vn1-34912203 Policy verification: verify_vn_policy_in_api_server, status: True 2026-06-05 13:22:45,944 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:45,944 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:45,944 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:45,958 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:45,959 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:45,959 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:45,974 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:45,974 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:45,974 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:45,986 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203?flat'} 2026-06-05 13:22:45,986 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 is found in opserver 2026-06-05 13:22:45,998 - DEBUG - VRF ids for VN ctest-vn1-34912203: {'10.0.0.41': '5'} 2026-06-05 13:22:45,998 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:46,004 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:46,019 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:46,126 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:46,138 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:46,148 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:46,157 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:46,168 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4d7458b4-4696-4c4e-aded-64ced2d8b36a 2026-06-05 13:22:46,175 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:46,176 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:46,189 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:46,212 - INFO - Verified VN network id 16 for VN 053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:46,212 - INFO - Verifications in API Server for VN ctest-vn2-83318571 passed 2026-06-05 13:22:46,212 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:46,227 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:46,237 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:22:46,248 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4d7458b4-4696-4c4e-aded-64ced2d8b36a 2026-06-05 13:22:46,274 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.102188'} 2026-06-05 13:22:46,282 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:46,289 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.122803'} 2026-06-05 13:22:46,296 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:46,302 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377710611049172019', 'uuid-lslong': '9757499715596735530'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:22:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.135691'} 2026-06-05 13:22:46,310 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-06-05 13:22:46,311 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-83318571 passed 2026-06-05 13:22:46,311 - DEBUG - ====Verifying policy data for ctest-vn2-83318571 in API_Server ====== 2026-06-05 13:22:46,311 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:46,319 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:46,339 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:46,449 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/053de5cc-af7b-4c33-8769-9a4b3c1e542a 2026-06-05 13:22:46,465 - DEBUG - ==>Verifying data for policy with id: 0dae889d-28a5-45fc-a7d9-1322ca1f4fb8, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-64198127', 'policy1'] 2026-06-05 13:22:46,465 - INFO - VN ctest-vn2-83318571 Policy verification: verify_vn_policy_in_api_server, status: True 2026-06-05 13:22:46,465 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:46,466 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:46,466 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:46,482 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:46,482 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:46,482 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:46,496 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:46,496 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:46,496 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:46,512 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571?flat'} 2026-06-05 13:22:46,512 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 is found in opserver 2026-06-05 13:22:46,528 - DEBUG - VRF ids for VN ctest-vn2-83318571: {'10.0.0.41': '6', '10.0.0.141': '5'} 2026-06-05 13:22:46,529 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:46,536 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:46,551 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:46,660 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:46,672 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:46,686 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:46,696 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:46,707 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/f29997c3-61c4-4666-99c3-3585797c2525 2026-06-05 13:22:46,717 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:46,717 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:46,728 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:46,747 - INFO - Verified VN network id 17 for VN a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:46,747 - INFO - Verifications in API Server for VN ctest-fip_vn-16923357 passed 2026-06-05 13:22:46,747 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:46,758 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:46,767 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:22:46,775 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/f29997c3-61c4-4666-99c3-3585797c2525 2026-06-05 13:22:46,794 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11683578757504977739', 'uuid-lslong': '11439366780557154500'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:49.620599'} 2026-06-05 13:22:46,806 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:46,812 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11683578757504977739', 'uuid-lslong': '11439366780557154500'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:49.643094'} 2026-06-05 13:22:46,819 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:46,826 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-64198127', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11683578757504977739', 'uuid-lslong': '11439366780557154500'}, 'enable': 'true', 'created': '2026-06-05T13:21:56', 'last-modified': '2026-06-05T13:21:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:49.632658'} 2026-06-05 13:22:46,832 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-06-05 13:22:46,832 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-16923357 passed 2026-06-05 13:22:46,832 - DEBUG - ====Verifying policy data for ctest-fip_vn-16923357 in API_Server ====== 2026-06-05 13:22:46,832 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:22:46,840 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:22:46,852 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:22:46,953 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/a22468fa-4a62-4b4b-9ec0-cb7a828358c4 2026-06-05 13:22:46,966 - DEBUG - =>VN ctest-fip_vn-16923357 has no policy to be verified 2026-06-05 13:22:46,966 - DEBUG - Verifying the vn in opserver 2026-06-05 13:22:46,966 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 virtual network link through opserver 10.0.0.242 2026-06-05 13:22:46,966 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-06-05 13:22:46,984 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357?flat'} 2026-06-05 13:22:46,984 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 virtual network link through opserver 10.0.0.50 2026-06-05 13:22:46,984 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2026-06-05 13:22:47,000 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357?flat'} 2026-06-05 13:22:47,000 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 virtual network link through opserver 10.0.0.129 2026-06-05 13:22:47,000 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks 2026-06-05 13:22:47,012 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357?flat'} 2026-06-05 13:22:47,012 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 is found in opserver 2026-06-05 13:22:47,024 - DEBUG - VRF ids for VN ctest-fip_vn-16923357: {'10.0.0.141': '6'} 2026-06-05 13:22:47,024 - INFO - start time= 1780665767024911 2026-06-05 13:22:47,025 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 15.228.143.131, host_string: cirros@169.254.0.6, password: gocubsgogateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2026-06-05 13:22:47,025 - DEBUG - ping -s 56 -c 3 -W 1 15.228.143.131 2026-06-05 13:22:50,786 - DEBUG - PING 15.228.143.131 (15.228.143.131): 56 data bytes 64 bytes from 15.228.143.131: seq=0 ttl=63 time=8.983 ms 64 bytes from 15.228.143.131: seq=1 ttl=63 time=1.663 ms 64 bytes from 15.228.143.131: seq=2 ttl=63 time=2.083 ms --- 15.228.143.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.663/4.243/8.983 ms 2026-06-05 13:22:50,786 - INFO - Ping to IP 15.228.143.131 from VM ctest-vn1_vm1-31051863 passed 2026-06-05 13:23:00,786 - INFO - Verify session samples and teardown pkts 2026-06-05 13:23:00,787 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.242 2026-06-05 13:23:00,790 - DEBUG - Posting: http://10.0.0.242:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1780665767024911, 'end_time': 1780665780790200, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-06-05 13:23:01,812 - DEBUG - [{'T': 1780665769061076}, {'T': 1780665770061109}, {'T': 1780665771061181}] 2026-06-05 13:23:01,812 - DEBUG - Posting: http://10.0.0.242:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1780665767024911, 'end_time': 1780665781812831, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2026-06-05 13:23:02,835 - DEBUG - [{'T': 1780665768961087}, {'T': 1780665769961137}, {'T': 1780665770961304}] 2026-06-05 13:23:02,835 - DEBUG - Posting: http://10.0.0.242:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1780665767024911, 'end_time': 1780665782835809, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-06-05 13:23:03,859 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', 'sample_count': 3}] 2026-06-05 13:23:03,859 - INFO - wait for the flows to get expire 2026-06-05 13:26:23,860 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5895-1:Compute:contrail-vrouter-agent:0?flat 2026-06-05 13:26:23,901 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5895-1?flat 2026-06-05 13:26:24,466 - INFO - Deleted policy policy1 2026-06-05 13:26:24,590 - INFO - Setting flow export rate: None 2026-06-05 13:26:25,923 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Fri Jun 5 13:26:23 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=) 1281 src_vn = self.res.vn1_fixture.vn_fq_name 1282 dst_vn = self.res.vn2_fixture.vn_fq_name 1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) 1284 1285 assert result,'Failed to get expected number of samples' result = True self = self.verify_session_sampling_teardown = > start_time = '1780665767024911' src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203' dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571' /contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1780665767024911', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571') 486 flow_record = self.analytics_obj.get_flows_vrouter_uve( 487 vrouter=vm_host) 488 assert not flow_record,'flows not got deleted even after 240 sec' 489 490 res = self.analytics_obj.ops_inspect[ip].post_query( flow_record = 18 AssertionError: flows not got deleted even after 240 sec __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('flows not got deleted even after 240 sec',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown assert not flow_record,'flows not got deleted even after 240 sec' AssertionError: flows not got deleted even after 240 sec 2026-06-05 13:26:25,923 - DEBUG - Skipping xmpp flap check 2026-06-05 13:26:25,923 - INFO - 2026-06-05 13:26:25,923 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:43] 2026-06-05 13:26:25,923 - INFO - -------------------------------------------------------------------------------- 2026-06-05 13:26:25,926 - INFO - Deleting VM mltf_vm 2026-06-05 13:26:26,028 - INFO - Deleting VM ctest-fvn_vm1-06412158 2026-06-05 13:26:26,107 - INFO - Deleting VM ctest-vn2_vm2-92646870 2026-06-05 13:26:26,184 - INFO - Deleting VN ctest-fip_vn-16923357 2026-06-05 13:26:26,230 - DEBUG - VN a22468fa-4a62-4b4b-9ec0-cb7a828358c4 still in use: Unable to complete operation on network a22468fa-4a62-4b4b-9ec0-cb7a828358c4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-536e941c-fecf-46cf-bc50-ecae6829cff3'] 2026-06-05 13:26:26,231 - WARNING - Deleting VN ctest-fip_vn-16923357 failed..Will retry 2026-06-05 13:26:28,454 - DEBUG - Response for deleting network () 2026-06-05 13:26:28,455 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4650c0a1-5f8a-4926-9187-a2bc34d182b1 2026-06-05 13:26:28,491 - DEBUG - Response Code: 404 2026-06-05 13:26:28,491 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:26:28,498 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:26:28,512 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:26:28,617 - INFO - Validated that VN ctest-fip_vn-16923357 is not found in API Server 2026-06-05 13:26:28,640 - DEBUG - VN ctest-fip_vn-16923357 is not present in Agent 10.0.0.41 2026-06-05 13:26:28,655 - DEBUG - VN ctest-fip_vn-16923357 is not present in Agent 10.0.0.141 2026-06-05 13:26:28,655 - INFO - Validated that VN ctest-fip_vn-16923357 is not in any agent 2026-06-05 13:26:28,663 - DEBUG - VRF 6 is not seen in agent 10.0.0.141 2026-06-05 13:26:28,670 - DEBUG - Vrouter 10.0.0.141 does not have vrf 6 for VN ctest-fip_vn-16923357 2026-06-05 13:26:28,670 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-fip_vn-16923357 2026-06-05 13:26:28,693 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-16923357 info 2026-06-05 13:26:28,694 - INFO - Deleting VN ctest-vn2-83318571 2026-06-05 13:26:28,925 - DEBUG - Response for deleting network () 2026-06-05 13:26:28,925 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/d35a877a-f5c0-4245-beab-94dec4bd21fc 2026-06-05 13:26:28,932 - DEBUG - Response Code: 404 2026-06-05 13:26:28,932 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:26:28,944 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:26:28,963 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:26:29,086 - INFO - Validated that VN ctest-vn2-83318571 is not found in API Server 2026-06-05 13:26:29,099 - DEBUG - VN ctest-vn2-83318571 is not present in Agent 10.0.0.41 2026-06-05 13:26:29,113 - DEBUG - VN ctest-vn2-83318571 is not present in Agent 10.0.0.141 2026-06-05 13:26:29,113 - INFO - Validated that VN ctest-vn2-83318571 is not in any agent 2026-06-05 13:26:29,120 - DEBUG - VRF 6 is not seen in agent 10.0.0.41 2026-06-05 13:26:29,129 - DEBUG - Vrouter 10.0.0.41 does not have vrf 6 for VN ctest-vn2-83318571 2026-06-05 13:26:29,137 - DEBUG - VRF 5 is not seen in agent 10.0.0.141 2026-06-05 13:26:29,144 - DEBUG - Vrouter 10.0.0.141 does not have vrf 5 for VN ctest-vn2-83318571 2026-06-05 13:26:29,144 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn2-83318571 2026-06-05 13:26:29,177 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-83318571 info 2026-06-05 13:26:29,177 - INFO - Deleting VM ctest-vn1_vm2-73879884 2026-06-05 13:26:29,265 - INFO - Deleting VM ctest-vn1_vm1-31051863 2026-06-05 13:26:29,353 - INFO - Deleting VN ctest-vn1-34912203 2026-06-05 13:26:29,400 - DEBUG - VN 99b0fbee-9981-467e-88a6-6e42f7a81e07 still in use: Unable to complete operation on network 99b0fbee-9981-467e-88a6-6e42f7a81e07. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1a734f0f-b9cf-4ba3-9a41-b8eb2e36c5ca'] 2026-06-05 13:26:29,400 - WARNING - Deleting VN ctest-vn1-34912203 failed..Will retry 2026-06-05 13:26:31,573 - DEBUG - Response for deleting network () 2026-06-05 13:26:31,573 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/27085421-8190-46fa-9b4d-6f61f6509070 2026-06-05 13:26:31,581 - DEBUG - Response Code: 404 2026-06-05 13:26:31,582 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-06-05 13:26:31,597 - DEBUG - Requesting: http://10.0.0.242:8082/domain/62815f74-0e86-490f-97a7-40f9728e4542 2026-06-05 13:26:31,625 - DEBUG - Requesting: http://10.0.0.242:8082/project/8e82d864-7226-4b80-9b54-e34ce491e59d 2026-06-05 13:26:31,730 - INFO - Validated that VN ctest-vn1-34912203 is not found in API Server 2026-06-05 13:26:31,743 - DEBUG - VN ctest-vn1-34912203 is not present in Agent 10.0.0.41 2026-06-05 13:26:31,757 - DEBUG - VN ctest-vn1-34912203 is not present in Agent 10.0.0.141 2026-06-05 13:26:31,757 - INFO - Validated that VN ctest-vn1-34912203 is not in any agent 2026-06-05 13:26:31,764 - DEBUG - VRF 5 is not seen in agent 10.0.0.41 2026-06-05 13:26:31,770 - DEBUG - Vrouter 10.0.0.41 does not have vrf 5 for VN ctest-vn1-34912203 2026-06-05 13:26:31,771 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-64198127:ctest-vn1-34912203 2026-06-05 13:26:31,798 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-34912203 info 2026-06-05 13:26:32,623 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-64198127, ID : 8e82d864-7226-4b80-9b54-e34ce491e59d