2026-05-11 04:06:53,792 - INFO - Domain Default found not creating 2026-05-11 04:06:53,985 - INFO - Project ctest-AnalyticsTestSanityWithResource-25086308 not found, creating it 2026-05-11 04:06:54,561 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-25086308, ID : 68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:06:57,193 - DEBUG - Response for create_network : {'network': {'id': '053cbe4b-0a30-49cf-ac4c-3094438df0e2', 'name': 'ctest-vn1-41327646', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'project_id': '68ddb98922c840f898d8230c4217f26d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'ctest-vn1-41327646'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 04:06:57,624 - DEBUG - Response for create_subnet : {'subnet': {'id': '1776d304-c9f2-44e0-b7d0-7b6bd6965d79', 'name': '', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'network_id': '053cbe4b-0a30-49cf-ac4c-3094438df0e2', 'ip_version': 4, 'cidr': '47.158.168.192/26', 'allocation_pools': [{'start': '47.158.168.194', 'end': '47.158.168.254'}], 'gateway_ip': '47.158.168.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '47.158.168.194', 'tags': [], 'project_id': '68ddb98922c840f898d8230c4217f26d'}} 2026-05-11 04:06:57,658 - INFO - Created VN ctest-vn1-41327646 2026-05-11 04:06:57,675 - DEBUG - VN ctest-vn1-41327646 UUID is 053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:06:57,805 - DEBUG - Services list from nova: [, , , ] 2026-05-11 04:06:57,805 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5767-2', 'an-jenkins-deploy-platform-ansible-os-5767-1']} 2026-05-11 04:06:59,176 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-2) 2026-05-11 04:07:00,874 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-2) 2026-05-11 04:07:00,874 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:01,247 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:01,303 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:01,342 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:01,484 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:01,533 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:01,557 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:01,567 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:01,588 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:07:01,611 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:01,611 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:01,635 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:01,661 - INFO - Verified VN network id 15 for VN 053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:01,661 - INFO - Verifications in API Server for VN ctest-vn1-41327646 passed 2026-05-11 04:07:01,662 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:01,715 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:01,734 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:01,747 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:07:01,776 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:06:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.207710'} 2026-05-11 04:07:01,783 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:01,791 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:06:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.208580'} 2026-05-11 04:07:01,800 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:01,807 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:06:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.241384'} 2026-05-11 04:07:01,818 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:01,818 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41327646 passed 2026-05-11 04:07:01,819 - DEBUG - ====Verifying policy data for ctest-vn1-41327646 in API_Server ====== 2026-05-11 04:07:01,819 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:01,857 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:01,889 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:02,031 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:02,058 - DEBUG - =>VN ctest-vn1-41327646 has no policy to be verified 2026-05-11 04:07:02,058 - DEBUG - Verifying the vn in opserver 2026-05-11 04:07:02,058 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.141 2026-05-11 04:07:02,059 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:07:02,437 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:07:02,517 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:07:02,517 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.249 2026-05-11 04:07:02,517 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:07:02,845 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:07:03,244 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:07:03,245 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.27 2026-05-11 04:07:03,245 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:07:03,589 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:07:03,972 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:07:03,972 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is found in opserver 2026-05-11 04:07:03,984 - DEBUG - VRF ids for VN ctest-vn1-41327646: {'10.0.0.240': '4'} 2026-05-11 04:07:03,985 - INFO - Waiting for VM ctest-vn1_vm1-01412581 to be up.. 2026-05-11 04:07:04,085 - DEBUG - VM is in ACTIVE state now 2026-05-11 04:07:04,085 - INFO - VM name : ctest-vn1_vm1-01412581 2026-05-11 04:07:04,183 - DEBUG - VM ctest-vn1_vm1-01412581 ID is a664af5d-316d-4375-8819-78b3adc40efa 2026-05-11 04:07:04,213 - DEBUG - VM ctest-vn1_vm1-01412581 launched on Node an-jenkins-deploy-platform-ansible-os-5767-2 2026-05-11 04:07:04,320 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/a664af5d-316d-4375-8819-78b3adc40efa 2026-05-11 04:07:04,619 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/a664af5d-316d-4375-8819-78b3adc40efa 2026-05-11 04:07:04,664 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/5ad4badb-ecb9-42ac-b78c-bd751f635c1d 2026-05-11 04:07:07,866 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2026-05-11 04:07:07,867 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-01412581 failed! 2026-05-11 04:07:07,881 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is 47.158.168.193 and allocation pool is NOT set 2026-05-11 04:07:11,963 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-11 04:07:11,964 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-01412581 failed! 2026-05-11 04:07:11,978 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is 47.158.168.193 and allocation pool is NOT set 2026-05-11 04:07:16,059 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-05-11 04:07:16,059 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-01412581 failed! 2026-05-11 04:07:16,079 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is 47.158.168.193 and allocation pool is NOT set 2026-05-11 04:07:20,185 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1036ms') 2026-05-11 04:07:20,186 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-01412581 failed! 2026-05-11 04:07:20,200 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is 47.158.168.193 and allocation pool is NOT set 2026-05-11 04:07:24,280 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2026-05-11 04:07:24,280 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-01412581 failed! 2026-05-11 04:07:24,296 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is 47.158.168.193 and allocation pool is NOT set 2026-05-11 04:07:26,364 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.39 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.988 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.988/2.688/4.388/1.700 ms') 2026-05-11 04:07:26,364 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-01412581 passed 2026-05-11 04:07:26,436 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:07:26,436 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-01412581, IP 47.158.168.195, Port 22 2026-05-11 04:07:26,502 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-11 04:07:26,599 - DEBUG - VM ctest-vn1_vm1-01412581 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-11 04:07:31,600 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:07:31,600 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-01412581, IP 47.158.168.195, Port 22 2026-05-11 04:07:31,668 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-11 04:07:31,754 - DEBUG - VM ctest-vn1_vm1-01412581 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-11 04:07:36,754 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:07:36,754 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-01412581, IP 47.158.168.195, Port 22 2026-05-11 04:07:36,938 - DEBUG - VM ctest-vn1_vm1-01412581 is ready for SSH connections 2026-05-11 04:07:36,939 - INFO - Waiting for VM ctest-vn1_vm2-70078907 to be up.. 2026-05-11 04:07:37,048 - DEBUG - VM is in ACTIVE state now 2026-05-11 04:07:37,048 - INFO - VM name : ctest-vn1_vm2-70078907 2026-05-11 04:07:37,145 - DEBUG - VM ctest-vn1_vm2-70078907 ID is c3130c6c-6ee5-48ad-8429-5310675f190f 2026-05-11 04:07:37,145 - DEBUG - VM ctest-vn1_vm2-70078907 launched on Node an-jenkins-deploy-platform-ansible-os-5767-2 2026-05-11 04:07:37,243 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/c3130c6c-6ee5-48ad-8429-5310675f190f 2026-05-11 04:07:37,254 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/14b0ef6b-659c-4470-8479-18a142a0524d 2026-05-11 04:07:38,428 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=3.68 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=3.77 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.678/3.724/3.771/0.046 ms') 2026-05-11 04:07:38,428 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm2-70078907 passed 2026-05-11 04:07:38,499 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:07:38,499 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-70078907, IP 47.158.168.196, Port 22 2026-05-11 04:07:38,567 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-11 04:07:38,664 - DEBUG - VM ctest-vn1_vm2-70078907 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-11 04:07:43,664 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:07:43,665 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-70078907, IP 47.158.168.196, Port 22 2026-05-11 04:07:43,839 - DEBUG - VM ctest-vn1_vm2-70078907 is ready for SSH connections 2026-05-11 04:07:44,136 - DEBUG - Response for create_network : {'network': {'id': 'a58e4ce0-4d23-4ee9-8471-fd0c9746934b', 'name': 'ctest-vn2-42864367', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'project_id': '68ddb98922c840f898d8230c4217f26d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'ctest-vn2-42864367'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 04:07:44,400 - DEBUG - Response for create_subnet : {'subnet': {'id': '91d27f15-dca6-46e5-89cf-b6a12550e050', 'name': '', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'network_id': 'a58e4ce0-4d23-4ee9-8471-fd0c9746934b', 'ip_version': 4, 'cidr': '22.231.130.0/26', 'allocation_pools': [{'start': '22.231.130.2', 'end': '22.231.130.62'}], 'gateway_ip': '22.231.130.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.231.130.2', 'tags': [], 'project_id': '68ddb98922c840f898d8230c4217f26d'}} 2026-05-11 04:07:44,423 - INFO - Created VN ctest-vn2-42864367 2026-05-11 04:07:44,433 - DEBUG - VN ctest-vn2-42864367 UUID is a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:44,823 - DEBUG - Response for create_network : {'network': {'id': '6bb8354d-ee13-478e-8bb6-03033b01b0c0', 'name': 'ctest-fip_vn-76381530', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'project_id': '68ddb98922c840f898d8230c4217f26d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'ctest-fip_vn-76381530'], 'port_security_enabled': True, 'description': ''}} 2026-05-11 04:07:45,089 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a4caef01-e0d2-4549-819c-63d505a27d54', 'name': '', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'network_id': '6bb8354d-ee13-478e-8bb6-03033b01b0c0', 'ip_version': 4, 'cidr': '63.244.224.128/26', 'allocation_pools': [{'start': '63.244.224.130', 'end': '63.244.224.190'}], 'gateway_ip': '63.244.224.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.244.224.130', 'tags': [], 'project_id': '68ddb98922c840f898d8230c4217f26d'}} 2026-05-11 04:07:45,114 - INFO - Created VN ctest-fip_vn-76381530 2026-05-11 04:07:45,126 - DEBUG - VN ctest-fip_vn-76381530 UUID is 6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:45,202 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5767-2', 'an-jenkins-deploy-platform-ansible-os-5767-1']} 2026-05-11 04:07:46,483 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-1) 2026-05-11 04:07:48,085 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-1) 2026-05-11 04:07:49,918 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5767-2) 2026-05-11 04:07:49,918 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:49,928 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:49,946 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:50,076 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:50,090 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:50,105 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:50,122 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:50,135 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:07:50,144 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:50,144 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:50,157 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:50,177 - INFO - Verified VN network id 15 for VN 053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:50,178 - INFO - Verifications in API Server for VN ctest-vn1-41327646 passed 2026-05-11 04:07:50,178 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:50,199 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:50,213 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:07:50,230 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:07:50,255 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:06:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:52.686999'} 2026-05-11 04:07:50,270 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:50,280 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:06:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:52.697795'} 2026-05-11 04:07:50,298 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:50,308 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:06:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:52.742811'} 2026-05-11 04:07:50,337 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:07:50,337 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41327646 passed 2026-05-11 04:07:50,337 - DEBUG - ====Verifying policy data for ctest-vn1-41327646 in API_Server ====== 2026-05-11 04:07:50,337 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:50,349 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:50,376 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:50,500 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:07:50,536 - DEBUG - =>VN ctest-vn1-41327646 has no policy to be verified 2026-05-11 04:07:50,536 - DEBUG - Verifying the vn in opserver 2026-05-11 04:07:50,536 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.141 2026-05-11 04:07:50,537 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:07:50,657 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:07:50,657 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.249 2026-05-11 04:07:50,657 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:07:50,816 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:07:50,816 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.27 2026-05-11 04:07:50,816 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:07:50,953 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:07:50,954 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is found in opserver 2026-05-11 04:07:50,973 - DEBUG - VRF ids for VN ctest-vn1-41327646: {'10.0.0.240': '4'} 2026-05-11 04:07:50,973 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:50,982 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:51,002 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:51,121 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:51,137 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:51,152 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:07:51,168 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:07:51,178 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/1d221946-7ded-42b1-b4f1-e946917863ee 2026-05-11 04:07:51,212 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:07:51,212 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:51,229 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:07:51,269 - INFO - Verified VN network id 16 for VN a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:51,269 - INFO - Verifications in API Server for VN ctest-vn2-42864367 passed 2026-05-11 04:07:51,269 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:51,287 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:07:51,307 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:07:51,318 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/1d221946-7ded-42b1-b4f1-e946917863ee 2026-05-11 04:07:51,338 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.006422'} 2026-05-11 04:07:51,346 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:07:51,354 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.016288'} 2026-05-11 04:07:51,366 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:07:51,374 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.034412'} 2026-05-11 04:07:51,381 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:07:51,381 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-42864367 passed 2026-05-11 04:07:51,382 - DEBUG - ====Verifying policy data for ctest-vn2-42864367 in API_Server ====== 2026-05-11 04:07:51,382 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:51,394 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:51,411 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:51,556 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:07:51,586 - DEBUG - =>VN ctest-vn2-42864367 has no policy to be verified 2026-05-11 04:07:51,586 - DEBUG - Verifying the vn in opserver 2026-05-11 04:07:51,586 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.141 2026-05-11 04:07:51,586 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:07:51,602 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:07:51,603 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.249 2026-05-11 04:07:51,603 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:07:51,619 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:07:51,619 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.27 2026-05-11 04:07:51,619 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:07:51,700 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:07:51,700 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 is found in opserver 2026-05-11 04:07:51,713 - DEBUG - VRF ids for VN ctest-vn2-42864367: {'10.0.0.23': '4'} 2026-05-11 04:07:51,713 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:51,719 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:51,732 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:51,854 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:51,876 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:51,895 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:07:51,906 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:07:51,924 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8523f3dc-288c-4581-8a91-cd269e82d771 2026-05-11 04:07:51,932 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:07:51,932 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:51,946 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:07:51,966 - INFO - Verified VN network id 17 for VN 6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:51,966 - INFO - Verifications in API Server for VN ctest-fip_vn-76381530 passed 2026-05-11 04:07:51,967 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:51,992 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:07:52,004 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:07:52,015 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8523f3dc-288c-4581-8a91-cd269e82d771 2026-05-11 04:07:52,028 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7762012566596044686', 'uuid-lslong': '10067237329443074240'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.000262'} 2026-05-11 04:07:52,035 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:07:52,042 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7762012566596044686', 'uuid-lslong': '10067237329443074240'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.011323'} 2026-05-11 04:07:52,050 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:07:52,057 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7762012566596044686', 'uuid-lslong': '10067237329443074240'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.026972'} 2026-05-11 04:07:52,063 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:07:52,063 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-76381530 passed 2026-05-11 04:07:52,063 - DEBUG - ====Verifying policy data for ctest-fip_vn-76381530 in API_Server ====== 2026-05-11 04:07:52,063 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:07:52,070 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:07:52,084 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:07:52,197 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:07:52,209 - DEBUG - =>VN ctest-fip_vn-76381530 has no policy to be verified 2026-05-11 04:07:52,209 - DEBUG - Verifying the vn in opserver 2026-05-11 04:07:52,210 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 virtual network link through opserver 10.0.0.141 2026-05-11 04:07:52,210 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:07:52,280 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530?flat'} 2026-05-11 04:07:52,280 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 virtual network link through opserver 10.0.0.249 2026-05-11 04:07:52,280 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:07:52,353 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530?flat'} 2026-05-11 04:07:52,353 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 virtual network link through opserver 10.0.0.27 2026-05-11 04:07:52,353 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:07:52,367 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530?flat'} 2026-05-11 04:07:52,367 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is found in opserver 2026-05-11 04:07:52,387 - DEBUG - VRF ids for VN ctest-fip_vn-76381530: {'10.0.0.23': '5'} 2026-05-11 04:07:52,387 - INFO - Waiting for VM ctest-fvn_vm1-93964415 to be up.. 2026-05-11 04:07:52,487 - DEBUG - VM is in ACTIVE state now 2026-05-11 04:07:52,487 - INFO - VM name : ctest-fvn_vm1-93964415 2026-05-11 04:07:52,578 - DEBUG - VM ctest-fvn_vm1-93964415 ID is 1c932864-993e-451e-8e45-cc3e75e0b010 2026-05-11 04:07:52,578 - DEBUG - VM ctest-fvn_vm1-93964415 launched on Node an-jenkins-deploy-platform-ansible-os-5767-1 2026-05-11 04:07:52,668 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/1c932864-993e-451e-8e45-cc3e75e0b010 2026-05-11 04:07:52,682 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/404a9dc7-f50e-47c5-a984-6e07a3047296 2026-05-11 04:07:55,867 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2026-05-11 04:07:55,867 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-93964415 failed! 2026-05-11 04:07:55,884 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is 63.244.224.129 and allocation pool is NOT set 2026-05-11 04:07:59,963 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-05-11 04:07:59,963 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-93964415 failed! 2026-05-11 04:07:59,978 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is 63.244.224.129 and allocation pool is NOT set 2026-05-11 04:08:04,069 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2026-05-11 04:08:04,069 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-93964415 failed! 2026-05-11 04:08:04,085 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is 63.244.224.129 and allocation pool is NOT set 2026-05-11 04:08:08,162 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-05-11 04:08:08,162 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-93964415 failed! 2026-05-11 04:08:08,177 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is 63.244.224.129 and allocation pool is NOT set 2026-05-11 04:08:12,258 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-11 04:08:12,258 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-93964415 failed! 2026-05-11 04:08:12,273 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is 63.244.224.129 and allocation pool is NOT set 2026-05-11 04:08:14,340 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=11.4 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=2.11 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.105/6.774/11.443/4.669 ms') 2026-05-11 04:08:14,340 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-93964415 passed 2026-05-11 04:08:14,410 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:14,410 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-93964415, IP 63.244.224.131, Port 22 2026-05-11 04:08:14,478 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-11 04:08:14,570 - DEBUG - VM ctest-fvn_vm1-93964415 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-11 04:08:19,571 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:19,571 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-93964415, IP 63.244.224.131, Port 22 2026-05-11 04:08:19,638 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-11 04:08:19,773 - DEBUG - VM ctest-fvn_vm1-93964415 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-11 04:08:24,773 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:24,773 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-93964415, IP 63.244.224.131, Port 22 2026-05-11 04:08:24,845 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-11 04:08:24,941 - DEBUG - VM ctest-fvn_vm1-93964415 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-11 04:08:29,943 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:29,943 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-93964415, IP 63.244.224.131, Port 22 2026-05-11 04:08:30,119 - DEBUG - VM ctest-fvn_vm1-93964415 is ready for SSH connections 2026-05-11 04:08:30,119 - INFO - Waiting for VM ctest-vn2_vm2-16887731 to be up.. 2026-05-11 04:08:30,210 - DEBUG - VM is in ACTIVE state now 2026-05-11 04:08:30,211 - INFO - VM name : ctest-vn2_vm2-16887731 2026-05-11 04:08:30,312 - DEBUG - VM ctest-vn2_vm2-16887731 ID is dd115436-7bf1-451b-93fc-5dcfd3e36dc2 2026-05-11 04:08:30,312 - DEBUG - VM ctest-vn2_vm2-16887731 launched on Node an-jenkins-deploy-platform-ansible-os-5767-1 2026-05-11 04:08:30,418 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/dd115436-7bf1-451b-93fc-5dcfd3e36dc2 2026-05-11 04:08:30,433 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/922cb22d-a7cf-498e-9805-0c6a7625c03e 2026-05-11 04:08:31,604 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.77 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.624 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.624/1.696/2.769/1.072 ms') 2026-05-11 04:08:31,605 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn2_vm2-16887731 passed 2026-05-11 04:08:31,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:31,677 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-16887731, IP 22.231.130.3, Port 22 2026-05-11 04:08:31,840 - DEBUG - VM ctest-vn2_vm2-16887731 is ready for SSH connections 2026-05-11 04:08:31,840 - INFO - Waiting for VM mltf_vm to be up.. 2026-05-11 04:08:31,952 - DEBUG - VM is in ACTIVE state now 2026-05-11 04:08:31,953 - INFO - VM name : mltf_vm 2026-05-11 04:08:32,064 - DEBUG - VM mltf_vm ID is cb259502-9b80-47ca-8957-72df3986547e 2026-05-11 04:08:32,064 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5767-2 2026-05-11 04:08:32,278 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/cb259502-9b80-47ca-8957-72df3986547e 2026-05-11 04:08:32,297 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/3b36bcf8-ae38-4872-be36-c8c31ae92160 2026-05-11 04:08:32,308 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/d6a89614-326b-4b5f-b929-7bea3af8ed68 2026-05-11 04:08:33,502 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=4.32 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.966 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.966/2.640/4.315/1.674 ms') 2026-05-11 04:08:33,502 - INFO - Ping to Metadata IP 169.254.0.7 of VM mltf_vm passed 2026-05-11 04:08:33,578 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:33,578 - DEBUG - Waiting to SSH to VM mltf_vm, IP 47.158.168.197, Port 22 2026-05-11 04:08:33,747 - DEBUG - VM mltf_vm is ready for SSH connections 2026-05-11 04:08:33,818 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-11 04:08:33,819 - DEBUG - Waiting to SSH to VM mltf_vm, IP 47.158.168.197, Port 22 2026-05-11 04:08:33,991 - DEBUG - VM mltf_vm is ready for SSH connections 2026-05-11 04:08:33,993 - INFO - ================================================================================ 2026-05-11 04:08:33,993 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2026-05-11 04:08:33,994 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2026-05-11 04:08:35,289 - DEBUG - Skipping xmpp flap check 2026-05-11 04:08:35,289 - INFO - Initial checks done. Running the testcase now 2026-05-11 04:08:35,289 - INFO - 2026-05-11 04:08:35,413 - INFO - Setting flow export rate: 100 2026-05-11 04:08:35,461 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-05-11 04:08:35,825 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '053cbe4b-0a30-49cf-ac4c-3094438df0e2', 'name': 'ctest-vn1-41327646', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'project_id': '68ddb98922c840f898d8230c4217f26d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['1776d304-c9f2-44e0-b7d0-7b6bd6965d79'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'ctest-vn1-41327646'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '47.158.168.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-05-11 04:08:36,061 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'a58e4ce0-4d23-4ee9-8471-fd0c9746934b', 'name': 'ctest-vn2-42864367', 'tenant_id': '68ddb98922c840f898d8230c4217f26d', 'project_id': '68ddb98922c840f898d8230c4217f26d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['91d27f15-dca6-46e5-89cf-b6a12550e050'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'ctest-vn2-42864367'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '22.231.130.0/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-05-11 04:08:36,171 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:36,177 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:36,188 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:36,284 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:36,308 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:36,317 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:36,327 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:36,335 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:08:36,342 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:36,342 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:36,353 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:36,369 - INFO - Verified VN network id 15 for VN 053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:36,369 - INFO - Verifications in API Server for VN ctest-vn1-41327646 passed 2026-05-11 04:08:36,369 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:36,380 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:36,390 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:36,398 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:08:36,410 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.628366'} 2026-05-11 04:08:36,418 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:36,424 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.648364'} 2026-05-11 04:08:36,431 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:36,436 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.659967'} 2026-05-11 04:08:36,442 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:36,442 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41327646 passed 2026-05-11 04:08:36,442 - DEBUG - ====Verifying policy data for ctest-vn1-41327646 in API_Server ====== 2026-05-11 04:08:36,442 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:36,448 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:36,461 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:36,552 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:36,566 - DEBUG - ==>Verifying data for policy with id: 75ed1857-73dd-47ce-8b68-26392830bd32, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'policy1'] 2026-05-11 04:08:36,566 - INFO - VN ctest-vn1-41327646 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-11 04:08:36,566 - DEBUG - Verifying the vn in opserver 2026-05-11 04:08:36,566 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.141 2026-05-11 04:08:36,566 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:08:36,580 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:08:36,580 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.249 2026-05-11 04:08:36,580 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:08:36,596 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:08:36,596 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.27 2026-05-11 04:08:36,596 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:08:36,609 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:08:36,609 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is found in opserver 2026-05-11 04:08:36,625 - DEBUG - VRF ids for VN ctest-vn1-41327646: {'10.0.0.240': '4'} 2026-05-11 04:08:36,625 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:36,636 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:36,653 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:36,762 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:36,778 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:36,789 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:36,801 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:36,811 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/1d221946-7ded-42b1-b4f1-e946917863ee 2026-05-11 04:08:36,818 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:36,818 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:36,827 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:36,846 - INFO - Verified VN network id 16 for VN a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:36,847 - INFO - Verifications in API Server for VN ctest-vn2-42864367 passed 2026-05-11 04:08:36,847 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:36,860 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:36,872 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:36,883 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/1d221946-7ded-42b1-b4f1-e946917863ee 2026-05-11 04:08:36,900 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.896087'} 2026-05-11 04:08:36,909 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:36,917 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.912623'} 2026-05-11 04:08:36,926 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:36,934 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.930059'} 2026-05-11 04:08:36,944 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:36,944 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-42864367 passed 2026-05-11 04:08:36,944 - DEBUG - ====Verifying policy data for ctest-vn2-42864367 in API_Server ====== 2026-05-11 04:08:36,944 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:36,952 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:36,967 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:37,064 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:37,077 - DEBUG - ==>Verifying data for policy with id: 75ed1857-73dd-47ce-8b68-26392830bd32, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'policy1'] 2026-05-11 04:08:37,077 - INFO - VN ctest-vn2-42864367 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-11 04:08:37,077 - DEBUG - Verifying the vn in opserver 2026-05-11 04:08:37,077 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.141 2026-05-11 04:08:37,077 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:08:37,091 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:08:37,091 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.249 2026-05-11 04:08:37,091 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:08:37,107 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:08:37,107 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.27 2026-05-11 04:08:37,107 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:08:37,123 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:08:37,124 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 is found in opserver 2026-05-11 04:08:37,136 - DEBUG - VRF ids for VN ctest-vn2-42864367: {'10.0.0.23': '4', '10.0.0.240': '5'} 2026-05-11 04:08:37,137 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:37,143 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:37,157 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:37,273 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:37,283 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:37,297 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:37,311 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:37,321 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:08:37,329 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:37,329 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:37,340 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:37,361 - INFO - Verified VN network id 15 for VN 053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:37,362 - INFO - Verifications in API Server for VN ctest-vn1-41327646 passed 2026-05-11 04:08:37,362 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:37,374 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:37,383 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:08:37,393 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/6b4289da-cc84-4f6f-8434-a47f871b4197 2026-05-11 04:08:37,408 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.624003'} 2026-05-11 04:08:37,418 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:37,426 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.650007'} 2026-05-11 04:08:37,434 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:37,441 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '377385698295040463', 'uuid-lslong': '12415351686100283618'}, 'enable': 'true', 'created': '2026-05-11T04:06:57', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.663944'} 2026-05-11 04:08:37,452 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-05-11 04:08:37,452 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-41327646 passed 2026-05-11 04:08:37,453 - DEBUG - ====Verifying policy data for ctest-vn1-41327646 in API_Server ====== 2026-05-11 04:08:37,453 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:37,463 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:37,480 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:37,590 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/053cbe4b-0a30-49cf-ac4c-3094438df0e2 2026-05-11 04:08:37,602 - DEBUG - ==>Verifying data for policy with id: 75ed1857-73dd-47ce-8b68-26392830bd32, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'policy1'] 2026-05-11 04:08:37,602 - INFO - VN ctest-vn1-41327646 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-11 04:08:37,602 - DEBUG - Verifying the vn in opserver 2026-05-11 04:08:37,602 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.141 2026-05-11 04:08:37,602 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:08:37,620 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:08:37,620 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.249 2026-05-11 04:08:37,620 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:08:37,638 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:08:37,638 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 virtual network link through opserver 10.0.0.27 2026-05-11 04:08:37,638 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:08:37,651 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646?flat'} 2026-05-11 04:08:37,651 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 is found in opserver 2026-05-11 04:08:37,662 - DEBUG - VRF ids for VN ctest-vn1-41327646: {'10.0.0.240': '4'} 2026-05-11 04:08:37,662 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:37,667 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:37,689 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:37,787 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:37,798 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:37,809 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:37,818 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:37,828 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/1d221946-7ded-42b1-b4f1-e946917863ee 2026-05-11 04:08:37,837 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:37,837 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:37,848 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:37,864 - INFO - Verified VN network id 16 for VN a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:37,864 - INFO - Verifications in API Server for VN ctest-vn2-42864367 passed 2026-05-11 04:08:37,865 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:37,877 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:37,885 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:08:37,893 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/1d221946-7ded-42b1-b4f1-e946917863ee 2026-05-11 04:08:37,909 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.905176'} 2026-05-11 04:08:37,917 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:37,924 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.920603'} 2026-05-11 04:08:37,932 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:37,937 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11929556989201567465', 'uuid-lslong': '9543687315894211403'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:08:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.933767'} 2026-05-11 04:08:37,944 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-11 04:08:37,944 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-42864367 passed 2026-05-11 04:08:37,944 - DEBUG - ====Verifying policy data for ctest-vn2-42864367 in API_Server ====== 2026-05-11 04:08:37,944 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:37,951 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:37,966 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:38,067 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/a58e4ce0-4d23-4ee9-8471-fd0c9746934b 2026-05-11 04:08:38,084 - DEBUG - ==>Verifying data for policy with id: 75ed1857-73dd-47ce-8b68-26392830bd32, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-25086308', 'policy1'] 2026-05-11 04:08:38,084 - INFO - VN ctest-vn2-42864367 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-11 04:08:38,084 - DEBUG - Verifying the vn in opserver 2026-05-11 04:08:38,085 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.141 2026-05-11 04:08:38,085 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:08:38,099 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:08:38,099 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.249 2026-05-11 04:08:38,099 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:08:38,121 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:08:38,121 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 virtual network link through opserver 10.0.0.27 2026-05-11 04:08:38,121 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:08:38,142 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367?flat'} 2026-05-11 04:08:38,142 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 is found in opserver 2026-05-11 04:08:38,155 - DEBUG - VRF ids for VN ctest-vn2-42864367: {'10.0.0.23': '4', '10.0.0.240': '5'} 2026-05-11 04:08:38,155 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:38,162 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:38,175 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:38,275 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:08:38,286 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:08:38,296 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:08:38,305 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:08:38,314 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8523f3dc-288c-4581-8a91-cd269e82d771 2026-05-11 04:08:38,322 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:08:38,323 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:08:38,335 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:08:38,353 - INFO - Verified VN network id 17 for VN 6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:08:38,353 - INFO - Verifications in API Server for VN ctest-fip_vn-76381530 passed 2026-05-11 04:08:38,353 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:08:38,363 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:08:38,373 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:08:38,382 - DEBUG - Requesting: http://10.0.0.141:8082/route-target/8523f3dc-288c-4581-8a91-cd269e82d771 2026-05-11 04:08:38,397 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7762012566596044686', 'uuid-lslong': '10067237329443074240'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:53.368691'} 2026-05-11 04:08:38,405 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:08:38,412 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7762012566596044686', 'uuid-lslong': '10067237329443074240'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:53.381735'} 2026-05-11 04:08:38,421 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:08:38,428 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-25086308', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7762012566596044686', 'uuid-lslong': '10067237329443074240'}, 'enable': 'true', 'created': '2026-05-11T04:07:44', 'last-modified': '2026-05-11T04:07:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:53.397268'} 2026-05-11 04:08:38,435 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-11 04:08:38,435 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-76381530 passed 2026-05-11 04:08:38,435 - DEBUG - ====Verifying policy data for ctest-fip_vn-76381530 in API_Server ====== 2026-05-11 04:08:38,435 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:08:38,442 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:08:38,454 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:08:38,545 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/6bb8354d-ee13-478e-8bb6-03033b01b0c0 2026-05-11 04:08:38,558 - DEBUG - =>VN ctest-fip_vn-76381530 has no policy to be verified 2026-05-11 04:08:38,558 - DEBUG - Verifying the vn in opserver 2026-05-11 04:08:38,558 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 virtual network link through opserver 10.0.0.141 2026-05-11 04:08:38,558 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks 2026-05-11 04:08:38,572 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530?flat'} 2026-05-11 04:08:38,572 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 virtual network link through opserver 10.0.0.249 2026-05-11 04:08:38,572 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-05-11 04:08:38,587 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530?flat'} 2026-05-11 04:08:38,587 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 virtual network link through opserver 10.0.0.27 2026-05-11 04:08:38,587 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-11 04:08:38,600 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530?flat'} 2026-05-11 04:08:38,600 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 is found in opserver 2026-05-11 04:08:38,617 - DEBUG - VRF ids for VN ctest-fip_vn-76381530: {'10.0.0.23': '5'} 2026-05-11 04:08:38,617 - INFO - start time= 1778472518617219 2026-05-11 04:08:38,617 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 22.231.130.3, host_string: cirros@169.254.0.5, password: gocubsgogateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-11 04:08:38,617 - DEBUG - ping -s 56 -c 3 -W 1 22.231.130.3 2026-05-11 04:08:42,645 - DEBUG - PING 22.231.130.3 (22.231.130.3): 56 data bytes 64 bytes from 22.231.130.3: seq=0 ttl=63 time=4.338 ms 64 bytes from 22.231.130.3: seq=1 ttl=63 time=1.703 ms 64 bytes from 22.231.130.3: seq=2 ttl=63 time=1.985 ms --- 22.231.130.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.703/2.675/4.338 ms 2026-05-11 04:08:42,645 - INFO - Ping to IP 22.231.130.3 from VM ctest-vn1_vm1-01412581 passed 2026-05-11 04:08:52,646 - INFO - Verify session samples and teardown pkts 2026-05-11 04:08:52,646 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.141 2026-05-11 04:08:52,650 - DEBUG - Posting: http://10.0.0.141:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1778472518617219, 'end_time': 1778472532650249, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-05-11 04:08:53,672 - DEBUG - [{'T': 1778472521033430}, {'T': 1778472522033434}, {'T': 1778472523033496}] 2026-05-11 04:08:53,672 - DEBUG - Posting: http://10.0.0.141:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1778472518617219, 'end_time': 1778472533672515, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2026-05-11 04:08:54,693 - DEBUG - [{'T': 1778472520667482}, {'T': 1778472521667651}, {'T': 1778472522667776}] 2026-05-11 04:08:54,693 - DEBUG - Posting: http://10.0.0.141:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1778472518617219, 'end_time': 1778472534693565, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-05-11 04:08:55,714 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', 'sample_count': 3}] 2026-05-11 04:08:55,714 - INFO - wait for the flows to get expire 2026-05-11 04:12:15,715 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5767-2:Compute:contrail-vrouter-agent:0?flat 2026-05-11 04:12:15,753 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5767-2?flat 2026-05-11 04:12:16,308 - INFO - Deleted policy policy1 2026-05-11 04:12:16,425 - INFO - Setting flow export rate: None 2026-05-11 04:12:17,727 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon May 11 04:12:15 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=) 1281 src_vn = self.res.vn1_fixture.vn_fq_name 1282 dst_vn = self.res.vn2_fixture.vn_fq_name 1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) 1284 1285 assert result,'Failed to get expected number of samples' result = True self = self.verify_session_sampling_teardown = > start_time = '1778472518617219' src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646' dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367' /contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1778472518617219', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367') 486 flow_record = self.analytics_obj.get_flows_vrouter_uve( 487 vrouter=vm_host) 488 assert not flow_record,'flows not got deleted even after 240 sec' 489 490 res = self.analytics_obj.ops_inspect[ip].post_query( flow_record = 10 AssertionError: flows not got deleted even after 240 sec __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('flows not got deleted even after 240 sec',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown assert not flow_record,'flows not got deleted even after 240 sec' AssertionError: flows not got deleted even after 240 sec 2026-05-11 04:12:17,728 - DEBUG - Skipping xmpp flap check 2026-05-11 04:12:17,728 - INFO - 2026-05-11 04:12:17,728 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:44] 2026-05-11 04:12:17,728 - INFO - -------------------------------------------------------------------------------- 2026-05-11 04:12:17,730 - INFO - Deleting VM mltf_vm 2026-05-11 04:12:17,804 - INFO - Deleting VM ctest-fvn_vm1-93964415 2026-05-11 04:12:17,891 - INFO - Deleting VM ctest-vn2_vm2-16887731 2026-05-11 04:12:17,967 - INFO - Deleting VN ctest-fip_vn-76381530 2026-05-11 04:12:18,020 - DEBUG - VN 6bb8354d-ee13-478e-8bb6-03033b01b0c0 still in use: Unable to complete operation on network 6bb8354d-ee13-478e-8bb6-03033b01b0c0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4ced5207-614a-4d4e-b8bc-160af90d5072'] 2026-05-11 04:12:18,020 - WARNING - Deleting VN ctest-fip_vn-76381530 failed..Will retry 2026-05-11 04:12:20,291 - DEBUG - Response for deleting network () 2026-05-11 04:12:20,291 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/3f5a9a8b-10af-4152-96b6-604dd5104d4f 2026-05-11 04:12:20,336 - DEBUG - Response Code: 404 2026-05-11 04:12:20,336 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:12:20,344 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:12:20,400 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:12:20,543 - INFO - Validated that VN ctest-fip_vn-76381530 is not found in API Server 2026-05-11 04:12:20,556 - DEBUG - VN ctest-fip_vn-76381530 is not present in Agent 10.0.0.23 2026-05-11 04:12:20,570 - DEBUG - VN ctest-fip_vn-76381530 is not present in Agent 10.0.0.240 2026-05-11 04:12:20,570 - INFO - Validated that VN ctest-fip_vn-76381530 is not in any agent 2026-05-11 04:12:20,578 - DEBUG - VRF 5 is not seen in agent 10.0.0.23 2026-05-11 04:12:20,585 - DEBUG - Vrouter 10.0.0.23 does not have vrf 5 for VN ctest-fip_vn-76381530 2026-05-11 04:12:20,585 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-fip_vn-76381530 2026-05-11 04:12:20,615 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-76381530 info 2026-05-11 04:12:20,615 - INFO - Deleting VN ctest-vn2-42864367 2026-05-11 04:12:20,885 - DEBUG - Response for deleting network () 2026-05-11 04:12:20,885 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/b6c4d89e-86d6-4588-a5f1-de8330659bcf 2026-05-11 04:12:20,891 - DEBUG - Response Code: 404 2026-05-11 04:12:20,892 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:12:20,897 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:12:20,911 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:12:21,017 - INFO - Validated that VN ctest-vn2-42864367 is not found in API Server 2026-05-11 04:12:21,032 - DEBUG - VN ctest-vn2-42864367 is not present in Agent 10.0.0.23 2026-05-11 04:12:21,045 - DEBUG - VN ctest-vn2-42864367 is not present in Agent 10.0.0.240 2026-05-11 04:12:21,045 - INFO - Validated that VN ctest-vn2-42864367 is not in any agent 2026-05-11 04:12:21,052 - DEBUG - VRF 4 is not seen in agent 10.0.0.23 2026-05-11 04:12:21,058 - DEBUG - Vrouter 10.0.0.23 does not have vrf 4 for VN ctest-vn2-42864367 2026-05-11 04:12:21,069 - DEBUG - VRF 5 is not seen in agent 10.0.0.240 2026-05-11 04:12:21,074 - DEBUG - Vrouter 10.0.0.240 does not have vrf 5 for VN ctest-vn2-42864367 2026-05-11 04:12:21,074 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn2-42864367 2026-05-11 04:12:21,098 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-42864367 info 2026-05-11 04:12:21,098 - INFO - Deleting VM ctest-vn1_vm2-70078907 2026-05-11 04:12:21,168 - INFO - Deleting VM ctest-vn1_vm1-01412581 2026-05-11 04:12:21,241 - INFO - Deleting VN ctest-vn1-41327646 2026-05-11 04:12:21,287 - DEBUG - VN 053cbe4b-0a30-49cf-ac4c-3094438df0e2 still in use: Unable to complete operation on network 053cbe4b-0a30-49cf-ac4c-3094438df0e2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f5f27c85-a5e2-46b8-9c19-357c94a09a6b'] 2026-05-11 04:12:21,287 - WARNING - Deleting VN ctest-vn1-41327646 failed..Will retry 2026-05-11 04:12:23,464 - DEBUG - Response for deleting network () 2026-05-11 04:12:23,464 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/af4f01bd-532b-4b83-8397-7924cfa47360 2026-05-11 04:12:23,473 - DEBUG - Response Code: 404 2026-05-11 04:12:23,473 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-05-11 04:12:23,490 - DEBUG - Requesting: http://10.0.0.141:8082/domain/a797b29a-b743-4bb0-b070-a90ae89983d0 2026-05-11 04:12:23,510 - DEBUG - Requesting: http://10.0.0.141:8082/project/68ddb989-22c8-40f8-98d8-230c4217f26d 2026-05-11 04:12:23,617 - INFO - Validated that VN ctest-vn1-41327646 is not found in API Server 2026-05-11 04:12:23,628 - DEBUG - VN ctest-vn1-41327646 is not present in Agent 10.0.0.23 2026-05-11 04:12:23,641 - DEBUG - VN ctest-vn1-41327646 is not present in Agent 10.0.0.240 2026-05-11 04:12:23,641 - INFO - Validated that VN ctest-vn1-41327646 is not in any agent 2026-05-11 04:12:23,648 - DEBUG - VRF 4 is not seen in agent 10.0.0.240 2026-05-11 04:12:23,654 - DEBUG - Vrouter 10.0.0.240 does not have vrf 4 for VN ctest-vn1-41327646 2026-05-11 04:12:23,654 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-25086308:ctest-vn1-41327646 2026-05-11 04:12:23,678 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-41327646 info 2026-05-11 04:12:24,440 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-25086308, ID : 68ddb989-22c8-40f8-98d8-230c4217f26d