2026-05-14 04:15:26,087 - INFO - Domain Default found not creating 2026-05-14 04:15:26,315 - INFO - Project ctest-AnalyticsTestSanityWithResource-31705655 not found, creating it 2026-05-14 04:15:26,945 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-31705655, ID : af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:15:29,588 - DEBUG - Response for create_network : {'network': {'id': '5519d1ea-a8d6-4111-a65f-a9feab05db82', 'name': 'ctest-vn1-32859705', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'project_id': 'af1de36ff6d348b291085652e93068c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'ctest-vn1-32859705'], 'port_security_enabled': True, 'description': ''}} 2026-05-14 04:15:29,940 - DEBUG - Response for create_subnet : {'subnet': {'id': '0a86d209-8946-4a5b-9554-33d8423483f9', 'name': '', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'network_id': '5519d1ea-a8d6-4111-a65f-a9feab05db82', 'ip_version': 4, 'cidr': '176.91.153.192/26', 'allocation_pools': [{'start': '176.91.153.194', 'end': '176.91.153.254'}], 'gateway_ip': '176.91.153.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '176.91.153.194', 'tags': [], 'project_id': 'af1de36ff6d348b291085652e93068c9'}} 2026-05-14 04:15:29,967 - INFO - Created VN ctest-vn1-32859705 2026-05-14 04:15:29,989 - DEBUG - VN ctest-vn1-32859705 UUID is 5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:30,112 - DEBUG - Services list from nova: [, , , ] 2026-05-14 04:15:30,112 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5780-1', 'an-jenkins-deploy-platform-ansible-os-5780-2']} 2026-05-14 04:15:31,767 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5780-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5780-1) 2026-05-14 04:15:33,526 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5780-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5780-1) 2026-05-14 04:15:33,527 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:15:33,885 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:15:33,945 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:15:33,964 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:15:34,132 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:34,163 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:34,179 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:15:34,195 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:15:34,211 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:15:34,225 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:15:34,225 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:34,247 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:15:34,297 - INFO - Verified VN network id 18 for VN 5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:34,297 - INFO - Verifications in API Server for VN ctest-vn1-32859705 passed 2026-05-14 04:15:34,297 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:34,316 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:15:34,364 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:15:34,379 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:15:34,396 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:15:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.521344'} 2026-05-14 04:15:34,409 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:15:34,420 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:15:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.546837'} 2026-05-14 04:15:34,444 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:15:34,453 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:15:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.579716'} 2026-05-14 04:15:34,467 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:15:34,467 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-32859705 passed 2026-05-14 04:15:34,467 - DEBUG - ====Verifying policy data for ctest-vn1-32859705 in API_Server ====== 2026-05-14 04:15:34,468 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:15:34,480 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:15:34,502 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:15:34,627 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:15:34,651 - DEBUG - =>VN ctest-vn1-32859705 has no policy to be verified 2026-05-14 04:15:34,651 - DEBUG - Verifying the vn in opserver 2026-05-14 04:15:34,651 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.27 2026-05-14 04:15:34,651 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:15:35,076 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:15:35,164 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:15:35,164 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.22 2026-05-14 04:15:35,164 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:15:35,536 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:15:35,622 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:15:35,623 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.23 2026-05-14 04:15:35,623 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:15:35,984 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:15:36,080 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:15:36,080 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is found in opserver 2026-05-14 04:15:36,093 - DEBUG - VRF ids for VN ctest-vn1-32859705: {'10.0.0.240': '4'} 2026-05-14 04:15:36,094 - INFO - Waiting for VM ctest-vn1_vm1-27269995 to be up.. 2026-05-14 04:15:36,206 - DEBUG - VM is in ACTIVE state now 2026-05-14 04:15:36,206 - INFO - VM name : ctest-vn1_vm1-27269995 2026-05-14 04:15:36,341 - DEBUG - VM ctest-vn1_vm1-27269995 ID is 4cbf33d7-dbd5-4270-bb75-d74ae3b14be4 2026-05-14 04:15:36,391 - DEBUG - VM ctest-vn1_vm1-27269995 launched on Node an-jenkins-deploy-platform-ansible-os-5780-1 2026-05-14 04:15:36,506 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4cbf33d7-dbd5-4270-bb75-d74ae3b14be4 2026-05-14 04:15:36,859 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4cbf33d7-dbd5-4270-bb75-d74ae3b14be4 2026-05-14 04:15:36,909 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/cf71abf8-b7dd-4985-9b3a-59f0e280519b 2026-05-14 04:15:40,115 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2026-05-14 04:15:40,116 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-27269995 failed! 2026-05-14 04:15:40,135 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is 176.91.153.193 and allocation pool is NOT set 2026-05-14 04:15:44,209 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2026-05-14 04:15:44,209 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-27269995 failed! 2026-05-14 04:15:44,227 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is 176.91.153.193 and allocation pool is NOT set 2026-05-14 04:15:48,302 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-14 04:15:48,302 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-27269995 failed! 2026-05-14 04:15:48,329 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is 176.91.153.193 and allocation pool is NOT set 2026-05-14 04:15:52,404 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms') 2026-05-14 04:15:52,405 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-27269995 failed! 2026-05-14 04:15:52,424 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is 176.91.153.193 and allocation pool is NOT set 2026-05-14 04:15:54,487 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.77 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=1.50 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.503/3.137/4.772/1.634 ms') 2026-05-14 04:15:54,488 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-27269995 passed 2026-05-14 04:15:54,576 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:15:54,576 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-27269995, IP 176.91.153.195, Port 22 2026-05-14 04:15:54,644 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:15:54,758 - DEBUG - VM ctest-vn1_vm1-27269995 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:15:59,759 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:15:59,759 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-27269995, IP 176.91.153.195, Port 22 2026-05-14 04:15:59,828 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:15:59,956 - DEBUG - VM ctest-vn1_vm1-27269995 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:16:04,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:04,957 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-27269995, IP 176.91.153.195, Port 22 2026-05-14 04:16:05,122 - DEBUG - VM ctest-vn1_vm1-27269995 is ready for SSH connections 2026-05-14 04:16:05,122 - INFO - Waiting for VM ctest-vn1_vm2-34911239 to be up.. 2026-05-14 04:16:05,235 - DEBUG - VM is in ACTIVE state now 2026-05-14 04:16:05,235 - INFO - VM name : ctest-vn1_vm2-34911239 2026-05-14 04:16:05,340 - DEBUG - VM ctest-vn1_vm2-34911239 ID is 319859d0-56e1-45ae-9cef-1f443d422a3a 2026-05-14 04:16:05,340 - DEBUG - VM ctest-vn1_vm2-34911239 launched on Node an-jenkins-deploy-platform-ansible-os-5780-1 2026-05-14 04:16:05,445 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/319859d0-56e1-45ae-9cef-1f443d422a3a 2026-05-14 04:16:05,463 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/735d0c47-bafa-4520-a115-a80b25b4e4f3 2026-05-14 04:16:06,686 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=2.91 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=3.80 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.905/3.351/3.798/0.446 ms') 2026-05-14 04:16:06,686 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm2-34911239 passed 2026-05-14 04:16:06,763 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:06,763 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-34911239, IP 176.91.153.196, Port 22 2026-05-14 04:16:06,831 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:16:06,956 - DEBUG - VM ctest-vn1_vm2-34911239 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:16:11,957 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:11,957 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-34911239, IP 176.91.153.196, Port 22 2026-05-14 04:16:12,121 - DEBUG - VM ctest-vn1_vm2-34911239 is ready for SSH connections 2026-05-14 04:16:12,475 - DEBUG - Response for create_network : {'network': {'id': '3d476fa9-9a8c-435c-bb96-22109bc14c42', 'name': 'ctest-vn2-19885192', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'project_id': 'af1de36ff6d348b291085652e93068c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'ctest-vn2-19885192'], 'port_security_enabled': True, 'description': ''}} 2026-05-14 04:16:12,852 - DEBUG - Response for create_subnet : {'subnet': {'id': '14178125-eed6-4f5d-a56b-73806b66b4ca', 'name': '', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'network_id': '3d476fa9-9a8c-435c-bb96-22109bc14c42', 'ip_version': 4, 'cidr': '48.169.28.128/26', 'allocation_pools': [{'start': '48.169.28.130', 'end': '48.169.28.190'}], 'gateway_ip': '48.169.28.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '48.169.28.130', 'tags': [], 'project_id': 'af1de36ff6d348b291085652e93068c9'}} 2026-05-14 04:16:12,883 - INFO - Created VN ctest-vn2-19885192 2026-05-14 04:16:12,911 - DEBUG - VN ctest-vn2-19885192 UUID is 3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:13,347 - DEBUG - Response for create_network : {'network': {'id': 'e3503aad-be80-48df-a258-a8659ac2ee9b', 'name': 'ctest-fip_vn-16321132', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'project_id': 'af1de36ff6d348b291085652e93068c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'ctest-fip_vn-16321132'], 'port_security_enabled': True, 'description': ''}} 2026-05-14 04:16:13,643 - DEBUG - Response for create_subnet : {'subnet': {'id': '098b1d7e-6dcb-4f97-a088-d6e9aa746112', 'name': '', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'network_id': 'e3503aad-be80-48df-a258-a8659ac2ee9b', 'ip_version': 4, 'cidr': '61.176.91.192/26', 'allocation_pools': [{'start': '61.176.91.194', 'end': '61.176.91.254'}], 'gateway_ip': '61.176.91.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '61.176.91.194', 'tags': [], 'project_id': 'af1de36ff6d348b291085652e93068c9'}} 2026-05-14 04:16:13,676 - INFO - Created VN ctest-fip_vn-16321132 2026-05-14 04:16:13,694 - DEBUG - VN ctest-fip_vn-16321132 UUID is e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:13,799 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5780-1', 'an-jenkins-deploy-platform-ansible-os-5780-2']} 2026-05-14 04:16:15,444 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5780-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5780-2) 2026-05-14 04:16:17,486 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5780-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5780-2) 2026-05-14 04:16:19,552 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5780-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5780-1) 2026-05-14 04:16:19,553 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:16:19,562 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:16:19,586 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:16:19,733 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:16:19,749 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:16:19,769 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:16:19,791 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:16:19,805 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:16:19,824 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:16:19,824 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:16:19,842 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:16:19,867 - INFO - Verified VN network id 18 for VN 5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:16:19,868 - INFO - Verifications in API Server for VN ctest-vn1-32859705 passed 2026-05-14 04:16:19,868 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:16:19,883 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:16:19,895 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:16:19,907 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:16:19,922 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:15:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:50.048446'} 2026-05-14 04:16:19,936 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:16:19,944 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:15:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:50.070862'} 2026-05-14 04:16:19,954 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:16:19,965 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:15:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:50.090407'} 2026-05-14 04:16:19,985 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:16:19,985 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-32859705 passed 2026-05-14 04:16:19,986 - DEBUG - ====Verifying policy data for ctest-vn1-32859705 in API_Server ====== 2026-05-14 04:16:19,986 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:16:20,000 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:16:20,032 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:16:20,164 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:16:20,188 - DEBUG - =>VN ctest-vn1-32859705 has no policy to be verified 2026-05-14 04:16:20,188 - DEBUG - Verifying the vn in opserver 2026-05-14 04:16:20,188 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.27 2026-05-14 04:16:20,188 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:16:20,337 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:16:20,337 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.22 2026-05-14 04:16:20,337 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:16:20,472 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:16:20,472 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.23 2026-05-14 04:16:20,472 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:16:20,585 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:16:20,586 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is found in opserver 2026-05-14 04:16:20,602 - DEBUG - VRF ids for VN ctest-vn1-32859705: {'10.0.0.240': '4'} 2026-05-14 04:16:20,602 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:16:20,611 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:16:20,634 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:16:20,882 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:20,920 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:20,941 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:16:20,959 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:16:20,971 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/bb51ec8f-1f64-4a2f-b0b3-956e077669fc 2026-05-14 04:16:20,981 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:16:20,981 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:20,995 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:16:21,025 - INFO - Verified VN network id 19 for VN 3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:21,025 - INFO - Verifications in API Server for VN ctest-vn2-19885192 passed 2026-05-14 04:16:21,025 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:21,047 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:16:21,059 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:16:21,071 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/bb51ec8f-1f64-4a2f-b0b3-956e077669fc 2026-05-14 04:16:21,097 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:16:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.436651'} 2026-05-14 04:16:21,114 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:16:21,127 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:16:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.468264'} 2026-05-14 04:16:21,136 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:16:21,161 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:16:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.499684'} 2026-05-14 04:16:21,178 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:16:21,179 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-19885192 passed 2026-05-14 04:16:21,179 - DEBUG - ====Verifying policy data for ctest-vn2-19885192 in API_Server ====== 2026-05-14 04:16:21,180 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:16:21,191 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:16:21,246 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:16:21,361 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:16:21,383 - DEBUG - =>VN ctest-vn2-19885192 has no policy to be verified 2026-05-14 04:16:21,383 - DEBUG - Verifying the vn in opserver 2026-05-14 04:16:21,383 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.27 2026-05-14 04:16:21,383 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:16:21,517 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:16:21,517 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.22 2026-05-14 04:16:21,517 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:16:21,563 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:16:21,563 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.23 2026-05-14 04:16:21,563 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:16:21,593 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:16:21,593 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 is found in opserver 2026-05-14 04:16:21,610 - DEBUG - VRF ids for VN ctest-vn2-19885192: {'10.0.0.65': '4'} 2026-05-14 04:16:21,610 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:16:21,622 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:16:21,651 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:16:21,791 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:21,812 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:21,829 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:16:21,841 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:16:21,851 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f41095ea-2768-42b8-a0f5-de141e8f76b7 2026-05-14 04:16:21,863 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:16:21,863 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:21,876 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:16:21,899 - INFO - Verified VN network id 20 for VN e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:21,899 - INFO - Verifications in API Server for VN ctest-fip_vn-16321132 passed 2026-05-14 04:16:21,899 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:21,912 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:16:21,923 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:16:21,932 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f41095ea-2768-42b8-a0f5-de141e8f76b7 2026-05-14 04:16:21,948 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16379656362646325471', 'uuid-lslong': '11698285186436492955'}, 'enable': 'true', 'created': '2026-05-14T04:16:13', 'last-modified': '2026-05-14T04:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.415982'} 2026-05-14 04:16:21,958 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:16:21,965 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16379656362646325471', 'uuid-lslong': '11698285186436492955'}, 'enable': 'true', 'created': '2026-05-14T04:16:13', 'last-modified': '2026-05-14T04:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.436357'} 2026-05-14 04:16:21,974 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:16:21,981 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16379656362646325471', 'uuid-lslong': '11698285186436492955'}, 'enable': 'true', 'created': '2026-05-14T04:16:13', 'last-modified': '2026-05-14T04:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:08.452460'} 2026-05-14 04:16:21,989 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:16:21,989 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-16321132 passed 2026-05-14 04:16:21,990 - DEBUG - ====Verifying policy data for ctest-fip_vn-16321132 in API_Server ====== 2026-05-14 04:16:21,990 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:16:21,998 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:16:22,014 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:16:22,162 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:16:22,179 - DEBUG - =>VN ctest-fip_vn-16321132 has no policy to be verified 2026-05-14 04:16:22,179 - DEBUG - Verifying the vn in opserver 2026-05-14 04:16:22,179 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 virtual network link through opserver 10.0.0.27 2026-05-14 04:16:22,179 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:16:22,196 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132?flat'} 2026-05-14 04:16:22,196 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 virtual network link through opserver 10.0.0.22 2026-05-14 04:16:22,196 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:16:22,321 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132?flat'} 2026-05-14 04:16:22,321 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 virtual network link through opserver 10.0.0.23 2026-05-14 04:16:22,321 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:16:22,413 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132?flat'} 2026-05-14 04:16:22,413 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is found in opserver 2026-05-14 04:16:22,427 - DEBUG - VRF ids for VN ctest-fip_vn-16321132: {'10.0.0.65': '5'} 2026-05-14 04:16:22,427 - INFO - Waiting for VM ctest-fvn_vm1-32285395 to be up.. 2026-05-14 04:16:22,556 - DEBUG - VM is in ACTIVE state now 2026-05-14 04:16:22,557 - INFO - VM name : ctest-fvn_vm1-32285395 2026-05-14 04:16:22,670 - DEBUG - VM ctest-fvn_vm1-32285395 ID is 0ca2f105-2e23-42c6-a05c-837a37f4eabc 2026-05-14 04:16:22,671 - DEBUG - VM ctest-fvn_vm1-32285395 launched on Node an-jenkins-deploy-platform-ansible-os-5780-2 2026-05-14 04:16:22,775 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/0ca2f105-2e23-42c6-a05c-837a37f4eabc 2026-05-14 04:16:22,787 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/4adc9d6a-b3f6-4b32-a770-710f776d4f46 2026-05-14 04:16:25,986 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-05-14 04:16:25,986 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-32285395 failed! 2026-05-14 04:16:26,005 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is 61.176.91.193 and allocation pool is NOT set 2026-05-14 04:16:30,081 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2026-05-14 04:16:30,081 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-32285395 failed! 2026-05-14 04:16:30,102 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is 61.176.91.193 and allocation pool is NOT set 2026-05-14 04:16:34,179 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2026-05-14 04:16:34,179 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-32285395 failed! 2026-05-14 04:16:34,197 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is 61.176.91.193 and allocation pool is NOT set 2026-05-14 04:16:38,269 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-14 04:16:38,269 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-32285395 failed! 2026-05-14 04:16:38,289 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is 61.176.91.193 and allocation pool is NOT set 2026-05-14 04:16:42,376 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2026-05-14 04:16:42,376 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-32285395 failed! 2026-05-14 04:16:42,393 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is 61.176.91.193 and allocation pool is NOT set 2026-05-14 04:16:44,464 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=13.7 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.424 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.424/7.060/13.696/6.636 ms') 2026-05-14 04:16:44,464 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-32285395 passed 2026-05-14 04:16:44,542 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:44,542 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-32285395, IP 61.176.91.195, Port 22 2026-05-14 04:16:44,609 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:16:44,726 - DEBUG - VM ctest-fvn_vm1-32285395 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:16:49,727 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:49,727 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-32285395, IP 61.176.91.195, Port 22 2026-05-14 04:16:49,807 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:16:49,917 - DEBUG - VM ctest-fvn_vm1-32285395 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:16:54,918 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:54,919 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-32285395, IP 61.176.91.195, Port 22 2026-05-14 04:16:55,101 - DEBUG - VM ctest-fvn_vm1-32285395 is ready for SSH connections 2026-05-14 04:16:55,102 - INFO - Waiting for VM ctest-vn2_vm2-28768032 to be up.. 2026-05-14 04:16:55,225 - DEBUG - VM is in ACTIVE state now 2026-05-14 04:16:55,225 - INFO - VM name : ctest-vn2_vm2-28768032 2026-05-14 04:16:55,339 - DEBUG - VM ctest-vn2_vm2-28768032 ID is eee99387-2885-4c3b-b6cc-e7ea961a712c 2026-05-14 04:16:55,339 - DEBUG - VM ctest-vn2_vm2-28768032 launched on Node an-jenkins-deploy-platform-ansible-os-5780-2 2026-05-14 04:16:55,447 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/eee99387-2885-4c3b-b6cc-e7ea961a712c 2026-05-14 04:16:55,460 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/d494d830-c297-4008-8b18-4fcfef6f91f6 2026-05-14 04:16:56,647 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.76 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.02 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.021/2.890/3.760/0.869 ms') 2026-05-14 04:16:56,647 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn2_vm2-28768032 passed 2026-05-14 04:16:56,726 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:16:56,726 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-28768032, IP 48.169.28.131, Port 22 2026-05-14 04:16:56,798 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:16:56,922 - DEBUG - VM ctest-vn2_vm2-28768032 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:17:01,922 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:17:01,923 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-28768032, IP 48.169.28.131, Port 22 2026-05-14 04:17:01,990 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-14 04:17:02,099 - DEBUG - VM ctest-vn2_vm2-28768032 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-14 04:17:07,100 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:17:07,100 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-28768032, IP 48.169.28.131, Port 22 2026-05-14 04:17:07,278 - DEBUG - VM ctest-vn2_vm2-28768032 is ready for SSH connections 2026-05-14 04:17:07,278 - INFO - Waiting for VM mltf_vm to be up.. 2026-05-14 04:17:07,400 - DEBUG - VM is in ACTIVE state now 2026-05-14 04:17:07,400 - INFO - VM name : mltf_vm 2026-05-14 04:17:07,538 - DEBUG - VM mltf_vm ID is efb93d37-b8e1-4a3c-99ed-b9998229333e 2026-05-14 04:17:07,538 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5780-1 2026-05-14 04:17:07,757 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/efb93d37-b8e1-4a3c-99ed-b9998229333e 2026-05-14 04:17:07,772 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/a096b35f-a300-4564-9392-2b4dc9bf02d8 2026-05-14 04:17:07,787 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/c48ff8bf-1470-479c-9a9c-76f91de4b427 2026-05-14 04:17:09,001 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=2.01 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.451 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.451/1.232/2.014/0.781 ms') 2026-05-14 04:17:09,001 - INFO - Ping to Metadata IP 169.254.0.7 of VM mltf_vm passed 2026-05-14 04:17:09,080 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:17:09,080 - DEBUG - Waiting to SSH to VM mltf_vm, IP 176.91.153.197, Port 22 2026-05-14 04:17:09,257 - DEBUG - VM mltf_vm is ready for SSH connections 2026-05-14 04:17:09,339 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-14 04:17:09,339 - DEBUG - Waiting to SSH to VM mltf_vm, IP 176.91.153.197, Port 22 2026-05-14 04:17:09,512 - DEBUG - VM mltf_vm is ready for SSH connections 2026-05-14 04:17:09,515 - INFO - ================================================================================ 2026-05-14 04:17:09,515 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2026-05-14 04:17:09,515 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2026-05-14 04:17:10,850 - DEBUG - Skipping xmpp flap check 2026-05-14 04:17:10,850 - INFO - Initial checks done. Running the testcase now 2026-05-14 04:17:10,850 - INFO - 2026-05-14 04:17:10,999 - INFO - Setting flow export rate: 100 2026-05-14 04:17:11,051 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-05-14 04:17:11,479 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '5519d1ea-a8d6-4111-a65f-a9feab05db82', 'name': 'ctest-vn1-32859705', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'project_id': 'af1de36ff6d348b291085652e93068c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['0a86d209-8946-4a5b-9554-33d8423483f9'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'ctest-vn1-32859705'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '176.91.153.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-05-14 04:17:11,739 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '3d476fa9-9a8c-435c-bb96-22109bc14c42', 'name': 'ctest-vn2-19885192', 'tenant_id': 'af1de36ff6d348b291085652e93068c9', 'project_id': 'af1de36ff6d348b291085652e93068c9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['14178125-eed6-4f5d-a56b-73806b66b4ca'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'ctest-vn2-19885192'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '48.169.28.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-05-14 04:17:11,842 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:11,858 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:11,882 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:11,992 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:12,018 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:12,045 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:12,064 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:12,076 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:17:12,085 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:12,085 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:12,100 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:12,130 - INFO - Verified VN network id 18 for VN 5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:12,130 - INFO - Verifications in API Server for VN ctest-vn1-32859705 passed 2026-05-14 04:17:12,130 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:12,145 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:12,156 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:12,173 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:17:12,189 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.789089'} 2026-05-14 04:17:12,196 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:12,203 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.800734'} 2026-05-14 04:17:12,211 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:12,218 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.812844'} 2026-05-14 04:17:12,227 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:12,227 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-32859705 passed 2026-05-14 04:17:12,227 - DEBUG - ====Verifying policy data for ctest-vn1-32859705 in API_Server ====== 2026-05-14 04:17:12,227 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:12,238 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:12,258 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:12,363 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:12,377 - DEBUG - ==>Verifying data for policy with id: a826cf83-bb0a-44a6-b602-425617b78f6f, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'policy1'] 2026-05-14 04:17:12,377 - INFO - VN ctest-vn1-32859705 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-14 04:17:12,377 - DEBUG - Verifying the vn in opserver 2026-05-14 04:17:12,377 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.27 2026-05-14 04:17:12,377 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:17:12,395 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:17:12,395 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.22 2026-05-14 04:17:12,395 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:17:12,414 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:17:12,414 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.23 2026-05-14 04:17:12,414 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:17:12,430 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:17:12,431 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is found in opserver 2026-05-14 04:17:12,446 - DEBUG - VRF ids for VN ctest-vn1-32859705: {'10.0.0.240': '4'} 2026-05-14 04:17:12,446 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:12,454 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:12,470 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:12,568 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:12,586 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:12,600 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:12,611 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:12,622 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/bb51ec8f-1f64-4a2f-b0b3-956e077669fc 2026-05-14 04:17:12,639 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:12,639 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:12,651 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:12,677 - INFO - Verified VN network id 19 for VN 3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:12,678 - INFO - Verifications in API Server for VN ctest-vn2-19885192 passed 2026-05-14 04:17:12,678 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:12,692 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:12,703 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:12,714 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/bb51ec8f-1f64-4a2f-b0b3-956e077669fc 2026-05-14 04:17:12,729 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.052485'} 2026-05-14 04:17:12,736 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:12,742 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.054656'} 2026-05-14 04:17:12,751 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:12,758 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.070221'} 2026-05-14 04:17:12,767 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:12,768 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-19885192 passed 2026-05-14 04:17:12,768 - DEBUG - ====Verifying policy data for ctest-vn2-19885192 in API_Server ====== 2026-05-14 04:17:12,768 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:12,776 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:12,792 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:12,913 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:12,926 - DEBUG - ==>Verifying data for policy with id: a826cf83-bb0a-44a6-b602-425617b78f6f, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'policy1'] 2026-05-14 04:17:12,926 - INFO - VN ctest-vn2-19885192 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-14 04:17:12,926 - DEBUG - Verifying the vn in opserver 2026-05-14 04:17:12,926 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.27 2026-05-14 04:17:12,926 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:17:12,948 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:17:12,948 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.22 2026-05-14 04:17:12,948 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:17:12,965 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:17:12,965 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.23 2026-05-14 04:17:12,965 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:17:12,986 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:17:12,987 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 is found in opserver 2026-05-14 04:17:13,004 - DEBUG - VRF ids for VN ctest-vn2-19885192: {'10.0.0.240': '5', '10.0.0.65': '4'} 2026-05-14 04:17:13,005 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:13,015 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:13,038 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:13,156 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:13,173 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:13,186 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:13,199 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:13,212 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:17:13,224 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:13,224 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:13,243 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:13,267 - INFO - Verified VN network id 18 for VN 5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:13,267 - INFO - Verifications in API Server for VN ctest-vn1-32859705 passed 2026-05-14 04:17:13,267 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:13,280 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:13,292 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:17:13,303 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/fa139741-7433-4a95-ae63-addd6bef8d10 2026-05-14 04:17:13,320 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.918176'} 2026-05-14 04:17:13,328 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:13,334 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.931981'} 2026-05-14 04:17:13,341 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:13,348 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6132163173426807057', 'uuid-lslong': '11988487644339624834'}, 'enable': 'true', 'created': '2026-05-14T04:15:29', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.942177'} 2026-05-14 04:17:13,356 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-14 04:17:13,357 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-32859705 passed 2026-05-14 04:17:13,357 - DEBUG - ====Verifying policy data for ctest-vn1-32859705 in API_Server ====== 2026-05-14 04:17:13,357 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:13,365 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:13,380 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:13,493 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5519d1ea-a8d6-4111-a65f-a9feab05db82 2026-05-14 04:17:13,507 - DEBUG - ==>Verifying data for policy with id: a826cf83-bb0a-44a6-b602-425617b78f6f, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'policy1'] 2026-05-14 04:17:13,507 - INFO - VN ctest-vn1-32859705 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-14 04:17:13,507 - DEBUG - Verifying the vn in opserver 2026-05-14 04:17:13,507 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.27 2026-05-14 04:17:13,507 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:17:13,526 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:17:13,526 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.22 2026-05-14 04:17:13,526 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:17:13,542 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:17:13,542 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 virtual network link through opserver 10.0.0.23 2026-05-14 04:17:13,542 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:17:13,559 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705?flat'} 2026-05-14 04:17:13,559 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 is found in opserver 2026-05-14 04:17:13,576 - DEBUG - VRF ids for VN ctest-vn1-32859705: {'10.0.0.240': '4'} 2026-05-14 04:17:13,576 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:13,584 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:13,608 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:13,730 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:13,745 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:13,760 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:13,772 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:13,784 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/bb51ec8f-1f64-4a2f-b0b3-956e077669fc 2026-05-14 04:17:13,798 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:13,798 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:13,819 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:13,841 - INFO - Verified VN network id 19 for VN 3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:13,841 - INFO - Verifications in API Server for VN ctest-vn2-19885192 passed 2026-05-14 04:17:13,842 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:13,855 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:13,865 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:17:13,876 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/bb51ec8f-1f64-4a2f-b0b3-956e077669fc 2026-05-14 04:17:13,894 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.217401'} 2026-05-14 04:17:13,902 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:13,911 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.222574'} 2026-05-14 04:17:13,919 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:13,928 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4415620733893100380', 'uuid-lslong': '13517028786327080002'}, 'enable': 'true', 'created': '2026-05-14T04:16:12', 'last-modified': '2026-05-14T04:17:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.239978'} 2026-05-14 04:17:13,939 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-14 04:17:13,940 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-19885192 passed 2026-05-14 04:17:13,940 - DEBUG - ====Verifying policy data for ctest-vn2-19885192 in API_Server ====== 2026-05-14 04:17:13,940 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:13,948 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:13,963 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:14,084 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3d476fa9-9a8c-435c-bb96-22109bc14c42 2026-05-14 04:17:14,097 - DEBUG - ==>Verifying data for policy with id: a826cf83-bb0a-44a6-b602-425617b78f6f, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-31705655', 'policy1'] 2026-05-14 04:17:14,097 - INFO - VN ctest-vn2-19885192 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-14 04:17:14,097 - DEBUG - Verifying the vn in opserver 2026-05-14 04:17:14,098 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.27 2026-05-14 04:17:14,098 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:17:14,114 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:17:14,115 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.22 2026-05-14 04:17:14,115 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:17:14,132 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:17:14,132 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 virtual network link through opserver 10.0.0.23 2026-05-14 04:17:14,132 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:17:14,156 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192?flat'} 2026-05-14 04:17:14,156 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 is found in opserver 2026-05-14 04:17:14,170 - DEBUG - VRF ids for VN ctest-vn2-19885192: {'10.0.0.240': '5', '10.0.0.65': '4'} 2026-05-14 04:17:14,170 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:14,178 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:14,194 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:14,305 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:17:14,333 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:17:14,349 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:17:14,359 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:17:14,370 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f41095ea-2768-42b8-a0f5-de141e8f76b7 2026-05-14 04:17:14,381 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:17:14,381 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:17:14,394 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:17:14,424 - INFO - Verified VN network id 20 for VN e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:17:14,424 - INFO - Verifications in API Server for VN ctest-fip_vn-16321132 passed 2026-05-14 04:17:14,424 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:17:14,436 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:17:14,446 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:17:14,456 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f41095ea-2768-42b8-a0f5-de141e8f76b7 2026-05-14 04:17:14,471 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16379656362646325471', 'uuid-lslong': '11698285186436492955'}, 'enable': 'true', 'created': '2026-05-14T04:16:13', 'last-modified': '2026-05-14T04:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:00.938472'} 2026-05-14 04:17:14,478 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:17:14,485 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16379656362646325471', 'uuid-lslong': '11698285186436492955'}, 'enable': 'true', 'created': '2026-05-14T04:16:13', 'last-modified': '2026-05-14T04:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:00.955222'} 2026-05-14 04:17:14,492 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:17:14,499 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-31705655', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16379656362646325471', 'uuid-lslong': '11698285186436492955'}, 'enable': 'true', 'created': '2026-05-14T04:16:13', 'last-modified': '2026-05-14T04:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:00.970767'} 2026-05-14 04:17:14,509 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-14 04:17:14,509 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-16321132 passed 2026-05-14 04:17:14,509 - DEBUG - ====Verifying policy data for ctest-fip_vn-16321132 in API_Server ====== 2026-05-14 04:17:14,509 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:17:14,516 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:17:14,535 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:17:14,642 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/e3503aad-be80-48df-a258-a8659ac2ee9b 2026-05-14 04:17:14,656 - DEBUG - =>VN ctest-fip_vn-16321132 has no policy to be verified 2026-05-14 04:17:14,656 - DEBUG - Verifying the vn in opserver 2026-05-14 04:17:14,656 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 virtual network link through opserver 10.0.0.27 2026-05-14 04:17:14,656 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-05-14 04:17:14,673 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132?flat'} 2026-05-14 04:17:14,673 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 virtual network link through opserver 10.0.0.22 2026-05-14 04:17:14,673 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-14 04:17:14,691 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132?flat'} 2026-05-14 04:17:14,691 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 virtual network link through opserver 10.0.0.23 2026-05-14 04:17:14,691 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-14 04:17:14,708 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132?flat'} 2026-05-14 04:17:14,708 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 is found in opserver 2026-05-14 04:17:14,722 - DEBUG - VRF ids for VN ctest-fip_vn-16321132: {'10.0.0.65': '5'} 2026-05-14 04:17:14,722 - INFO - start time= 1778732234722670 2026-05-14 04:17:14,722 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 48.169.28.131, host_string: cirros@169.254.0.5, password: gocubsgogateway: ubuntu@10.0.0.240, gateway password: c0ntrail123 2026-05-14 04:17:14,722 - DEBUG - ping -s 56 -c 3 -W 1 48.169.28.131 2026-05-14 04:17:18,750 - DEBUG - PING 48.169.28.131 (48.169.28.131): 56 data bytes 64 bytes from 48.169.28.131: seq=0 ttl=63 time=6.367 ms 64 bytes from 48.169.28.131: seq=1 ttl=63 time=3.199 ms 64 bytes from 48.169.28.131: seq=2 ttl=63 time=1.598 ms --- 48.169.28.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.598/3.721/6.367 ms 2026-05-14 04:17:18,750 - INFO - Ping to IP 48.169.28.131 from VM ctest-vn1_vm1-27269995 passed 2026-05-14 04:17:28,751 - INFO - Verify session samples and teardown pkts 2026-05-14 04:17:28,751 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.27 2026-05-14 04:17:28,755 - DEBUG - Posting: http://10.0.0.27:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1778732234722670, 'end_time': 1778732248755202, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-05-14 04:17:29,778 - DEBUG - [{'T': 1778732237195600}, {'T': 1778732238195667}, {'T': 1778732239195803}] 2026-05-14 04:17:29,779 - DEBUG - Posting: http://10.0.0.27:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1778732234722670, 'end_time': 1778732249778965, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2026-05-14 04:17:30,804 - DEBUG - [{'T': 1778732236812062}, {'T': 1778732237812144}, {'T': 1778732238812246}] 2026-05-14 04:17:30,804 - DEBUG - Posting: http://10.0.0.27:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1778732234722670, 'end_time': 1778732250804902, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-05-14 04:17:31,836 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', 'sample_count': 3}] 2026-05-14 04:17:31,837 - INFO - wait for the flows to get expire 2026-05-14 04:20:51,837 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5780-1:Compute:contrail-vrouter-agent:0?flat 2026-05-14 04:20:51,941 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5780-1?flat 2026-05-14 04:20:52,638 - INFO - Deleted policy policy1 2026-05-14 04:20:52,767 - INFO - Setting flow export rate: None 2026-05-14 04:20:54,094 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Thu May 14 04:20:51 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=) 1281 src_vn = self.res.vn1_fixture.vn_fq_name 1282 dst_vn = self.res.vn2_fixture.vn_fq_name 1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) 1284 1285 assert result,'Failed to get expected number of samples' result = True self = self.verify_session_sampling_teardown = > start_time = '1778732234722670' src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705' dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192' /contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1778732234722670', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192') 486 flow_record = self.analytics_obj.get_flows_vrouter_uve( 487 vrouter=vm_host) 488 assert not flow_record,'flows not got deleted even after 240 sec' 489 490 res = self.analytics_obj.ops_inspect[ip].post_query( flow_record = 8 AssertionError: flows not got deleted even after 240 sec __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('flows not got deleted even after 240 sec',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown assert not flow_record,'flows not got deleted even after 240 sec' AssertionError: flows not got deleted even after 240 sec 2026-05-14 04:20:54,094 - DEBUG - Skipping xmpp flap check 2026-05-14 04:20:54,094 - INFO - 2026-05-14 04:20:54,095 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:45] 2026-05-14 04:20:54,095 - INFO - -------------------------------------------------------------------------------- 2026-05-14 04:20:54,097 - INFO - Deleting VM mltf_vm 2026-05-14 04:20:54,189 - INFO - Deleting VM ctest-fvn_vm1-32285395 2026-05-14 04:20:54,351 - INFO - Deleting VM ctest-vn2_vm2-28768032 2026-05-14 04:20:54,450 - INFO - Deleting VN ctest-fip_vn-16321132 2026-05-14 04:20:54,508 - DEBUG - VN e3503aad-be80-48df-a258-a8659ac2ee9b still in use: Unable to complete operation on network e3503aad-be80-48df-a258-a8659ac2ee9b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-03caf8e0-e7fa-4392-a712-3db473dfcfba'] 2026-05-14 04:20:54,508 - WARNING - Deleting VN ctest-fip_vn-16321132 failed..Will retry 2026-05-14 04:20:56,709 - DEBUG - Response for deleting network () 2026-05-14 04:20:56,709 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3bf6d0e3-d205-47a1-8e13-b7ebf7a9f5c7 2026-05-14 04:20:56,777 - DEBUG - Response Code: 404 2026-05-14 04:20:56,777 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:20:56,786 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:20:56,806 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:20:56,915 - INFO - Validated that VN ctest-fip_vn-16321132 is not found in API Server 2026-05-14 04:20:56,928 - DEBUG - VN ctest-fip_vn-16321132 is not present in Agent 10.0.0.240 2026-05-14 04:20:56,942 - DEBUG - VN ctest-fip_vn-16321132 is not present in Agent 10.0.0.65 2026-05-14 04:20:56,942 - INFO - Validated that VN ctest-fip_vn-16321132 is not in any agent 2026-05-14 04:20:56,951 - DEBUG - VRF 5 is not seen in agent 10.0.0.65 2026-05-14 04:20:56,958 - DEBUG - Vrouter 10.0.0.65 does not have vrf 5 for VN ctest-fip_vn-16321132 2026-05-14 04:20:56,958 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-fip_vn-16321132 2026-05-14 04:20:56,986 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-16321132 info 2026-05-14 04:20:56,986 - INFO - Deleting VN ctest-vn2-19885192 2026-05-14 04:20:57,251 - DEBUG - Response for deleting network () 2026-05-14 04:20:57,251 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bfef3e24-dbe7-405b-acc7-cc45eabb9b32 2026-05-14 04:20:57,258 - DEBUG - Response Code: 404 2026-05-14 04:20:57,258 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:20:57,273 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:20:57,329 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:20:57,438 - INFO - Validated that VN ctest-vn2-19885192 is not found in API Server 2026-05-14 04:20:57,454 - DEBUG - VN ctest-vn2-19885192 is not present in Agent 10.0.0.240 2026-05-14 04:20:57,470 - DEBUG - VN ctest-vn2-19885192 is not present in Agent 10.0.0.65 2026-05-14 04:20:57,470 - INFO - Validated that VN ctest-vn2-19885192 is not in any agent 2026-05-14 04:20:57,478 - DEBUG - VRF 5 is not seen in agent 10.0.0.240 2026-05-14 04:20:57,484 - DEBUG - Vrouter 10.0.0.240 does not have vrf 5 for VN ctest-vn2-19885192 2026-05-14 04:20:57,493 - DEBUG - VRF 4 is not seen in agent 10.0.0.65 2026-05-14 04:20:57,509 - DEBUG - Vrouter 10.0.0.65 does not have vrf 4 for VN ctest-vn2-19885192 2026-05-14 04:20:57,509 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn2-19885192 2026-05-14 04:20:57,542 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-19885192 info 2026-05-14 04:20:57,542 - INFO - Deleting VM ctest-vn1_vm2-34911239 2026-05-14 04:20:57,639 - INFO - Deleting VM ctest-vn1_vm1-27269995 2026-05-14 04:20:57,746 - INFO - Deleting VN ctest-vn1-32859705 2026-05-14 04:20:57,803 - DEBUG - VN 5519d1ea-a8d6-4111-a65f-a9feab05db82 still in use: Unable to complete operation on network 5519d1ea-a8d6-4111-a65f-a9feab05db82. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6f08d202-a3da-4591-b2bc-025190419cbf'] 2026-05-14 04:20:57,803 - WARNING - Deleting VN ctest-vn1-32859705 failed..Will retry 2026-05-14 04:21:00,077 - DEBUG - Response for deleting network () 2026-05-14 04:21:00,077 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/e83caa0d-1280-41f5-8045-ddb2bf09993c 2026-05-14 04:21:00,085 - DEBUG - Response Code: 404 2026-05-14 04:21:00,085 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2026-05-14 04:21:00,095 - DEBUG - Requesting: http://10.0.0.27:8082/domain/50f581a9-730f-4c54-9cc2-74fc8369ab40 2026-05-14 04:21:00,111 - DEBUG - Requesting: http://10.0.0.27:8082/project/af1de36f-f6d3-48b2-9108-5652e93068c9 2026-05-14 04:21:00,243 - INFO - Validated that VN ctest-vn1-32859705 is not found in API Server 2026-05-14 04:21:00,255 - DEBUG - VN ctest-vn1-32859705 is not present in Agent 10.0.0.240 2026-05-14 04:21:00,267 - DEBUG - VN ctest-vn1-32859705 is not present in Agent 10.0.0.65 2026-05-14 04:21:00,267 - INFO - Validated that VN ctest-vn1-32859705 is not in any agent 2026-05-14 04:21:00,273 - DEBUG - VRF 4 is not seen in agent 10.0.0.240 2026-05-14 04:21:00,281 - DEBUG - Vrouter 10.0.0.240 does not have vrf 4 for VN ctest-vn1-32859705 2026-05-14 04:21:00,281 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-31705655:ctest-vn1-32859705 2026-05-14 04:21:00,313 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-32859705 info 2026-05-14 04:21:01,440 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-31705655, ID : af1de36f-f6d3-48b2-9108-5652e93068c9