2026-05-18 03:59:38,771 - INFO - Domain Default found not creating 2026-05-18 03:59:38,961 - INFO - Project ctest-AnalyticsTestSanityWithResource-57451062 not found, creating it 2026-05-18 03:59:39,605 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-57451062, ID : 4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 03:59:41,957 - DEBUG - Response for create_network : {'network': {'id': '98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04', 'name': 'ctest-vn1-01804707', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn1-01804707'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:59:42,233 - DEBUG - Response for create_subnet : {'subnet': {'id': '19d0d62b-c420-470f-828e-2fbb078e65cd', 'name': '', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'network_id': '98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04', 'ip_version': 4, 'cidr': '159.23.80.128/26', 'allocation_pools': [{'start': '159.23.80.130', 'end': '159.23.80.190'}], 'gateway_ip': '159.23.80.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '159.23.80.130', 'tags': [], 'project_id': '4a9a18dd7ed94924b47a038603332339'}} 2026-05-18 03:59:42,258 - INFO - Created VN ctest-vn1-01804707 2026-05-18 03:59:42,272 - DEBUG - VN ctest-vn1-01804707 UUID is 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:42,380 - DEBUG - Services list from nova: [, , , ] 2026-05-18 03:59:42,380 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5792-2', 'an-jenkins-deploy-platform-ansible-os-5792-1']} 2026-05-18 03:59:43,694 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 03:59:45,172 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 03:59:45,173 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:59:45,523 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:59:45,611 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:59:45,628 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 03:59:45,766 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:45,804 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:45,820 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 03:59:45,833 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 03:59:45,849 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 03:59:45,858 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:59:45,859 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:45,871 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 03:59:45,894 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:45,895 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed 2026-05-18 03:59:45,896 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:45,907 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 03:59:45,922 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 03:59:45,931 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 03:59:45,957 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.778092'} 2026-05-18 03:59:45,967 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:59:45,976 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.798549'} 2026-05-18 03:59:45,986 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:59:46,006 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.824256'} 2026-05-18 03:59:46,042 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:59:46,043 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed 2026-05-18 03:59:46,044 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ====== 2026-05-18 03:59:46,044 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:59:46,060 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:59:46,079 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 03:59:46,187 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 03:59:46,202 - DEBUG - =>VN ctest-vn1-01804707 has no policy to be verified 2026-05-18 03:59:46,202 - DEBUG - Verifying the vn in opserver 2026-05-18 03:59:46,202 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23 2026-05-18 03:59:46,203 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:59:46,520 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:59:46,603 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 03:59:46,603 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22 2026-05-18 03:59:46,603 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:59:46,918 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:59:46,992 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 03:59:46,992 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240 2026-05-18 03:59:46,993 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:59:47,304 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:59:47,379 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 03:59:47,379 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver 2026-05-18 03:59:47,393 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'} 2026-05-18 03:59:47,393 - INFO - Waiting for VM ctest-vn1_vm1-91150996 to be up.. 2026-05-18 03:59:47,506 - DEBUG - VM is in ACTIVE state now 2026-05-18 03:59:47,506 - INFO - VM name : ctest-vn1_vm1-91150996 2026-05-18 03:59:47,603 - DEBUG - VM ctest-vn1_vm1-91150996 ID is 3567de70-848a-451d-bc8a-76fbedf9e068 2026-05-18 03:59:47,631 - DEBUG - VM ctest-vn1_vm1-91150996 launched on Node an-jenkins-deploy-platform-ansible-os-5792-2 2026-05-18 03:59:47,735 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3567de70-848a-451d-bc8a-76fbedf9e068 2026-05-18 03:59:48,059 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3567de70-848a-451d-bc8a-76fbedf9e068 2026-05-18 03:59:48,102 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/576f7ac2-6783-4e62-b7f1-03910134a482 2026-05-18 03:59:51,300 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2026-05-18 03:59:51,301 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed! 2026-05-18 03:59:51,317 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set 2026-05-18 03:59:55,422 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms') 2026-05-18 03:59:55,422 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed! 2026-05-18 03:59:55,440 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set 2026-05-18 03:59:59,513 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-05-18 03:59:59,513 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed! 2026-05-18 03:59:59,530 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set 2026-05-18 04:00:03,612 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2026-05-18 04:00:03,612 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed! 2026-05-18 04:00:03,629 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set 2026-05-18 04:00:07,710 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-05-18 04:00:07,710 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed! 2026-05-18 04:00:07,731 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set 2026-05-18 04:00:09,801 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=10.4 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.08 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.080/6.238/10.396/4.158 ms') 2026-05-18 04:00:09,801 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 passed 2026-05-18 04:00:09,873 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:00:09,874 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-91150996, IP 159.23.80.131, Port 22 2026-05-18 04:00:09,944 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 04:00:10,049 - DEBUG - VM ctest-vn1_vm1-91150996 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 04:00:15,050 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:00:15,050 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-91150996, IP 159.23.80.131, Port 22 2026-05-18 04:00:15,231 - DEBUG - VM ctest-vn1_vm1-91150996 is ready for SSH connections 2026-05-18 04:00:15,231 - INFO - Waiting for VM ctest-vn1_vm2-97415784 to be up.. 2026-05-18 04:00:15,324 - DEBUG - VM is in ACTIVE state now 2026-05-18 04:00:15,324 - INFO - VM name : ctest-vn1_vm2-97415784 2026-05-18 04:00:15,458 - DEBUG - VM ctest-vn1_vm2-97415784 ID is 3a5fb02c-0e92-4ea4-9ffa-dd7509491ea8 2026-05-18 04:00:15,458 - DEBUG - VM ctest-vn1_vm2-97415784 launched on Node an-jenkins-deploy-platform-ansible-os-5792-2 2026-05-18 04:00:15,559 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3a5fb02c-0e92-4ea4-9ffa-dd7509491ea8 2026-05-18 04:00:15,572 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/b3589f57-9f8e-4c7a-bdf3-0ed055675cc5 2026-05-18 04:00:16,754 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=4.67 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=3.13 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.129/3.900/4.672/0.771 ms') 2026-05-18 04:00:16,754 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm2-97415784 passed 2026-05-18 04:00:16,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:00:16,825 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-97415784, IP 159.23.80.132, Port 22 2026-05-18 04:00:16,896 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 04:00:16,993 - DEBUG - VM ctest-vn1_vm2-97415784 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 04:00:21,995 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:00:21,995 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-97415784, IP 159.23.80.132, Port 22 2026-05-18 04:00:22,179 - DEBUG - VM ctest-vn1_vm2-97415784 is ready for SSH connections 2026-05-18 04:00:22,483 - DEBUG - Response for create_network : {'network': {'id': '0302ac13-07a8-450f-bafc-4e908ae23124', 'name': 'ctest-vn2-14236620', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn2-14236620'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 04:00:22,757 - DEBUG - Response for create_subnet : {'subnet': {'id': '7b8232db-6402-48ef-8ef8-6f8291abb72e', 'name': '', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'network_id': '0302ac13-07a8-450f-bafc-4e908ae23124', 'ip_version': 4, 'cidr': '122.48.136.0/26', 'allocation_pools': [{'start': '122.48.136.2', 'end': '122.48.136.62'}], 'gateway_ip': '122.48.136.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '122.48.136.2', 'tags': [], 'project_id': '4a9a18dd7ed94924b47a038603332339'}} 2026-05-18 04:00:22,782 - INFO - Created VN ctest-vn2-14236620 2026-05-18 04:00:22,802 - DEBUG - VN ctest-vn2-14236620 UUID is 0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:23,213 - DEBUG - Response for create_network : {'network': {'id': '5855c471-f288-40bb-aed4-65da270e0b3a', 'name': 'ctest-fip_vn-40013376', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-fip_vn-40013376'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 04:00:23,459 - DEBUG - Response for create_subnet : {'subnet': {'id': '44f5ab11-0aef-4db3-ab5d-abb35ff2cad4', 'name': '', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'network_id': '5855c471-f288-40bb-aed4-65da270e0b3a', 'ip_version': 4, 'cidr': '57.104.109.64/26', 'allocation_pools': [{'start': '57.104.109.66', 'end': '57.104.109.126'}], 'gateway_ip': '57.104.109.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '57.104.109.66', 'tags': [], 'project_id': '4a9a18dd7ed94924b47a038603332339'}} 2026-05-18 04:00:23,486 - INFO - Created VN ctest-fip_vn-40013376 2026-05-18 04:00:23,499 - DEBUG - VN ctest-fip_vn-40013376 UUID is 5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:23,582 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5792-2', 'an-jenkins-deploy-platform-ansible-os-5792-1']} 2026-05-18 04:00:24,990 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1) 2026-05-18 04:00:26,644 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1) 2026-05-18 04:00:28,355 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 04:00:28,355 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:00:28,363 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:00:28,377 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:00:28,478 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:00:28,492 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:00:28,508 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:00:28,522 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:00:28,532 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 04:00:28,541 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:00:28,541 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:00:28,556 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:00:28,578 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:00:28,579 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed 2026-05-18 04:00:28,579 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:00:28,592 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:00:28,601 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:00:28,610 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 04:00:28,629 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.452076'} 2026-05-18 04:00:28,639 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:00:28,644 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.468158'} 2026-05-18 04:00:28,651 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:00:28,660 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.487120'} 2026-05-18 04:00:28,670 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:00:28,670 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed 2026-05-18 04:00:28,670 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ====== 2026-05-18 04:00:28,670 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:00:28,677 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:00:28,693 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:00:28,804 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:00:28,815 - DEBUG - =>VN ctest-vn1-01804707 has no policy to be verified 2026-05-18 04:00:28,815 - DEBUG - Verifying the vn in opserver 2026-05-18 04:00:28,816 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23 2026-05-18 04:00:28,816 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:00:28,964 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:00:28,964 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22 2026-05-18 04:00:28,964 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:00:29,081 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:00:29,081 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240 2026-05-18 04:00:29,081 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:00:29,206 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:00:29,206 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver 2026-05-18 04:00:29,232 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'} 2026-05-18 04:00:29,232 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:00:29,245 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:00:29,274 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:00:29,358 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:29,409 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:29,420 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:00:29,435 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:00:29,449 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387 2026-05-18 04:00:29,456 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:00:29,456 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:29,469 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:00:29,495 - INFO - Verified VN network id 15 for VN 0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:29,495 - INFO - Verifications in API Server for VN ctest-vn2-14236620 passed 2026-05-18 04:00:29,496 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:29,508 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:00:29,518 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:00:29,533 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387 2026-05-18 04:00:29,548 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:00:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.867282'} 2026-05-18 04:00:29,556 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:00:29,562 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:00:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.877456'} 2026-05-18 04:00:29,580 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:00:29,603 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:00:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.912718'} 2026-05-18 04:00:29,612 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:00:29,612 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14236620 passed 2026-05-18 04:00:29,612 - DEBUG - ====Verifying policy data for ctest-vn2-14236620 in API_Server ====== 2026-05-18 04:00:29,612 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:00:29,620 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:00:29,643 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:00:29,811 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:00:29,831 - DEBUG - =>VN ctest-vn2-14236620 has no policy to be verified 2026-05-18 04:00:29,831 - DEBUG - Verifying the vn in opserver 2026-05-18 04:00:29,832 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.23 2026-05-18 04:00:29,832 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:00:29,848 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:00:29,848 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.22 2026-05-18 04:00:29,848 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:00:29,865 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:00:29,865 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.240 2026-05-18 04:00:29,865 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:00:29,950 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:00:29,950 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 is found in opserver 2026-05-18 04:00:29,966 - DEBUG - VRF ids for VN ctest-vn2-14236620: {'10.0.0.65': '4'} 2026-05-18 04:00:29,966 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:00:29,973 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:00:30,012 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:00:30,141 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:30,173 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:30,201 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:00:30,213 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:00:30,221 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8 2026-05-18 04:00:30,229 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:00:30,229 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:30,239 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:00:30,268 - INFO - Verified VN network id 16 for VN 5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:30,268 - INFO - Verifications in API Server for VN ctest-fip_vn-40013376 passed 2026-05-18 04:00:30,268 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:30,280 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:00:30,289 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:00:30,297 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8 2026-05-18 04:00:30,312 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.916607'} 2026-05-18 04:00:30,323 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:00:30,335 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.941062'} 2026-05-18 04:00:30,343 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:00:30,360 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.956765'} 2026-05-18 04:00:30,368 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:00:30,368 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-40013376 passed 2026-05-18 04:00:30,368 - DEBUG - ====Verifying policy data for ctest-fip_vn-40013376 in API_Server ====== 2026-05-18 04:00:30,368 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:00:30,380 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:00:30,405 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:00:30,546 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:00:30,560 - DEBUG - =>VN ctest-fip_vn-40013376 has no policy to be verified 2026-05-18 04:00:30,560 - DEBUG - Verifying the vn in opserver 2026-05-18 04:00:30,560 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.23 2026-05-18 04:00:30,560 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:00:30,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'} 2026-05-18 04:00:30,648 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.22 2026-05-18 04:00:30,648 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:00:30,732 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'} 2026-05-18 04:00:30,732 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.240 2026-05-18 04:00:30,732 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:00:30,746 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'} 2026-05-18 04:00:30,747 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is found in opserver 2026-05-18 04:00:30,758 - DEBUG - VRF ids for VN ctest-fip_vn-40013376: {'10.0.0.65': '5'} 2026-05-18 04:00:30,758 - INFO - Waiting for VM ctest-fvn_vm1-79303953 to be up.. 2026-05-18 04:00:30,881 - DEBUG - VM is in ACTIVE state now 2026-05-18 04:00:30,882 - INFO - VM name : ctest-fvn_vm1-79303953 2026-05-18 04:00:30,968 - DEBUG - VM ctest-fvn_vm1-79303953 ID is 2a8899ef-e6d3-442f-a7e1-561ada58cd79 2026-05-18 04:00:30,968 - DEBUG - VM ctest-fvn_vm1-79303953 launched on Node an-jenkins-deploy-platform-ansible-os-5792-1 2026-05-18 04:00:31,076 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/2a8899ef-e6d3-442f-a7e1-561ada58cd79 2026-05-18 04:00:31,087 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/ab316877-b226-48a3-b057-93c8216366e7 2026-05-18 04:00:34,315 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-18 04:00:34,315 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed! 2026-05-18 04:00:34,330 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set 2026-05-18 04:00:38,406 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-05-18 04:00:38,407 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed! 2026-05-18 04:00:38,427 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set 2026-05-18 04:00:42,511 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-18 04:00:42,512 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed! 2026-05-18 04:00:42,529 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set 2026-05-18 04:00:46,605 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-05-18 04:00:46,605 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed! 2026-05-18 04:00:46,624 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set 2026-05-18 04:00:50,697 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-05-18 04:00:50,697 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed! 2026-05-18 04:00:50,715 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set 2026-05-18 04:00:54,790 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2026-05-18 04:00:54,790 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed! 2026-05-18 04:00:54,806 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set 2026-05-18 04:00:56,880 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=11.9 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=6.25 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 6.254/9.098/11.943/2.844 ms') 2026-05-18 04:00:56,880 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 passed 2026-05-18 04:00:56,955 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:00:56,955 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22 2026-05-18 04:00:57,023 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 04:00:57,140 - DEBUG - VM ctest-fvn_vm1-79303953 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 04:01:02,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:01:02,141 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22 2026-05-18 04:01:02,218 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 04:01:02,328 - DEBUG - VM ctest-fvn_vm1-79303953 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 04:01:07,329 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:01:07,329 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22 2026-05-18 04:01:07,399 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 04:01:07,539 - DEBUG - VM ctest-fvn_vm1-79303953 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 04:01:12,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:01:12,540 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22 2026-05-18 04:01:12,715 - DEBUG - VM ctest-fvn_vm1-79303953 is ready for SSH connections 2026-05-18 04:01:12,715 - INFO - Waiting for VM ctest-vn2_vm2-54828921 to be up.. 2026-05-18 04:01:12,817 - DEBUG - VM is in ACTIVE state now 2026-05-18 04:01:12,817 - INFO - VM name : ctest-vn2_vm2-54828921 2026-05-18 04:01:12,917 - DEBUG - VM ctest-vn2_vm2-54828921 ID is 19847682-84fa-40b6-a2c3-e916140212d2 2026-05-18 04:01:12,917 - DEBUG - VM ctest-vn2_vm2-54828921 launched on Node an-jenkins-deploy-platform-ansible-os-5792-1 2026-05-18 04:01:13,024 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/19847682-84fa-40b6-a2c3-e916140212d2 2026-05-18 04:01:13,036 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9984e053-947c-49e8-9225-588805e03733 2026-05-18 04:01:14,212 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.32 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.555 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.555/1.439/2.323/0.884 ms') 2026-05-18 04:01:14,212 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn2_vm2-54828921 passed 2026-05-18 04:01:14,285 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:01:14,285 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-54828921, IP 122.48.136.3, Port 22 2026-05-18 04:01:14,456 - DEBUG - VM ctest-vn2_vm2-54828921 is ready for SSH connections 2026-05-18 04:01:14,456 - INFO - Waiting for VM mltf_vm to be up.. 2026-05-18 04:01:14,575 - DEBUG - VM is in ACTIVE state now 2026-05-18 04:01:14,575 - INFO - VM name : mltf_vm 2026-05-18 04:01:14,688 - DEBUG - VM mltf_vm ID is d7716c32-bd00-4c00-aa68-915ff5f46beb 2026-05-18 04:01:14,689 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5792-2 2026-05-18 04:01:14,913 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/d7716c32-bd00-4c00-aa68-915ff5f46beb 2026-05-18 04:01:14,930 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/187b2d67-14b6-428b-96ba-52822418f64f 2026-05-18 04:01:14,944 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/3675d538-69a1-4ab9-a923-abb17a8effe1 2026-05-18 04:01:16,155 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=3.34 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.809 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.809/2.073/3.338/1.264 ms') 2026-05-18 04:01:16,155 - INFO - Ping to Metadata IP 169.254.0.7 of VM mltf_vm passed 2026-05-18 04:01:16,230 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:01:16,231 - DEBUG - Waiting to SSH to VM mltf_vm, IP 159.23.80.133, Port 22 2026-05-18 04:01:16,404 - DEBUG - VM mltf_vm is ready for SSH connections 2026-05-18 04:01:16,481 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 04:01:16,481 - DEBUG - Waiting to SSH to VM mltf_vm, IP 159.23.80.133, Port 22 2026-05-18 04:01:16,638 - DEBUG - VM mltf_vm is ready for SSH connections 2026-05-18 04:01:16,641 - INFO - ================================================================================ 2026-05-18 04:01:16,642 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2026-05-18 04:01:16,642 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2026-05-18 04:01:17,934 - DEBUG - Skipping xmpp flap check 2026-05-18 04:01:17,934 - INFO - Initial checks done. Running the testcase now 2026-05-18 04:01:17,934 - INFO - 2026-05-18 04:01:18,072 - INFO - Setting flow export rate: 100 2026-05-18 04:01:18,120 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-05-18 04:01:18,468 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04', 'name': 'ctest-vn1-01804707', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['19d0d62b-c420-470f-828e-2fbb078e65cd'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn1-01804707'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '159.23.80.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-05-18 04:01:18,689 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '0302ac13-07a8-450f-bafc-4e908ae23124', 'name': 'ctest-vn2-14236620', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['7b8232db-6402-48ef-8ef8-6f8291abb72e'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn2-14236620'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '122.48.136.0/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2026-05-18 04:01:18,781 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:18,789 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:18,802 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:18,943 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:18,969 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:18,981 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:18,991 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:19,028 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 04:01:19,049 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:19,050 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:19,072 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:19,112 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:19,113 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed 2026-05-18 04:01:19,113 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:19,127 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:19,139 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:19,149 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 04:01:19,167 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.726654'} 2026-05-18 04:01:19,177 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:19,190 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.758446'} 2026-05-18 04:01:19,199 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:19,206 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771026'} 2026-05-18 04:01:19,218 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:19,218 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed 2026-05-18 04:01:19,219 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ====== 2026-05-18 04:01:19,219 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:19,227 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:19,243 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:19,368 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:19,389 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1'] 2026-05-18 04:01:19,389 - INFO - VN ctest-vn1-01804707 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-18 04:01:19,389 - DEBUG - Verifying the vn in opserver 2026-05-18 04:01:19,389 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23 2026-05-18 04:01:19,389 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:01:19,408 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:01:19,408 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22 2026-05-18 04:01:19,408 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:01:19,424 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:01:19,424 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240 2026-05-18 04:01:19,424 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:01:19,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:01:19,439 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver 2026-05-18 04:01:19,452 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'} 2026-05-18 04:01:19,452 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:19,461 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:19,475 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:19,579 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:19,600 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:19,614 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:19,629 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:19,641 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387 2026-05-18 04:01:19,649 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:19,649 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:19,659 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:19,678 - INFO - Verified VN network id 15 for VN 0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:19,678 - INFO - Verifications in API Server for VN ctest-vn2-14236620 passed 2026-05-18 04:01:19,678 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:19,694 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:19,705 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:19,716 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387 2026-05-18 04:01:19,733 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.096217'} 2026-05-18 04:01:19,740 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:19,747 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.101919'} 2026-05-18 04:01:19,760 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:19,767 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.123239'} 2026-05-18 04:01:19,776 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:19,776 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14236620 passed 2026-05-18 04:01:19,776 - DEBUG - ====Verifying policy data for ctest-vn2-14236620 in API_Server ====== 2026-05-18 04:01:19,776 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:19,783 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:19,798 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:19,924 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:19,942 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1'] 2026-05-18 04:01:19,942 - INFO - VN ctest-vn2-14236620 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-18 04:01:19,943 - DEBUG - Verifying the vn in opserver 2026-05-18 04:01:19,943 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.23 2026-05-18 04:01:19,943 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:01:19,960 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:01:19,960 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.22 2026-05-18 04:01:19,960 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:01:19,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:01:19,976 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.240 2026-05-18 04:01:19,976 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:01:19,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:01:19,997 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 is found in opserver 2026-05-18 04:01:20,010 - DEBUG - VRF ids for VN ctest-vn2-14236620: {'10.0.0.65': '4', '10.0.0.130': '5'} 2026-05-18 04:01:20,010 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:20,017 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:20,032 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:20,144 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:20,161 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:20,172 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:20,182 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:20,192 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 04:01:20,200 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:20,200 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:20,219 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:20,243 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:20,243 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed 2026-05-18 04:01:20,243 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:20,258 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:20,269 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:01:20,283 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc 2026-05-18 04:01:20,305 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.859011'} 2026-05-18 04:01:20,316 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:20,324 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.892565'} 2026-05-18 04:01:20,333 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:20,341 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.905388'} 2026-05-18 04:01:20,351 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 04:01:20,351 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed 2026-05-18 04:01:20,351 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ====== 2026-05-18 04:01:20,351 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:20,358 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:20,373 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:20,489 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 2026-05-18 04:01:20,507 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1'] 2026-05-18 04:01:20,507 - INFO - VN ctest-vn1-01804707 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-18 04:01:20,508 - DEBUG - Verifying the vn in opserver 2026-05-18 04:01:20,508 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23 2026-05-18 04:01:20,508 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:01:20,523 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:01:20,523 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22 2026-05-18 04:01:20,523 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:01:20,541 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:01:20,541 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240 2026-05-18 04:01:20,541 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:01:20,558 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'} 2026-05-18 04:01:20,558 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver 2026-05-18 04:01:20,571 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'} 2026-05-18 04:01:20,571 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:20,580 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:20,599 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:20,708 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:20,721 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:20,735 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:20,745 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:20,763 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387 2026-05-18 04:01:20,774 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:20,774 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:20,788 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:20,810 - INFO - Verified VN network id 15 for VN 0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:20,811 - INFO - Verifications in API Server for VN ctest-vn2-14236620 passed 2026-05-18 04:01:20,811 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:20,826 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:20,836 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:01:20,847 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387 2026-05-18 04:01:20,867 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.229761'} 2026-05-18 04:01:20,875 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:20,884 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.238922'} 2026-05-18 04:01:20,893 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:20,901 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.256849'} 2026-05-18 04:01:20,912 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 04:01:20,912 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14236620 passed 2026-05-18 04:01:20,913 - DEBUG - ====Verifying policy data for ctest-vn2-14236620 in API_Server ====== 2026-05-18 04:01:20,913 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:20,922 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:20,937 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:21,042 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124 2026-05-18 04:01:21,059 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1'] 2026-05-18 04:01:21,059 - INFO - VN ctest-vn2-14236620 Policy verification: verify_vn_policy_in_api_server, status: True 2026-05-18 04:01:21,059 - DEBUG - Verifying the vn in opserver 2026-05-18 04:01:21,059 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.23 2026-05-18 04:01:21,059 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:01:21,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:01:21,076 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.22 2026-05-18 04:01:21,076 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:01:21,093 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:01:21,093 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.240 2026-05-18 04:01:21,093 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:01:21,110 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'} 2026-05-18 04:01:21,110 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 is found in opserver 2026-05-18 04:01:21,128 - DEBUG - VRF ids for VN ctest-vn2-14236620: {'10.0.0.65': '4', '10.0.0.130': '5'} 2026-05-18 04:01:21,128 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:21,139 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:21,154 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:21,256 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:01:21,266 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:01:21,278 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:01:21,288 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:01:21,299 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8 2026-05-18 04:01:21,308 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:01:21,308 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:01:21,319 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:01:21,340 - INFO - Verified VN network id 16 for VN 5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:01:21,341 - INFO - Verifications in API Server for VN ctest-fip_vn-40013376 passed 2026-05-18 04:01:21,341 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:01:21,354 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:01:21,363 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:01:21,372 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8 2026-05-18 04:01:21,388 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:57.993474'} 2026-05-18 04:01:21,398 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:01:21,405 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:58.010670'} 2026-05-18 04:01:21,411 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:01:21,418 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:58.024025'} 2026-05-18 04:01:21,425 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 04:01:21,425 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-40013376 passed 2026-05-18 04:01:21,425 - DEBUG - ====Verifying policy data for ctest-fip_vn-40013376 in API_Server ====== 2026-05-18 04:01:21,425 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:01:21,435 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:01:21,450 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:01:21,552 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a 2026-05-18 04:01:21,566 - DEBUG - =>VN ctest-fip_vn-40013376 has no policy to be verified 2026-05-18 04:01:21,566 - DEBUG - Verifying the vn in opserver 2026-05-18 04:01:21,566 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.23 2026-05-18 04:01:21,566 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 04:01:21,583 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'} 2026-05-18 04:01:21,583 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.22 2026-05-18 04:01:21,583 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 04:01:21,600 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'} 2026-05-18 04:01:21,600 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.240 2026-05-18 04:01:21,600 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 04:01:21,619 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'} 2026-05-18 04:01:21,619 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is found in opserver 2026-05-18 04:01:21,631 - DEBUG - VRF ids for VN ctest-fip_vn-40013376: {'10.0.0.65': '5'} 2026-05-18 04:01:21,631 - INFO - start time= 1779076881631789 2026-05-18 04:01:21,632 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 122.48.136.3, host_string: cirros@169.254.0.5, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2026-05-18 04:01:21,632 - DEBUG - ping -s 56 -c 3 -W 1 122.48.136.3 2026-05-18 04:01:25,619 - DEBUG - PING 122.48.136.3 (122.48.136.3): 56 data bytes 64 bytes from 122.48.136.3: seq=0 ttl=63 time=5.778 ms 64 bytes from 122.48.136.3: seq=1 ttl=63 time=1.822 ms 64 bytes from 122.48.136.3: seq=2 ttl=63 time=1.718 ms --- 122.48.136.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.718/3.106/5.778 ms 2026-05-18 04:01:25,619 - INFO - Ping to IP 122.48.136.3 from VM ctest-vn1_vm1-91150996 passed 2026-05-18 04:01:35,620 - INFO - Verify session samples and teardown pkts 2026-05-18 04:01:35,621 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.23 2026-05-18 04:01:35,627 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1779076881631789, 'end_time': 1779076895627246, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-05-18 04:01:36,654 - DEBUG - [{'T': 1779076884590033}, {'T': 1779076885589988}, {'T': 1779076886590056}] 2026-05-18 04:01:36,654 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1779076881631789, 'end_time': 1779076896654238, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2026-05-18 04:01:37,681 - DEBUG - [{'T': 1779076884255295}, {'T': 1779076885255394}, {'T': 1779076886255513}] 2026-05-18 04:01:37,681 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1779076881631789, 'end_time': 1779076897681814, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2026-05-18 04:01:38,707 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'sample_count': 3}] 2026-05-18 04:01:38,708 - INFO - wait for the flows to get expire 2026-05-18 04:04:58,708 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5792-2:Compute:contrail-vrouter-agent:0?flat 2026-05-18 04:04:58,748 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5792-2?flat 2026-05-18 04:04:59,417 - INFO - Deleted policy policy1 2026-05-18 04:04:59,540 - INFO - Setting flow export rate: None 2026-05-18 04:05:00,887 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon May 18 04:04:58 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=) 1281 src_vn = self.res.vn1_fixture.vn_fq_name 1282 dst_vn = self.res.vn2_fixture.vn_fq_name 1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) 1284 1285 assert result,'Failed to get expected number of samples' result = True self = self.verify_session_sampling_teardown = > start_time = '1779076881631789' src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707' dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620' /contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1779076881631789', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620') 486 flow_record = self.analytics_obj.get_flows_vrouter_uve( 487 vrouter=vm_host) 488 assert not flow_record,'flows not got deleted even after 240 sec' 489 490 res = self.analytics_obj.ops_inspect[ip].post_query( flow_record = 8 AssertionError: flows not got deleted even after 240 sec __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('flows not got deleted even after 240 sec',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown assert not flow_record,'flows not got deleted even after 240 sec' AssertionError: flows not got deleted even after 240 sec 2026-05-18 04:05:00,887 - DEBUG - Skipping xmpp flap check 2026-05-18 04:05:00,887 - INFO -
2026-05-18 04:05:00,887 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:44]
2026-05-18 04:05:00,887 - INFO - -------------------------------------------------------------------------------- 2026-05-18 04:05:00,889 - INFO - Deleting VM mltf_vm 2026-05-18 04:05:00,996 - INFO - Deleting VM ctest-fvn_vm1-79303953 2026-05-18 04:05:01,100 - INFO - Deleting VM ctest-vn2_vm2-54828921 2026-05-18 04:05:01,193 - INFO - Deleting VN ctest-fip_vn-40013376 2026-05-18 04:05:01,246 - DEBUG - VN 5855c471-f288-40bb-aed4-65da270e0b3a still in use: Unable to complete operation on network 5855c471-f288-40bb-aed4-65da270e0b3a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-e8773d66-600a-49e4-b42d-fa92774987b2'] 2026-05-18 04:05:01,246 - WARNING - Deleting VN ctest-fip_vn-40013376 failed..Will retry 2026-05-18 04:05:03,541 - DEBUG - Response for deleting network () 2026-05-18 04:05:03,541 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8 2026-05-18 04:05:03,578 - DEBUG - Response Code: 404 2026-05-18 04:05:03,578 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:05:03,587 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:05:03,650 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:05:03,752 - INFO - Validated that VN ctest-fip_vn-40013376 is not found in API Server 2026-05-18 04:05:03,766 - DEBUG - VN ctest-fip_vn-40013376 is not present in Agent 10.0.0.65 2026-05-18 04:05:03,780 - DEBUG - VN ctest-fip_vn-40013376 is not present in Agent 10.0.0.130 2026-05-18 04:05:03,780 - INFO - Validated that VN ctest-fip_vn-40013376 is not in any agent 2026-05-18 04:05:03,787 - DEBUG - VRF 5 is not seen in agent 10.0.0.65 2026-05-18 04:05:03,793 - DEBUG - Vrouter 10.0.0.65 does not have vrf 5 for VN ctest-fip_vn-40013376 2026-05-18 04:05:03,793 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 2026-05-18 04:05:03,823 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-40013376 info 2026-05-18 04:05:03,823 - INFO - Deleting VN ctest-vn2-14236620 2026-05-18 04:05:04,019 - DEBUG - Response for deleting network () 2026-05-18 04:05:04,019 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709 2026-05-18 04:05:04,026 - DEBUG - Response Code: 404 2026-05-18 04:05:04,026 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:05:04,042 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:05:04,065 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:05:04,172 - INFO - Validated that VN ctest-vn2-14236620 is not found in API Server 2026-05-18 04:05:04,189 - DEBUG - VN ctest-vn2-14236620 is not present in Agent 10.0.0.65 2026-05-18 04:05:04,201 - DEBUG - VN ctest-vn2-14236620 is not present in Agent 10.0.0.130 2026-05-18 04:05:04,201 - INFO - Validated that VN ctest-vn2-14236620 is not in any agent 2026-05-18 04:05:04,208 - DEBUG - VRF 4 is not seen in agent 10.0.0.65 2026-05-18 04:05:04,215 - DEBUG - Vrouter 10.0.0.65 does not have vrf 4 for VN ctest-vn2-14236620 2026-05-18 04:05:04,221 - DEBUG - VRF 5 is not seen in agent 10.0.0.130 2026-05-18 04:05:04,227 - DEBUG - Vrouter 10.0.0.130 does not have vrf 5 for VN ctest-vn2-14236620 2026-05-18 04:05:04,227 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 2026-05-18 04:05:04,259 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-14236620 info 2026-05-18 04:05:04,261 - INFO - Deleting VM ctest-vn1_vm2-97415784 2026-05-18 04:05:04,362 - INFO - Deleting VM ctest-vn1_vm1-91150996 2026-05-18 04:05:04,471 - INFO - Deleting VN ctest-vn1-01804707 2026-05-18 04:05:04,527 - DEBUG - VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 still in use: Unable to complete operation on network 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8f4b6b60-86f5-45a9-9978-d8b7cf8abc06'] 2026-05-18 04:05:04,527 - WARNING - Deleting VN ctest-vn1-01804707 failed..Will retry 2026-05-18 04:05:06,703 - DEBUG - Response for deleting network () 2026-05-18 04:05:06,703 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b 2026-05-18 04:05:06,712 - DEBUG - Response Code: 404 2026-05-18 04:05:06,712 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 04:05:06,723 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 04:05:06,750 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339 2026-05-18 04:05:06,868 - INFO - Validated that VN ctest-vn1-01804707 is not found in API Server 2026-05-18 04:05:06,880 - DEBUG - VN ctest-vn1-01804707 is not present in Agent 10.0.0.65 2026-05-18 04:05:06,892 - DEBUG - VN ctest-vn1-01804707 is not present in Agent 10.0.0.130 2026-05-18 04:05:06,892 - INFO - Validated that VN ctest-vn1-01804707 is not in any agent 2026-05-18 04:05:06,898 - DEBUG - VRF 4 is not seen in agent 10.0.0.130 2026-05-18 04:05:06,904 - DEBUG - Vrouter 10.0.0.130 does not have vrf 4 for VN ctest-vn1-01804707 2026-05-18 04:05:06,905 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 2026-05-18 04:05:06,929 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-01804707 info 2026-05-18 04:05:07,844 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-57451062, ID : 4a9a18dd-7ed9-4924-b47a-038603332339