2026-05-18 03:59:38,771 - INFO - Domain Default found not creating
2026-05-18 03:59:38,961 - INFO - Project ctest-AnalyticsTestSanityWithResource-57451062 not found, creating it
2026-05-18 03:59:39,605 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-57451062, ID : 4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 03:59:41,957 - DEBUG - Response for create_network : {'network': {'id': '98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04', 'name': 'ctest-vn1-01804707', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn1-01804707'], 'port_security_enabled': True, 'description': ''}}
2026-05-18 03:59:42,233 - DEBUG - Response for create_subnet : {'subnet': {'id': '19d0d62b-c420-470f-828e-2fbb078e65cd', 'name': '', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'network_id': '98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04', 'ip_version': 4, 'cidr': '159.23.80.128/26', 'allocation_pools': [{'start': '159.23.80.130', 'end': '159.23.80.190'}], 'gateway_ip': '159.23.80.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '159.23.80.130', 'tags': [], 'project_id': '4a9a18dd7ed94924b47a038603332339'}}
2026-05-18 03:59:42,258 - INFO - Created VN ctest-vn1-01804707
2026-05-18 03:59:42,272 - DEBUG - VN ctest-vn1-01804707 UUID is 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:42,380 - DEBUG - Services list from nova: [, , , ]
2026-05-18 03:59:42,380 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5792-2', 'an-jenkins-deploy-platform-ansible-os-5792-1']}
2026-05-18 03:59:43,694 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2)
2026-05-18 03:59:45,172 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2)
2026-05-18 03:59:45,173 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 03:59:45,523 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 03:59:45,611 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 03:59:45,628 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 03:59:45,766 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:45,804 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:45,820 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 03:59:45,833 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 03:59:45,849 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 03:59:45,858 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 03:59:45,859 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:45,871 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 03:59:45,894 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:45,895 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed
2026-05-18 03:59:45,896 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:45,907 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 03:59:45,922 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 03:59:45,931 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 03:59:45,957 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.778092'}
2026-05-18 03:59:45,967 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 03:59:45,976 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.798549'}
2026-05-18 03:59:45,986 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 03:59:46,006 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.824256'}
2026-05-18 03:59:46,042 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 03:59:46,043 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed
2026-05-18 03:59:46,044 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ======
2026-05-18 03:59:46,044 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 03:59:46,060 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 03:59:46,079 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 03:59:46,187 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 03:59:46,202 - DEBUG - =>VN ctest-vn1-01804707 has no policy to be verified
2026-05-18 03:59:46,202 - DEBUG - Verifying the vn in opserver
2026-05-18 03:59:46,202 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23
2026-05-18 03:59:46,203 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 03:59:46,520 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 03:59:46,603 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 03:59:46,603 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22
2026-05-18 03:59:46,603 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 03:59:46,918 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 03:59:46,992 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 03:59:46,992 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240
2026-05-18 03:59:46,993 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 03:59:47,304 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 03:59:47,379 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 03:59:47,379 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver
2026-05-18 03:59:47,393 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'}
2026-05-18 03:59:47,393 - INFO - Waiting for VM ctest-vn1_vm1-91150996 to be up..
2026-05-18 03:59:47,506 - DEBUG - VM is in ACTIVE state now
2026-05-18 03:59:47,506 - INFO - VM name : ctest-vn1_vm1-91150996
2026-05-18 03:59:47,603 - DEBUG - VM ctest-vn1_vm1-91150996 ID is 3567de70-848a-451d-bc8a-76fbedf9e068
2026-05-18 03:59:47,631 - DEBUG - VM ctest-vn1_vm1-91150996 launched on Node an-jenkins-deploy-platform-ansible-os-5792-2
2026-05-18 03:59:47,735 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3567de70-848a-451d-bc8a-76fbedf9e068
2026-05-18 03:59:48,059 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3567de70-848a-451d-bc8a-76fbedf9e068
2026-05-18 03:59:48,102 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/576f7ac2-6783-4e62-b7f1-03910134a482
2026-05-18 03:59:51,300 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms')
2026-05-18 03:59:51,301 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed!
2026-05-18 03:59:51,317 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set
2026-05-18 03:59:55,422 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms')
2026-05-18 03:59:55,422 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed!
2026-05-18 03:59:55,440 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set
2026-05-18 03:59:59,513 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2026-05-18 03:59:59,513 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed!
2026-05-18 03:59:59,530 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set
2026-05-18 04:00:03,612 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2026-05-18 04:00:03,612 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed!
2026-05-18 04:00:03,629 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set
2026-05-18 04:00:07,710 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-05-18 04:00:07,710 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 failed!
2026-05-18 04:00:07,731 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is 159.23.80.129 and allocation pool is NOT set
2026-05-18 04:00:09,801 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=10.4 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.08 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.080/6.238/10.396/4.158 ms')
2026-05-18 04:00:09,801 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm1-91150996 passed
2026-05-18 04:00:09,873 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:00:09,874 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-91150996, IP 159.23.80.131, Port 22
2026-05-18 04:00:09,944 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-18 04:00:10,049 - DEBUG - VM ctest-vn1_vm1-91150996 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-18 04:00:15,050 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:00:15,050 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-91150996, IP 159.23.80.131, Port 22
2026-05-18 04:00:15,231 - DEBUG - VM ctest-vn1_vm1-91150996 is ready for SSH connections
2026-05-18 04:00:15,231 - INFO - Waiting for VM ctest-vn1_vm2-97415784 to be up..
2026-05-18 04:00:15,324 - DEBUG - VM is in ACTIVE state now
2026-05-18 04:00:15,324 - INFO - VM name : ctest-vn1_vm2-97415784
2026-05-18 04:00:15,458 - DEBUG - VM ctest-vn1_vm2-97415784 ID is 3a5fb02c-0e92-4ea4-9ffa-dd7509491ea8
2026-05-18 04:00:15,458 - DEBUG - VM ctest-vn1_vm2-97415784 launched on Node an-jenkins-deploy-platform-ansible-os-5792-2
2026-05-18 04:00:15,559 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/3a5fb02c-0e92-4ea4-9ffa-dd7509491ea8
2026-05-18 04:00:15,572 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/b3589f57-9f8e-4c7a-bdf3-0ed055675cc5
2026-05-18 04:00:16,754 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=4.67 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=3.13 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.129/3.900/4.672/0.771 ms')
2026-05-18 04:00:16,754 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-vn1_vm2-97415784 passed
2026-05-18 04:00:16,825 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:00:16,825 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-97415784, IP 159.23.80.132, Port 22
2026-05-18 04:00:16,896 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-18 04:00:16,993 - DEBUG - VM ctest-vn1_vm2-97415784 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-18 04:00:21,995 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:00:21,995 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-97415784, IP 159.23.80.132, Port 22
2026-05-18 04:00:22,179 - DEBUG - VM ctest-vn1_vm2-97415784 is ready for SSH connections
2026-05-18 04:00:22,483 - DEBUG - Response for create_network : {'network': {'id': '0302ac13-07a8-450f-bafc-4e908ae23124', 'name': 'ctest-vn2-14236620', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn2-14236620'], 'port_security_enabled': True, 'description': ''}}
2026-05-18 04:00:22,757 - DEBUG - Response for create_subnet : {'subnet': {'id': '7b8232db-6402-48ef-8ef8-6f8291abb72e', 'name': '', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'network_id': '0302ac13-07a8-450f-bafc-4e908ae23124', 'ip_version': 4, 'cidr': '122.48.136.0/26', 'allocation_pools': [{'start': '122.48.136.2', 'end': '122.48.136.62'}], 'gateway_ip': '122.48.136.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '122.48.136.2', 'tags': [], 'project_id': '4a9a18dd7ed94924b47a038603332339'}}
2026-05-18 04:00:22,782 - INFO - Created VN ctest-vn2-14236620
2026-05-18 04:00:22,802 - DEBUG - VN ctest-vn2-14236620 UUID is 0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:23,213 - DEBUG - Response for create_network : {'network': {'id': '5855c471-f288-40bb-aed4-65da270e0b3a', 'name': 'ctest-fip_vn-40013376', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-fip_vn-40013376'], 'port_security_enabled': True, 'description': ''}}
2026-05-18 04:00:23,459 - DEBUG - Response for create_subnet : {'subnet': {'id': '44f5ab11-0aef-4db3-ab5d-abb35ff2cad4', 'name': '', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'network_id': '5855c471-f288-40bb-aed4-65da270e0b3a', 'ip_version': 4, 'cidr': '57.104.109.64/26', 'allocation_pools': [{'start': '57.104.109.66', 'end': '57.104.109.126'}], 'gateway_ip': '57.104.109.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '57.104.109.66', 'tags': [], 'project_id': '4a9a18dd7ed94924b47a038603332339'}}
2026-05-18 04:00:23,486 - INFO - Created VN ctest-fip_vn-40013376
2026-05-18 04:00:23,499 - DEBUG - VN ctest-fip_vn-40013376 UUID is 5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:23,582 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5792-2', 'an-jenkins-deploy-platform-ansible-os-5792-1']}
2026-05-18 04:00:24,990 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1)
2026-05-18 04:00:26,644 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1)
2026-05-18 04:00:28,355 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2)
2026-05-18 04:00:28,355 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:00:28,363 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:00:28,377 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:00:28,478 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:00:28,492 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:00:28,508 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:00:28,522 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:00:28,532 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 04:00:28,541 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:00:28,541 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:00:28,556 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:00:28,578 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:00:28,579 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed
2026-05-18 04:00:28,579 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:00:28,592 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:00:28,601 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:00:28,610 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 04:00:28,629 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.452076'}
2026-05-18 04:00:28,639 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:00:28,644 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.468158'}
2026-05-18 04:00:28,651 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:00:28,660 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T03:59:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:46.487120'}
2026-05-18 04:00:28,670 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:00:28,670 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed
2026-05-18 04:00:28,670 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ======
2026-05-18 04:00:28,670 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:00:28,677 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:00:28,693 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:00:28,804 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:00:28,815 - DEBUG - =>VN ctest-vn1-01804707 has no policy to be verified
2026-05-18 04:00:28,815 - DEBUG - Verifying the vn in opserver
2026-05-18 04:00:28,816 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23
2026-05-18 04:00:28,816 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:00:28,964 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:00:28,964 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22
2026-05-18 04:00:28,964 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:00:29,081 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:00:29,081 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240
2026-05-18 04:00:29,081 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:00:29,206 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:00:29,206 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver
2026-05-18 04:00:29,232 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'}
2026-05-18 04:00:29,232 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:00:29,245 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:00:29,274 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:00:29,358 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:29,409 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:29,420 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:00:29,435 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:00:29,449 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387
2026-05-18 04:00:29,456 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:00:29,456 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:29,469 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:00:29,495 - INFO - Verified VN network id 15 for VN 0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:29,495 - INFO - Verifications in API Server for VN ctest-vn2-14236620 passed
2026-05-18 04:00:29,496 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:29,508 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:00:29,518 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:00:29,533 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387
2026-05-18 04:00:29,548 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:00:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.867282'}
2026-05-18 04:00:29,556 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:00:29,562 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:00:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.877456'}
2026-05-18 04:00:29,580 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:00:29,603 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:00:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.912718'}
2026-05-18 04:00:29,612 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:00:29,612 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14236620 passed
2026-05-18 04:00:29,612 - DEBUG - ====Verifying policy data for ctest-vn2-14236620 in API_Server ======
2026-05-18 04:00:29,612 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:00:29,620 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:00:29,643 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:00:29,811 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:00:29,831 - DEBUG - =>VN ctest-vn2-14236620 has no policy to be verified
2026-05-18 04:00:29,831 - DEBUG - Verifying the vn in opserver
2026-05-18 04:00:29,832 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.23
2026-05-18 04:00:29,832 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:00:29,848 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:00:29,848 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.22
2026-05-18 04:00:29,848 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:00:29,865 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:00:29,865 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.240
2026-05-18 04:00:29,865 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:00:29,950 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:00:29,950 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 is found in opserver
2026-05-18 04:00:29,966 - DEBUG - VRF ids for VN ctest-vn2-14236620: {'10.0.0.65': '4'}
2026-05-18 04:00:29,966 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:00:29,973 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:00:30,012 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:00:30,141 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:30,173 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:30,201 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:00:30,213 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:00:30,221 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8
2026-05-18 04:00:30,229 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:00:30,229 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:30,239 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:00:30,268 - INFO - Verified VN network id 16 for VN 5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:30,268 - INFO - Verifications in API Server for VN ctest-fip_vn-40013376 passed
2026-05-18 04:00:30,268 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:30,280 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:00:30,289 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:00:30,297 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8
2026-05-18 04:00:30,312 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.916607'}
2026-05-18 04:00:30,323 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:00:30,335 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.941062'}
2026-05-18 04:00:30,343 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:00:30,360 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.956765'}
2026-05-18 04:00:30,368 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:00:30,368 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-40013376 passed
2026-05-18 04:00:30,368 - DEBUG - ====Verifying policy data for ctest-fip_vn-40013376 in API_Server ======
2026-05-18 04:00:30,368 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:00:30,380 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:00:30,405 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:00:30,546 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:00:30,560 - DEBUG - =>VN ctest-fip_vn-40013376 has no policy to be verified
2026-05-18 04:00:30,560 - DEBUG - Verifying the vn in opserver
2026-05-18 04:00:30,560 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.23
2026-05-18 04:00:30,560 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:00:30,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'}
2026-05-18 04:00:30,648 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.22
2026-05-18 04:00:30,648 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:00:30,732 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'}
2026-05-18 04:00:30,732 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.240
2026-05-18 04:00:30,732 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:00:30,746 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'}
2026-05-18 04:00:30,747 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is found in opserver
2026-05-18 04:00:30,758 - DEBUG - VRF ids for VN ctest-fip_vn-40013376: {'10.0.0.65': '5'}
2026-05-18 04:00:30,758 - INFO - Waiting for VM ctest-fvn_vm1-79303953 to be up..
2026-05-18 04:00:30,881 - DEBUG - VM is in ACTIVE state now
2026-05-18 04:00:30,882 - INFO - VM name : ctest-fvn_vm1-79303953
2026-05-18 04:00:30,968 - DEBUG - VM ctest-fvn_vm1-79303953 ID is 2a8899ef-e6d3-442f-a7e1-561ada58cd79
2026-05-18 04:00:30,968 - DEBUG - VM ctest-fvn_vm1-79303953 launched on Node an-jenkins-deploy-platform-ansible-os-5792-1
2026-05-18 04:00:31,076 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/2a8899ef-e6d3-442f-a7e1-561ada58cd79
2026-05-18 04:00:31,087 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/ab316877-b226-48a3-b057-93c8216366e7
2026-05-18 04:00:34,315 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-05-18 04:00:34,315 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed!
2026-05-18 04:00:34,330 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set
2026-05-18 04:00:38,406 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2026-05-18 04:00:38,407 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed!
2026-05-18 04:00:38,427 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set
2026-05-18 04:00:42,511 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2026-05-18 04:00:42,512 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed!
2026-05-18 04:00:42,529 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set
2026-05-18 04:00:46,605 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2026-05-18 04:00:46,605 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed!
2026-05-18 04:00:46,624 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set
2026-05-18 04:00:50,697 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2026-05-18 04:00:50,697 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed!
2026-05-18 04:00:50,715 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set
2026-05-18 04:00:54,790 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2026-05-18 04:00:54,790 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 failed!
2026-05-18 04:00:54,806 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is 57.104.109.65 and allocation pool is NOT set
2026-05-18 04:00:56,880 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=11.9 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=6.25 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 6.254/9.098/11.943/2.844 ms')
2026-05-18 04:00:56,880 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-fvn_vm1-79303953 passed
2026-05-18 04:00:56,955 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:00:56,955 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22
2026-05-18 04:00:57,023 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-18 04:00:57,140 - DEBUG - VM ctest-fvn_vm1-79303953 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-18 04:01:02,141 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:01:02,141 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22
2026-05-18 04:01:02,218 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-18 04:01:02,328 - DEBUG - VM ctest-fvn_vm1-79303953 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-18 04:01:07,329 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:01:07,329 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22
2026-05-18 04:01:07,399 - DEBUG - Error on ssh to cirros@169.254.0.6:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-05-18 04:01:07,539 - DEBUG - VM ctest-fvn_vm1-79303953 is NOT ready for SSH connections, VM status: ACTIVE
2026-05-18 04:01:12,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:01:12,540 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-79303953, IP 57.104.109.67, Port 22
2026-05-18 04:01:12,715 - DEBUG - VM ctest-fvn_vm1-79303953 is ready for SSH connections
2026-05-18 04:01:12,715 - INFO - Waiting for VM ctest-vn2_vm2-54828921 to be up..
2026-05-18 04:01:12,817 - DEBUG - VM is in ACTIVE state now
2026-05-18 04:01:12,817 - INFO - VM name : ctest-vn2_vm2-54828921
2026-05-18 04:01:12,917 - DEBUG - VM ctest-vn2_vm2-54828921 ID is 19847682-84fa-40b6-a2c3-e916140212d2
2026-05-18 04:01:12,917 - DEBUG - VM ctest-vn2_vm2-54828921 launched on Node an-jenkins-deploy-platform-ansible-os-5792-1
2026-05-18 04:01:13,024 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/19847682-84fa-40b6-a2c3-e916140212d2
2026-05-18 04:01:13,036 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9984e053-947c-49e8-9225-588805e03733
2026-05-18 04:01:14,212 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.32 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.555 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.555/1.439/2.323/0.884 ms')
2026-05-18 04:01:14,212 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn2_vm2-54828921 passed
2026-05-18 04:01:14,285 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:01:14,285 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-54828921, IP 122.48.136.3, Port 22
2026-05-18 04:01:14,456 - DEBUG - VM ctest-vn2_vm2-54828921 is ready for SSH connections
2026-05-18 04:01:14,456 - INFO - Waiting for VM mltf_vm to be up..
2026-05-18 04:01:14,575 - DEBUG - VM is in ACTIVE state now
2026-05-18 04:01:14,575 - INFO - VM name : mltf_vm
2026-05-18 04:01:14,688 - DEBUG - VM mltf_vm ID is d7716c32-bd00-4c00-aa68-915ff5f46beb
2026-05-18 04:01:14,689 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5792-2
2026-05-18 04:01:14,913 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/d7716c32-bd00-4c00-aa68-915ff5f46beb
2026-05-18 04:01:14,930 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/187b2d67-14b6-428b-96ba-52822418f64f
2026-05-18 04:01:14,944 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/3675d538-69a1-4ab9-a923-abb17a8effe1
2026-05-18 04:01:16,155 - DEBUG - (True, 'PING 169.254.0.7 (169.254.0.7) 56(84) bytes of data.\r\n64 bytes from 169.254.0.7: icmp_seq=1 ttl=63 time=3.34 ms\r\n64 bytes from 169.254.0.7: icmp_seq=2 ttl=63 time=0.809 ms\r\n\r\n--- 169.254.0.7 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.809/2.073/3.338/1.264 ms')
2026-05-18 04:01:16,155 - INFO - Ping to Metadata IP 169.254.0.7 of VM mltf_vm passed
2026-05-18 04:01:16,230 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:01:16,231 - DEBUG - Waiting to SSH to VM mltf_vm, IP 159.23.80.133, Port 22
2026-05-18 04:01:16,404 - DEBUG - VM mltf_vm is ready for SSH connections
2026-05-18 04:01:16,481 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-05-18 04:01:16,481 - DEBUG - Waiting to SSH to VM mltf_vm, IP 159.23.80.133, Port 22
2026-05-18 04:01:16,638 - DEBUG - VM mltf_vm is ready for SSH connections
2026-05-18 04:01:16,641 - INFO - ================================================================================
2026-05-18 04:01:16,642 - INFO - STARTING TEST : test_verify_session_sampling_teardown
2026-05-18 04:01:16,642 - INFO - TEST DESCRIPTION :
1.query client session samples
2.query server session samples
3.query client session to get number of sessions exported
4.query session record table for teardown bytes/pkts
5.query sample count after teardown on server side
2026-05-18 04:01:17,934 - DEBUG - Skipping xmpp flap check
2026-05-18 04:01:17,934 - INFO - Initial checks done. Running the testcase now
2026-05-18 04:01:17,934 - INFO -
2026-05-18 04:01:18,072 - INFO - Setting flow export rate: 100
2026-05-18 04:01:18,120 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2026-05-18 04:01:18,468 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04', 'name': 'ctest-vn1-01804707', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['19d0d62b-c420-470f-828e-2fbb078e65cd'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn1-01804707'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '159.23.80.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2026-05-18 04:01:18,689 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '0302ac13-07a8-450f-bafc-4e908ae23124', 'name': 'ctest-vn2-14236620', 'tenant_id': '4a9a18dd7ed94924b47a038603332339', 'project_id': '4a9a18dd7ed94924b47a038603332339', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['7b8232db-6402-48ef-8ef8-6f8291abb72e'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'ctest-vn2-14236620'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '122.48.136.0/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2026-05-18 04:01:18,781 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:18,789 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:18,802 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:18,943 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:18,969 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:18,981 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:18,991 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:19,028 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 04:01:19,049 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:19,050 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:19,072 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:19,112 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:19,113 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed
2026-05-18 04:01:19,113 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:19,127 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:19,139 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:19,149 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 04:01:19,167 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.726654'}
2026-05-18 04:01:19,177 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:19,190 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.758446'}
2026-05-18 04:01:19,199 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:19,206 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771026'}
2026-05-18 04:01:19,218 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:19,218 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed
2026-05-18 04:01:19,219 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ======
2026-05-18 04:01:19,219 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:19,227 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:19,243 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:19,368 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:19,389 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']
2026-05-18 04:01:19,389 - INFO - VN ctest-vn1-01804707 Policy verification: verify_vn_policy_in_api_server, status: True
2026-05-18 04:01:19,389 - DEBUG - Verifying the vn in opserver
2026-05-18 04:01:19,389 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23
2026-05-18 04:01:19,389 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:01:19,408 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:01:19,408 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22
2026-05-18 04:01:19,408 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:01:19,424 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:01:19,424 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240
2026-05-18 04:01:19,424 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:01:19,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:01:19,439 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver
2026-05-18 04:01:19,452 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'}
2026-05-18 04:01:19,452 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:19,461 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:19,475 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:19,579 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:19,600 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:19,614 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:19,629 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:19,641 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387
2026-05-18 04:01:19,649 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:19,649 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:19,659 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:19,678 - INFO - Verified VN network id 15 for VN 0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:19,678 - INFO - Verifications in API Server for VN ctest-vn2-14236620 passed
2026-05-18 04:01:19,678 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:19,694 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:19,705 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:19,716 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387
2026-05-18 04:01:19,733 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.096217'}
2026-05-18 04:01:19,740 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:19,747 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.101919'}
2026-05-18 04:01:19,760 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:19,767 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.123239'}
2026-05-18 04:01:19,776 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:19,776 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14236620 passed
2026-05-18 04:01:19,776 - DEBUG - ====Verifying policy data for ctest-vn2-14236620 in API_Server ======
2026-05-18 04:01:19,776 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:19,783 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:19,798 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:19,924 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:19,942 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']
2026-05-18 04:01:19,942 - INFO - VN ctest-vn2-14236620 Policy verification: verify_vn_policy_in_api_server, status: True
2026-05-18 04:01:19,943 - DEBUG - Verifying the vn in opserver
2026-05-18 04:01:19,943 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.23
2026-05-18 04:01:19,943 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:01:19,960 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:01:19,960 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.22
2026-05-18 04:01:19,960 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:01:19,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:01:19,976 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.240
2026-05-18 04:01:19,976 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:01:19,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:01:19,997 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 is found in opserver
2026-05-18 04:01:20,010 - DEBUG - VRF ids for VN ctest-vn2-14236620: {'10.0.0.65': '4', '10.0.0.130': '5'}
2026-05-18 04:01:20,010 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:20,017 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:20,032 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:20,144 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:20,161 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:20,172 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:20,182 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:20,192 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 04:01:20,200 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:20,200 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:20,219 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:20,243 - INFO - Verified VN network id 14 for VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:20,243 - INFO - Verifications in API Server for VN ctest-vn1-01804707 passed
2026-05-18 04:01:20,243 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:20,258 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:20,269 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:01:20,283 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f8a7fcd2-8c08-4dc6-9114-cc0add5579fc
2026-05-18 04:01:20,305 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.859011'}
2026-05-18 04:01:20,316 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:20,324 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.892565'}
2026-05-18 04:01:20,333 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:20,341 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11015984114816470782', 'uuid-lslong': '12162460345318296580'}, 'enable': 'true', 'created': '2026-05-18T03:59:41', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.905388'}
2026-05-18 04:01:20,351 - DEBUG - Route Targets: ['target:64512:8000007']
2026-05-18 04:01:20,351 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-01804707 passed
2026-05-18 04:01:20,351 - DEBUG - ====Verifying policy data for ctest-vn1-01804707 in API_Server ======
2026-05-18 04:01:20,351 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:20,358 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:20,373 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:20,489 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04
2026-05-18 04:01:20,507 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']
2026-05-18 04:01:20,507 - INFO - VN ctest-vn1-01804707 Policy verification: verify_vn_policy_in_api_server, status: True
2026-05-18 04:01:20,508 - DEBUG - Verifying the vn in opserver
2026-05-18 04:01:20,508 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.23
2026-05-18 04:01:20,508 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:01:20,523 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:01:20,523 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.22
2026-05-18 04:01:20,523 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:01:20,541 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:01:20,541 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 virtual network link through opserver 10.0.0.240
2026-05-18 04:01:20,541 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:01:20,558 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707?flat'}
2026-05-18 04:01:20,558 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707 is found in opserver
2026-05-18 04:01:20,571 - DEBUG - VRF ids for VN ctest-vn1-01804707: {'10.0.0.130': '4'}
2026-05-18 04:01:20,571 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:20,580 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:20,599 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:20,708 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:20,721 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:20,735 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:20,745 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:20,763 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387
2026-05-18 04:01:20,774 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:20,774 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:20,788 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:20,810 - INFO - Verified VN network id 15 for VN 0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:20,811 - INFO - Verifications in API Server for VN ctest-vn2-14236620 passed
2026-05-18 04:01:20,811 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:20,826 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:20,836 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:01:20,847 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e471c68f-ad3a-4d92-847e-bb8076844387
2026-05-18 04:01:20,867 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.229761'}
2026-05-18 04:01:20,875 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:20,884 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.238922'}
2026-05-18 04:01:20,893 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:20,901 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216924929800029455', 'uuid-lslong': '13473730567898018084'}, 'enable': 'true', 'created': '2026-05-18T04:00:22', 'last-modified': '2026-05-18T04:01:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.256849'}
2026-05-18 04:01:20,912 - DEBUG - Route Targets: ['target:64512:8000008']
2026-05-18 04:01:20,912 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14236620 passed
2026-05-18 04:01:20,913 - DEBUG - ====Verifying policy data for ctest-vn2-14236620 in API_Server ======
2026-05-18 04:01:20,913 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:20,922 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:20,937 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:21,042 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0302ac13-07a8-450f-bafc-4e908ae23124
2026-05-18 04:01:21,059 - DEBUG - ==>Verifying data for policy with id: c657c6f1-abe1-49c1-8b7f-fc1a2ba153a9, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-57451062', 'policy1']
2026-05-18 04:01:21,059 - INFO - VN ctest-vn2-14236620 Policy verification: verify_vn_policy_in_api_server, status: True
2026-05-18 04:01:21,059 - DEBUG - Verifying the vn in opserver
2026-05-18 04:01:21,059 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.23
2026-05-18 04:01:21,059 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:01:21,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:01:21,076 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.22
2026-05-18 04:01:21,076 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:01:21,093 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:01:21,093 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 virtual network link through opserver 10.0.0.240
2026-05-18 04:01:21,093 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:01:21,110 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620?flat'}
2026-05-18 04:01:21,110 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620 is found in opserver
2026-05-18 04:01:21,128 - DEBUG - VRF ids for VN ctest-vn2-14236620: {'10.0.0.65': '4', '10.0.0.130': '5'}
2026-05-18 04:01:21,128 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:21,139 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:21,154 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:21,256 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:01:21,266 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:01:21,278 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:01:21,288 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:01:21,299 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8
2026-05-18 04:01:21,308 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:01:21,308 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:01:21,319 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:01:21,340 - INFO - Verified VN network id 16 for VN 5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:01:21,341 - INFO - Verifications in API Server for VN ctest-fip_vn-40013376 passed
2026-05-18 04:01:21,341 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:01:21,354 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:01:21,363 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:01:21,372 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ee160715-ca8f-485e-a5d3-21df02b4dbd8
2026-05-18 04:01:21,388 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:57.993474'}
2026-05-18 04:01:21,398 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:01:21,405 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:58.010670'}
2026-05-18 04:01:21,411 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:01:21,418 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-57451062', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6365209642037428411', 'uuid-lslong': '12597806045294627642'}, 'enable': 'true', 'created': '2026-05-18T04:00:23', 'last-modified': '2026-05-18T04:00:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:58.024025'}
2026-05-18 04:01:21,425 - DEBUG - Route Targets: ['target:64512:8000009']
2026-05-18 04:01:21,425 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-40013376 passed
2026-05-18 04:01:21,425 - DEBUG - ====Verifying policy data for ctest-fip_vn-40013376 in API_Server ======
2026-05-18 04:01:21,425 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:01:21,435 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:01:21,450 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:01:21,552 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5855c471-f288-40bb-aed4-65da270e0b3a
2026-05-18 04:01:21,566 - DEBUG - =>VN ctest-fip_vn-40013376 has no policy to be verified
2026-05-18 04:01:21,566 - DEBUG - Verifying the vn in opserver
2026-05-18 04:01:21,566 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.23
2026-05-18 04:01:21,566 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2026-05-18 04:01:21,583 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'}
2026-05-18 04:01:21,583 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.22
2026-05-18 04:01:21,583 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2026-05-18 04:01:21,600 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'}
2026-05-18 04:01:21,600 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 virtual network link through opserver 10.0.0.240
2026-05-18 04:01:21,600 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks
2026-05-18 04:01:21,619 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376?flat'}
2026-05-18 04:01:21,619 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376 is found in opserver
2026-05-18 04:01:21,631 - DEBUG - VRF ids for VN ctest-fip_vn-40013376: {'10.0.0.65': '5'}
2026-05-18 04:01:21,631 - INFO - start time= 1779076881631789
2026-05-18 04:01:21,632 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 122.48.136.3, host_string: cirros@169.254.0.5, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2026-05-18 04:01:21,632 - DEBUG - ping -s 56 -c 3 -W 1 122.48.136.3
2026-05-18 04:01:25,619 - DEBUG - PING 122.48.136.3 (122.48.136.3): 56 data bytes
64 bytes from 122.48.136.3: seq=0 ttl=63 time=5.778 ms
64 bytes from 122.48.136.3: seq=1 ttl=63 time=1.822 ms
64 bytes from 122.48.136.3: seq=2 ttl=63 time=1.718 ms
--- 122.48.136.3 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.718/3.106/5.778 ms
2026-05-18 04:01:25,619 - INFO - Ping to IP 122.48.136.3 from VM ctest-vn1_vm1-91150996 passed
2026-05-18 04:01:35,620 - INFO - Verify session samples and teardown pkts
2026-05-18 04:01:35,621 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.23
2026-05-18 04:01:35,627 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1779076881631789, 'end_time': 1779076895627246, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-05-18 04:01:36,654 - DEBUG - [{'T': 1779076884590033}, {'T': 1779076885589988}, {'T': 1779076886590056}]
2026-05-18 04:01:36,654 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1779076881631789, 'end_time': 1779076896654238, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2026-05-18 04:01:37,681 - DEBUG - [{'T': 1779076884255295}, {'T': 1779076885255394}, {'T': 1779076886255513}]
2026-05-18 04:01:37,681 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1779076881631789, 'end_time': 1779076897681814, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-05-18 04:01:38,707 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', 'sample_count': 3}]
2026-05-18 04:01:38,708 - INFO - wait for the flows to get expire
2026-05-18 04:04:58,708 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5792-2:Compute:contrail-vrouter-agent:0?flat
2026-05-18 04:04:58,748 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5792-2?flat
2026-05-18 04:04:59,417 - INFO - Deleted policy policy1
2026-05-18 04:04:59,540 - INFO - Setting flow export rate: None
2026-05-18 04:05:00,887 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Mon May 18 04:04:58 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=)
1281 src_vn = self.res.vn1_fixture.vn_fq_name
1282 dst_vn = self.res.vn2_fixture.vn_fq_name
1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn)
1284
1285 assert result,'Failed to get expected number of samples'
result = True
self =
self.verify_session_sampling_teardown = >
start_time = '1779076881631789'
src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707'
dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620'
/contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1779076881631789', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620')
486 flow_record = self.analytics_obj.get_flows_vrouter_uve(
487 vrouter=vm_host)
488 assert not flow_record,'flows not got deleted even after 240 sec'
489
490 res = self.analytics_obj.ops_inspect[ip].post_query(
flow_record = 8
AssertionError: flows not got deleted even after 240 sec
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('flows not got deleted even after 240 sec',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown
result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn)
File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown
assert not flow_record,'flows not got deleted even after 240 sec'
AssertionError: flows not got deleted even after 240 sec
2026-05-18 04:05:00,887 - DEBUG - Skipping xmpp flap check
2026-05-18 04:05:00,887 - INFO -
2026-05-18 04:05:00,887 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:44]
2026-05-18 04:05:00,887 - INFO - --------------------------------------------------------------------------------
2026-05-18 04:05:00,889 - INFO - Deleting VM mltf_vm
2026-05-18 04:05:00,996 - INFO - Deleting VM ctest-fvn_vm1-79303953
2026-05-18 04:05:01,100 - INFO - Deleting VM ctest-vn2_vm2-54828921
2026-05-18 04:05:01,193 - INFO - Deleting VN ctest-fip_vn-40013376
2026-05-18 04:05:01,246 - DEBUG - VN 5855c471-f288-40bb-aed4-65da270e0b3a still in use: Unable to complete operation on network 5855c471-f288-40bb-aed4-65da270e0b3a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e8773d66-600a-49e4-b42d-fa92774987b2']
2026-05-18 04:05:01,246 - WARNING - Deleting VN ctest-fip_vn-40013376 failed..Will retry
2026-05-18 04:05:03,541 - DEBUG - Response for deleting network ()
2026-05-18 04:05:03,541 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/7313f163-29dd-4a03-bb12-1f3e59cedfa8
2026-05-18 04:05:03,578 - DEBUG - Response Code: 404
2026-05-18 04:05:03,578 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:05:03,587 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:05:03,650 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:05:03,752 - INFO - Validated that VN ctest-fip_vn-40013376 is not found in API Server
2026-05-18 04:05:03,766 - DEBUG - VN ctest-fip_vn-40013376 is not present in Agent 10.0.0.65
2026-05-18 04:05:03,780 - DEBUG - VN ctest-fip_vn-40013376 is not present in Agent 10.0.0.130
2026-05-18 04:05:03,780 - INFO - Validated that VN ctest-fip_vn-40013376 is not in any agent
2026-05-18 04:05:03,787 - DEBUG - VRF 5 is not seen in agent 10.0.0.65
2026-05-18 04:05:03,793 - DEBUG - Vrouter 10.0.0.65 does not have vrf 5 for VN ctest-fip_vn-40013376
2026-05-18 04:05:03,793 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-fip_vn-40013376
2026-05-18 04:05:03,823 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-40013376 info
2026-05-18 04:05:03,823 - INFO - Deleting VN ctest-vn2-14236620
2026-05-18 04:05:04,019 - DEBUG - Response for deleting network ()
2026-05-18 04:05:04,019 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/11c29218-efa0-46d3-9eeb-f5fd94aab709
2026-05-18 04:05:04,026 - DEBUG - Response Code: 404
2026-05-18 04:05:04,026 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:05:04,042 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:05:04,065 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:05:04,172 - INFO - Validated that VN ctest-vn2-14236620 is not found in API Server
2026-05-18 04:05:04,189 - DEBUG - VN ctest-vn2-14236620 is not present in Agent 10.0.0.65
2026-05-18 04:05:04,201 - DEBUG - VN ctest-vn2-14236620 is not present in Agent 10.0.0.130
2026-05-18 04:05:04,201 - INFO - Validated that VN ctest-vn2-14236620 is not in any agent
2026-05-18 04:05:04,208 - DEBUG - VRF 4 is not seen in agent 10.0.0.65
2026-05-18 04:05:04,215 - DEBUG - Vrouter 10.0.0.65 does not have vrf 4 for VN ctest-vn2-14236620
2026-05-18 04:05:04,221 - DEBUG - VRF 5 is not seen in agent 10.0.0.130
2026-05-18 04:05:04,227 - DEBUG - Vrouter 10.0.0.130 does not have vrf 5 for VN ctest-vn2-14236620
2026-05-18 04:05:04,227 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn2-14236620
2026-05-18 04:05:04,259 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-14236620 info
2026-05-18 04:05:04,261 - INFO - Deleting VM ctest-vn1_vm2-97415784
2026-05-18 04:05:04,362 - INFO - Deleting VM ctest-vn1_vm1-91150996
2026-05-18 04:05:04,471 - INFO - Deleting VN ctest-vn1-01804707
2026-05-18 04:05:04,527 - DEBUG - VN 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04 still in use: Unable to complete operation on network 98e0a32f-eefb-4efe-a8c9-bd3e9d78cc04. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-8f4b6b60-86f5-45a9-9978-d8b7cf8abc06']
2026-05-18 04:05:04,527 - WARNING - Deleting VN ctest-vn1-01804707 failed..Will retry
2026-05-18 04:05:06,703 - DEBUG - Response for deleting network ()
2026-05-18 04:05:06,703 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4b21caa5-8165-44bd-bced-2b49a784dc1b
2026-05-18 04:05:06,712 - DEBUG - Response Code: 404
2026-05-18 04:05:06,712 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2026-05-18 04:05:06,723 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989
2026-05-18 04:05:06,750 - DEBUG - Requesting: http://10.0.0.23:8082/project/4a9a18dd-7ed9-4924-b47a-038603332339
2026-05-18 04:05:06,868 - INFO - Validated that VN ctest-vn1-01804707 is not found in API Server
2026-05-18 04:05:06,880 - DEBUG - VN ctest-vn1-01804707 is not present in Agent 10.0.0.65
2026-05-18 04:05:06,892 - DEBUG - VN ctest-vn1-01804707 is not present in Agent 10.0.0.130
2026-05-18 04:05:06,892 - INFO - Validated that VN ctest-vn1-01804707 is not in any agent
2026-05-18 04:05:06,898 - DEBUG - VRF 4 is not seen in agent 10.0.0.130
2026-05-18 04:05:06,904 - DEBUG - Vrouter 10.0.0.130 does not have vrf 4 for VN ctest-vn1-01804707
2026-05-18 04:05:06,905 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-57451062:ctest-vn1-01804707
2026-05-18 04:05:06,929 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-01804707 info
2026-05-18 04:05:07,844 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-57451062, ID : 4a9a18dd-7ed9-4924-b47a-038603332339