2026-04-06 04:04:40,773 - INFO - Domain Default found not creating
2026-04-06 04:04:40,940 - INFO - Project ctest-AnalyticsTestSanityWithResource-16880733 not found, creating it
2026-04-06 04:04:41,553 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-16880733, ID : fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:04:43,809 - DEBUG - Response for create_network : {'network': {'id': 'ea4fce47-6bcb-4810-8647-ee56ed686e1b', 'name': 'ctest-vn1-16842154', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'project_id': 'fdc3710892ea4755925f73a997cf56c8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'ctest-vn1-16842154'], 'port_security_enabled': True, 'description': ''}}
2026-04-06 04:04:44,161 - DEBUG - Response for create_subnet : {'subnet': {'id': '15e90d30-7cb3-4a86-ad66-4394656baf88', 'name': '', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'network_id': 'ea4fce47-6bcb-4810-8647-ee56ed686e1b', 'ip_version': 4, 'cidr': '138.133.131.192/26', 'allocation_pools': [{'start': '138.133.131.194', 'end': '138.133.131.254'}], 'gateway_ip': '138.133.131.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '138.133.131.194', 'tags': [], 'project_id': 'fdc3710892ea4755925f73a997cf56c8'}}
2026-04-06 04:04:44,185 - INFO - Created VN ctest-vn1-16842154
2026-04-06 04:04:44,198 - DEBUG - VN ctest-vn1-16842154 UUID is ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:44,302 - DEBUG - Services list from nova: [, , , ]
2026-04-06 04:04:44,302 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5596-2', 'an-jenkins-deploy-platform-ansible-os-5596-1']}
2026-04-06 04:04:45,892 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-2)
2026-04-06 04:04:47,696 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-2)
2026-04-06 04:04:47,697 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:04:48,042 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:04:48,078 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:04:48,100 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:04:48,195 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:48,206 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:48,218 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:04:48,226 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:04:48,235 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:04:48,249 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:04:48,249 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:48,267 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:04:48,286 - INFO - Verified VN network id 15 for VN ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:48,286 - INFO - Verifications in API Server for VN ctest-vn1-16842154 passed
2026-04-06 04:04:48,286 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:48,299 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:04:48,319 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:04:48,330 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:04:48,352 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.256347'}
2026-04-06 04:04:48,363 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:04:48,369 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.280463'}
2026-04-06 04:04:48,377 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:04:48,384 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.288161'}
2026-04-06 04:04:48,391 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:04:48,391 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-16842154 passed
2026-04-06 04:04:48,391 - DEBUG - ====Verifying policy data for ctest-vn1-16842154 in API_Server ======
2026-04-06 04:04:48,391 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:04:48,417 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:04:48,456 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:04:48,616 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:04:48,628 - DEBUG - =>VN ctest-vn1-16842154 has no policy to be verified
2026-04-06 04:04:48,628 - DEBUG - Verifying the vn in opserver
2026-04-06 04:04:48,628 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.249
2026-04-06 04:04:48,628 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:04:49,012 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:04:49,092 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:04:49,092 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.27
2026-04-06 04:04:49,092 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:04:49,399 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:04:49,476 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:04:49,476 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.33
2026-04-06 04:04:49,476 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:04:49,781 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:04:49,855 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:04:49,855 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is found in opserver
2026-04-06 04:04:49,867 - DEBUG - VRF ids for VN ctest-vn1-16842154: {'10.0.0.241': '3'}
2026-04-06 04:04:49,867 - INFO - Waiting for VM ctest-vn1_vm1-86723029 to be up..
2026-04-06 04:04:49,965 - DEBUG - VM is in ACTIVE state now
2026-04-06 04:04:49,965 - INFO - VM name : ctest-vn1_vm1-86723029
2026-04-06 04:04:50,046 - DEBUG - VM ctest-vn1_vm1-86723029 ID is 12a8e4a0-d4e5-44f3-b6d6-6a00318c146f
2026-04-06 04:04:50,077 - DEBUG - VM ctest-vn1_vm1-86723029 launched on Node an-jenkins-deploy-platform-ansible-os-5596-2
2026-04-06 04:04:50,177 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/12a8e4a0-d4e5-44f3-b6d6-6a00318c146f
2026-04-06 04:04:50,488 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/12a8e4a0-d4e5-44f3-b6d6-6a00318c146f
2026-04-06 04:04:50,522 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/9aa4f2da-9ae7-437c-8010-327664684f37
2026-04-06 04:04:53,730 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-04-06 04:04:53,730 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm1-86723029 failed!
2026-04-06 04:04:53,747 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is 138.133.131.193 and allocation pool is NOT set
2026-04-06 04:04:57,818 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms')
2026-04-06 04:04:57,818 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm1-86723029 failed!
2026-04-06 04:04:57,836 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is 138.133.131.193 and allocation pool is NOT set
2026-04-06 04:05:01,919 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2026-04-06 04:05:01,919 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm1-86723029 failed!
2026-04-06 04:05:01,934 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is 138.133.131.193 and allocation pool is NOT set
2026-04-06 04:05:06,008 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=6.14 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1019ms\r\nrtt min/avg/max/mdev = 6.140/6.140/6.140/0.000 ms')
2026-04-06 04:05:06,008 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm1-86723029 passed
2026-04-06 04:05:06,082 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:06,082 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-86723029, IP 138.133.131.195, Port 22
2026-04-06 04:05:06,150 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-06 04:05:06,247 - DEBUG - VM ctest-vn1_vm1-86723029 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-06 04:05:11,248 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:11,248 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-86723029, IP 138.133.131.195, Port 22
2026-04-06 04:05:11,318 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-06 04:05:11,405 - DEBUG - VM ctest-vn1_vm1-86723029 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-06 04:05:16,406 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:16,406 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-86723029, IP 138.133.131.195, Port 22
2026-04-06 04:05:16,571 - DEBUG - VM ctest-vn1_vm1-86723029 is ready for SSH connections
2026-04-06 04:05:16,571 - INFO - Waiting for VM ctest-vn1_vm2-48022468 to be up..
2026-04-06 04:05:16,656 - DEBUG - VM is in ACTIVE state now
2026-04-06 04:05:16,656 - INFO - VM name : ctest-vn1_vm2-48022468
2026-04-06 04:05:16,744 - DEBUG - VM ctest-vn1_vm2-48022468 ID is e248e16a-200d-456a-8b18-b64952a97209
2026-04-06 04:05:16,744 - DEBUG - VM ctest-vn1_vm2-48022468 launched on Node an-jenkins-deploy-platform-ansible-os-5596-2
2026-04-06 04:05:16,824 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/e248e16a-200d-456a-8b18-b64952a97209
2026-04-06 04:05:16,834 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/c1227982-7720-4488-8649-abd8aaaeb81d
2026-04-06 04:05:17,999 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.96 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.55 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.554/3.257/3.960/0.703 ms')
2026-04-06 04:05:17,999 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-vn1_vm2-48022468 passed
2026-04-06 04:05:18,075 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:18,075 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-48022468, IP 138.133.131.196, Port 22
2026-04-06 04:05:18,235 - DEBUG - VM ctest-vn1_vm2-48022468 is ready for SSH connections
2026-04-06 04:05:18,584 - DEBUG - Response for create_network : {'network': {'id': 'af48a683-da93-401d-be2b-ef2969f6e3b7', 'name': 'ctest-vn2-89443678', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'project_id': 'fdc3710892ea4755925f73a997cf56c8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'ctest-vn2-89443678'], 'port_security_enabled': True, 'description': ''}}
2026-04-06 04:05:18,940 - DEBUG - Response for create_subnet : {'subnet': {'id': '4e9e87af-1a66-4ac4-ac09-f49eff2bb80d', 'name': '', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'network_id': 'af48a683-da93-401d-be2b-ef2969f6e3b7', 'ip_version': 4, 'cidr': '209.216.19.128/26', 'allocation_pools': [{'start': '209.216.19.130', 'end': '209.216.19.190'}], 'gateway_ip': '209.216.19.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '209.216.19.130', 'tags': [], 'project_id': 'fdc3710892ea4755925f73a997cf56c8'}}
2026-04-06 04:05:18,971 - INFO - Created VN ctest-vn2-89443678
2026-04-06 04:05:18,990 - DEBUG - VN ctest-vn2-89443678 UUID is af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:19,440 - DEBUG - Response for create_network : {'network': {'id': '204e40fc-fbab-4571-8a2b-156391e1b465', 'name': 'ctest-fip_vn-23002226', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'project_id': 'fdc3710892ea4755925f73a997cf56c8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'ctest-fip_vn-23002226'], 'port_security_enabled': True, 'description': ''}}
2026-04-06 04:05:19,695 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f35db4ed-8782-40dd-8a0f-8305c3d41049', 'name': '', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'network_id': '204e40fc-fbab-4571-8a2b-156391e1b465', 'ip_version': 4, 'cidr': '29.170.117.64/26', 'allocation_pools': [{'start': '29.170.117.66', 'end': '29.170.117.126'}], 'gateway_ip': '29.170.117.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '29.170.117.66', 'tags': [], 'project_id': 'fdc3710892ea4755925f73a997cf56c8'}}
2026-04-06 04:05:19,716 - INFO - Created VN ctest-fip_vn-23002226
2026-04-06 04:05:19,728 - DEBUG - VN ctest-fip_vn-23002226 UUID is 204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:19,804 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5596-2', 'an-jenkins-deploy-platform-ansible-os-5596-1']}
2026-04-06 04:05:21,154 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-1)
2026-04-06 04:05:22,917 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-1)
2026-04-06 04:05:24,637 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5596-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5596-2)
2026-04-06 04:05:24,637 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:05:24,643 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:05:24,657 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:05:24,750 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:05:24,771 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:05:24,785 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:05:24,797 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:05:24,805 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:05:24,816 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:05:24,816 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:05:24,826 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:05:24,845 - INFO - Verified VN network id 15 for VN ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:05:24,845 - INFO - Verifications in API Server for VN ctest-vn1-16842154 passed
2026-04-06 04:05:24,845 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:05:24,857 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:05:24,865 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:05:24,872 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:05:24,885 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:40.791779'}
2026-04-06 04:05:24,890 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:05:24,901 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:40.807857'}
2026-04-06 04:05:24,907 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:05:24,912 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:40.817860'}
2026-04-06 04:05:24,918 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:05:24,918 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-16842154 passed
2026-04-06 04:05:24,918 - DEBUG - ====Verifying policy data for ctest-vn1-16842154 in API_Server ======
2026-04-06 04:05:24,918 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:05:24,924 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:05:24,936 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:05:25,057 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:05:25,072 - DEBUG - =>VN ctest-vn1-16842154 has no policy to be verified
2026-04-06 04:05:25,072 - DEBUG - Verifying the vn in opserver
2026-04-06 04:05:25,072 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.249
2026-04-06 04:05:25,072 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:05:25,169 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:05:25,169 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.27
2026-04-06 04:05:25,169 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:05:25,246 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:05:25,246 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.33
2026-04-06 04:05:25,246 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:05:25,352 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:05:25,352 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is found in opserver
2026-04-06 04:05:25,367 - DEBUG - VRF ids for VN ctest-vn1-16842154: {'10.0.0.241': '3'}
2026-04-06 04:05:25,367 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:05:25,384 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:05:25,412 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:05:25,557 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:25,572 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:25,583 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:05:25,599 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:05:25,609 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/76ebc919-978f-4b6e-97b8-ea51e5613808
2026-04-06 04:05:25,621 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:05:25,621 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:25,638 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:05:25,655 - INFO - Verified VN network id 16 for VN af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:25,656 - INFO - Verifications in API Server for VN ctest-vn2-89443678 passed
2026-04-06 04:05:25,656 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:25,668 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:05:25,678 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:05:25,687 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/76ebc919-978f-4b6e-97b8-ea51e5613808
2026-04-06 04:05:25,699 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:05:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.878942'}
2026-04-06 04:05:25,706 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:05:25,712 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:05:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.892111'}
2026-04-06 04:05:25,718 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:05:25,724 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:05:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.908577'}
2026-04-06 04:05:25,732 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:05:25,732 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-89443678 passed
2026-04-06 04:05:25,732 - DEBUG - ====Verifying policy data for ctest-vn2-89443678 in API_Server ======
2026-04-06 04:05:25,732 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:05:25,738 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:05:25,770 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:05:25,883 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:05:25,896 - DEBUG - =>VN ctest-vn2-89443678 has no policy to be verified
2026-04-06 04:05:25,896 - DEBUG - Verifying the vn in opserver
2026-04-06 04:05:25,896 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.249
2026-04-06 04:05:25,896 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:05:25,979 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:05:25,979 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.27
2026-04-06 04:05:25,979 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:05:26,079 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:05:26,079 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.33
2026-04-06 04:05:26,080 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:05:26,141 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:05:26,141 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 is found in opserver
2026-04-06 04:05:26,152 - DEBUG - VRF ids for VN ctest-vn2-89443678: {'10.0.0.19': '3'}
2026-04-06 04:05:26,153 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:05:26,159 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:05:26,170 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:05:26,267 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:26,278 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:26,287 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:05:26,295 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:05:26,302 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ba8cec5-5385-499e-beb0-4c9d01e02f61
2026-04-06 04:05:26,308 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:05:26,308 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:26,321 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:05:26,338 - INFO - Verified VN network id 17 for VN 204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:26,338 - INFO - Verifications in API Server for VN ctest-fip_vn-23002226 passed
2026-04-06 04:05:26,338 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:26,352 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:05:26,360 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:05:26,367 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ba8cec5-5385-499e-beb0-4c9d01e02f61
2026-04-06 04:05:26,381 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2327869512695367025', 'uuid-lslong': '9956074918626047077'}, 'enable': 'true', 'created': '2026-04-06T04:05:19', 'last-modified': '2026-04-06T04:05:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.746883'}
2026-04-06 04:05:26,388 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:05:26,394 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2327869512695367025', 'uuid-lslong': '9956074918626047077'}, 'enable': 'true', 'created': '2026-04-06T04:05:19', 'last-modified': '2026-04-06T04:05:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.759291'}
2026-04-06 04:05:26,400 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:05:26,406 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2327869512695367025', 'uuid-lslong': '9956074918626047077'}, 'enable': 'true', 'created': '2026-04-06T04:05:19', 'last-modified': '2026-04-06T04:05:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.772093'}
2026-04-06 04:05:26,414 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:05:26,414 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-23002226 passed
2026-04-06 04:05:26,414 - DEBUG - ====Verifying policy data for ctest-fip_vn-23002226 in API_Server ======
2026-04-06 04:05:26,414 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:05:26,420 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:05:26,430 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:05:26,528 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:05:26,542 - DEBUG - =>VN ctest-fip_vn-23002226 has no policy to be verified
2026-04-06 04:05:26,542 - DEBUG - Verifying the vn in opserver
2026-04-06 04:05:26,542 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 virtual network link through opserver 10.0.0.249
2026-04-06 04:05:26,543 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:05:26,559 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226?flat'}
2026-04-06 04:05:26,559 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 virtual network link through opserver 10.0.0.27
2026-04-06 04:05:26,560 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:05:26,573 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226?flat'}
2026-04-06 04:05:26,573 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 virtual network link through opserver 10.0.0.33
2026-04-06 04:05:26,573 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:05:26,587 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226?flat'}
2026-04-06 04:05:26,587 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is found in opserver
2026-04-06 04:05:26,606 - DEBUG - VRF ids for VN ctest-fip_vn-23002226: {'10.0.0.19': '4'}
2026-04-06 04:05:26,606 - INFO - Waiting for VM ctest-fvn_vm1-09086440 to be up..
2026-04-06 04:05:26,700 - DEBUG - VM is in ACTIVE state now
2026-04-06 04:05:26,700 - INFO - VM name : ctest-fvn_vm1-09086440
2026-04-06 04:05:26,791 - DEBUG - VM ctest-fvn_vm1-09086440 ID is dd8f0f6c-8834-4544-813c-a0940662485e
2026-04-06 04:05:26,792 - DEBUG - VM ctest-fvn_vm1-09086440 launched on Node an-jenkins-deploy-platform-ansible-os-5596-1
2026-04-06 04:05:26,880 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/dd8f0f6c-8834-4544-813c-a0940662485e
2026-04-06 04:05:26,894 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/ad3548b0-4f5b-45b6-8462-cadc33cfee5c
2026-04-06 04:05:30,097 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2026-04-06 04:05:30,097 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-fvn_vm1-09086440 failed!
2026-04-06 04:05:30,113 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is 29.170.117.65 and allocation pool is NOT set
2026-04-06 04:05:34,194 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-04-06 04:05:34,194 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-fvn_vm1-09086440 failed!
2026-04-06 04:05:34,209 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is 29.170.117.65 and allocation pool is NOT set
2026-04-06 04:05:38,286 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms')
2026-04-06 04:05:38,286 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-fvn_vm1-09086440 failed!
2026-04-06 04:05:38,300 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is 29.170.117.65 and allocation pool is NOT set
2026-04-06 04:05:42,387 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms')
2026-04-06 04:05:42,387 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-fvn_vm1-09086440 failed!
2026-04-06 04:05:42,402 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is 29.170.117.65 and allocation pool is NOT set
2026-04-06 04:05:46,484 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms')
2026-04-06 04:05:46,484 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-fvn_vm1-09086440 failed!
2026-04-06 04:05:46,499 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is 29.170.117.65 and allocation pool is NOT set
2026-04-06 04:05:48,566 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=12.0 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=4.19 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 4.193/8.078/11.964/3.885 ms')
2026-04-06 04:05:48,566 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-fvn_vm1-09086440 passed
2026-04-06 04:05:48,642 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:48,642 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-09086440, IP 29.170.117.67, Port 22
2026-04-06 04:05:48,709 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-06 04:05:48,795 - DEBUG - VM ctest-fvn_vm1-09086440 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-06 04:05:53,796 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:53,796 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-09086440, IP 29.170.117.67, Port 22
2026-04-06 04:05:53,865 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-06 04:05:53,951 - DEBUG - VM ctest-fvn_vm1-09086440 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-06 04:05:58,952 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:05:58,952 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-09086440, IP 29.170.117.67, Port 22
2026-04-06 04:05:59,017 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-04-06 04:05:59,102 - DEBUG - VM ctest-fvn_vm1-09086440 is NOT ready for SSH connections, VM status: ACTIVE
2026-04-06 04:06:04,103 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:06:04,104 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-09086440, IP 29.170.117.67, Port 22
2026-04-06 04:06:04,277 - DEBUG - VM ctest-fvn_vm1-09086440 is ready for SSH connections
2026-04-06 04:06:04,277 - INFO - Waiting for VM ctest-vn2_vm2-09655157 to be up..
2026-04-06 04:06:04,383 - DEBUG - VM is in ACTIVE state now
2026-04-06 04:06:04,383 - INFO - VM name : ctest-vn2_vm2-09655157
2026-04-06 04:06:04,462 - DEBUG - VM ctest-vn2_vm2-09655157 ID is 0f242a70-a698-4c98-853a-61d075ae3c16
2026-04-06 04:06:04,462 - DEBUG - VM ctest-vn2_vm2-09655157 launched on Node an-jenkins-deploy-platform-ansible-os-5596-1
2026-04-06 04:06:04,547 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/0f242a70-a698-4c98-853a-61d075ae3c16
2026-04-06 04:06:04,559 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/c7d8a707-4713-4050-b9ad-52d62a5b3115
2026-04-06 04:06:05,727 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.19 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.522 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.522/1.353/2.185/0.831 ms')
2026-04-06 04:06:05,727 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn2_vm2-09655157 passed
2026-04-06 04:06:05,801 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:06:05,802 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-09655157, IP 209.216.19.131, Port 22
2026-04-06 04:06:05,970 - DEBUG - VM ctest-vn2_vm2-09655157 is ready for SSH connections
2026-04-06 04:06:05,970 - INFO - Waiting for VM mltf_vm to be up..
2026-04-06 04:06:06,078 - DEBUG - VM is in ACTIVE state now
2026-04-06 04:06:06,078 - INFO - VM name : mltf_vm
2026-04-06 04:06:06,183 - DEBUG - VM mltf_vm ID is bcc85453-0395-4db2-ba83-53f8735b9076
2026-04-06 04:06:06,183 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-5596-2
2026-04-06 04:06:06,401 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/bcc85453-0395-4db2-ba83-53f8735b9076
2026-04-06 04:06:06,415 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/5e7cff3d-b43c-4ca1-9f7d-c3f40e7d760d
2026-04-06 04:06:06,429 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/7a8a6962-d5f1-4684-bec2-2cb93028e7c1
2026-04-06 04:06:07,607 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=2.14 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.410 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.410/1.273/2.136/0.863 ms')
2026-04-06 04:06:07,607 - INFO - Ping to Metadata IP 169.254.0.6 of VM mltf_vm passed
2026-04-06 04:06:07,677 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:06:07,677 - DEBUG - Waiting to SSH to VM mltf_vm, IP 138.133.131.197, Port 22
2026-04-06 04:06:07,849 - DEBUG - VM mltf_vm is ready for SSH connections
2026-04-06 04:06:07,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-06 04:06:07,932 - DEBUG - Waiting to SSH to VM mltf_vm, IP 138.133.131.197, Port 22
2026-04-06 04:06:08,095 - DEBUG - VM mltf_vm is ready for SSH connections
2026-04-06 04:06:08,098 - INFO - ================================================================================
2026-04-06 04:06:08,098 - INFO - STARTING TEST : test_verify_session_sampling_teardown
2026-04-06 04:06:08,098 - INFO - TEST DESCRIPTION :
1.query client session samples
2.query server session samples
3.query client session to get number of sessions exported
4.query session record table for teardown bytes/pkts
5.query sample count after teardown on server side
2026-04-06 04:06:09,402 - DEBUG - Skipping xmpp flap check
2026-04-06 04:06:09,402 - INFO - Initial checks done. Running the testcase now
2026-04-06 04:06:09,402 - INFO -
2026-04-06 04:06:09,539 - INFO - Setting flow export rate: 100
2026-04-06 04:06:09,588 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2026-04-06 04:06:09,934 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'ea4fce47-6bcb-4810-8647-ee56ed686e1b', 'name': 'ctest-vn1-16842154', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'project_id': 'fdc3710892ea4755925f73a997cf56c8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['15e90d30-7cb3-4a86-ad66-4394656baf88'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'ctest-vn1-16842154'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '138.133.131.192/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2026-04-06 04:06:10,121 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'af48a683-da93-401d-be2b-ef2969f6e3b7', 'name': 'ctest-vn2-89443678', 'tenant_id': 'fdc3710892ea4755925f73a997cf56c8', 'project_id': 'fdc3710892ea4755925f73a997cf56c8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['4e9e87af-1a66-4ac4-ac09-f49eff2bb80d'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'ctest-vn2-89443678'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '209.216.19.128/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2026-04-06 04:06:10,211 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:10,217 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:10,228 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:10,330 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:10,342 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:10,361 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:10,373 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:10,396 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:06:10,406 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:10,406 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:10,426 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:10,455 - INFO - Verified VN network id 15 for VN ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:10,455 - INFO - Verifications in API Server for VN ctest-vn1-16842154 passed
2026-04-06 04:06:10,455 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:10,469 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:10,481 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:10,510 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:06:10,536 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.639455'}
2026-04-06 04:06:10,557 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:10,565 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.671884'}
2026-04-06 04:06:10,581 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:10,586 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.686910'}
2026-04-06 04:06:10,593 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:10,593 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-16842154 passed
2026-04-06 04:06:10,593 - DEBUG - ====Verifying policy data for ctest-vn1-16842154 in API_Server ======
2026-04-06 04:06:10,593 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:10,599 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:10,615 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:10,701 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:10,715 - DEBUG - ==>Verifying data for policy with id: 6ac406c9-c517-4d0f-b13d-5f9fc6960c68, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'policy1']
2026-04-06 04:06:10,715 - INFO - VN ctest-vn1-16842154 Policy verification: verify_vn_policy_in_api_server, status: True
2026-04-06 04:06:10,716 - DEBUG - Verifying the vn in opserver
2026-04-06 04:06:10,716 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.249
2026-04-06 04:06:10,716 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:06:10,729 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:06:10,729 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.27
2026-04-06 04:06:10,729 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:06:10,745 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:06:10,745 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.33
2026-04-06 04:06:10,745 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:06:10,760 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:06:10,760 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is found in opserver
2026-04-06 04:06:10,772 - DEBUG - VRF ids for VN ctest-vn1-16842154: {'10.0.0.241': '3'}
2026-04-06 04:06:10,772 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:10,778 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:10,789 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:10,890 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:10,904 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:10,914 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:10,924 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:10,931 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/76ebc919-978f-4b6e-97b8-ea51e5613808
2026-04-06 04:06:10,938 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:10,938 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:10,949 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:10,966 - INFO - Verified VN network id 16 for VN af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:10,966 - INFO - Verifications in API Server for VN ctest-vn2-89443678 passed
2026-04-06 04:06:10,966 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:10,975 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:10,983 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:10,990 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/76ebc919-978f-4b6e-97b8-ea51e5613808
2026-04-06 04:06:11,001 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.909108'}
2026-04-06 04:06:11,006 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,013 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.921749'}
2026-04-06 04:06:11,021 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,028 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.935471'}
2026-04-06 04:06:11,036 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,036 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-89443678 passed
2026-04-06 04:06:11,037 - DEBUG - ====Verifying policy data for ctest-vn2-89443678 in API_Server ======
2026-04-06 04:06:11,037 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:11,044 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:11,058 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:11,163 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:11,176 - DEBUG - ==>Verifying data for policy with id: 6ac406c9-c517-4d0f-b13d-5f9fc6960c68, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'policy1']
2026-04-06 04:06:11,176 - INFO - VN ctest-vn2-89443678 Policy verification: verify_vn_policy_in_api_server, status: True
2026-04-06 04:06:11,177 - DEBUG - Verifying the vn in opserver
2026-04-06 04:06:11,177 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.249
2026-04-06 04:06:11,177 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:06:11,199 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:06:11,199 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.27
2026-04-06 04:06:11,199 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:06:11,214 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:06:11,214 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.33
2026-04-06 04:06:11,214 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:06:11,233 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:06:11,233 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 is found in opserver
2026-04-06 04:06:11,244 - DEBUG - VRF ids for VN ctest-vn2-89443678: {'10.0.0.19': '3', '10.0.0.241': '4'}
2026-04-06 04:06:11,244 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:11,252 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:11,266 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:11,366 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:11,380 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:11,391 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:11,400 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:11,410 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:06:11,418 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:11,418 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:11,430 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:11,452 - INFO - Verified VN network id 15 for VN ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:11,452 - INFO - Verifications in API Server for VN ctest-vn1-16842154 passed
2026-04-06 04:06:11,452 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:11,466 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:11,475 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:06:11,484 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/81dffc2a-97ba-4162-a5ee-2ba3eebc1a22
2026-04-06 04:06:11,499 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.606694'}
2026-04-06 04:06:11,508 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:11,516 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.623309'}
2026-04-06 04:06:11,523 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:11,531 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16883940334181763088', 'uuid-lslong': '9675964381546442267'}, 'enable': 'true', 'created': '2026-04-06T04:04:43', 'last-modified': '2026-04-06T04:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.631055'}
2026-04-06 04:06:11,540 - DEBUG - Route Targets: ['target:64512:8000008']
2026-04-06 04:06:11,540 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-16842154 passed
2026-04-06 04:06:11,540 - DEBUG - ====Verifying policy data for ctest-vn1-16842154 in API_Server ======
2026-04-06 04:06:11,541 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:11,547 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:11,558 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:11,656 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ea4fce47-6bcb-4810-8647-ee56ed686e1b
2026-04-06 04:06:11,666 - DEBUG - ==>Verifying data for policy with id: 6ac406c9-c517-4d0f-b13d-5f9fc6960c68, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'policy1']
2026-04-06 04:06:11,666 - INFO - VN ctest-vn1-16842154 Policy verification: verify_vn_policy_in_api_server, status: True
2026-04-06 04:06:11,666 - DEBUG - Verifying the vn in opserver
2026-04-06 04:06:11,666 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.249
2026-04-06 04:06:11,666 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:06:11,680 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:06:11,680 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.27
2026-04-06 04:06:11,680 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:06:11,695 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:06:11,695 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 virtual network link through opserver 10.0.0.33
2026-04-06 04:06:11,695 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:06:11,710 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154?flat'}
2026-04-06 04:06:11,710 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154 is found in opserver
2026-04-06 04:06:11,723 - DEBUG - VRF ids for VN ctest-vn1-16842154: {'10.0.0.241': '3'}
2026-04-06 04:06:11,724 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:11,731 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:11,744 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:11,837 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:11,854 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:11,866 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:11,873 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:11,879 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/76ebc919-978f-4b6e-97b8-ea51e5613808
2026-04-06 04:06:11,886 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,886 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:11,894 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:11,910 - INFO - Verified VN network id 16 for VN af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:11,910 - INFO - Verifications in API Server for VN ctest-vn2-89443678 passed
2026-04-06 04:06:11,911 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:11,921 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:11,930 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:06:11,939 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/76ebc919-978f-4b6e-97b8-ea51e5613808
2026-04-06 04:06:11,953 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.861263'}
2026-04-06 04:06:11,959 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,964 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.873407'}
2026-04-06 04:06:11,970 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,976 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12630528240198565917', 'uuid-lslong': '13703309252355351479'}, 'enable': 'true', 'created': '2026-04-06T04:05:18', 'last-modified': '2026-04-06T04:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.885251'}
2026-04-06 04:06:11,982 - DEBUG - Route Targets: ['target:64512:8000009']
2026-04-06 04:06:11,982 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-89443678 passed
2026-04-06 04:06:11,982 - DEBUG - ====Verifying policy data for ctest-vn2-89443678 in API_Server ======
2026-04-06 04:06:11,983 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:11,988 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:11,999 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:12,099 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/af48a683-da93-401d-be2b-ef2969f6e3b7
2026-04-06 04:06:12,109 - DEBUG - ==>Verifying data for policy with id: 6ac406c9-c517-4d0f-b13d-5f9fc6960c68, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-16880733', 'policy1']
2026-04-06 04:06:12,109 - INFO - VN ctest-vn2-89443678 Policy verification: verify_vn_policy_in_api_server, status: True
2026-04-06 04:06:12,109 - DEBUG - Verifying the vn in opserver
2026-04-06 04:06:12,109 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.249
2026-04-06 04:06:12,109 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:06:12,120 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:06:12,120 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.27
2026-04-06 04:06:12,120 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:06:12,133 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:06:12,134 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 virtual network link through opserver 10.0.0.33
2026-04-06 04:06:12,134 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:06:12,148 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678?flat'}
2026-04-06 04:06:12,149 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678 is found in opserver
2026-04-06 04:06:12,159 - DEBUG - VRF ids for VN ctest-vn2-89443678: {'10.0.0.19': '3', '10.0.0.241': '4'}
2026-04-06 04:06:12,159 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:12,165 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:12,177 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:12,279 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:06:12,289 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:06:12,297 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:06:12,306 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:06:12,314 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ba8cec5-5385-499e-beb0-4c9d01e02f61
2026-04-06 04:06:12,321 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:06:12,321 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:06:12,332 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:06:12,353 - INFO - Verified VN network id 17 for VN 204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:06:12,353 - INFO - Verifications in API Server for VN ctest-fip_vn-23002226 passed
2026-04-06 04:06:12,353 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:06:12,369 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:06:12,383 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:06:12,394 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ba8cec5-5385-499e-beb0-4c9d01e02f61
2026-04-06 04:06:12,413 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2327869512695367025', 'uuid-lslong': '9956074918626047077'}, 'enable': 'true', 'created': '2026-04-06T04:05:19', 'last-modified': '2026-04-06T04:05:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:52.777267'}
2026-04-06 04:06:12,422 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:06:12,430 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2327869512695367025', 'uuid-lslong': '9956074918626047077'}, 'enable': 'true', 'created': '2026-04-06T04:05:19', 'last-modified': '2026-04-06T04:05:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:52.794517'}
2026-04-06 04:06:12,440 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:06:12,448 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-16880733', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2327869512695367025', 'uuid-lslong': '9956074918626047077'}, 'enable': 'true', 'created': '2026-04-06T04:05:19', 'last-modified': '2026-04-06T04:05:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:52.813113'}
2026-04-06 04:06:12,455 - DEBUG - Route Targets: ['target:64512:8000010']
2026-04-06 04:06:12,455 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-23002226 passed
2026-04-06 04:06:12,455 - DEBUG - ====Verifying policy data for ctest-fip_vn-23002226 in API_Server ======
2026-04-06 04:06:12,455 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:06:12,465 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:06:12,481 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:06:12,586 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/204e40fc-fbab-4571-8a2b-156391e1b465
2026-04-06 04:06:12,600 - DEBUG - =>VN ctest-fip_vn-23002226 has no policy to be verified
2026-04-06 04:06:12,600 - DEBUG - Verifying the vn in opserver
2026-04-06 04:06:12,600 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 virtual network link through opserver 10.0.0.249
2026-04-06 04:06:12,600 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-04-06 04:06:12,613 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226?flat'}
2026-04-06 04:06:12,613 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 virtual network link through opserver 10.0.0.27
2026-04-06 04:06:12,613 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2026-04-06 04:06:12,629 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226?flat'}
2026-04-06 04:06:12,629 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 virtual network link through opserver 10.0.0.33
2026-04-06 04:06:12,629 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2026-04-06 04:06:12,646 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226?flat'}
2026-04-06 04:06:12,646 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226 is found in opserver
2026-04-06 04:06:12,658 - DEBUG - VRF ids for VN ctest-fip_vn-23002226: {'10.0.0.19': '4'}
2026-04-06 04:06:12,658 - INFO - start time= 1775448372658434
2026-04-06 04:06:12,658 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 209.216.19.131, host_string: cirros@169.254.0.4, password: gocubsgogateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-06 04:06:12,658 - DEBUG - ping -s 56 -c 3 -W 1 209.216.19.131
2026-04-06 04:06:16,582 - DEBUG - PING 209.216.19.131 (209.216.19.131): 56 data bytes
64 bytes from 209.216.19.131: seq=0 ttl=63 time=6.248 ms
64 bytes from 209.216.19.131: seq=1 ttl=63 time=1.682 ms
64 bytes from 209.216.19.131: seq=2 ttl=63 time=1.265 ms
--- 209.216.19.131 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.265/3.065/6.248 ms
2026-04-06 04:06:16,583 - INFO - Ping to IP 209.216.19.131 from VM ctest-vn1_vm1-86723029 passed
2026-04-06 04:06:26,583 - INFO - Verify session samples and teardown pkts
2026-04-06 04:06:26,584 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.249
2026-04-06 04:06:26,592 - DEBUG - Posting: http://10.0.0.249:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1775448372658434, 'end_time': 1775448386592341, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-04-06 04:06:27,620 - DEBUG - [{'T': 1775448375504251}, {'T': 1775448376504287}, {'T': 1775448377504418}]
2026-04-06 04:06:27,621 - DEBUG - Posting: http://10.0.0.249:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1775448372658434, 'end_time': 1775448387621236, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2026-04-06 04:06:28,643 - DEBUG - [{'T': 1775448375491499}, {'T': 1775448376491587}, {'T': 1775448377491683}]
2026-04-06 04:06:28,643 - DEBUG - Posting: http://10.0.0.249:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1775448372658434, 'end_time': 1775448388643732, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2026-04-06 04:06:29,668 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', 'sample_count': 3}]
2026-04-06 04:06:29,668 - INFO - wait for the flows to get expire
2026-04-06 04:09:49,670 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-5596-2:Compute:contrail-vrouter-agent:0?flat
2026-04-06 04:09:49,774 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-5596-2?flat
2026-04-06 04:09:50,366 - INFO - Deleted policy policy1
2026-04-06 04:09:50,479 - INFO - Setting flow export rate: None
2026-04-06 04:09:51,767 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Mon Apr 6 04:09:49 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=)
1281 src_vn = self.res.vn1_fixture.vn_fq_name
1282 dst_vn = self.res.vn2_fixture.vn_fq_name
1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn)
1284
1285 assert result,'Failed to get expected number of samples'
result = True
self =
self.verify_session_sampling_teardown = >
start_time = '1775448372658434'
src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154'
dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678'
/contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1775448372658434', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678')
486 flow_record = self.analytics_obj.get_flows_vrouter_uve(
487 vrouter=vm_host)
488 assert not flow_record,'flows not got deleted even after 240 sec'
489
490 res = self.analytics_obj.ops_inspect[ip].post_query(
flow_record = 10
AssertionError: flows not got deleted even after 240 sec
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('flows not got deleted even after 240 sec',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown
result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn)
File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown
assert not flow_record,'flows not got deleted even after 240 sec'
AssertionError: flows not got deleted even after 240 sec
2026-04-06 04:09:51,768 - DEBUG - Skipping xmpp flap check
2026-04-06 04:09:51,768 - INFO -
2026-04-06 04:09:51,768 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:43]
2026-04-06 04:09:51,768 - INFO - --------------------------------------------------------------------------------
2026-04-06 04:09:51,771 - INFO - Deleting VM mltf_vm
2026-04-06 04:09:51,864 - INFO - Deleting VM ctest-fvn_vm1-09086440
2026-04-06 04:09:51,933 - INFO - Deleting VM ctest-vn2_vm2-09655157
2026-04-06 04:09:52,006 - INFO - Deleting VN ctest-fip_vn-23002226
2026-04-06 04:09:52,054 - DEBUG - VN 204e40fc-fbab-4571-8a2b-156391e1b465 still in use: Unable to complete operation on network 204e40fc-fbab-4571-8a2b-156391e1b465. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-d6aa2c27-7325-4fbc-a828-5b81492bd4e8']
2026-04-06 04:09:52,054 - WARNING - Deleting VN ctest-fip_vn-23002226 failed..Will retry
2026-04-06 04:09:54,233 - DEBUG - Response for deleting network ()
2026-04-06 04:09:54,233 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2f3410fe-2691-490a-8788-be9ba9cd3cbf
2026-04-06 04:09:54,292 - DEBUG - Response Code: 404
2026-04-06 04:09:54,292 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:09:54,300 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:09:54,316 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:09:54,414 - INFO - Validated that VN ctest-fip_vn-23002226 is not found in API Server
2026-04-06 04:09:54,424 - DEBUG - VN ctest-fip_vn-23002226 is not present in Agent 10.0.0.19
2026-04-06 04:09:54,435 - DEBUG - VN ctest-fip_vn-23002226 is not present in Agent 10.0.0.241
2026-04-06 04:09:54,435 - INFO - Validated that VN ctest-fip_vn-23002226 is not in any agent
2026-04-06 04:09:54,439 - DEBUG - VRF 4 is not seen in agent 10.0.0.19
2026-04-06 04:09:54,444 - DEBUG - Vrouter 10.0.0.19 does not have vrf 4 for VN ctest-fip_vn-23002226
2026-04-06 04:09:54,444 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-fip_vn-23002226
2026-04-06 04:09:54,464 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-23002226 info
2026-04-06 04:09:54,464 - INFO - Deleting VN ctest-vn2-89443678
2026-04-06 04:09:59,639 - DEBUG - Response for deleting network ()
2026-04-06 04:09:59,639 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/d3d6b138-7782-43c4-99a9-ea61e0de01aa
2026-04-06 04:09:59,647 - DEBUG - Response Code: 404
2026-04-06 04:09:59,647 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:09:59,659 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:09:59,713 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:09:59,801 - INFO - Validated that VN ctest-vn2-89443678 is not found in API Server
2026-04-06 04:09:59,813 - DEBUG - VN ctest-vn2-89443678 is not present in Agent 10.0.0.19
2026-04-06 04:09:59,824 - DEBUG - VN ctest-vn2-89443678 is not present in Agent 10.0.0.241
2026-04-06 04:09:59,824 - INFO - Validated that VN ctest-vn2-89443678 is not in any agent
2026-04-06 04:09:59,830 - DEBUG - VRF 3 is not seen in agent 10.0.0.19
2026-04-06 04:09:59,835 - DEBUG - Vrouter 10.0.0.19 does not have vrf 3 for VN ctest-vn2-89443678
2026-04-06 04:09:59,840 - DEBUG - VRF 4 is not seen in agent 10.0.0.241
2026-04-06 04:09:59,845 - DEBUG - Vrouter 10.0.0.241 does not have vrf 4 for VN ctest-vn2-89443678
2026-04-06 04:09:59,845 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn2-89443678
2026-04-06 04:09:59,864 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-89443678 info
2026-04-06 04:09:59,864 - INFO - Deleting VM ctest-vn1_vm2-48022468
2026-04-06 04:09:59,954 - INFO - Deleting VM ctest-vn1_vm1-86723029
2026-04-06 04:10:00,050 - INFO - Deleting VN ctest-vn1-16842154
2026-04-06 04:10:00,108 - DEBUG - VN ea4fce47-6bcb-4810-8647-ee56ed686e1b still in use: Unable to complete operation on network ea4fce47-6bcb-4810-8647-ee56ed686e1b. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-73c6b23b-442b-4e13-9b5f-102165f1a91d']
2026-04-06 04:10:00,108 - WARNING - Deleting VN ctest-vn1-16842154 failed..Will retry
2026-04-06 04:10:02,373 - DEBUG - Response for deleting network ()
2026-04-06 04:10:02,373 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/77b5c1f2-e3e0-448b-8112-8eee4caeff75
2026-04-06 04:10:02,380 - DEBUG - Response Code: 404
2026-04-06 04:10:02,380 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-04-06 04:10:02,387 - DEBUG - Requesting: http://10.0.0.249:8082/domain/500738d8-636d-4330-98c4-d5dafb5cbb39
2026-04-06 04:10:02,403 - DEBUG - Requesting: http://10.0.0.249:8082/project/fdc37108-92ea-4755-925f-73a997cf56c8
2026-04-06 04:10:02,493 - INFO - Validated that VN ctest-vn1-16842154 is not found in API Server
2026-04-06 04:10:02,506 - DEBUG - VN ctest-vn1-16842154 is not present in Agent 10.0.0.19
2026-04-06 04:10:02,516 - DEBUG - VN ctest-vn1-16842154 is not present in Agent 10.0.0.241
2026-04-06 04:10:02,516 - INFO - Validated that VN ctest-vn1-16842154 is not in any agent
2026-04-06 04:10:02,521 - DEBUG - VRF 3 is not seen in agent 10.0.0.241
2026-04-06 04:10:02,526 - DEBUG - Vrouter 10.0.0.241 does not have vrf 3 for VN ctest-vn1-16842154
2026-04-06 04:10:02,526 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-16880733:ctest-vn1-16842154
2026-04-06 04:10:02,548 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-16842154 info
2026-04-06 04:10:03,357 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-16880733, ID : fdc37108-92ea-4755-925f-73a997cf56c8