2025-08-11 12:18:05,237 - INFO - Domain Default found not creating 2025-08-11 12:18:05,356 - INFO - Project ctest-AnalyticsTestSanityWithResource-65455482 not found, creating it 2025-08-11 12:18:06,115 - INFO - Created Project:ctest-AnalyticsTestSanityWithResource-65455482, ID : 2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:08,091 - DEBUG - Response for create_network : {'network': {'id': '98f5cadf-1f69-4040-b621-36c721b08707', 'name': 'ctest-vn1-63983662', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'project_id': '2effd72f8ace46378712b92c708d89ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'ctest-vn1-63983662'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 12:18:08,368 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a7fdb6fa-1893-4552-9f06-6c66d3c12b40', 'name': '', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'network_id': '98f5cadf-1f69-4040-b621-36c721b08707', 'ip_version': 4, 'cidr': '197.85.155.64/26', 'allocation_pools': [{'start': '197.85.155.66', 'end': '197.85.155.126'}], 'gateway_ip': '197.85.155.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.85.155.66', 'tags': [], 'project_id': '2effd72f8ace46378712b92c708d89ad'}} 2025-08-11 12:18:08,394 - INFO - Created VN ctest-vn1-63983662 2025-08-11 12:18:08,404 - DEBUG - VN ctest-vn1-63983662 UUID is 98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:08,483 - DEBUG - Services list from nova: [, , , ] 2025-08-11 12:18:08,483 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3803-2', 'an-jenkins-deploy-platform-ansible-os-3803-1']} 2025-08-11 12:18:09,476 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3803-2) 2025-08-11 12:18:10,864 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3803-2) 2025-08-11 12:18:10,864 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:11,380 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:11,442 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:11,467 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:11,571 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:11,585 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:11,601 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:11,620 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:11,636 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:18:11,645 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:11,645 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:11,657 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:11,674 - INFO - Verified VN network id 12 for VN 98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:11,674 - INFO - Verifications in API Server for VN ctest-vn1-63983662 passed 2025-08-11 12:18:11,674 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:11,684 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:11,691 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:11,698 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:18:11,709 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:18:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.399380'} 2025-08-11 12:18:11,714 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:11,720 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:18:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.413353'} 2025-08-11 12:18:11,726 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:11,732 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:18:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.424634'} 2025-08-11 12:18:11,739 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:11,739 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-63983662 passed 2025-08-11 12:18:11,740 - DEBUG - ====Verifying policy data for ctest-vn1-63983662 in API_Server ====== 2025-08-11 12:18:11,740 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:11,745 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:11,757 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:11,844 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:11,855 - DEBUG - =>VN ctest-vn1-63983662 has no policy to be verified 2025-08-11 12:18:11,855 - DEBUG - Verifying the vn in opserver 2025-08-11 12:18:11,855 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.56 2025-08-11 12:18:11,855 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:18:12,144 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:18:12,195 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:18:12,195 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.38 2025-08-11 12:18:12,195 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:18:12,483 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:18:12,535 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:18:12,535 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.22 2025-08-11 12:18:12,535 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:18:12,828 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:18:12,884 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:18:12,884 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is found in opserver 2025-08-11 12:18:12,896 - DEBUG - VRF ids for VN ctest-vn1-63983662: {'10.0.0.41': '2'} 2025-08-11 12:18:12,896 - INFO - Waiting for VM ctest-vn1_vm1-56250947 to be up.. 2025-08-11 12:18:12,971 - DEBUG - VM is in ACTIVE state now 2025-08-11 12:18:12,971 - INFO - VM name : ctest-vn1_vm1-56250947 2025-08-11 12:18:13,059 - DEBUG - VM ctest-vn1_vm1-56250947 ID is ef2ecf34-a2b3-4a09-bea9-3bf4debc4abb 2025-08-11 12:18:13,082 - DEBUG - VM ctest-vn1_vm1-56250947 launched on Node an-jenkins-deploy-platform-ansible-os-3803-2 2025-08-11 12:18:13,155 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/ef2ecf34-a2b3-4a09-bea9-3bf4debc4abb 2025-08-11 12:18:13,445 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/ef2ecf34-a2b3-4a09-bea9-3bf4debc4abb 2025-08-11 12:18:13,475 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/4be82fb7-c7e7-42f9-9f70-7d7b05231f32 2025-08-11 12:18:16,708 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2025-08-11 12:18:16,708 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-56250947 failed! 2025-08-11 12:18:16,724 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is 197.85.155.65 and allocation pool is NOT set 2025-08-11 12:18:20,805 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-11 12:18:20,805 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-56250947 failed! 2025-08-11 12:18:20,817 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is 197.85.155.65 and allocation pool is NOT set 2025-08-11 12:18:24,902 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-08-11 12:18:24,902 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-56250947 failed! 2025-08-11 12:18:24,917 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is 197.85.155.65 and allocation pool is NOT set 2025-08-11 12:18:29,002 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=7.42 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1024ms\r\nrtt min/avg/max/mdev = 7.417/7.417/7.417/0.000 ms') 2025-08-11 12:18:29,002 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1-56250947 passed 2025-08-11 12:18:29,117 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:18:29,117 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-56250947, IP 197.85.155.67, Port 22 2025-08-11 12:18:29,187 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-11 12:18:29,266 - DEBUG - VM ctest-vn1_vm1-56250947 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-11 12:18:34,267 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:18:34,267 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1-56250947, IP 197.85.155.67, Port 22 2025-08-11 12:18:34,441 - DEBUG - VM ctest-vn1_vm1-56250947 is ready for SSH connections 2025-08-11 12:18:34,441 - INFO - Waiting for VM ctest-vn1_vm2-25007964 to be up.. 2025-08-11 12:18:34,509 - DEBUG - VM is in ACTIVE state now 2025-08-11 12:18:34,510 - INFO - VM name : ctest-vn1_vm2-25007964 2025-08-11 12:18:34,575 - DEBUG - VM ctest-vn1_vm2-25007964 ID is 7b99d5f8-9f4d-4301-b098-2285687b5f87 2025-08-11 12:18:34,576 - DEBUG - VM ctest-vn1_vm2-25007964 launched on Node an-jenkins-deploy-platform-ansible-os-3803-2 2025-08-11 12:18:34,645 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/7b99d5f8-9f4d-4301-b098-2285687b5f87 2025-08-11 12:18:34,655 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/303ce320-697e-4fea-acac-346cd9c808f8 2025-08-11 12:18:35,848 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.74 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.551 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.551/1.643/2.736/1.092 ms') 2025-08-11 12:18:35,848 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vn1_vm2-25007964 passed 2025-08-11 12:18:35,956 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:18:35,957 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-25007964, IP 197.85.155.68, Port 22 2025-08-11 12:18:36,022 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-11 12:18:36,091 - DEBUG - VM ctest-vn1_vm2-25007964 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-11 12:18:41,092 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:18:41,092 - DEBUG - Waiting to SSH to VM ctest-vn1_vm2-25007964, IP 197.85.155.68, Port 22 2025-08-11 12:18:41,244 - DEBUG - VM ctest-vn1_vm2-25007964 is ready for SSH connections 2025-08-11 12:18:41,470 - DEBUG - Response for create_network : {'network': {'id': '3a69406a-4a6f-4705-9daf-7e6c3dda0149', 'name': 'ctest-vn2-83537811', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'project_id': '2effd72f8ace46378712b92c708d89ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'ctest-vn2-83537811'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 12:18:41,694 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e1a08b59-fa37-4fb5-af28-80678e671854', 'name': '', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'network_id': '3a69406a-4a6f-4705-9daf-7e6c3dda0149', 'ip_version': 4, 'cidr': '117.98.34.64/26', 'allocation_pools': [{'start': '117.98.34.66', 'end': '117.98.34.126'}], 'gateway_ip': '117.98.34.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '117.98.34.66', 'tags': [], 'project_id': '2effd72f8ace46378712b92c708d89ad'}} 2025-08-11 12:18:41,717 - INFO - Created VN ctest-vn2-83537811 2025-08-11 12:18:41,730 - DEBUG - VN ctest-vn2-83537811 UUID is 3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:42,026 - DEBUG - Response for create_network : {'network': {'id': '3805e5e4-fa1a-4199-8fac-3a30fd09227e', 'name': 'ctest-fip_vn-12245910', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'project_id': '2effd72f8ace46378712b92c708d89ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'ctest-fip_vn-12245910'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 12:18:42,253 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ea8931a9-3eb3-436d-b866-28f2bfeb5729', 'name': '', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'network_id': '3805e5e4-fa1a-4199-8fac-3a30fd09227e', 'ip_version': 4, 'cidr': '190.215.160.0/26', 'allocation_pools': [{'start': '190.215.160.2', 'end': '190.215.160.62'}], 'gateway_ip': '190.215.160.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.215.160.2', 'tags': [], 'project_id': '2effd72f8ace46378712b92c708d89ad'}} 2025-08-11 12:18:42,276 - INFO - Created VN ctest-fip_vn-12245910 2025-08-11 12:18:42,288 - DEBUG - VN ctest-fip_vn-12245910 UUID is 3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:42,346 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3803-2', 'an-jenkins-deploy-platform-ansible-os-3803-1']} 2025-08-11 12:18:43,474 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3803-1) 2025-08-11 12:18:44,700 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3803-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3803-1) 2025-08-11 12:18:46,122 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3803-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3803-2) 2025-08-11 12:18:46,122 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:46,130 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:46,142 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:46,256 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:46,269 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:46,290 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:46,299 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:46,308 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:18:46,316 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:46,316 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:46,325 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:46,346 - INFO - Verified VN network id 12 for VN 98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:46,346 - INFO - Verifications in API Server for VN ctest-vn1-63983662 passed 2025-08-11 12:18:46,346 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:46,356 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:46,365 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:18:46,374 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:18:46,387 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:18:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:38.076623'} 2025-08-11 12:18:46,398 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:46,405 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:18:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:38.098762'} 2025-08-11 12:18:46,413 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:46,419 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:18:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:38.111167'} 2025-08-11 12:18:46,427 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:18:46,427 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-63983662 passed 2025-08-11 12:18:46,428 - DEBUG - ====Verifying policy data for ctest-vn1-63983662 in API_Server ====== 2025-08-11 12:18:46,428 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:46,444 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:46,457 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:46,573 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:18:46,613 - DEBUG - =>VN ctest-vn1-63983662 has no policy to be verified 2025-08-11 12:18:46,613 - DEBUG - Verifying the vn in opserver 2025-08-11 12:18:46,613 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.56 2025-08-11 12:18:46,613 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:18:46,709 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:18:46,709 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.38 2025-08-11 12:18:46,709 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:18:46,783 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:18:46,783 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.22 2025-08-11 12:18:46,783 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:18:46,892 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:18:46,892 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is found in opserver 2025-08-11 12:18:46,925 - DEBUG - VRF ids for VN ctest-vn1-63983662: {'10.0.0.41': '2'} 2025-08-11 12:18:46,925 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:46,939 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:46,953 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:47,074 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:47,099 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:47,138 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:18:47,164 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:18:47,176 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e408c062-17e8-43fd-9c5f-624110e0644a 2025-08-11 12:18:47,187 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:18:47,187 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:47,198 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:18:47,214 - INFO - Verified VN network id 13 for VN 3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:47,214 - INFO - Verifications in API Server for VN ctest-vn2-83537811 passed 2025-08-11 12:18:47,214 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:47,229 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:18:47,236 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:18:47,242 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e408c062-17e8-43fd-9c5f-624110e0644a 2025-08-11 12:18:47,256 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.603507'} 2025-08-11 12:18:47,265 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:18:47,271 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.621643'} 2025-08-11 12:18:47,287 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:18:47,293 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.645078'} 2025-08-11 12:18:47,300 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:18:47,300 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-83537811 passed 2025-08-11 12:18:47,300 - DEBUG - ====Verifying policy data for ctest-vn2-83537811 in API_Server ====== 2025-08-11 12:18:47,301 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:47,322 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:47,343 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:47,455 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:18:47,477 - DEBUG - =>VN ctest-vn2-83537811 has no policy to be verified 2025-08-11 12:18:47,478 - DEBUG - Verifying the vn in opserver 2025-08-11 12:18:47,478 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.56 2025-08-11 12:18:47,478 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:18:47,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:18:47,594 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.38 2025-08-11 12:18:47,594 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:18:47,715 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:18:47,715 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.22 2025-08-11 12:18:47,715 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:18:47,793 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:18:47,794 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 is found in opserver 2025-08-11 12:18:47,806 - DEBUG - VRF ids for VN ctest-vn2-83537811: {'10.0.0.19': '2'} 2025-08-11 12:18:47,806 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:47,812 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:47,841 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:47,942 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:47,957 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:47,970 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:18:47,978 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:18:47,986 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/eb561ffc-743e-4603-9b4e-bc955ba35c9c 2025-08-11 12:18:48,001 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:18:48,001 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:48,014 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:18:48,034 - INFO - Verified VN network id 14 for VN 3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:48,035 - INFO - Verifications in API Server for VN ctest-fip_vn-12245910 passed 2025-08-11 12:18:48,035 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:48,047 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:18:48,055 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:18:48,064 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/eb561ffc-743e-4603-9b4e-bc955ba35c9c 2025-08-11 12:18:48,081 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4036885412618846617', 'uuid-lslong': '10352713625496003198'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.873086'} 2025-08-11 12:18:48,094 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:18:48,102 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4036885412618846617', 'uuid-lslong': '10352713625496003198'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.897540'} 2025-08-11 12:18:48,109 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:18:48,115 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4036885412618846617', 'uuid-lslong': '10352713625496003198'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.914077'} 2025-08-11 12:18:48,121 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:18:48,121 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-12245910 passed 2025-08-11 12:18:48,122 - DEBUG - ====Verifying policy data for ctest-fip_vn-12245910 in API_Server ====== 2025-08-11 12:18:48,122 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:18:48,129 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:18:48,140 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:18:48,243 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:18:48,253 - DEBUG - =>VN ctest-fip_vn-12245910 has no policy to be verified 2025-08-11 12:18:48,253 - DEBUG - Verifying the vn in opserver 2025-08-11 12:18:48,253 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 virtual network link through opserver 10.0.0.56 2025-08-11 12:18:48,253 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:18:48,265 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910?flat'} 2025-08-11 12:18:48,265 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 virtual network link through opserver 10.0.0.38 2025-08-11 12:18:48,265 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:18:48,277 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910?flat'} 2025-08-11 12:18:48,277 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 virtual network link through opserver 10.0.0.22 2025-08-11 12:18:48,277 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:18:48,289 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910?flat'} 2025-08-11 12:18:48,289 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 is found in opserver 2025-08-11 12:18:48,302 - DEBUG - VRF ids for VN ctest-fip_vn-12245910: {'10.0.0.19': '3'} 2025-08-11 12:18:48,303 - INFO - Waiting for VM ctest-fvn_vm1-78149083 to be up.. 2025-08-11 12:18:48,386 - DEBUG - VM is in ACTIVE state now 2025-08-11 12:18:48,387 - INFO - VM name : ctest-fvn_vm1-78149083 2025-08-11 12:18:48,479 - DEBUG - VM ctest-fvn_vm1-78149083 ID is df9565c4-6fd9-4abb-8b10-37480d97a051 2025-08-11 12:18:48,479 - DEBUG - VM ctest-fvn_vm1-78149083 launched on Node an-jenkins-deploy-platform-ansible-os-3803-1 2025-08-11 12:18:48,554 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/df9565c4-6fd9-4abb-8b10-37480d97a051 2025-08-11 12:18:48,564 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/9a356da3-dc78-4f18-8529-3886b27975d7 2025-08-11 12:18:51,800 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-08-11 12:18:51,800 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-78149083 failed! 2025-08-11 12:18:51,813 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 is 190.215.160.1 and allocation pool is NOT set 2025-08-11 12:18:55,898 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-11 12:18:55,898 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-78149083 failed! 2025-08-11 12:18:55,913 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 is 190.215.160.1 and allocation pool is NOT set 2025-08-11 12:18:59,996 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-08-11 12:18:59,996 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-78149083 failed! 2025-08-11 12:19:00,011 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 is 190.215.160.1 and allocation pool is NOT set 2025-08-11 12:19:04,084 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-11 12:19:04,084 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-78149083 failed! 2025-08-11 12:19:04,097 - DEBUG - Gateway for vn default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 is 190.215.160.1 and allocation pool is NOT set 2025-08-11 12:19:06,164 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.88 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.21 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.206/5.044/6.882/1.838 ms') 2025-08-11 12:19:06,165 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-fvn_vm1-78149083 passed 2025-08-11 12:19:06,276 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:19:06,276 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-78149083, IP 190.215.160.3, Port 22 2025-08-11 12:19:06,344 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-11 12:19:06,415 - DEBUG - VM ctest-fvn_vm1-78149083 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-11 12:19:11,416 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:19:11,416 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1-78149083, IP 190.215.160.3, Port 22 2025-08-11 12:19:11,574 - DEBUG - VM ctest-fvn_vm1-78149083 is ready for SSH connections 2025-08-11 12:19:11,574 - INFO - Waiting for VM ctest-vn2_vm2-94165282 to be up.. 2025-08-11 12:19:11,850 - DEBUG - VM is in ACTIVE state now 2025-08-11 12:19:11,850 - INFO - VM name : ctest-vn2_vm2-94165282 2025-08-11 12:19:11,924 - DEBUG - VM ctest-vn2_vm2-94165282 ID is 2bc4b34b-7fa4-41f1-ab53-18def6ebb52f 2025-08-11 12:19:11,924 - DEBUG - VM ctest-vn2_vm2-94165282 launched on Node an-jenkins-deploy-platform-ansible-os-3803-1 2025-08-11 12:19:11,995 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/2bc4b34b-7fa4-41f1-ab53-18def6ebb52f 2025-08-11 12:19:12,004 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/1231935e-fe73-4f36-8ed8-a7b82ce8816a 2025-08-11 12:19:13,198 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.35 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.38 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.377/2.862/4.347/1.485 ms') 2025-08-11 12:19:13,199 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn2_vm2-94165282 passed 2025-08-11 12:19:13,308 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:19:13,308 - DEBUG - Waiting to SSH to VM ctest-vn2_vm2-94165282, IP 117.98.34.67, Port 22 2025-08-11 12:19:13,465 - DEBUG - VM ctest-vn2_vm2-94165282 is ready for SSH connections 2025-08-11 12:19:13,465 - INFO - Waiting for VM mltf_vm to be up.. 2025-08-11 12:19:13,534 - DEBUG - VM is in ACTIVE state now 2025-08-11 12:19:13,534 - INFO - VM name : mltf_vm 2025-08-11 12:19:13,607 - DEBUG - VM mltf_vm ID is 44c3bad7-565c-4576-87ef-27337fd8833e 2025-08-11 12:19:13,607 - DEBUG - VM mltf_vm launched on Node an-jenkins-deploy-platform-ansible-os-3803-2 2025-08-11 12:19:13,741 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/44c3bad7-565c-4576-87ef-27337fd8833e 2025-08-11 12:19:13,752 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/588bb8f3-325f-4941-9d04-b896af3f8eb8 2025-08-11 12:19:13,762 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/b10687d4-3129-4677-8caa-5432099a9a9b 2025-08-11 12:19:14,978 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=1.53 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.415 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.415/0.974/1.534/0.559 ms') 2025-08-11 12:19:14,978 - INFO - Ping to Metadata IP 169.254.0.5 of VM mltf_vm passed 2025-08-11 12:19:15,088 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:19:15,088 - DEBUG - Waiting to SSH to VM mltf_vm, IP 197.85.155.69, Port 22 2025-08-11 12:19:15,248 - DEBUG - VM mltf_vm is ready for SSH connections 2025-08-11 12:19:15,355 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-11 12:19:15,355 - DEBUG - Waiting to SSH to VM mltf_vm, IP 197.85.155.69, Port 22 2025-08-11 12:19:15,522 - DEBUG - VM mltf_vm is ready for SSH connections 2025-08-11 12:19:15,523 - INFO - ================================================================================ 2025-08-11 12:19:15,523 - INFO - STARTING TEST : test_verify_session_sampling_teardown 2025-08-11 12:19:15,524 - INFO - TEST DESCRIPTION : 1.query client session samples 2.query server session samples 3.query client session to get number of sessions exported 4.query session record table for teardown bytes/pkts 5.query sample count after teardown on server side 2025-08-11 12:19:16,777 - DEBUG - Skipping xmpp flap check 2025-08-11 12:19:16,777 - INFO - Initial checks done. Running the testcase now 2025-08-11 12:19:16,777 - INFO - 2025-08-11 12:19:16,984 - INFO - Setting flow export rate: 100 2025-08-11 12:19:17,032 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-11 12:19:17,341 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '98f5cadf-1f69-4040-b621-36c721b08707', 'name': 'ctest-vn1-63983662', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'project_id': '2effd72f8ace46378712b92c708d89ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['a7fdb6fa-1893-4552-9f06-6c66d3c12b40'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'ctest-vn1-63983662'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '197.85.155.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-11 12:19:17,568 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '3a69406a-4a6f-4705-9daf-7e6c3dda0149', 'name': 'ctest-vn2-83537811', 'tenant_id': '2effd72f8ace46378712b92c708d89ad', 'project_id': '2effd72f8ace46378712b92c708d89ad', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['e1a08b59-fa37-4fb5-af28-80678e671854'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'ctest-vn2-83537811'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '117.98.34.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}} 2025-08-11 12:19:17,650 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:17,659 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:17,693 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:17,787 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:17,803 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:17,815 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:17,825 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:17,836 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:19:17,880 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:17,881 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:17,897 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:17,916 - INFO - Verified VN network id 12 for VN 98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:17,916 - INFO - Verifications in API Server for VN ctest-vn1-63983662 passed 2025-08-11 12:19:17,916 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:17,947 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:17,971 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:18,002 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:19:18,038 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.727209'} 2025-08-11 12:19:18,047 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,054 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.746046'} 2025-08-11 12:19:18,063 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,070 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.759667'} 2025-08-11 12:19:18,077 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,077 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-63983662 passed 2025-08-11 12:19:18,077 - DEBUG - ====Verifying policy data for ctest-vn1-63983662 in API_Server ====== 2025-08-11 12:19:18,077 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:18,086 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:18,104 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:18,221 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:18,233 - DEBUG - ==>Verifying data for policy with id: 1c50500e-72dc-4b7c-8ced-535d5c939506, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'policy1'] 2025-08-11 12:19:18,233 - INFO - VN ctest-vn1-63983662 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-11 12:19:18,233 - DEBUG - Verifying the vn in opserver 2025-08-11 12:19:18,234 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.56 2025-08-11 12:19:18,234 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:19:18,245 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:19:18,245 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.38 2025-08-11 12:19:18,245 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:19:18,255 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:19:18,256 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.22 2025-08-11 12:19:18,256 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:19:18,268 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:19:18,268 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is found in opserver 2025-08-11 12:19:18,284 - DEBUG - VRF ids for VN ctest-vn1-63983662: {'10.0.0.41': '2'} 2025-08-11 12:19:18,284 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:18,290 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:18,301 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:18,391 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:18,405 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:18,415 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:18,422 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:18,430 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e408c062-17e8-43fd-9c5f-624110e0644a 2025-08-11 12:19:18,436 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:18,436 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:18,445 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:18,461 - INFO - Verified VN network id 13 for VN 3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:18,461 - INFO - Verifications in API Server for VN ctest-vn2-83537811 passed 2025-08-11 12:19:18,461 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:18,470 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:18,478 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:18,485 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e408c062-17e8-43fd-9c5f-624110e0644a 2025-08-11 12:19:18,496 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.971243'} 2025-08-11 12:19:18,502 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:18,508 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.987314'} 2025-08-11 12:19:18,514 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:18,519 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.996307'} 2025-08-11 12:19:18,526 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:18,526 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-83537811 passed 2025-08-11 12:19:18,526 - DEBUG - ====Verifying policy data for ctest-vn2-83537811 in API_Server ====== 2025-08-11 12:19:18,527 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:18,532 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:18,551 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:18,648 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:18,660 - DEBUG - ==>Verifying data for policy with id: 1c50500e-72dc-4b7c-8ced-535d5c939506, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'policy1'] 2025-08-11 12:19:18,660 - INFO - VN ctest-vn2-83537811 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-11 12:19:18,660 - DEBUG - Verifying the vn in opserver 2025-08-11 12:19:18,660 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.56 2025-08-11 12:19:18,660 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:19:18,671 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:19:18,671 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.38 2025-08-11 12:19:18,671 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:19:18,682 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:19:18,682 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.22 2025-08-11 12:19:18,682 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:19:18,695 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:19:18,695 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 is found in opserver 2025-08-11 12:19:18,709 - DEBUG - VRF ids for VN ctest-vn2-83537811: {'10.0.0.19': '2', '10.0.0.41': '3'} 2025-08-11 12:19:18,709 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:18,714 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:18,726 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:18,825 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:18,840 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:18,852 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:18,859 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:18,867 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:19:18,874 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,874 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:18,884 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:18,899 - INFO - Verified VN network id 12 for VN 98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:18,899 - INFO - Verifications in API Server for VN ctest-vn1-63983662 passed 2025-08-11 12:19:18,899 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:18,909 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:18,917 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:19:18,924 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c70b3050-017f-4f21-a839-3904a1da3f28 2025-08-11 12:19:18,935 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.626589'} 2025-08-11 12:19:18,941 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,946 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.638736'} 2025-08-11 12:19:18,952 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,958 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11021938722712666176', 'uuid-lslong': '13123831018025944839'}, 'enable': 'true', 'created': '2025-08-11T12:18:08', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.647233'} 2025-08-11 12:19:18,964 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 12:19:18,964 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-63983662 passed 2025-08-11 12:19:18,964 - DEBUG - ====Verifying policy data for ctest-vn1-63983662 in API_Server ====== 2025-08-11 12:19:18,964 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:18,969 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:18,980 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:19,070 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/98f5cadf-1f69-4040-b621-36c721b08707 2025-08-11 12:19:19,083 - DEBUG - ==>Verifying data for policy with id: 1c50500e-72dc-4b7c-8ced-535d5c939506, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'policy1'] 2025-08-11 12:19:19,083 - INFO - VN ctest-vn1-63983662 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-11 12:19:19,083 - DEBUG - Verifying the vn in opserver 2025-08-11 12:19:19,083 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.56 2025-08-11 12:19:19,083 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,094 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:19:19,094 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.38 2025-08-11 12:19:19,094 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,105 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:19:19,105 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 virtual network link through opserver 10.0.0.22 2025-08-11 12:19:19,105 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,116 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662?flat'} 2025-08-11 12:19:19,116 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 is found in opserver 2025-08-11 12:19:19,128 - DEBUG - VRF ids for VN ctest-vn1-63983662: {'10.0.0.41': '2'} 2025-08-11 12:19:19,128 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:19,133 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:19,144 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:19,233 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:19,243 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:19,253 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:19,260 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:19,267 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e408c062-17e8-43fd-9c5f-624110e0644a 2025-08-11 12:19:19,273 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:19,273 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:19,282 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:19,296 - INFO - Verified VN network id 13 for VN 3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:19,296 - INFO - Verifications in API Server for VN ctest-vn2-83537811 passed 2025-08-11 12:19:19,296 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:19,306 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:19,313 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:19:19,320 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e408c062-17e8-43fd-9c5f-624110e0644a 2025-08-11 12:19:19,331 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.806385'} 2025-08-11 12:19:19,338 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:19,344 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.823094'} 2025-08-11 12:19:19,351 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:19,356 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4208966152013956869', 'uuid-lslong': '11362439388238315849'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:19:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.833111'} 2025-08-11 12:19:19,363 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 12:19:19,363 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-83537811 passed 2025-08-11 12:19:19,363 - DEBUG - ====Verifying policy data for ctest-vn2-83537811 in API_Server ====== 2025-08-11 12:19:19,363 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:19,369 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:19,380 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:19,468 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3a69406a-4a6f-4705-9daf-7e6c3dda0149 2025-08-11 12:19:19,478 - DEBUG - ==>Verifying data for policy with id: 1c50500e-72dc-4b7c-8ced-535d5c939506, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-65455482', 'policy1'] 2025-08-11 12:19:19,478 - INFO - VN ctest-vn2-83537811 Policy verification: verify_vn_policy_in_api_server, status: True 2025-08-11 12:19:19,478 - DEBUG - Verifying the vn in opserver 2025-08-11 12:19:19,478 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.56 2025-08-11 12:19:19,478 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,490 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:19:19,490 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.38 2025-08-11 12:19:19,490 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,501 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:19:19,501 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 virtual network link through opserver 10.0.0.22 2025-08-11 12:19:19,501 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811?flat'} 2025-08-11 12:19:19,511 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 is found in opserver 2025-08-11 12:19:19,524 - DEBUG - VRF ids for VN ctest-vn2-83537811: {'10.0.0.19': '2', '10.0.0.41': '3'} 2025-08-11 12:19:19,524 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:19,530 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:19,541 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:19,640 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:19:19,652 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:19:19,661 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:19:19,668 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:19:19,676 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/eb561ffc-743e-4603-9b4e-bc955ba35c9c 2025-08-11 12:19:19,683 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:19:19,683 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:19:19,693 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:19:19,706 - INFO - Verified VN network id 14 for VN 3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:19:19,706 - INFO - Verifications in API Server for VN ctest-fip_vn-12245910 passed 2025-08-11 12:19:19,707 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:19:19,716 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:19:19,723 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:19:19,731 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/eb561ffc-743e-4603-9b4e-bc955ba35c9c 2025-08-11 12:19:19,754 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4036885412618846617', 'uuid-lslong': '10352713625496003198'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:37.548937'} 2025-08-11 12:19:19,761 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:19:19,769 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4036885412618846617', 'uuid-lslong': '10352713625496003198'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:37.563785'} 2025-08-11 12:19:19,775 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:19:19,780 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-65455482', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4036885412618846617', 'uuid-lslong': '10352713625496003198'}, 'enable': 'true', 'created': '2025-08-11T12:18:41', 'last-modified': '2025-08-11T12:18:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:37.579486'} 2025-08-11 12:19:19,787 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 12:19:19,787 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-12245910 passed 2025-08-11 12:19:19,787 - DEBUG - ====Verifying policy data for ctest-fip_vn-12245910 in API_Server ====== 2025-08-11 12:19:19,787 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:19:19,793 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:19:19,810 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:19:19,896 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/3805e5e4-fa1a-4199-8fac-3a30fd09227e 2025-08-11 12:19:19,908 - DEBUG - =>VN ctest-fip_vn-12245910 has no policy to be verified 2025-08-11 12:19:19,908 - DEBUG - Verifying the vn in opserver 2025-08-11 12:19:19,909 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 virtual network link through opserver 10.0.0.56 2025-08-11 12:19:19,909 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,920 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910?flat'} 2025-08-11 12:19:19,920 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 virtual network link through opserver 10.0.0.38 2025-08-11 12:19:19,920 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,930 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910?flat'} 2025-08-11 12:19:19,930 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 virtual network link through opserver 10.0.0.22 2025-08-11 12:19:19,931 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-08-11 12:19:19,941 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910?flat'} 2025-08-11 12:19:19,941 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 is found in opserver 2025-08-11 12:19:19,953 - DEBUG - VRF ids for VN ctest-fip_vn-12245910: {'10.0.0.19': '3'} 2025-08-11 12:19:19,953 - INFO - start time= 1754914759953215 2025-08-11 12:19:19,953 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 117.98.34.67, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-08-11 12:19:19,953 - DEBUG - ping -s 56 -c 3 -W 1 117.98.34.67 2025-08-11 12:19:23,756 - DEBUG - PING 117.98.34.67 (117.98.34.67): 56 data bytes 64 bytes from 117.98.34.67: seq=0 ttl=63 time=3.957 ms 64 bytes from 117.98.34.67: seq=1 ttl=63 time=1.108 ms 64 bytes from 117.98.34.67: seq=2 ttl=63 time=1.015 ms --- 117.98.34.67 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.015/2.026/3.957 ms 2025-08-11 12:19:23,756 - INFO - Ping to IP 117.98.34.67 from VM ctest-vn1_vm1-56250947 passed 2025-08-11 12:19:33,756 - INFO - Verify session samples and teardown pkts 2025-08-11 12:19:33,757 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.56 2025-08-11 12:19:33,760 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754914759953215, 'end_time': 1754914773760176, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-08-11 12:19:34,779 - DEBUG - [{'T': 1754914761742561}, {'T': 1754914762742690}, {'T': 1754914763742718}] 2025-08-11 12:19:34,779 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754914759953215, 'end_time': 1754914774779185, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'} 2025-08-11 12:19:35,796 - DEBUG - [{'T': 1754914761772633}, {'T': 1754914762772668}, {'T': 1754914763772704}] 2025-08-11 12:19:35,796 - DEBUG - Posting: http://10.0.0.56:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754914759953215, 'end_time': 1754914775796618, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'} 2025-08-11 12:19:36,814 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', 'sample_count': 3}] 2025-08-11 12:19:36,814 - INFO - wait for the flows to get expire 2025-08-11 12:22:56,814 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3803-2:Compute:contrail-vrouter-agent:0?flat 2025-08-11 12:22:56,859 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3803-2?flat 2025-08-11 12:22:57,283 - INFO - Deleted policy policy1 2025-08-11 12:22:57,440 - INFO - Setting flow export rate: None 2025-08-11 12:22:58,691 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Mon Aug 11 12:22:56 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_sampling_teardown(self=) 1281 src_vn = self.res.vn1_fixture.vn_fq_name 1282 dst_vn = self.res.vn2_fixture.vn_fq_name 1283 result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) 1284 1285 assert result,'Failed to get expected number of samples' result = True self = self.verify_session_sampling_teardown = > start_time = '1754914759953215' src_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662' dst_vn = 'default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811' /contrail-test/serial_scripts/analytics/base.py in verify_session_sampling_teardown(self=, start_time='1754914759953215', src_vn='default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662', dst_vn='default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811') 486 flow_record = self.analytics_obj.get_flows_vrouter_uve( 487 vrouter=vm_host) 488 assert not flow_record,'flows not got deleted even after 240 sec' 489 490 res = self.analytics_obj.ops_inspect[ip].post_query( flow_record = 2 AssertionError: flows not got deleted even after 240 sec __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('flows not got deleted even after 240 sec',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1283, in test_verify_session_sampling_teardown result = self.verify_session_sampling_teardown(start_time, src_vn, dst_vn) File "/contrail-test/serial_scripts/analytics/base.py", line 488, in verify_session_sampling_teardown assert not flow_record,'flows not got deleted even after 240 sec' AssertionError: flows not got deleted even after 240 sec 2025-08-11 12:22:58,691 - DEBUG - Skipping xmpp flap check 2025-08-11 12:22:58,691 - INFO -
2025-08-11 12:22:58,691 - INFO - END TEST : test_verify_session_sampling_teardown : FAILED[0:03:43]
2025-08-11 12:22:58,692 - INFO - -------------------------------------------------------------------------------- 2025-08-11 12:22:58,693 - INFO - Deleting VM mltf_vm 2025-08-11 12:22:58,751 - INFO - Deleting VM ctest-fvn_vm1-78149083 2025-08-11 12:22:58,806 - INFO - Deleting VM ctest-vn2_vm2-94165282 2025-08-11 12:22:58,863 - INFO - Deleting VN ctest-fip_vn-12245910 2025-08-11 12:22:58,898 - DEBUG - VN 3805e5e4-fa1a-4199-8fac-3a30fd09227e still in use: Unable to complete operation on network 3805e5e4-fa1a-4199-8fac-3a30fd09227e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-9e9cdae8-5e71-4c4b-ba0b-2c1b24240303'] 2025-08-11 12:22:58,898 - WARNING - Deleting VN ctest-fip_vn-12245910 failed..Will retry 2025-08-11 12:23:01,063 - DEBUG - Response for deleting network () 2025-08-11 12:23:01,063 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/c5a3bbb4-32ea-4747-9326-5981340fb1c9 2025-08-11 12:23:01,069 - DEBUG - Response Code: 404 2025-08-11 12:23:01,069 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:23:01,074 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:23:01,085 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:23:01,175 - INFO - Validated that VN ctest-fip_vn-12245910 is not found in API Server 2025-08-11 12:23:01,186 - DEBUG - VN ctest-fip_vn-12245910 is not present in Agent 10.0.0.19 2025-08-11 12:23:01,198 - DEBUG - VN ctest-fip_vn-12245910 is not present in Agent 10.0.0.41 2025-08-11 12:23:01,198 - INFO - Validated that VN ctest-fip_vn-12245910 is not in any agent 2025-08-11 12:23:01,204 - DEBUG - VRF 3 is not seen in agent 10.0.0.19 2025-08-11 12:23:01,209 - DEBUG - Vrouter 10.0.0.19 does not have vrf 3 for VN ctest-fip_vn-12245910 2025-08-11 12:23:01,209 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-fip_vn-12245910 2025-08-11 12:23:01,230 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-12245910 info 2025-08-11 12:23:01,230 - INFO - Deleting VN ctest-vn2-83537811 2025-08-11 12:23:01,406 - DEBUG - Response for deleting network () 2025-08-11 12:23:01,406 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/cc0c6c40-7a32-4c83-aaa4-a8c466712d47 2025-08-11 12:23:01,412 - DEBUG - Response Code: 404 2025-08-11 12:23:01,412 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:23:01,418 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:23:01,468 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:23:01,545 - INFO - Validated that VN ctest-vn2-83537811 is not found in API Server 2025-08-11 12:23:01,559 - DEBUG - VN ctest-vn2-83537811 is not present in Agent 10.0.0.19 2025-08-11 12:23:01,572 - DEBUG - VN ctest-vn2-83537811 is not present in Agent 10.0.0.41 2025-08-11 12:23:01,572 - INFO - Validated that VN ctest-vn2-83537811 is not in any agent 2025-08-11 12:23:01,577 - DEBUG - VRF 2 is not seen in agent 10.0.0.19 2025-08-11 12:23:01,582 - DEBUG - Vrouter 10.0.0.19 does not have vrf 2 for VN ctest-vn2-83537811 2025-08-11 12:23:01,589 - DEBUG - VRF 3 is not seen in agent 10.0.0.41 2025-08-11 12:23:01,596 - DEBUG - Vrouter 10.0.0.41 does not have vrf 3 for VN ctest-vn2-83537811 2025-08-11 12:23:01,596 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn2-83537811 2025-08-11 12:23:01,616 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-83537811 info 2025-08-11 12:23:01,616 - INFO - Deleting VM ctest-vn1_vm2-25007964 2025-08-11 12:23:01,678 - INFO - Deleting VM ctest-vn1_vm1-56250947 2025-08-11 12:23:01,731 - INFO - Deleting VN ctest-vn1-63983662 2025-08-11 12:23:01,767 - DEBUG - VN 98f5cadf-1f69-4040-b621-36c721b08707 still in use: Unable to complete operation on network 98f5cadf-1f69-4040-b621-36c721b08707. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-11ca57d1-bf69-4b24-9be1-d4d84f788f88'] 2025-08-11 12:23:01,767 - WARNING - Deleting VN ctest-vn1-63983662 failed..Will retry 2025-08-11 12:23:03,897 - DEBUG - Response for deleting network () 2025-08-11 12:23:03,898 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f20505fd-e785-4b6d-a9b1-f3ecb29b37b6 2025-08-11 12:23:03,904 - DEBUG - Response Code: 404 2025-08-11 12:23:03,904 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-11 12:23:03,910 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b5486b30-eba1-4fa6-8a8f-46cb32823c52 2025-08-11 12:23:03,930 - DEBUG - Requesting: http://10.0.0.56:8082/project/2effd72f-8ace-4637-8712-b92c708d89ad 2025-08-11 12:23:04,015 - INFO - Validated that VN ctest-vn1-63983662 is not found in API Server 2025-08-11 12:23:04,026 - DEBUG - VN ctest-vn1-63983662 is not present in Agent 10.0.0.19 2025-08-11 12:23:04,036 - DEBUG - VN ctest-vn1-63983662 is not present in Agent 10.0.0.41 2025-08-11 12:23:04,036 - INFO - Validated that VN ctest-vn1-63983662 is not in any agent 2025-08-11 12:23:04,042 - DEBUG - VRF 2 is not seen in agent 10.0.0.41 2025-08-11 12:23:04,046 - DEBUG - Vrouter 10.0.0.41 does not have vrf 2 for VN ctest-vn1-63983662 2025-08-11 12:23:04,047 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-65455482:ctest-vn1-63983662 2025-08-11 12:23:04,066 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-63983662 info 2025-08-11 12:23:04,742 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-65455482, ID : 2effd72f-8ace-4637-8712-b92c708d89ad