2025-11-03 02:30:19,459 - INFO - Domain Default found not creating 2025-11-03 02:30:19,591 - INFO - Project ctest-TestPolicyAcl-01861864 not found, creating it 2025-11-03 02:30:20,120 - INFO - Created Project:ctest-TestPolicyAcl-01861864, ID : 46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:21,574 - INFO - ================================================================================ 2025-11-03 02:30:21,574 - INFO - STARTING TEST : test_policy_inheritance_src_vn_dst_pol 2025-11-03 02:30:21,574 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-11-03 02:30:22,849 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with 2025-11-03 02:30:22,849 - INFO - Initial checks done. Running the testcase now 2025-11-03 02:30:22,849 - INFO - 2025-11-03 02:30:24,359 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:24,651 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:24,683 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:24,700 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:24,806 - DEBUG - Requesting: http://10.0.0.249:8082/network-ipam/2739eb6d-dbba-45df-af85-ae58b2570e15 2025-11-03 02:30:24,815 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-11-03 02:30:24,821 - DEBUG - Control-node 10.0.0.249 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2826549098222077407', 'uuid-lslong': '12647706824512310805'}, 'enable': 'true', 'created': '2025-11-03T02:30:23', 'last-modified': '2025-11-03T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.213659'} 2025-11-03 02:30:24,828 - DEBUG - Control-node 10.0.0.61 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2826549098222077407', 'uuid-lslong': '12647706824512310805'}, 'enable': 'true', 'created': '2025-11-03T02:30:23', 'last-modified': '2025-11-03T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.222494'} 2025-11-03 02:30:24,834 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2826549098222077407', 'uuid-lslong': '12647706824512310805'}, 'enable': 'true', 'created': '2025-11-03T02:30:23', 'last-modified': '2025-11-03T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.231671'} 2025-11-03 02:30:24,834 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-11-03 02:30:24,834 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:24,842 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:24,854 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:24,954 - DEBUG - Requesting: http://10.0.0.249:8082/network-ipam/848adb8a-3f55-409d-9e05-0a9aba4813ef 2025-11-03 02:30:24,961 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-11-03 02:30:24,965 - DEBUG - Control-node 10.0.0.249 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9550687346607079581', 'uuid-lslong': '11386518892542694383'}, 'enable': 'true', 'created': '2025-11-03T02:30:23', 'last-modified': '2025-11-03T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.975737'} 2025-11-03 02:30:24,971 - DEBUG - Control-node 10.0.0.61 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9550687346607079581', 'uuid-lslong': '11386518892542694383'}, 'enable': 'true', 'created': '2025-11-03T02:30:23', 'last-modified': '2025-11-03T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.983808'} 2025-11-03 02:30:24,976 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9550687346607079581', 'uuid-lslong': '11386518892542694383'}, 'enable': 'true', 'created': '2025-11-03T02:30:23', 'last-modified': '2025-11-03T02:30:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.989638'} 2025-11-03 02:30:24,976 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-11-03 02:30:24,976 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:24,982 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:24,993 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:25,121 - DEBUG - Requesting: http://10.0.0.249:8082/network-ipam/eba43f52-5921-41c2-a0b5-5e50a553c5aa 2025-11-03 02:30:25,133 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-11-03 02:30:25,140 - DEBUG - Control-node 10.0.0.249 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16979766118008832450', 'uuid-lslong': '11580265717317223850'}, 'enable': 'true', 'created': '2025-11-03T02:30:24', 'last-modified': '2025-11-03T02:30:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.813814'} 2025-11-03 02:30:25,146 - DEBUG - Control-node 10.0.0.61 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16979766118008832450', 'uuid-lslong': '11580265717317223850'}, 'enable': 'true', 'created': '2025-11-03T02:30:24', 'last-modified': '2025-11-03T02:30:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.817187'} 2025-11-03 02:30:25,157 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-01861864:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16979766118008832450', 'uuid-lslong': '11580265717317223850'}, 'enable': 'true', 'created': '2025-11-03T02:30:24', 'last-modified': '2025-11-03T02:30:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.828799'} 2025-11-03 02:30:25,157 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-11-03 02:30:25,483 - DEBUG - Response for create_network : {'network': {'id': '53218015-a13d-40dd-a9d4-ce9d9db655f4', 'name': 'ctest-VN1-21052109', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-VN1-21052109'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:30:25,811 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b1de62de-4af9-4a23-893d-6ea2201b89f6', 'name': '', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'network_id': '53218015-a13d-40dd-a9d4-ce9d9db655f4', 'ip_version': 4, 'cidr': '202.31.169.64/26', 'allocation_pools': [{'start': '202.31.169.66', 'end': '202.31.169.126'}], 'gateway_ip': '202.31.169.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '202.31.169.66', 'tags': [], 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7'}} 2025-11-03 02:30:25,837 - INFO - Created VN ctest-VN1-21052109 2025-11-03 02:30:25,853 - DEBUG - VN ctest-VN1-21052109 UUID is 53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:26,007 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109(53218015-a13d-40dd-a9d4-ce9d9db655f4) with subnets ['202.31.169.64/26'] 2025-11-03 02:30:26,354 - DEBUG - Response for create_network : {'network': {'id': '0d586a8e-286b-4860-a05a-63ad1e6f9e86', 'name': 'ctest-VN2-40301645', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-VN2-40301645'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:30:26,577 - DEBUG - Response for create_subnet : {'subnet': {'id': 'daa6c94a-24e7-4f99-a73d-52cb4fe1942c', 'name': '', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'network_id': '0d586a8e-286b-4860-a05a-63ad1e6f9e86', 'ip_version': 4, 'cidr': '57.12.10.128/26', 'allocation_pools': [{'start': '57.12.10.130', 'end': '57.12.10.190'}], 'gateway_ip': '57.12.10.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '57.12.10.130', 'tags': [], 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7'}} 2025-11-03 02:30:26,599 - INFO - Created VN ctest-VN2-40301645 2025-11-03 02:30:26,609 - DEBUG - VN ctest-VN2-40301645 UUID is 0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:26,995 - DEBUG - Response for create_network : {'network': {'id': '31d03b7b-8025-41de-a1aa-07f1f33f38f9', 'name': 'ctest-VN3-22240630', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-VN3-22240630'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:30:27,194 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c42094b1-b346-4110-b62e-75e6d61d5c4a', 'name': '', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'network_id': '31d03b7b-8025-41de-a1aa-07f1f33f38f9', 'ip_version': 4, 'cidr': '68.78.52.64/26', 'allocation_pools': [{'start': '68.78.52.66', 'end': '68.78.52.126'}], 'gateway_ip': '68.78.52.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '68.78.52.66', 'tags': [], 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7'}} 2025-11-03 02:30:27,220 - INFO - Created VN ctest-VN3-22240630 2025-11-03 02:30:27,233 - DEBUG - VN ctest-VN3-22240630 UUID is 31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:27,303 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:27,308 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:27,320 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:27,409 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:27,420 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:27,429 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f0f76e12-8a56-4692-b889-781cac9cd44d 2025-11-03 02:30:27,435 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f0f76e12-8a56-4692-b889-781cac9cd44d 2025-11-03 02:30:27,442 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d4af9154-1ee3-47b7-82a5-a180075d11b3 2025-11-03 02:30:27,448 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 02:30:27,448 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:27,456 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f0f76e12-8a56-4692-b889-781cac9cd44d 2025-11-03 02:30:27,469 - INFO - Verified VN network id 16 for VN 53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:27,470 - INFO - Verifications in API Server for VN ctest-VN1-21052109 passed 2025-11-03 02:30:27,470 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:27,480 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f0f76e12-8a56-4692-b889-781cac9cd44d 2025-11-03 02:30:27,486 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f0f76e12-8a56-4692-b889-781cac9cd44d 2025-11-03 02:30:27,493 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d4af9154-1ee3-47b7-82a5-a180075d11b3 2025-11-03 02:30:27,505 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5990209809767284957', 'uuid-lslong': '12237633263823640052'}, 'enable': 'true', 'created': '2025-11-03T02:30:25', 'last-modified': '2025-11-03T02:30:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.771585'} 2025-11-03 02:30:27,509 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 02:30:27,515 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5990209809767284957', 'uuid-lslong': '12237633263823640052'}, 'enable': 'true', 'created': '2025-11-03T02:30:25', 'last-modified': '2025-11-03T02:30:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.787004'} 2025-11-03 02:30:27,521 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 02:30:27,527 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5990209809767284957', 'uuid-lslong': '12237633263823640052'}, 'enable': 'true', 'created': '2025-11-03T02:30:25', 'last-modified': '2025-11-03T02:30:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.794740'} 2025-11-03 02:30:27,531 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 02:30:27,531 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-21052109 passed 2025-11-03 02:30:27,532 - DEBUG - ====Verifying policy data for ctest-VN1-21052109 in API_Server ====== 2025-11-03 02:30:27,532 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:27,538 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:27,547 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:27,636 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:27,646 - DEBUG - =>VN ctest-VN1-21052109 has no policy to be verified 2025-11-03 02:30:27,646 - DEBUG - Verifying the vn in opserver 2025-11-03 02:30:27,646 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 virtual network link through opserver 10.0.0.249 2025-11-03 02:30:27,646 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 02:30:27,944 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 02:30:28,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109?flat'} 2025-11-03 02:30:28,001 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 virtual network link through opserver 10.0.0.61 2025-11-03 02:30:28,001 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 02:30:28,294 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 02:30:28,366 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109?flat'} 2025-11-03 02:30:28,366 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 virtual network link through opserver 10.0.0.23 2025-11-03 02:30:28,366 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 02:30:28,664 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 02:30:28,725 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109?flat'} 2025-11-03 02:30:28,725 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is found in opserver 2025-11-03 02:30:28,744 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 02:30:28,753 - DEBUG - VRF ids for VN ctest-VN1-21052109: {} 2025-11-03 02:30:28,753 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:28,758 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:28,770 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:28,863 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:28,874 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:28,882 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f79e5640-812d-4c76-b425-4995e94caa76 2025-11-03 02:30:28,890 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f79e5640-812d-4c76-b425-4995e94caa76 2025-11-03 02:30:28,896 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/cb47cad7-f5c8-45e8-a36d-63a4931d6b2f 2025-11-03 02:30:28,903 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 02:30:28,903 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:28,913 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f79e5640-812d-4c76-b425-4995e94caa76 2025-11-03 02:30:28,928 - INFO - Verified VN network id 17 for VN 0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:28,928 - INFO - Verifications in API Server for VN ctest-VN2-40301645 passed 2025-11-03 02:30:28,928 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:28,938 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f79e5640-812d-4c76-b425-4995e94caa76 2025-11-03 02:30:28,945 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f79e5640-812d-4c76-b425-4995e94caa76 2025-11-03 02:30:28,951 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/cb47cad7-f5c8-45e8-a36d-63a4931d6b2f 2025-11-03 02:30:28,964 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '961635679239620704', 'uuid-lslong': '11554657389163552390'}, 'enable': 'true', 'created': '2025-11-03T02:30:26', 'last-modified': '2025-11-03T02:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.439441'} 2025-11-03 02:30:28,969 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 02:30:28,976 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '961635679239620704', 'uuid-lslong': '11554657389163552390'}, 'enable': 'true', 'created': '2025-11-03T02:30:26', 'last-modified': '2025-11-03T02:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.455374'} 2025-11-03 02:30:28,982 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 02:30:28,987 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '961635679239620704', 'uuid-lslong': '11554657389163552390'}, 'enable': 'true', 'created': '2025-11-03T02:30:26', 'last-modified': '2025-11-03T02:30:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.462946'} 2025-11-03 02:30:28,993 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 02:30:28,993 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-40301645 passed 2025-11-03 02:30:28,993 - DEBUG - ====Verifying policy data for ctest-VN2-40301645 in API_Server ====== 2025-11-03 02:30:28,993 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:29,000 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:29,010 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:29,100 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:29,109 - DEBUG - =>VN ctest-VN2-40301645 has no policy to be verified 2025-11-03 02:30:29,109 - DEBUG - Verifying the vn in opserver 2025-11-03 02:30:29,109 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 virtual network link through opserver 10.0.0.249 2025-11-03 02:30:29,109 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 02:30:29,158 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645?flat'} 2025-11-03 02:30:29,158 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 virtual network link through opserver 10.0.0.61 2025-11-03 02:30:29,158 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 02:30:29,216 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645?flat'} 2025-11-03 02:30:29,216 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 virtual network link through opserver 10.0.0.23 2025-11-03 02:30:29,216 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 02:30:29,279 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645?flat'} 2025-11-03 02:30:29,279 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 is found in opserver 2025-11-03 02:30:29,298 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 02:30:29,308 - DEBUG - VRF ids for VN ctest-VN2-40301645: {} 2025-11-03 02:30:29,308 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:29,323 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:29,334 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:29,433 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:29,443 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:29,453 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/59176efc-3d38-411a-b7af-37e42bf00998 2025-11-03 02:30:29,460 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/59176efc-3d38-411a-b7af-37e42bf00998 2025-11-03 02:30:29,466 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a909031e-b282-4613-b998-7ffe94a4b228 2025-11-03 02:30:29,472 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 02:30:29,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:29,481 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/59176efc-3d38-411a-b7af-37e42bf00998 2025-11-03 02:30:29,497 - INFO - Verified VN network id 18 for VN 31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:29,497 - INFO - Verifications in API Server for VN ctest-VN3-22240630 passed 2025-11-03 02:30:29,497 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:29,507 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/59176efc-3d38-411a-b7af-37e42bf00998 2025-11-03 02:30:29,514 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/59176efc-3d38-411a-b7af-37e42bf00998 2025-11-03 02:30:29,522 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a909031e-b282-4613-b998-7ffe94a4b228 2025-11-03 02:30:29,536 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3589434304631226846', 'uuid-lslong': '11649132121896728825'}, 'enable': 'true', 'created': '2025-11-03T02:30:26', 'last-modified': '2025-11-03T02:30:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.383994'} 2025-11-03 02:30:29,541 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 02:30:29,547 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3589434304631226846', 'uuid-lslong': '11649132121896728825'}, 'enable': 'true', 'created': '2025-11-03T02:30:26', 'last-modified': '2025-11-03T02:30:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.399398'} 2025-11-03 02:30:29,553 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 02:30:29,558 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-01861864', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3589434304631226846', 'uuid-lslong': '11649132121896728825'}, 'enable': 'true', 'created': '2025-11-03T02:30:26', 'last-modified': '2025-11-03T02:30:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.406319'} 2025-11-03 02:30:29,564 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 02:30:29,564 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-22240630 passed 2025-11-03 02:30:29,564 - DEBUG - ====Verifying policy data for ctest-VN3-22240630 in API_Server ====== 2025-11-03 02:30:29,564 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:29,570 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:29,581 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:29,677 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/31d03b7b-8025-41de-a1aa-07f1f33f38f9 2025-11-03 02:30:29,685 - DEBUG - =>VN ctest-VN3-22240630 has no policy to be verified 2025-11-03 02:30:29,686 - DEBUG - Verifying the vn in opserver 2025-11-03 02:30:29,686 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 virtual network link through opserver 10.0.0.249 2025-11-03 02:30:29,686 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 02:30:29,741 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630?flat'} 2025-11-03 02:30:29,741 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 virtual network link through opserver 10.0.0.61 2025-11-03 02:30:29,741 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 02:30:29,792 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630?flat'} 2025-11-03 02:30:29,792 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 virtual network link through opserver 10.0.0.23 2025-11-03 02:30:29,792 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 02:30:29,853 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630?flat'} 2025-11-03 02:30:29,853 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 is found in opserver 2025-11-03 02:30:29,875 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 02:30:29,886 - DEBUG - VRF ids for VN ctest-VN3-22240630: {} 2025-11-03 02:30:29,892 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-11-03 02:30:30,163 - DEBUG - No destination network defined 2025-11-03 02:30:30,163 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAcl-01861864:ctest-policy13-42422583, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-11-03 02:30:30,431 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-11-03 02:30:30,667 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:30,674 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:30,683 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:30,775 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:30:30,786 - DEBUG - Setup step: Associating the policy to VN' 2025-11-03 02:30:30,963 - INFO - Associated Policy to ctest-VN1-21052109 2025-11-03 02:30:30,963 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:30:30,969 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:30:30,979 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:30:31,075 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:30:31,089 - DEBUG - Setup step: Associating the policy to VN' 2025-11-03 02:30:31,192 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '0d586a8e-286b-4860-a05a-63ad1e6f9e86', 'name': 'ctest-VN2-40301645', 'tenant_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'project_id': '46ce3ae0e69a442ebd4c33904a6250b7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['daa6c94a-24e7-4f99-a73d-52cb4fe1942c'], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-VN2-40301645'], 'policys': [['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-policy21-46115196']], 'subnet_ipam': [{'subnet_cidr': '57.12.10.128/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAcl-01861864', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:30:31,302 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-policy21-46115196']] to ctest-VN2-40301645 2025-11-03 02:30:31,397 - DEBUG - Services list from nova: [, , , ] 2025-11-03 02:30:32,402 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 02:30:33,656 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 02:30:35,042 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 02:30:35,125 - DEBUG - VM is in ACTIVE state now 2025-11-03 02:30:35,125 - INFO - VM name : ctest-VM11-65952243 2025-11-03 02:30:35,209 - DEBUG - VM ctest-VM11-65952243 ID is 6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:30:35,300 - DEBUG - VM is in ACTIVE state now 2025-11-03 02:30:35,323 - DEBUG - VM ctest-VM11-65952243 launched on Node an-jenkins-deploy-platform-ansible-os-4597-1 2025-11-03 02:30:35,421 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:30:36,001 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:30:36,063 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:30:36,073 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ec9cd863-3623-4cee-8b37-fd2f12411758 2025-11-03 02:30:36,084 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:30:36,092 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ec9cd863-3623-4cee-8b37-fd2f12411758 2025-11-03 02:30:36,107 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/095fa243-3026-4543-91a4-8a3e35e5a980 2025-11-03 02:30:36,123 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:30:36,123 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:30:36,130 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ec9cd863-3623-4cee-8b37-fd2f12411758 2025-11-03 02:30:36,147 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/095fa243-3026-4543-91a4-8a3e35e5a980 2025-11-03 02:30:36,159 - INFO - VM ctest-VM11-65952243 verfication in all API Servers passed 2025-11-03 02:30:36,179 - DEBUG - VM ctest-VM11-65952243 Tap interface: {'index': '3', 'name': 'tapec9cd863-36', 'uuid': 'ec9cd863-3623-4cee-8b37-fd2f12411758', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109:ctest-VN1-21052109', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'vm_uuid': '6805f0bb-49ea-40b8-98ef-68bf65891f29', 'vm_name': 'ctest-VM11-65952243', 'ip_addr': '202.31.169.67', 'mac_addr': '02:ec:9c:d8:63:36', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '46', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758', 'sg_uuid_list': ['f8947a12-dca3-4f08-b2d3-a8b17dbdf893'], 'static_route_list': None, 'vm_project_uuid': '46ce3ae0-e69a-442e-bd4c-33904a6250b7', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-11-03 02:30:36,179 - DEBUG - Agent 10.0.0.73 vrf name: default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109:ctest-VN1-21052109 2025-11-03 02:30:36,190 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109:ctest-VN1-21052109', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'table_label': '-1', 'vxlan_id': '16', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-11-03 02:30:36,273 - DEBUG - VM ctest-VM11-65952243 : Tap interface tapec9cd863-36 is set to Active 2025-11-03 02:30:36,274 - DEBUG - Tap interface tapec9cd863-36 detail : {'index': '3', 'name': 'tapec9cd863-36', 'uuid': 'ec9cd863-3623-4cee-8b37-fd2f12411758', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109:ctest-VN1-21052109', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'vm_uuid': '6805f0bb-49ea-40b8-98ef-68bf65891f29', 'vm_name': 'ctest-VM11-65952243', 'ip_addr': '202.31.169.67', 'mac_addr': '02:ec:9c:d8:63:36', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '46', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758', 'sg_uuid_list': ['f8947a12-dca3-4f08-b2d3-a8b17dbdf893'], 'static_route_list': None, 'vm_project_uuid': '46ce3ae0-e69a-442e-bd4c-33904a6250b7', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-11-03 02:30:36,385 - DEBUG - Starting Layer 2 verification in Agent 2025-11-03 02:30:36,403 - DEBUG - Layer 2 path is seen for VM MAC 02:ec:9c:d8:63:36 in agent 10.0.0.73 2025-11-03 02:30:36,403 - DEBUG - Active layer 2 route in agent is present for VMI tapec9cd863-36 2025-11-03 02:30:36,403 - DEBUG - L2 label(29) matches bw route table and interface table 2025-11-03 02:30:36,410 - DEBUG - VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is found in Agent of node 10.0.0.73 2025-11-03 02:30:36,634 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is consistent in agent 10.0.0.73 2025-11-03 02:30:36,634 - DEBUG - Route for VM IP ['202.31.169.67'] is consistent in agent 10.0.0.73 2025-11-03 02:30:36,634 - DEBUG - VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 verification for VM ctest-VM11-65952243 in Agent 10.0.0.73 passed 2025-11-03 02:30:36,707 - DEBUG - Starting all layer 2 verification in agent 10.0.0.73 2025-11-03 02:30:36,717 - DEBUG - Route for VM MAC 02:ec:9c:d8:63:36 is consistent in agent 10.0.0.73 2025-11-03 02:30:39,904 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-11-03 02:30:39,904 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:30:39,919 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:30:44,003 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-11-03 02:30:44,003 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:30:44,016 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:30:48,095 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms') 2025-11-03 02:30:48,096 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:30:48,109 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:30:52,190 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-03 02:30:52,190 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:30:52,204 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:30:56,288 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-11-03 02:30:56,288 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:30:56,303 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:31:00,385 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 02:31:00,385 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:31:00,401 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:31:04,488 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-11-03 02:31:04,488 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:31:04,502 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:31:08,582 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-11-03 02:31:08,582 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:31:08,599 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:31:12,676 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-11-03 02:31:12,676 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:31:12,689 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:31:16,770 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-11-03 02:31:16,771 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 failed! 2025-11-03 02:31:16,784 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 is 202.31.169.65 and allocation pool is NOT set 2025-11-03 02:31:18,856 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.79 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.39 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.391/3.591/5.791/2.200 ms') 2025-11-03 02:31:18,856 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 passed 2025-11-03 02:31:18,856 - INFO - VM ctest-VM11-65952243 verifications in Compute nodes passed 2025-11-03 02:31:19,075 - DEBUG - Validated VM route 202.31.169.67 in vrouter of 10.0.0.73 2025-11-03 02:31:19,082 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-11-03 02:31:19,082 - INFO - Validated routes of VM ctest-VM11-65952243 in all vrouters 2025-11-03 02:31:19,512 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node 2025-11-03 02:31:19,639 - DEBUG - Layer2 route found for VM MAC 02:ec:9c:d8:63:36 in Control-node 10.0.0.23 2025-11-03 02:31:19,639 - DEBUG - L2 Label for VM ctest-VM11-65952243 same between Control-node 10.0.0.23 and Agent, Expected: 29, Seen: 29 2025-11-03 02:31:19,639 - DEBUG - Starting all layer2 verification in 10.0.0.61 Control Node 2025-11-03 02:31:19,768 - DEBUG - Layer2 route found for VM MAC 02:ec:9c:d8:63:36 in Control-node 10.0.0.61 2025-11-03 02:31:19,768 - DEBUG - L2 Label for VM ctest-VM11-65952243 same between Control-node 10.0.0.61 and Agent, Expected: 29, Seen: 29 2025-11-03 02:31:19,768 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node 2025-11-03 02:31:19,888 - DEBUG - Layer2 route found for VM MAC 02:ec:9c:d8:63:36 in Control-node 10.0.0.249 2025-11-03 02:31:19,888 - DEBUG - L2 Label for VM ctest-VM11-65952243 same between Control-node 10.0.0.249 and Agent, Expected: 29, Seen: 29 2025-11-03 02:31:19,888 - INFO - Verification in Control-nodes for VM ctest-VM11-65952243 passed 2025-11-03 02:31:19,889 - DEBUG - Verifying the vm in opserver 2025-11-03 02:31:19,889 - DEBUG - Verifying in collector 10.0.0.23 ... 2025-11-03 02:31:19,889 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29?flat 2025-11-03 02:31:19,903 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758?flat 2025-11-03 02:31:19,924 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758?flat 2025-11-03 02:31:19,941 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29?flat 2025-11-03 02:31:19,957 - DEBUG - Verifying vm in vn uve 2025-11-03 02:31:19,957 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758?flat 2025-11-03 02:31:19,976 - DEBUG - VM uve shows interface as {'fixed_ip4_list': ['202.31.169.67'], 'vhostuser_mode': 0, 'ip_address': '202.31.169.67', 'admin_state': True, 'gateway': '202.31.169.65', 'label': 25, 'l2_active': True, 'active': True, 'port_mirror_enabled': False, 'tx_vlan': 65535, 'ip6_active': False, 'rx_vlan': 65535, 'vm_name': 'ctest-VM11-65952243', 'vm_uuid': '6805f0bb-49ea-40b8-98ef-68bf65891f29', 'uuid': 'ec9cd863-3623-4cee-8b37-fd2f12411758', 'mac_address': '02:ec:9c:d8:63:36', '__T': 1762137059478584, 'virtual_network': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109', 'is_health_check_active': True, 'ip6_address': '::', 'vn_uuid': '53218015-a13d-40dd-a9d4-ce9d9db655f4', 'ip4_active': True} 2025-11-03 02:31:19,976 - DEBUG - VM uve shows ip address as ['202.31.169.67', '::'] 2025-11-03 02:31:19,976 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 2025-11-03 02:31:19,976 - INFO - Verifying through opserver in 10.0.0.249 2025-11-03 02:31:19,976 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109?flat 2025-11-03 02:31:20,000 - DEBUG - expected vm list 6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:31:20,000 - DEBUG - Extracted vm list ['6805f0bb-49ea-40b8-98ef-68bf65891f29'] 2025-11-03 02:31:20,000 - INFO - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is present in default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 2025-11-03 02:31:20,000 - DEBUG - Verifying vm in vrouter uve 2025-11-03 02:31:20,000 - DEBUG - Getting info from collector 10.0.0.23.. 2025-11-03 02:31:20,000 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29?flat 2025-11-03 02:31:20,016 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4597-1'] 2025-11-03 02:31:20,016 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:31:20,054 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:31:20,087 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:20,088 - DEBUG - Validated that VM ctest-VM11-65952243 is in Vrouter an-jenkins-deploy-platform-ansible-os-4597-1 UVE 2025-11-03 02:31:20,088 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-11-03 02:31:20,096 - DEBUG - Expected tap interface of VM uuid 6805f0bb-49ea-40b8-98ef-68bf65891f29 is default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758 2025-11-03 02:31:20,096 - DEBUG - Expected VN of VM uuid 6805f0bb-49ea-40b8-98ef-68bf65891f29 is default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 2025-11-03 02:31:20,096 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:31:20,132 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:31:20,167 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:20,167 - INFO - tap interface default-domain:ctest-TestPolicyAcl-01861864:ec9cd863-3623-4cee-8b37-fd2f12411758 of vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:20,167 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 of vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:20,167 - DEBUG - Verifying the 6805f0bb-49ea-40b8-98ef-68bf65891f29 virtual network link through opserver 10.0.0.249 2025-11-03 02:31:20,168 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2025-11-03 02:31:20,183 - DEBUG - VM link and name as {'name': '6805f0bb-49ea-40b8-98ef-68bf65891f29', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29?flat'} 2025-11-03 02:31:20,183 - DEBUG - Verifying the 6805f0bb-49ea-40b8-98ef-68bf65891f29 virtual network link through opserver 10.0.0.61 2025-11-03 02:31:20,183 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-11-03 02:31:20,200 - DEBUG - VM link and name as {'name': '6805f0bb-49ea-40b8-98ef-68bf65891f29', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29?flat'} 2025-11-03 02:31:20,200 - DEBUG - Verifying the 6805f0bb-49ea-40b8-98ef-68bf65891f29 virtual network link through opserver 10.0.0.23 2025-11-03 02:31:20,200 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-11-03 02:31:20,211 - DEBUG - VM link and name as {'name': '6805f0bb-49ea-40b8-98ef-68bf65891f29', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29?flat'} 2025-11-03 02:31:20,212 - INFO - VM ctest-VM11-65952243 validations in Opserver passed 2025-11-03 02:31:20,300 - DEBUG - VM is in ACTIVE state now 2025-11-03 02:31:20,300 - INFO - VM name : ctest-VM21-90876706 2025-11-03 02:31:20,385 - DEBUG - VM ctest-VM21-90876706 ID is 95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:20,469 - DEBUG - VM is in ACTIVE state now 2025-11-03 02:31:20,470 - DEBUG - VM ctest-VM21-90876706 launched on Node an-jenkins-deploy-platform-ansible-os-4597-2 2025-11-03 02:31:20,558 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:20,567 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:20,574 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/851db1b4-09af-4a80-8d09-5d1b3ab2c7f1 2025-11-03 02:31:20,583 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:20,590 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/851db1b4-09af-4a80-8d09-5d1b3ab2c7f1 2025-11-03 02:31:20,600 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/f0aba423-881b-4e70-a0ad-66fc14cbc79a 2025-11-03 02:31:20,611 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:31:20,611 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:20,618 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/851db1b4-09af-4a80-8d09-5d1b3ab2c7f1 2025-11-03 02:31:20,626 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/f0aba423-881b-4e70-a0ad-66fc14cbc79a 2025-11-03 02:31:20,633 - INFO - VM ctest-VM21-90876706 verfication in all API Servers passed 2025-11-03 02:31:20,651 - DEBUG - VM ctest-VM21-90876706 Tap interface: {'index': '3', 'name': 'tap851db1b4-09', 'uuid': '851db1b4-09af-4a80-8d09-5d1b3ab2c7f1', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645:ctest-VN2-40301645', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'vm_uuid': '95917319-8fc5-4669-9e80-13235187c5b9', 'vm_name': 'ctest-VM21-90876706', 'ip_addr': '57.12.10.131', 'mac_addr': '02:85:1d:b1:b4:09', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1', 'sg_uuid_list': ['f8947a12-dca3-4f08-b2d3-a8b17dbdf893'], 'static_route_list': None, 'vm_project_uuid': '46ce3ae0-e69a-442e-bd4c-33904a6250b7', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-11-03 02:31:20,651 - DEBUG - Agent 10.0.0.33 vrf name: default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645:ctest-VN2-40301645 2025-11-03 02:31:20,659 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645:ctest-VN2-40301645', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'table_label': '-1', 'vxlan_id': '17', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-11-03 02:31:20,738 - DEBUG - VM ctest-VM21-90876706 : Tap interface tap851db1b4-09 is set to Active 2025-11-03 02:31:20,738 - DEBUG - Tap interface tap851db1b4-09 detail : {'index': '3', 'name': 'tap851db1b4-09', 'uuid': '851db1b4-09af-4a80-8d09-5d1b3ab2c7f1', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645:ctest-VN2-40301645', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '17', 'vn_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'vm_uuid': '95917319-8fc5-4669-9e80-13235187c5b9', 'vm_name': 'ctest-VM21-90876706', 'ip_addr': '57.12.10.131', 'mac_addr': '02:85:1d:b1:b4:09', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1', 'sg_uuid_list': ['f8947a12-dca3-4f08-b2d3-a8b17dbdf893'], 'static_route_list': None, 'vm_project_uuid': '46ce3ae0-e69a-442e-bd4c-33904a6250b7', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-11-03 02:31:20,851 - DEBUG - Starting Layer 2 verification in Agent 2025-11-03 02:31:20,866 - DEBUG - Layer 2 path is seen for VM MAC 02:85:1d:b1:b4:09 in agent 10.0.0.33 2025-11-03 02:31:20,867 - DEBUG - Active layer 2 route in agent is present for VMI tap851db1b4-09 2025-11-03 02:31:20,867 - DEBUG - L2 label(29) matches bw route table and interface table 2025-11-03 02:31:20,880 - DEBUG - VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 is found in Agent of node 10.0.0.33 2025-11-03 02:31:21,023 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 is consistent in agent 10.0.0.33 2025-11-03 02:31:21,023 - DEBUG - Route for VM IP ['57.12.10.131'] is consistent in agent 10.0.0.33 2025-11-03 02:31:21,023 - DEBUG - VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 verification for VM ctest-VM21-90876706 in Agent 10.0.0.33 passed 2025-11-03 02:31:21,138 - DEBUG - Starting all layer 2 verification in agent 10.0.0.33 2025-11-03 02:31:21,151 - DEBUG - Route for VM MAC 02:85:1d:b1:b4:09 is consistent in agent 10.0.0.33 2025-11-03 02:31:24,343 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-11-03 02:31:24,343 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-90876706 failed! 2025-11-03 02:31:24,359 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 is 57.12.10.129 and allocation pool is NOT set 2025-11-03 02:31:28,433 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.24 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1019ms\r\nrtt min/avg/max/mdev = 4.241/4.241/4.241/0.000 ms') 2025-11-03 02:31:28,433 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-90876706 passed 2025-11-03 02:31:28,433 - INFO - VM ctest-VM21-90876706 verifications in Compute nodes passed 2025-11-03 02:31:28,729 - DEBUG - Validated VM route 57.12.10.131 in vrouter of 10.0.0.33 2025-11-03 02:31:28,740 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-11-03 02:31:28,741 - INFO - Validated routes of VM ctest-VM21-90876706 in all vrouters 2025-11-03 02:31:29,159 - DEBUG - Starting all layer2 verification in 10.0.0.23 Control Node 2025-11-03 02:31:29,284 - DEBUG - Layer2 route found for VM MAC 02:85:1d:b1:b4:09 in Control-node 10.0.0.23 2025-11-03 02:31:29,284 - DEBUG - L2 Label for VM ctest-VM21-90876706 same between Control-node 10.0.0.23 and Agent, Expected: 29, Seen: 29 2025-11-03 02:31:29,284 - DEBUG - Starting all layer2 verification in 10.0.0.61 Control Node 2025-11-03 02:31:29,406 - DEBUG - Layer2 route found for VM MAC 02:85:1d:b1:b4:09 in Control-node 10.0.0.61 2025-11-03 02:31:29,406 - DEBUG - L2 Label for VM ctest-VM21-90876706 same between Control-node 10.0.0.61 and Agent, Expected: 29, Seen: 29 2025-11-03 02:31:29,406 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node 2025-11-03 02:31:29,535 - DEBUG - Layer2 route found for VM MAC 02:85:1d:b1:b4:09 in Control-node 10.0.0.249 2025-11-03 02:31:29,535 - DEBUG - L2 Label for VM ctest-VM21-90876706 same between Control-node 10.0.0.249 and Agent, Expected: 29, Seen: 29 2025-11-03 02:31:29,535 - INFO - Verification in Control-nodes for VM ctest-VM21-90876706 passed 2025-11-03 02:31:29,535 - DEBUG - Verifying the vm in opserver 2025-11-03 02:31:29,535 - DEBUG - Verifying in collector 10.0.0.23 ... 2025-11-03 02:31:29,537 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9?flat 2025-11-03 02:31:29,553 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1?flat 2025-11-03 02:31:29,570 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1?flat 2025-11-03 02:31:29,588 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9?flat 2025-11-03 02:31:29,603 - DEBUG - Verifying vm in vn uve 2025-11-03 02:31:29,603 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1?flat 2025-11-03 02:31:29,622 - DEBUG - VM uve shows interface as {'vhostuser_mode': 0, 'ip6_active': False, '__T': 1762137061009982, 'ip4_active': True, 'l2_active': True, 'tx_vlan': 65535, 'vm_uuid': '95917319-8fc5-4669-9e80-13235187c5b9', 'mac_address': '02:85:1d:b1:b4:09', 'label': 25, 'admin_state': True, 'ip_address': '57.12.10.131', 'port_mirror_enabled': False, 'gateway': '57.12.10.129', 'vm_name': 'ctest-VM21-90876706', 'vn_uuid': '0d586a8e-286b-4860-a05a-63ad1e6f9e86', 'virtual_network': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645', 'ip6_address': '::', 'fixed_ip4_list': ['57.12.10.131'], 'is_health_check_active': True, 'rx_vlan': 65535, 'uuid': '851db1b4-09af-4a80-8d09-5d1b3ab2c7f1', 'active': True} 2025-11-03 02:31:29,622 - DEBUG - VM uve shows ip address as ['57.12.10.131', '::'] 2025-11-03 02:31:29,622 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 2025-11-03 02:31:29,622 - INFO - Verifying through opserver in 10.0.0.249 2025-11-03 02:31:29,622 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645?flat 2025-11-03 02:31:29,642 - DEBUG - expected vm list 95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:29,642 - DEBUG - Extracted vm list ['95917319-8fc5-4669-9e80-13235187c5b9'] 2025-11-03 02:31:29,642 - INFO - VM 95917319-8fc5-4669-9e80-13235187c5b9 is present in default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 2025-11-03 02:31:29,642 - DEBUG - Verifying vm in vrouter uve 2025-11-03 02:31:29,642 - DEBUG - Getting info from collector 10.0.0.23.. 2025-11-03 02:31:29,642 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9?flat 2025-11-03 02:31:29,659 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4597-2'] 2025-11-03 02:31:29,659 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:31:29,697 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:31:29,734 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:31:29,734 - DEBUG - Validated that VM ctest-VM21-90876706 is in Vrouter an-jenkins-deploy-platform-ansible-os-4597-2 UVE 2025-11-03 02:31:29,734 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-11-03 02:31:29,742 - DEBUG - Expected tap interface of VM uuid 95917319-8fc5-4669-9e80-13235187c5b9 is default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1 2025-11-03 02:31:29,743 - DEBUG - Expected VN of VM uuid 95917319-8fc5-4669-9e80-13235187c5b9 is default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 2025-11-03 02:31:29,743 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:31:29,776 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:31:29,819 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:31:29,819 - INFO - tap interface default-domain:ctest-TestPolicyAcl-01861864:851db1b4-09af-4a80-8d09-5d1b3ab2c7f1 of vm 95917319-8fc5-4669-9e80-13235187c5b9 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:31:29,819 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 of vm 95917319-8fc5-4669-9e80-13235187c5b9 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:31:29,819 - DEBUG - Verifying the 95917319-8fc5-4669-9e80-13235187c5b9 virtual network link through opserver 10.0.0.249 2025-11-03 02:31:29,819 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2025-11-03 02:31:29,830 - DEBUG - VM link and name as {'name': '95917319-8fc5-4669-9e80-13235187c5b9', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9?flat'} 2025-11-03 02:31:29,830 - DEBUG - Verifying the 95917319-8fc5-4669-9e80-13235187c5b9 virtual network link through opserver 10.0.0.61 2025-11-03 02:31:29,830 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-11-03 02:31:29,845 - DEBUG - VM link and name as {'name': '95917319-8fc5-4669-9e80-13235187c5b9', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9?flat'} 2025-11-03 02:31:29,845 - DEBUG - Verifying the 95917319-8fc5-4669-9e80-13235187c5b9 virtual network link through opserver 10.0.0.23 2025-11-03 02:31:29,845 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-11-03 02:31:29,859 - DEBUG - VM link and name as {'name': '95917319-8fc5-4669-9e80-13235187c5b9', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9?flat'} 2025-11-03 02:31:29,859 - INFO - VM ctest-VM21-90876706 validations in Opserver passed 2025-11-03 02:31:29,935 - DEBUG - VM is in ACTIVE state now 2025-11-03 02:31:29,935 - INFO - VM name : ctest-VM31-07841856 2025-11-03 02:31:30,018 - DEBUG - VM ctest-VM31-07841856 ID is a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:30,110 - DEBUG - VM is in ACTIVE state now 2025-11-03 02:31:30,110 - DEBUG - VM ctest-VM31-07841856 launched on Node an-jenkins-deploy-platform-ansible-os-4597-1 2025-11-03 02:31:30,186 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:30,196 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:30,204 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ada6bf5f-de9c-40bd-82b0-d150c4648790 2025-11-03 02:31:30,215 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:30,223 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ada6bf5f-de9c-40bd-82b0-d150c4648790 2025-11-03 02:31:30,233 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/a9c184e8-991b-41c9-a1b4-a7f02e215245 2025-11-03 02:31:30,243 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:31:30,243 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:30,252 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ada6bf5f-de9c-40bd-82b0-d150c4648790 2025-11-03 02:31:30,263 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/a9c184e8-991b-41c9-a1b4-a7f02e215245 2025-11-03 02:31:30,271 - INFO - VM ctest-VM31-07841856 verfication in all API Servers passed 2025-11-03 02:31:30,290 - DEBUG - VM ctest-VM31-07841856 Tap interface: {'index': '4', 'name': 'tapada6bf5f-de', 'uuid': 'ada6bf5f-de9c-40bd-82b0-d150c4648790', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630:ctest-VN3-22240630', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'vm_uuid': 'a8f6b52a-c7af-43e0-864d-815ee12d3c55', 'vm_name': 'ctest-VM31-07841856', 'ip_addr': '68.78.52.67', 'mac_addr': '02:ad:a6:bf:5f:de', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790', 'sg_uuid_list': ['f8947a12-dca3-4f08-b2d3-a8b17dbdf893'], 'static_route_list': None, 'vm_project_uuid': '46ce3ae0-e69a-442e-bd4c-33904a6250b7', 'admin_state': 'Enabled', 'flow_key_idx': '38', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-11-03 02:31:30,290 - DEBUG - Agent 10.0.0.73 vrf name: default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630:ctest-VN3-22240630 2025-11-03 02:31:30,294 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630:ctest-VN3-22240630', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'table_label': '-1', 'vxlan_id': '18', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.129:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-11-03 02:31:30,373 - DEBUG - VM ctest-VM31-07841856 : Tap interface tapada6bf5f-de is set to Active 2025-11-03 02:31:30,373 - DEBUG - Tap interface tapada6bf5f-de detail : {'index': '4', 'name': 'tapada6bf5f-de', 'uuid': 'ada6bf5f-de9c-40bd-82b0-d150c4648790', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630:ctest-VN3-22240630', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'vm_uuid': 'a8f6b52a-c7af-43e0-864d-815ee12d3c55', 'vm_name': 'ctest-VM31-07841856', 'ip_addr': '68.78.52.67', 'mac_addr': '02:ad:a6:bf:5f:de', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790', 'sg_uuid_list': ['f8947a12-dca3-4f08-b2d3-a8b17dbdf893'], 'static_route_list': None, 'vm_project_uuid': '46ce3ae0-e69a-442e-bd4c-33904a6250b7', 'admin_state': 'Enabled', 'flow_key_idx': '38', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-11-03 02:31:30,483 - DEBUG - Starting Layer 2 verification in Agent 2025-11-03 02:31:30,493 - DEBUG - Layer 2 path is seen for VM MAC 02:ad:a6:bf:5f:de in agent 10.0.0.73 2025-11-03 02:31:30,493 - DEBUG - Active layer 2 route in agent is present for VMI tapada6bf5f-de 2025-11-03 02:31:30,493 - DEBUG - L2 label(36) matches bw route table and interface table 2025-11-03 02:31:30,498 - DEBUG - VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 is found in Agent of node 10.0.0.73 2025-11-03 02:31:30,623 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 is consistent in agent 10.0.0.73 2025-11-03 02:31:30,623 - DEBUG - Route for VM IP ['68.78.52.67'] is consistent in agent 10.0.0.73 2025-11-03 02:31:30,623 - DEBUG - VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 verification for VM ctest-VM31-07841856 in Agent 10.0.0.73 passed 2025-11-03 02:31:30,736 - DEBUG - Starting all layer 2 verification in agent 10.0.0.73 2025-11-03 02:31:30,746 - DEBUG - Route for VM MAC 02:ad:a6:bf:5f:de is consistent in agent 10.0.0.73 2025-11-03 02:31:31,932 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.93 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.316 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.316/2.625/4.934/2.309 ms') 2025-11-03 02:31:31,932 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-07841856 passed 2025-11-03 02:31:31,932 - INFO - VM ctest-VM31-07841856 verifications in Compute nodes passed 2025-11-03 02:31:32,119 - DEBUG - Validated VM route 68.78.52.67 in vrouter of 10.0.0.73 2025-11-03 02:31:32,123 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-11-03 02:31:32,123 - INFO - Validated routes of VM ctest-VM31-07841856 in all vrouters 2025-11-03 02:31:32,665 - DEBUG - Starting all layer2 verification in 10.0.0.61 Control Node 2025-11-03 02:31:32,794 - DEBUG - Layer2 route found for VM MAC 02:ad:a6:bf:5f:de in Control-node 10.0.0.61 2025-11-03 02:31:32,794 - DEBUG - L2 Label for VM ctest-VM31-07841856 same between Control-node 10.0.0.61 and Agent, Expected: 36, Seen: 36 2025-11-03 02:31:32,794 - DEBUG - Starting all layer2 verification in 10.0.0.249 Control Node 2025-11-03 02:31:32,919 - DEBUG - Layer2 route found for VM MAC 02:ad:a6:bf:5f:de in Control-node 10.0.0.249 2025-11-03 02:31:32,919 - DEBUG - L2 Label for VM ctest-VM31-07841856 same between Control-node 10.0.0.249 and Agent, Expected: 36, Seen: 36 2025-11-03 02:31:32,919 - INFO - Verification in Control-nodes for VM ctest-VM31-07841856 passed 2025-11-03 02:31:32,919 - DEBUG - Verifying the vm in opserver 2025-11-03 02:31:32,919 - DEBUG - Verifying in collector 10.0.0.23 ... 2025-11-03 02:31:32,919 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55?flat 2025-11-03 02:31:32,934 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790?flat 2025-11-03 02:31:32,953 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790?flat 2025-11-03 02:31:32,971 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55?flat 2025-11-03 02:31:32,986 - DEBUG - Verifying vm in vn uve 2025-11-03 02:31:32,986 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790?flat 2025-11-03 02:31:33,004 - DEBUG - VM uve shows interface as {'fixed_ip4_list': ['68.78.52.67'], 'vhostuser_mode': 0, 'ip_address': '68.78.52.67', 'admin_state': True, 'gateway': '68.78.52.65', 'label': 32, 'l2_active': True, 'active': True, 'port_mirror_enabled': False, 'tx_vlan': 65535, 'ip6_active': False, 'rx_vlan': 65535, 'vm_name': 'ctest-VM31-07841856', 'vm_uuid': 'a8f6b52a-c7af-43e0-864d-815ee12d3c55', 'uuid': 'ada6bf5f-de9c-40bd-82b0-d150c4648790', 'mac_address': '02:ad:a6:bf:5f:de', '__T': 1762137059478555, 'virtual_network': 'default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630', 'is_health_check_active': True, 'ip6_address': '::', 'vn_uuid': '31d03b7b-8025-41de-a1aa-07f1f33f38f9', 'ip4_active': True} 2025-11-03 02:31:33,004 - DEBUG - VM uve shows ip address as ['68.78.52.67', '::'] 2025-11-03 02:31:33,004 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 2025-11-03 02:31:33,004 - INFO - Verifying through opserver in 10.0.0.249 2025-11-03 02:31:33,004 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630?flat 2025-11-03 02:31:33,027 - DEBUG - expected vm list a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:33,027 - DEBUG - Extracted vm list ['a8f6b52a-c7af-43e0-864d-815ee12d3c55'] 2025-11-03 02:31:33,027 - INFO - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is present in default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 2025-11-03 02:31:33,027 - DEBUG - Verifying vm in vrouter uve 2025-11-03 02:31:33,027 - DEBUG - Getting info from collector 10.0.0.23.. 2025-11-03 02:31:33,027 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55?flat 2025-11-03 02:31:33,045 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4597-1'] 2025-11-03 02:31:33,045 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:31:33,086 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:31:33,119 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:33,119 - DEBUG - Validated that VM ctest-VM31-07841856 is in Vrouter an-jenkins-deploy-platform-ansible-os-4597-1 UVE 2025-11-03 02:31:33,119 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-11-03 02:31:33,126 - DEBUG - Expected tap interface of VM uuid a8f6b52a-c7af-43e0-864d-815ee12d3c55 is default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790 2025-11-03 02:31:33,126 - DEBUG - Expected VN of VM uuid a8f6b52a-c7af-43e0-864d-815ee12d3c55 is default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 2025-11-03 02:31:33,127 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:31:33,164 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:31:33,193 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:33,193 - INFO - tap interface default-domain:ctest-TestPolicyAcl-01861864:ada6bf5f-de9c-40bd-82b0-d150c4648790 of vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:33,193 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 of vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 is present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:31:33,193 - DEBUG - Verifying the a8f6b52a-c7af-43e0-864d-815ee12d3c55 virtual network link through opserver 10.0.0.249 2025-11-03 02:31:33,193 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2025-11-03 02:31:33,204 - DEBUG - VM link and name as {'name': 'a8f6b52a-c7af-43e0-864d-815ee12d3c55', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55?flat'} 2025-11-03 02:31:33,204 - DEBUG - Verifying the a8f6b52a-c7af-43e0-864d-815ee12d3c55 virtual network link through opserver 10.0.0.61 2025-11-03 02:31:33,204 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-11-03 02:31:33,217 - DEBUG - VM link and name as {'name': 'a8f6b52a-c7af-43e0-864d-815ee12d3c55', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55?flat'} 2025-11-03 02:31:33,217 - DEBUG - Verifying the a8f6b52a-c7af-43e0-864d-815ee12d3c55 virtual network link through opserver 10.0.0.23 2025-11-03 02:31:33,217 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-11-03 02:31:33,230 - DEBUG - VM link and name as {'name': 'a8f6b52a-c7af-43e0-864d-815ee12d3c55', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55?flat'} 2025-11-03 02:31:33,230 - INFO - VM ctest-VM31-07841856 validations in Opserver passed 2025-11-03 02:31:33,230 - INFO - Waiting for VM ctest-VM11-65952243 to be up.. 2025-11-03 02:31:33,230 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:33,230 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:31:33,240 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ec9cd863-3623-4cee-8b37-fd2f12411758 2025-11-03 02:31:34,407 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.87 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.18 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.180/2.524/3.869/1.344 ms') 2025-11-03 02:31:34,407 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-65952243 passed 2025-11-03 02:31:34,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:34,476 - DEBUG - Waiting to SSH to VM ctest-VM11-65952243, IP 202.31.169.67, Port 22 2025-11-03 02:31:34,651 - DEBUG - VM ctest-VM11-65952243 is ready for SSH connections 2025-11-03 02:31:34,651 - INFO - Waiting for VM ctest-VM21-90876706 to be up.. 2025-11-03 02:31:34,652 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:34,652 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:31:34,660 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/851db1b4-09af-4a80-8d09-5d1b3ab2c7f1 2025-11-03 02:31:35,841 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.722 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.722/2.220/3.718/1.498 ms') 2025-11-03 02:31:35,841 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-90876706 passed 2025-11-03 02:31:35,912 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:35,912 - DEBUG - Waiting to SSH to VM ctest-VM21-90876706, IP 57.12.10.131, Port 22 2025-11-03 02:31:35,977 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 02:31:36,063 - DEBUG - VM ctest-VM21-90876706 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 02:31:41,063 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:41,064 - DEBUG - Waiting to SSH to VM ctest-VM21-90876706, IP 57.12.10.131, Port 22 2025-11-03 02:31:41,119 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-11-03 02:31:41,202 - DEBUG - VM ctest-VM21-90876706 is NOT ready for SSH connections, VM status: ACTIVE 2025-11-03 02:31:46,202 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:46,203 - DEBUG - Waiting to SSH to VM ctest-VM21-90876706, IP 57.12.10.131, Port 22 2025-11-03 02:31:46,370 - DEBUG - VM ctest-VM21-90876706 is ready for SSH connections 2025-11-03 02:31:46,370 - INFO - Waiting for VM ctest-VM31-07841856 to be up.. 2025-11-03 02:31:46,370 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:46,370 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:31:46,378 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/ada6bf5f-de9c-40bd-82b0-d150c4648790 2025-11-03 02:31:47,543 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.93 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.79 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.789/3.361/3.934/0.572 ms') 2025-11-03 02:31:47,544 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-07841856 passed 2025-11-03 02:31:47,613 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-11-03 02:31:47,613 - DEBUG - Waiting to SSH to VM ctest-VM31-07841856, IP 68.78.52.67, Port 22 2025-11-03 02:31:47,779 - DEBUG - VM ctest-VM31-07841856 is ready for SSH connections 2025-11-03 02:31:47,780 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 57.12.10.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.73, gateway password: c0ntrail123 2025-11-03 02:31:47,780 - DEBUG - ping -s 56 -c 3 -W 1 57.12.10.131 2025-11-03 02:32:31,519 - DEBUG - PING 57.12.10.131 (57.12.10.131) 56(84) bytes of data. 64 bytes from 57.12.10.131: icmp_req=1 ttl=63 time=9.87 ms 64 bytes from 57.12.10.131: icmp_req=2 ttl=63 time=1.08 ms 64 bytes from 57.12.10.131: icmp_req=3 ttl=63 time=1.09 ms --- 57.12.10.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.089/4.021/9.879/4.142 ms 2025-11-03 02:32:31,519 - INFO - Ping to IP 57.12.10.131 from VM ctest-VM11-65952243 passed 2025-11-03 02:32:31,519 - INFO - Test with src as VN and dst as policy PASSED 2025-11-03 02:32:31,519 - INFO - Deleting VM ctest-VM31-07841856 2025-11-03 02:32:31,611 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:32:31,612 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:32:31,621 - DEBUG - VM ID a8f6b52a-c7af-43e0-864d-815ee12d3c55 of VM ctest-VM31-07841856 is still found in API Server 2025-11-03 02:32:33,622 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:32:33,622 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:32:33,629 - DEBUG - Response Code: 404 2025-11-03 02:32:33,629 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:32:33,636 - DEBUG - Response Code: 404 2025-11-03 02:32:33,637 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/a8f6b52a-c7af-43e0-864d-815ee12d3c55 2025-11-03 02:32:33,642 - DEBUG - Response Code: 404 2025-11-03 02:32:33,642 - INFO - VM ctest-VM31-07841856 is fully removed in API-Server 2025-11-03 02:32:33,799 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-11-03 02:32:33,837 - DEBUG - Validated that vrouter 10.0.0.73 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 2025-11-03 02:32:33,847 - DEBUG - Validated that vrouter 10.0.0.33 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 2025-11-03 02:32:33,847 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 2025-11-03 02:32:33,847 - INFO - VM ctest-VM31-07841856 is removed in Compute, and routes are removed in all compute nodes 2025-11-03 02:32:34,079 - INFO - Routes for VM ctest-VM31-07841856 is removed in all control-nodes 2025-11-03 02:32:34,079 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:34,112 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:34,141 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:34,141 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:34,141 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:34,141 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:37,142 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:37,179 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:37,211 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:37,211 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:37,211 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:37,211 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:40,212 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:40,244 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:40,272 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:40,272 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:40,272 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:40,272 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:43,273 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:43,305 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:43,333 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:43,333 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:43,333 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:43,333 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:46,333 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:46,374 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:46,402 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:46,402 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:46,402 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:46,402 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:49,403 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:49,438 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:49,470 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:49,470 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:49,470 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:49,470 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:52,471 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:52,506 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:52,533 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:52,533 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:52,533 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:52,533 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:55,534 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:55,569 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:55,601 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:55,601 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:55,601 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:55,601 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:32:58,601 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:32:58,639 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:32:58,669 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:32:58,669 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:32:58,669 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:32:58,669 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:01,670 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:01,708 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:01,740 - DEBUG - VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:01,740 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:01,740 - DEBUG - interface for vm a8f6b52a-c7af-43e0-864d-815ee12d3c55 deleted from vrouter uve ... 2025-11-03 02:33:01,741 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:01,741 - DEBUG - Validated that VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is removed in Vrouter UVE 2025-11-03 02:33:01,741 - DEBUG - Verifying through opserver in 10.0.0.249 2025-11-03 02:33:01,741 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630?flat 2025-11-03 02:33:01,770 - DEBUG - a8f6b52a-c7af-43e0-864d-815ee12d3c55 BM not in default-domain:ctest-TestPolicyAcl-01861864:ctest-VN3-22240630 uve 2025-11-03 02:33:01,770 - DEBUG - Validated that VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is not present in the VN UVE 2025-11-03 02:33:01,770 - DEBUG - Verifying the a8f6b52a-c7af-43e0-864d-815ee12d3c55 virtual network link through opserver 10.0.0.249 2025-11-03 02:33:01,770 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2025-11-03 02:33:01,784 - INFO - a8f6b52a-c7af-43e0-864d-815ee12d3c55 vm uve deleted from opserver 2025-11-03 02:33:01,784 - DEBUG - Verifying the a8f6b52a-c7af-43e0-864d-815ee12d3c55 virtual network link through opserver 10.0.0.61 2025-11-03 02:33:01,784 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-11-03 02:33:01,798 - INFO - a8f6b52a-c7af-43e0-864d-815ee12d3c55 vm uve deleted from opserver 2025-11-03 02:33:01,798 - DEBUG - Verifying the a8f6b52a-c7af-43e0-864d-815ee12d3c55 virtual network link through opserver 10.0.0.23 2025-11-03 02:33:01,798 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-11-03 02:33:01,812 - INFO - a8f6b52a-c7af-43e0-864d-815ee12d3c55 vm uve deleted from opserver 2025-11-03 02:33:01,812 - INFO - Validated that VM a8f6b52a-c7af-43e0-864d-815ee12d3c55 is removed from Opserver 2025-11-03 02:33:01,812 - INFO - Deleting VM ctest-VM21-90876706 2025-11-03 02:33:01,902 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:33:01,902 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:33:01,910 - DEBUG - VM ID 95917319-8fc5-4669-9e80-13235187c5b9 of VM ctest-VM21-90876706 is still found in API Server 2025-11-03 02:33:03,911 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:33:03,911 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:33:03,919 - DEBUG - Response Code: 404 2025-11-03 02:33:03,919 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:33:03,925 - DEBUG - Response Code: 404 2025-11-03 02:33:03,926 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/95917319-8fc5-4669-9e80-13235187c5b9 2025-11-03 02:33:03,933 - DEBUG - Response Code: 404 2025-11-03 02:33:03,933 - INFO - VM ctest-VM21-90876706 is fully removed in API-Server 2025-11-03 02:33:04,094 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-11-03 02:33:04,135 - DEBUG - Validated that vrouter 10.0.0.73 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 2025-11-03 02:33:04,144 - DEBUG - Validated that vrouter 10.0.0.33 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 2025-11-03 02:33:04,144 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 2025-11-03 02:33:04,144 - INFO - VM ctest-VM21-90876706 is removed in Compute, and routes are removed in all compute nodes 2025-11-03 02:33:04,347 - INFO - Routes for VM ctest-VM21-90876706 is removed in all control-nodes 2025-11-03 02:33:04,348 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:04,380 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:04,415 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:04,415 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:04,415 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:04,416 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:07,416 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:07,465 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:07,499 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:07,499 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:07,499 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:07,499 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:10,499 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:10,536 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:10,570 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:10,570 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:10,570 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:10,570 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:13,571 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:13,603 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:13,635 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:13,635 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:13,635 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:13,635 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:16,636 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:16,668 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:16,702 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:16,702 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:16,702 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:16,702 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:19,703 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:19,735 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:19,767 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:19,768 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:19,768 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:19,768 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:22,768 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:22,799 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:22,835 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:22,835 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:22,835 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:22,835 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:25,836 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:25,879 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:25,918 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:25,918 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:25,918 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:25,918 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:28,919 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:28,954 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:28,985 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:28,985 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:28,985 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:28,985 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:31,986 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-2:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:32,026 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-2?flat 2025-11-03 02:33:32,065 - DEBUG - VM 95917319-8fc5-4669-9e80-13235187c5b9 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4597-2 uve 2025-11-03 02:33:32,065 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:32,065 - DEBUG - interface for vm 95917319-8fc5-4669-9e80-13235187c5b9 deleted from vrouter uve ... 2025-11-03 02:33:32,065 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:32,065 - DEBUG - Validated that VM 95917319-8fc5-4669-9e80-13235187c5b9 is removed in Vrouter UVE 2025-11-03 02:33:32,065 - DEBUG - Verifying through opserver in 10.0.0.249 2025-11-03 02:33:32,065 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645?flat 2025-11-03 02:33:32,084 - DEBUG - 95917319-8fc5-4669-9e80-13235187c5b9 BM not in default-domain:ctest-TestPolicyAcl-01861864:ctest-VN2-40301645 uve 2025-11-03 02:33:32,084 - DEBUG - Validated that VM 95917319-8fc5-4669-9e80-13235187c5b9 is not present in the VN UVE 2025-11-03 02:33:32,084 - DEBUG - Verifying the 95917319-8fc5-4669-9e80-13235187c5b9 virtual network link through opserver 10.0.0.249 2025-11-03 02:33:32,084 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2025-11-03 02:33:32,096 - INFO - 95917319-8fc5-4669-9e80-13235187c5b9 vm uve deleted from opserver 2025-11-03 02:33:32,096 - DEBUG - Verifying the 95917319-8fc5-4669-9e80-13235187c5b9 virtual network link through opserver 10.0.0.61 2025-11-03 02:33:32,096 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-11-03 02:33:32,111 - INFO - 95917319-8fc5-4669-9e80-13235187c5b9 vm uve deleted from opserver 2025-11-03 02:33:32,111 - DEBUG - Verifying the 95917319-8fc5-4669-9e80-13235187c5b9 virtual network link through opserver 10.0.0.23 2025-11-03 02:33:32,111 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-11-03 02:33:32,124 - INFO - 95917319-8fc5-4669-9e80-13235187c5b9 vm uve deleted from opserver 2025-11-03 02:33:32,124 - INFO - Validated that VM 95917319-8fc5-4669-9e80-13235187c5b9 is removed from Opserver 2025-11-03 02:33:32,124 - INFO - Deleting VM ctest-VM11-65952243 2025-11-03 02:33:32,197 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:33:32,197 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:33:32,206 - DEBUG - VM ID 6805f0bb-49ea-40b8-98ef-68bf65891f29 of VM ctest-VM11-65952243 is still found in API Server 2025-11-03 02:33:34,207 - DEBUG - Verifying in api server 10.0.0.23 2025-11-03 02:33:34,207 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:33:34,214 - DEBUG - Response Code: 404 2025-11-03 02:33:34,214 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:33:34,220 - DEBUG - Response Code: 404 2025-11-03 02:33:34,220 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:33:34,225 - DEBUG - Response Code: 404 2025-11-03 02:33:34,225 - INFO - VM ctest-VM11-65952243 is fully removed in API-Server 2025-11-03 02:33:34,378 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-11-03 02:33:34,412 - DEBUG - Validated that vrouter 10.0.0.73 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 2025-11-03 02:33:34,422 - DEBUG - Validated that vrouter 10.0.0.33 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 2025-11-03 02:33:34,422 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 2025-11-03 02:33:34,422 - INFO - VM ctest-VM11-65952243 is removed in Compute, and routes are removed in all compute nodes 2025-11-03 02:33:34,615 - INFO - Routes for VM ctest-VM11-65952243 is removed in all control-nodes 2025-11-03 02:33:34,615 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:34,650 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:34,681 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:34,681 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:34,682 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:34,682 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:37,682 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:37,724 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:37,767 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:37,767 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:37,767 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:37,767 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:40,769 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:40,802 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:40,830 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:40,831 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:40,831 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:40,831 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:43,831 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:43,869 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:43,900 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:43,901 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:43,901 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:43,901 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:46,901 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:46,935 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:46,964 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:46,964 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:46,964 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:46,964 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:49,965 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:50,007 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:50,036 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:50,036 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:50,036 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:50,036 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:53,037 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:53,073 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:53,108 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:53,108 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:53,108 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:53,108 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:56,109 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:56,149 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:56,187 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:56,187 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:56,187 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:56,187 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:33:59,187 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:33:59,221 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:33:59,250 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:33:59,250 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:33:59,250 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:33:59,250 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:34:02,251 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4597-1:Compute:contrail-vrouter-agent:0?flat 2025-11-03 02:34:02,285 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4597-1?flat 2025-11-03 02:34:02,319 - DEBUG - VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4597-1 uve 2025-11-03 02:34:02,319 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-11-03 02:34:02,319 - DEBUG - interface for vm 6805f0bb-49ea-40b8-98ef-68bf65891f29 deleted from vrouter uve ... 2025-11-03 02:34:02,319 - DEBUG - Deleted interface not in error interface list ... 2025-11-03 02:34:02,319 - DEBUG - Validated that VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is removed in Vrouter UVE 2025-11-03 02:34:02,319 - DEBUG - Verifying through opserver in 10.0.0.249 2025-11-03 02:34:02,319 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109?flat 2025-11-03 02:34:02,337 - DEBUG - 6805f0bb-49ea-40b8-98ef-68bf65891f29 BM not in default-domain:ctest-TestPolicyAcl-01861864:ctest-VN1-21052109 uve 2025-11-03 02:34:02,337 - DEBUG - Validated that VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is not present in the VN UVE 2025-11-03 02:34:02,337 - DEBUG - Verifying the 6805f0bb-49ea-40b8-98ef-68bf65891f29 virtual network link through opserver 10.0.0.249 2025-11-03 02:34:02,337 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-machines 2025-11-03 02:34:02,353 - DEBUG - No links retuned for 6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:34:02,353 - INFO - 6805f0bb-49ea-40b8-98ef-68bf65891f29 vm uve deleted from opserver 2025-11-03 02:34:02,354 - DEBUG - Verifying the 6805f0bb-49ea-40b8-98ef-68bf65891f29 virtual network link through opserver 10.0.0.61 2025-11-03 02:34:02,354 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-11-03 02:34:02,372 - DEBUG - No links retuned for 6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:34:02,372 - INFO - 6805f0bb-49ea-40b8-98ef-68bf65891f29 vm uve deleted from opserver 2025-11-03 02:34:02,372 - DEBUG - Verifying the 6805f0bb-49ea-40b8-98ef-68bf65891f29 virtual network link through opserver 10.0.0.23 2025-11-03 02:34:02,372 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-machines 2025-11-03 02:34:02,384 - DEBUG - No links retuned for 6805f0bb-49ea-40b8-98ef-68bf65891f29 2025-11-03 02:34:02,384 - INFO - 6805f0bb-49ea-40b8-98ef-68bf65891f29 vm uve deleted from opserver 2025-11-03 02:34:02,385 - INFO - Validated that VM 6805f0bb-49ea-40b8-98ef-68bf65891f29 is removed from Opserver 2025-11-03 02:34:02,385 - DEBUG - Detaching the Policy for VN :ctest-VN2-40301645 2025-11-03 02:34:02,385 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:34:02,390 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:34:02,401 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:34:02,490 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0d586a8e-286b-4860-a05a-63ad1e6f9e86 2025-11-03 02:34:02,506 - DEBUG - Requesting: http://10.0.0.249:8082/network-policy/40f1c2a5-671b-469f-887e-89d85381c3cf 2025-11-03 02:34:02,686 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAcl-01861864', 'ctest-policy21-46115196']] from ctest-VN2-40301645 2025-11-03 02:34:02,686 - DEBUG - Detaching the Policy for VN :ctest-VN1-21052109 2025-11-03 02:34:02,686 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:34:02,692 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:34:02,703 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:34:02,797 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/53218015-a13d-40dd-a9d4-ce9d9db655f4 2025-11-03 02:34:03,067 - INFO - Detached Policy from ctest-VN1-21052109 2025-11-03 02:34:03,134 - INFO - Deleted policy ctest-policy13-42422583 2025-11-03 02:34:03,183 - INFO - Deleted policy ctest-policy21-46115196 2025-11-03 02:34:03,221 - INFO - Deleted policy ctest-policy12-45196422 2025-11-03 02:34:03,222 - INFO - Deleting VN ctest-VN3-22240630 2025-11-03 02:34:03,378 - DEBUG - Response for deleting network () 2025-11-03 02:34:03,378 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/59176efc-3d38-411a-b7af-37e42bf00998 2025-11-03 02:34:03,389 - DEBUG - Response Code: 404 2025-11-03 02:34:03,389 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:34:03,396 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:34:03,448 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:34:03,531 - INFO - Validated that VN ctest-VN3-22240630 is not found in API Server 2025-11-03 02:34:03,541 - DEBUG - VN ctest-VN3-22240630 is not present in Agent 10.0.0.73 2025-11-03 02:34:03,551 - DEBUG - VN ctest-VN3-22240630 is not present in Agent 10.0.0.33 2025-11-03 02:34:03,551 - INFO - Validated that VN ctest-VN3-22240630 is not in any agent 2025-11-03 02:34:03,585 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-22240630 info 2025-11-03 02:34:03,585 - INFO - Deleting VN ctest-VN2-40301645 2025-11-03 02:34:03,793 - DEBUG - Response for deleting network () 2025-11-03 02:34:03,793 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f79e5640-812d-4c76-b425-4995e94caa76 2025-11-03 02:34:03,798 - DEBUG - Response Code: 404 2025-11-03 02:34:03,798 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:34:03,804 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:34:03,814 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:34:03,899 - INFO - Validated that VN ctest-VN2-40301645 is not found in API Server 2025-11-03 02:34:03,911 - DEBUG - VN ctest-VN2-40301645 is not present in Agent 10.0.0.73 2025-11-03 02:34:03,921 - DEBUG - VN ctest-VN2-40301645 is not present in Agent 10.0.0.33 2025-11-03 02:34:03,921 - INFO - Validated that VN ctest-VN2-40301645 is not in any agent 2025-11-03 02:34:03,951 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-40301645 info 2025-11-03 02:34:03,951 - INFO - Deleting VN ctest-VN1-21052109 2025-11-03 02:34:04,169 - DEBUG - Response for deleting network () 2025-11-03 02:34:04,169 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f0f76e12-8a56-4692-b889-781cac9cd44d 2025-11-03 02:34:04,174 - DEBUG - Response Code: 404 2025-11-03 02:34:04,174 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 02:34:04,179 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 02:34:04,190 - DEBUG - Requesting: http://10.0.0.249:8082/project/46ce3ae0-e69a-442e-bd4c-33904a6250b7 2025-11-03 02:34:04,294 - INFO - Validated that VN ctest-VN1-21052109 is not found in API Server 2025-11-03 02:34:04,305 - DEBUG - VN ctest-VN1-21052109 is not present in Agent 10.0.0.73 2025-11-03 02:34:04,316 - DEBUG - VN ctest-VN1-21052109 is not present in Agent 10.0.0.33 2025-11-03 02:34:04,316 - INFO - Validated that VN ctest-VN1-21052109 is not in any agent 2025-11-03 02:34:04,348 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-21052109 info 2025-11-03 02:34:04,443 - INFO - IPAM: ipam3 is not found in API Server 2025-11-03 02:34:04,467 - INFO - IPAM:ipam3 is not found in control node 2025-11-03 02:34:04,607 - INFO - IPAM: ipam2 is not found in API Server 2025-11-03 02:34:04,628 - INFO - IPAM:ipam2 is not found in control node 2025-11-03 02:34:04,759 - INFO - IPAM: ipam1 is not found in API Server 2025-11-03 02:34:04,782 - INFO - IPAM:ipam1 is not found in control node 2025-11-03 02:34:06,058 - DEBUG - No XMPP flaps were noticed during the test 2025-11-03 02:34:06,058 - INFO - END TEST : test_policy_inheritance_src_vn_dst_pol : PASSED[0:03:45] 2025-11-03 02:34:06,059 - INFO - -------------------------------------------------------------------------------- 2025-11-03 02:34:06,796 - INFO - Deleted project: ctest-TestPolicyAcl-01861864, ID : 46ce3ae0-e69a-442e-bd4c-33904a6250b7