2025-08-18 02:30:38,925 - INFO - Domain Default found not creating 2025-08-18 02:30:39,057 - INFO - Project ctest-TestPolicyAcl-30486983 not found, creating it 2025-08-18 02:30:39,582 - INFO - Created Project:ctest-TestPolicyAcl-30486983, ID : 24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:41,561 - INFO - ================================================================================ 2025-08-18 02:30:41,561 - INFO - STARTING TEST : test_policy_inheritance_src_vn_dst_pol 2025-08-18 02:30:41,561 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-08-18 02:30:42,821 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.41': {'10.20.0.129': '0', '10.20.0.25': '0'}} with 2025-08-18 02:30:42,822 - INFO - Initial checks done. Running the testcase now 2025-08-18 02:30:42,822 - INFO - 2025-08-18 02:30:44,082 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:44,372 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:44,402 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:44,418 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:44,515 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/a29dab59-6709-4fa0-a85d-6656c5477d3f 2025-08-18 02:30:44,522 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-08-18 02:30:44,528 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11717710205957001120', 'uuid-lslong': '12131965494069001535'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.142689'} 2025-08-18 02:30:44,534 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11717710205957001120', 'uuid-lslong': '12131965494069001535'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.153107'} 2025-08-18 02:30:44,539 - DEBUG - Control-node 10.0.0.19 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11717710205957001120', 'uuid-lslong': '12131965494069001535'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.157329'} 2025-08-18 02:30:44,539 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-08-18 02:30:44,540 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:44,546 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:44,559 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:44,647 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/4c919f4d-2d51-491c-bf45-ae0668420ca7 2025-08-18 02:30:44,655 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-08-18 02:30:44,663 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5517366172327168284', 'uuid-lslong': '13782613577179466919'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.939814'} 2025-08-18 02:30:44,669 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5517366172327168284', 'uuid-lslong': '13782613577179466919'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.942595'} 2025-08-18 02:30:44,677 - DEBUG - Control-node 10.0.0.19 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5517366172327168284', 'uuid-lslong': '13782613577179466919'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.954786'} 2025-08-18 02:30:44,677 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-08-18 02:30:44,677 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:44,685 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:44,697 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:44,794 - DEBUG - Requesting: http://10.0.0.27:8082/network-ipam/785807f3-9cd3-46fc-a414-c4a61be84758 2025-08-18 02:30:44,802 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-08-18 02:30:44,812 - DEBUG - Control-node 10.0.0.27 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8671689825391429372', 'uuid-lslong': '11823291139466217304'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.756157'} 2025-08-18 02:30:44,819 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8671689825391429372', 'uuid-lslong': '11823291139466217304'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.765077'} 2025-08-18 02:30:44,825 - DEBUG - Control-node 10.0.0.19 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAcl-30486983:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8671689825391429372', 'uuid-lslong': '11823291139466217304'}, 'enable': 'true', 'created': '2025-08-18T02:30:43', 'last-modified': '2025-08-18T02:30:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.774245'} 2025-08-18 02:30:44,825 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-08-18 02:30:45,108 - DEBUG - Response for create_network : {'network': {'id': '5d3dbeca-0887-4c4a-8c86-7f95df3a24db', 'name': 'ctest-VN1-65142615', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'project_id': '24039f01012d49798738adca3c0e4fc2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-VN1-65142615'], 'port_security_enabled': True, 'description': ''}} 2025-08-18 02:30:45,394 - DEBUG - Response for create_subnet : {'subnet': {'id': 'afd9eda4-7bb1-4c5b-b819-4dd35e653ec8', 'name': '', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'network_id': '5d3dbeca-0887-4c4a-8c86-7f95df3a24db', 'ip_version': 4, 'cidr': '143.223.168.0/26', 'allocation_pools': [{'start': '143.223.168.2', 'end': '143.223.168.62'}], 'gateway_ip': '143.223.168.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.223.168.2', 'tags': [], 'project_id': '24039f01012d49798738adca3c0e4fc2'}} 2025-08-18 02:30:45,415 - INFO - Created VN ctest-VN1-65142615 2025-08-18 02:30:45,430 - DEBUG - VN ctest-VN1-65142615 UUID is 5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:45,582 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615(5d3dbeca-0887-4c4a-8c86-7f95df3a24db) with subnets ['143.223.168.0/26'] 2025-08-18 02:30:45,915 - DEBUG - Response for create_network : {'network': {'id': 'c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc', 'name': 'ctest-VN2-12574820', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'project_id': '24039f01012d49798738adca3c0e4fc2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-VN2-12574820'], 'port_security_enabled': True, 'description': ''}} 2025-08-18 02:30:46,184 - DEBUG - Response for create_subnet : {'subnet': {'id': '16f9a2e5-85c9-4cc6-97bb-16be3159f444', 'name': '', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'network_id': 'c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc', 'ip_version': 4, 'cidr': '190.82.221.0/26', 'allocation_pools': [{'start': '190.82.221.2', 'end': '190.82.221.62'}], 'gateway_ip': '190.82.221.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '190.82.221.2', 'tags': [], 'project_id': '24039f01012d49798738adca3c0e4fc2'}} 2025-08-18 02:30:46,206 - INFO - Created VN ctest-VN2-12574820 2025-08-18 02:30:46,220 - DEBUG - VN ctest-VN2-12574820 UUID is c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:46,564 - DEBUG - Response for create_network : {'network': {'id': 'c40a67c7-8d02-4758-95d9-9efc38920e79', 'name': 'ctest-VN3-60515399', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'project_id': '24039f01012d49798738adca3c0e4fc2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-VN3-60515399'], 'port_security_enabled': True, 'description': ''}} 2025-08-18 02:30:46,834 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a89c2e21-003c-4110-9827-0b0944f1ec76', 'name': '', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'network_id': 'c40a67c7-8d02-4758-95d9-9efc38920e79', 'ip_version': 4, 'cidr': '211.189.37.192/26', 'allocation_pools': [{'start': '211.189.37.194', 'end': '211.189.37.254'}], 'gateway_ip': '211.189.37.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '211.189.37.194', 'tags': [], 'project_id': '24039f01012d49798738adca3c0e4fc2'}} 2025-08-18 02:30:46,857 - INFO - Created VN ctest-VN3-60515399 2025-08-18 02:30:46,873 - DEBUG - VN ctest-VN3-60515399 UUID is c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:46,953 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:46,960 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:46,974 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:47,070 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:47,089 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:47,100 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/53e35074-9384-4796-a437-2096887dcb11 2025-08-18 02:30:47,111 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/53e35074-9384-4796-a437-2096887dcb11 2025-08-18 02:30:47,118 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/dff9af99-b351-48dd-b7c8-42f0dd4bf9ff 2025-08-18 02:30:47,125 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-18 02:30:47,125 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:47,136 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/53e35074-9384-4796-a437-2096887dcb11 2025-08-18 02:30:47,154 - INFO - Verified VN network id 13 for VN 5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:47,154 - INFO - Verifications in API Server for VN ctest-VN1-65142615 passed 2025-08-18 02:30:47,154 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:47,166 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/53e35074-9384-4796-a437-2096887dcb11 2025-08-18 02:30:47,175 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/53e35074-9384-4796-a437-2096887dcb11 2025-08-18 02:30:47,185 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/dff9af99-b351-48dd-b7c8-42f0dd4bf9ff 2025-08-18 02:30:47,202 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6718735994042403914', 'uuid-lslong': '10125921093861123291'}, 'enable': 'true', 'created': '2025-08-18T02:30:45', 'last-modified': '2025-08-18T02:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.877117'} 2025-08-18 02:30:47,210 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-18 02:30:47,215 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6718735994042403914', 'uuid-lslong': '10125921093861123291'}, 'enable': 'true', 'created': '2025-08-18T02:30:45', 'last-modified': '2025-08-18T02:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.891490'} 2025-08-18 02:30:47,221 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-18 02:30:47,228 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6718735994042403914', 'uuid-lslong': '10125921093861123291'}, 'enable': 'true', 'created': '2025-08-18T02:30:45', 'last-modified': '2025-08-18T02:30:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.902993'} 2025-08-18 02:30:47,235 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-18 02:30:47,235 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-65142615 passed 2025-08-18 02:30:47,235 - DEBUG - ====Verifying policy data for ctest-VN1-65142615 in API_Server ====== 2025-08-18 02:30:47,235 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:47,243 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:47,261 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:47,380 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:47,391 - DEBUG - =>VN ctest-VN1-65142615 has no policy to be verified 2025-08-18 02:30:47,391 - DEBUG - Verifying the vn in opserver 2025-08-18 02:30:47,391 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 virtual network link through opserver 10.0.0.27 2025-08-18 02:30:47,392 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-18 02:30:47,698 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-18 02:30:47,761 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615?flat'} 2025-08-18 02:30:47,761 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 virtual network link through opserver 10.0.0.38 2025-08-18 02:30:47,761 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-18 02:30:48,098 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-18 02:30:48,163 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615?flat'} 2025-08-18 02:30:48,163 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 virtual network link through opserver 10.0.0.19 2025-08-18 02:30:48,164 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-18 02:30:48,472 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-18 02:30:48,530 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615?flat'} 2025-08-18 02:30:48,530 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is found in opserver 2025-08-18 02:30:48,555 - DEBUG - Do not have enough data to verify VN in agent 2025-08-18 02:30:48,568 - DEBUG - VRF ids for VN ctest-VN1-65142615: {} 2025-08-18 02:30:48,568 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:48,575 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:48,592 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:48,686 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:48,704 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:48,715 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/6bb0d005-fcdc-4dc3-816c-0a910122e5e5 2025-08-18 02:30:48,726 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/6bb0d005-fcdc-4dc3-816c-0a910122e5e5 2025-08-18 02:30:48,734 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/91d01590-faa5-470f-8c6a-1efeb3ed0b5b 2025-08-18 02:30:48,742 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-18 02:30:48,742 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:48,752 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/6bb0d005-fcdc-4dc3-816c-0a910122e5e5 2025-08-18 02:30:48,773 - INFO - Verified VN network id 14 for VN c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:48,773 - INFO - Verifications in API Server for VN ctest-VN2-12574820 passed 2025-08-18 02:30:48,774 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:48,789 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/6bb0d005-fcdc-4dc3-816c-0a910122e5e5 2025-08-18 02:30:48,800 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/6bb0d005-fcdc-4dc3-816c-0a910122e5e5 2025-08-18 02:30:48,808 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/91d01590-faa5-470f-8c6a-1efeb3ed0b5b 2025-08-18 02:30:48,822 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14472524624964305911', 'uuid-lslong': '11802120802361466300'}, 'enable': 'true', 'created': '2025-08-18T02:30:45', 'last-modified': '2025-08-18T02:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.702546'} 2025-08-18 02:30:48,829 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-18 02:30:48,835 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14472524624964305911', 'uuid-lslong': '11802120802361466300'}, 'enable': 'true', 'created': '2025-08-18T02:30:45', 'last-modified': '2025-08-18T02:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.715272'} 2025-08-18 02:30:48,843 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-18 02:30:48,850 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14472524624964305911', 'uuid-lslong': '11802120802361466300'}, 'enable': 'true', 'created': '2025-08-18T02:30:45', 'last-modified': '2025-08-18T02:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.731814'} 2025-08-18 02:30:48,857 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-18 02:30:48,857 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-12574820 passed 2025-08-18 02:30:48,858 - DEBUG - ====Verifying policy data for ctest-VN2-12574820 in API_Server ====== 2025-08-18 02:30:48,858 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:48,866 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:48,882 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:48,980 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:48,993 - DEBUG - =>VN ctest-VN2-12574820 has no policy to be verified 2025-08-18 02:30:48,993 - DEBUG - Verifying the vn in opserver 2025-08-18 02:30:48,993 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 virtual network link through opserver 10.0.0.27 2025-08-18 02:30:48,993 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-18 02:30:49,045 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820?flat'} 2025-08-18 02:30:49,045 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 virtual network link through opserver 10.0.0.38 2025-08-18 02:30:49,045 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-18 02:30:49,101 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820?flat'} 2025-08-18 02:30:49,101 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 virtual network link through opserver 10.0.0.19 2025-08-18 02:30:49,101 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-18 02:30:49,152 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820?flat'} 2025-08-18 02:30:49,152 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 is found in opserver 2025-08-18 02:30:49,176 - DEBUG - Do not have enough data to verify VN in agent 2025-08-18 02:30:49,187 - DEBUG - VRF ids for VN ctest-VN2-12574820: {} 2025-08-18 02:30:49,187 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:49,193 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:49,205 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:49,306 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:49,319 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:49,331 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fb06da96-eba7-4cc5-b1ba-668da7dfb70e 2025-08-18 02:30:49,338 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fb06da96-eba7-4cc5-b1ba-668da7dfb70e 2025-08-18 02:30:49,347 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/6cb1261d-4a96-4c57-aee1-00ab3962d77c 2025-08-18 02:30:49,355 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-18 02:30:49,355 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:49,368 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fb06da96-eba7-4cc5-b1ba-668da7dfb70e 2025-08-18 02:30:49,388 - INFO - Verified VN network id 15 for VN c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:49,388 - INFO - Verifications in API Server for VN ctest-VN3-60515399 passed 2025-08-18 02:30:49,388 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:49,400 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fb06da96-eba7-4cc5-b1ba-668da7dfb70e 2025-08-18 02:30:49,409 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fb06da96-eba7-4cc5-b1ba-668da7dfb70e 2025-08-18 02:30:49,417 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/6cb1261d-4a96-4c57-aee1-00ab3962d77c 2025-08-18 02:30:49,432 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14126217287962871640', 'uuid-lslong': '10797836387715518073'}, 'enable': 'true', 'created': '2025-08-18T02:30:46', 'last-modified': '2025-08-18T02:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.698659'} 2025-08-18 02:30:49,439 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-18 02:30:49,446 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14126217287962871640', 'uuid-lslong': '10797836387715518073'}, 'enable': 'true', 'created': '2025-08-18T02:30:46', 'last-modified': '2025-08-18T02:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.712335'} 2025-08-18 02:30:49,452 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-18 02:30:49,459 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAcl-30486983', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14126217287962871640', 'uuid-lslong': '10797836387715518073'}, 'enable': 'true', 'created': '2025-08-18T02:30:46', 'last-modified': '2025-08-18T02:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.725831'} 2025-08-18 02:30:49,467 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-18 02:30:49,467 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-60515399 passed 2025-08-18 02:30:49,467 - DEBUG - ====Verifying policy data for ctest-VN3-60515399 in API_Server ====== 2025-08-18 02:30:49,467 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:49,476 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:49,491 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:49,601 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c40a67c7-8d02-4758-95d9-9efc38920e79 2025-08-18 02:30:49,614 - DEBUG - =>VN ctest-VN3-60515399 has no policy to be verified 2025-08-18 02:30:49,614 - DEBUG - Verifying the vn in opserver 2025-08-18 02:30:49,614 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 virtual network link through opserver 10.0.0.27 2025-08-18 02:30:49,614 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-18 02:30:49,675 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399?flat'} 2025-08-18 02:30:49,675 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 virtual network link through opserver 10.0.0.38 2025-08-18 02:30:49,675 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-18 02:30:49,731 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399?flat'} 2025-08-18 02:30:49,731 - DEBUG - Verifying the default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 virtual network link through opserver 10.0.0.19 2025-08-18 02:30:49,731 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-18 02:30:49,784 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399?flat'} 2025-08-18 02:30:49,784 - INFO - Validated that VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 is found in opserver 2025-08-18 02:30:49,807 - DEBUG - Do not have enough data to verify VN in agent 2025-08-18 02:30:49,818 - DEBUG - VRF ids for VN ctest-VN3-60515399: {} 2025-08-18 02:30:49,824 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-18 02:30:50,090 - DEBUG - No destination network defined 2025-08-18 02:30:50,090 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAcl-30486983:ctest-policy13-60813015, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-18 02:30:50,362 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-08-18 02:30:50,575 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:50,582 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:50,593 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:50,697 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:30:50,708 - DEBUG - Setup step: Associating the policy to VN' 2025-08-18 02:30:50,898 - INFO - Associated Policy to ctest-VN1-65142615 2025-08-18 02:30:50,898 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:30:50,908 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:30:50,924 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:30:51,016 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:30:51,027 - DEBUG - Setup step: Associating the policy to VN' 2025-08-18 02:30:51,115 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc', 'name': 'ctest-VN2-12574820', 'tenant_id': '24039f01012d49798738adca3c0e4fc2', 'project_id': '24039f01012d49798738adca3c0e4fc2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['16f9a2e5-85c9-4cc6-97bb-16be3159f444'], 'fq_name': ['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-VN2-12574820'], 'policys': [['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-policy21-05382748']], 'subnet_ipam': [{'subnet_cidr': '190.82.221.0/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAcl-30486983', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-08-18 02:30:51,206 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-policy21-05382748']] to ctest-VN2-12574820 2025-08-18 02:30:51,314 - DEBUG - Services list from nova: [, , , ] 2025-08-18 02:30:52,300 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3870-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3870-1) 2025-08-18 02:30:53,627 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3870-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3870-2) 2025-08-18 02:30:54,981 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3870-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3870-1) 2025-08-18 02:30:55,057 - DEBUG - VM is in ACTIVE state now 2025-08-18 02:30:55,057 - INFO - VM name : ctest-VM11-78493763 2025-08-18 02:30:55,131 - DEBUG - VM ctest-VM11-78493763 ID is 171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:30:55,205 - DEBUG - VM is in ACTIVE state now 2025-08-18 02:30:55,229 - DEBUG - VM ctest-VM11-78493763 launched on Node an-jenkins-deploy-platform-ansible-os-3870-1 2025-08-18 02:30:55,318 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:30:55,764 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:30:55,834 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:30:55,841 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/4c445c47-b9c9-4deb-97c1-a28f99e5a61d 2025-08-18 02:30:55,852 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:30:55,859 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/4c445c47-b9c9-4deb-97c1-a28f99e5a61d 2025-08-18 02:30:55,869 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/3eea0a3d-321e-421e-95a9-6c98f35560f0 2025-08-18 02:30:55,878 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:30:55,878 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:30:55,885 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/4c445c47-b9c9-4deb-97c1-a28f99e5a61d 2025-08-18 02:30:55,894 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/3eea0a3d-321e-421e-95a9-6c98f35560f0 2025-08-18 02:30:55,901 - INFO - VM ctest-VM11-78493763 verfication in all API Servers passed 2025-08-18 02:30:55,923 - DEBUG - VM ctest-VM11-78493763 Tap interface: {'index': '3', 'name': 'tap4c445c47-b9', 'uuid': '4c445c47-b9c9-4deb-97c1-a28f99e5a61d', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615:ctest-VN1-65142615', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'vm_uuid': '171e8610-bfef-450c-b598-01a3259e1e95', 'vm_name': 'ctest-VM11-78493763', 'ip_addr': '143.223.168.3', 'mac_addr': '02:4c:44:5c:47:b9', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '46', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d', 'sg_uuid_list': ['d739d5aa-c96c-472c-8d6f-8cd55d0c0bc1'], 'static_route_list': None, 'vm_project_uuid': '24039f01-012d-4979-8738-adca3c0e4fc2', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-18 02:30:55,923 - DEBUG - Agent 10.0.0.241 vrf name: default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615:ctest-VN1-65142615 2025-08-18 02:30:55,933 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615:ctest-VN1-65142615', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.18:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-18 02:30:56,024 - DEBUG - VM ctest-VM11-78493763 : Tap interface tap4c445c47-b9 is set to Active 2025-08-18 02:30:56,024 - DEBUG - Tap interface tap4c445c47-b9 detail : {'index': '3', 'name': 'tap4c445c47-b9', 'uuid': '4c445c47-b9c9-4deb-97c1-a28f99e5a61d', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615:ctest-VN1-65142615', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'vm_uuid': '171e8610-bfef-450c-b598-01a3259e1e95', 'vm_name': 'ctest-VM11-78493763', 'ip_addr': '143.223.168.3', 'mac_addr': '02:4c:44:5c:47:b9', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '46', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d', 'sg_uuid_list': ['d739d5aa-c96c-472c-8d6f-8cd55d0c0bc1'], 'static_route_list': None, 'vm_project_uuid': '24039f01-012d-4979-8738-adca3c0e4fc2', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-18 02:30:56,138 - DEBUG - Starting Layer 2 verification in Agent 2025-08-18 02:30:56,150 - DEBUG - Layer 2 path is seen for VM MAC 02:4c:44:5c:47:b9 in agent 10.0.0.241 2025-08-18 02:30:56,150 - DEBUG - Active layer 2 route in agent is present for VMI tap4c445c47-b9 2025-08-18 02:30:56,150 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-18 02:30:56,157 - DEBUG - VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is found in Agent of node 10.0.0.241 2025-08-18 02:30:56,309 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is consistent in agent 10.0.0.241 2025-08-18 02:30:56,310 - DEBUG - Route for VM IP ['143.223.168.3'] is consistent in agent 10.0.0.241 2025-08-18 02:30:56,310 - DEBUG - VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 verification for VM ctest-VM11-78493763 in Agent 10.0.0.241 passed 2025-08-18 02:30:56,423 - DEBUG - Starting all layer 2 verification in agent 10.0.0.241 2025-08-18 02:30:56,450 - DEBUG - Route for VM MAC 02:4c:44:5c:47:b9 is consistent in agent 10.0.0.241 2025-08-18 02:30:59,663 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-08-18 02:30:59,663 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:30:59,681 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:03,764 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-08-18 02:31:03,764 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:03,780 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:07,860 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-08-18 02:31:07,860 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:07,876 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:11,949 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-08-18 02:31:11,949 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:11,964 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:16,047 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-18 02:31:16,047 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:16,060 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:20,140 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-08-18 02:31:20,141 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:20,163 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:24,235 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-08-18 02:31:24,235 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:24,253 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:28,339 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-18 02:31:28,339 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:28,353 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:32,432 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-08-18 02:31:32,432 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:32,449 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:36,531 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-08-18 02:31:36,531 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 failed! 2025-08-18 02:31:36,548 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 is 143.223.168.1 and allocation pool is NOT set 2025-08-18 02:31:38,617 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.57 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.33 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.331/3.452/5.574/2.121 ms') 2025-08-18 02:31:38,617 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 passed 2025-08-18 02:31:38,617 - INFO - VM ctest-VM11-78493763 verifications in Compute nodes passed 2025-08-18 02:31:38,890 - DEBUG - Validated VM route 143.223.168.3 in vrouter of 10.0.0.241 2025-08-18 02:31:38,898 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-18 02:31:38,898 - INFO - Validated routes of VM ctest-VM11-78493763 in all vrouters 2025-08-18 02:31:39,363 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-08-18 02:31:39,487 - DEBUG - Layer2 route found for VM MAC 02:4c:44:5c:47:b9 in Control-node 10.0.0.27 2025-08-18 02:31:39,487 - DEBUG - L2 Label for VM ctest-VM11-78493763 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29 2025-08-18 02:31:39,487 - DEBUG - Starting all layer2 verification in 10.0.0.19 Control Node 2025-08-18 02:31:39,617 - DEBUG - Layer2 route found for VM MAC 02:4c:44:5c:47:b9 in Control-node 10.0.0.19 2025-08-18 02:31:39,617 - DEBUG - L2 Label for VM ctest-VM11-78493763 same between Control-node 10.0.0.19 and Agent, Expected: 29, Seen: 29 2025-08-18 02:31:39,617 - INFO - Verification in Control-nodes for VM ctest-VM11-78493763 passed 2025-08-18 02:31:39,617 - DEBUG - Verifying the vm in opserver 2025-08-18 02:31:39,617 - DEBUG - Verifying in collector 10.0.0.19 ... 2025-08-18 02:31:39,617 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95?flat 2025-08-18 02:31:39,636 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d?flat 2025-08-18 02:31:39,661 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d?flat 2025-08-18 02:31:39,684 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95?flat 2025-08-18 02:31:39,703 - DEBUG - Verifying vm in vn uve 2025-08-18 02:31:39,703 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d?flat 2025-08-18 02:31:39,726 - DEBUG - VM uve shows interface as {'__T': 1755484277710567, 'label': 25, 'active': True, 'tx_vlan': 65535, 'ip6_active': False, 'vn_uuid': '5d3dbeca-0887-4c4a-8c86-7f95df3a24db', 'vm_uuid': '171e8610-bfef-450c-b598-01a3259e1e95', 'ip6_address': '::', 'ip4_active': True, 'port_mirror_enabled': False, 'rx_vlan': 65535, 'gateway': '143.223.168.1', 'uuid': '4c445c47-b9c9-4deb-97c1-a28f99e5a61d', 'vm_name': 'ctest-VM11-78493763', 'admin_state': True, 'ip_address': '143.223.168.3', 'virtual_network': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615', 'l2_active': True, 'mac_address': '02:4c:44:5c:47:b9', 'fixed_ip4_list': ['143.223.168.3'], 'is_health_check_active': True, 'vhostuser_mode': 0} 2025-08-18 02:31:39,726 - DEBUG - VM uve shows ip address as ['143.223.168.3', '::'] 2025-08-18 02:31:39,727 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 2025-08-18 02:31:39,727 - INFO - Verifying through opserver in 10.0.0.27 2025-08-18 02:31:39,727 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615?flat 2025-08-18 02:31:39,758 - DEBUG - expected vm list 171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:31:39,758 - DEBUG - Extracted vm list ['171e8610-bfef-450c-b598-01a3259e1e95'] 2025-08-18 02:31:39,758 - INFO - VM 171e8610-bfef-450c-b598-01a3259e1e95 is present in default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 2025-08-18 02:31:39,758 - DEBUG - Verifying vm in vrouter uve 2025-08-18 02:31:39,758 - DEBUG - Getting info from collector 10.0.0.19.. 2025-08-18 02:31:39,758 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95?flat 2025-08-18 02:31:39,777 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3870-1'] 2025-08-18 02:31:39,777 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:31:39,826 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:31:39,869 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:39,869 - DEBUG - Validated that VM ctest-VM11-78493763 is in Vrouter an-jenkins-deploy-platform-ansible-os-3870-1 UVE 2025-08-18 02:31:39,869 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-18 02:31:39,883 - DEBUG - Expected tap interface of VM uuid 171e8610-bfef-450c-b598-01a3259e1e95 is default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d 2025-08-18 02:31:39,883 - DEBUG - Expected VN of VM uuid 171e8610-bfef-450c-b598-01a3259e1e95 is default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 2025-08-18 02:31:39,883 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:31:39,930 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:31:39,981 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:39,981 - INFO - tap interface default-domain:ctest-TestPolicyAcl-30486983:4c445c47-b9c9-4deb-97c1-a28f99e5a61d of vm 171e8610-bfef-450c-b598-01a3259e1e95 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:39,981 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 of vm 171e8610-bfef-450c-b598-01a3259e1e95 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:39,981 - DEBUG - Verifying the 171e8610-bfef-450c-b598-01a3259e1e95 virtual network link through opserver 10.0.0.27 2025-08-18 02:31:39,982 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-18 02:31:39,994 - DEBUG - VM link and name as {'name': '171e8610-bfef-450c-b598-01a3259e1e95', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95?flat'} 2025-08-18 02:31:39,994 - DEBUG - Verifying the 171e8610-bfef-450c-b598-01a3259e1e95 virtual network link through opserver 10.0.0.38 2025-08-18 02:31:39,994 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-18 02:31:40,006 - DEBUG - VM link and name as {'name': '171e8610-bfef-450c-b598-01a3259e1e95', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95?flat'} 2025-08-18 02:31:40,006 - DEBUG - Verifying the 171e8610-bfef-450c-b598-01a3259e1e95 virtual network link through opserver 10.0.0.19 2025-08-18 02:31:40,006 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines 2025-08-18 02:31:40,020 - DEBUG - VM link and name as {'name': '171e8610-bfef-450c-b598-01a3259e1e95', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95?flat'} 2025-08-18 02:31:40,020 - INFO - VM ctest-VM11-78493763 validations in Opserver passed 2025-08-18 02:31:40,108 - DEBUG - VM is in ACTIVE state now 2025-08-18 02:31:40,108 - INFO - VM name : ctest-VM21-82535836 2025-08-18 02:31:40,187 - DEBUG - VM ctest-VM21-82535836 ID is 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:40,259 - DEBUG - VM is in ACTIVE state now 2025-08-18 02:31:40,259 - DEBUG - VM ctest-VM21-82535836 launched on Node an-jenkins-deploy-platform-ansible-os-3870-2 2025-08-18 02:31:40,335 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:40,345 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:40,353 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/e735ebe4-a771-49bb-846e-d66e8ffc2891 2025-08-18 02:31:40,364 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:40,372 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/e735ebe4-a771-49bb-846e-d66e8ffc2891 2025-08-18 02:31:40,382 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/ff87304e-58d0-49f0-b6ac-23c7da5798ec 2025-08-18 02:31:40,392 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:31:40,392 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:40,401 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/e735ebe4-a771-49bb-846e-d66e8ffc2891 2025-08-18 02:31:40,412 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/ff87304e-58d0-49f0-b6ac-23c7da5798ec 2025-08-18 02:31:40,423 - INFO - VM ctest-VM21-82535836 verfication in all API Servers passed 2025-08-18 02:31:40,442 - DEBUG - VM ctest-VM21-82535836 Tap interface: {'index': '3', 'name': 'tape735ebe4-a7', 'uuid': 'e735ebe4-a771-49bb-846e-d66e8ffc2891', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820:ctest-VN2-12574820', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'vm_uuid': '3063ef8f-4066-4341-b2b8-6dfb3d411ee3', 'vm_name': 'ctest-VM21-82535836', 'ip_addr': '190.82.221.3', 'mac_addr': '02:e7:35:eb:e4:a7', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891', 'sg_uuid_list': ['d739d5aa-c96c-472c-8d6f-8cd55d0c0bc1'], 'static_route_list': None, 'vm_project_uuid': '24039f01-012d-4979-8738-adca3c0e4fc2', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-18 02:31:40,443 - DEBUG - Agent 10.0.0.41 vrf name: default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820:ctest-VN2-12574820 2025-08-18 02:31:40,450 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820:ctest-VN2-12574820', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-18 02:31:40,538 - DEBUG - VM ctest-VM21-82535836 : Tap interface tape735ebe4-a7 is set to Active 2025-08-18 02:31:40,539 - DEBUG - Tap interface tape735ebe4-a7 detail : {'index': '3', 'name': 'tape735ebe4-a7', 'uuid': 'e735ebe4-a771-49bb-846e-d66e8ffc2891', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820:ctest-VN2-12574820', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'vm_uuid': '3063ef8f-4066-4341-b2b8-6dfb3d411ee3', 'vm_name': 'ctest-VM21-82535836', 'ip_addr': '190.82.221.3', 'mac_addr': '02:e7:35:eb:e4:a7', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '42', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891', 'sg_uuid_list': ['d739d5aa-c96c-472c-8d6f-8cd55d0c0bc1'], 'static_route_list': None, 'vm_project_uuid': '24039f01-012d-4979-8738-adca3c0e4fc2', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-18 02:31:40,652 - DEBUG - Starting Layer 2 verification in Agent 2025-08-18 02:31:40,665 - DEBUG - Layer 2 path is seen for VM MAC 02:e7:35:eb:e4:a7 in agent 10.0.0.41 2025-08-18 02:31:40,666 - DEBUG - Active layer 2 route in agent is present for VMI tape735ebe4-a7 2025-08-18 02:31:40,666 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-18 02:31:40,685 - DEBUG - VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 is found in Agent of node 10.0.0.41 2025-08-18 02:31:40,839 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 is consistent in agent 10.0.0.41 2025-08-18 02:31:40,839 - DEBUG - Route for VM IP ['190.82.221.3'] is consistent in agent 10.0.0.41 2025-08-18 02:31:40,840 - DEBUG - VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 verification for VM ctest-VM21-82535836 in Agent 10.0.0.41 passed 2025-08-18 02:31:40,955 - DEBUG - Starting all layer 2 verification in agent 10.0.0.41 2025-08-18 02:31:40,971 - DEBUG - Route for VM MAC 02:e7:35:eb:e4:a7 is consistent in agent 10.0.0.41 2025-08-18 02:31:42,158 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.58 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.19 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.187/3.384/3.582/0.197 ms') 2025-08-18 02:31:42,158 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-82535836 passed 2025-08-18 02:31:42,158 - INFO - VM ctest-VM21-82535836 verifications in Compute nodes passed 2025-08-18 02:31:42,424 - DEBUG - Validated VM route 190.82.221.3 in vrouter of 10.0.0.41 2025-08-18 02:31:42,430 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-18 02:31:42,431 - INFO - Validated routes of VM ctest-VM21-82535836 in all vrouters 2025-08-18 02:31:42,887 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-08-18 02:31:43,015 - DEBUG - Layer2 route found for VM MAC 02:e7:35:eb:e4:a7 in Control-node 10.0.0.27 2025-08-18 02:31:43,015 - DEBUG - L2 Label for VM ctest-VM21-82535836 same between Control-node 10.0.0.27 and Agent, Expected: 29, Seen: 29 2025-08-18 02:31:43,015 - DEBUG - Starting all layer2 verification in 10.0.0.19 Control Node 2025-08-18 02:31:43,154 - DEBUG - Layer2 route found for VM MAC 02:e7:35:eb:e4:a7 in Control-node 10.0.0.19 2025-08-18 02:31:43,154 - DEBUG - L2 Label for VM ctest-VM21-82535836 same between Control-node 10.0.0.19 and Agent, Expected: 29, Seen: 29 2025-08-18 02:31:43,154 - INFO - Verification in Control-nodes for VM ctest-VM21-82535836 passed 2025-08-18 02:31:43,154 - DEBUG - Verifying the vm in opserver 2025-08-18 02:31:43,154 - DEBUG - Verifying in collector 10.0.0.19 ... 2025-08-18 02:31:43,154 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3?flat 2025-08-18 02:31:43,176 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891?flat 2025-08-18 02:31:43,198 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891?flat 2025-08-18 02:31:43,220 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3?flat 2025-08-18 02:31:43,243 - DEBUG - Verifying vm in vn uve 2025-08-18 02:31:43,243 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891?flat 2025-08-18 02:31:43,267 - DEBUG - VM uve shows interface as {'__T': 1755484277776825, 'label': 25, 'active': True, 'tx_vlan': 65535, 'ip6_active': False, 'vn_uuid': 'c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc', 'vm_uuid': '3063ef8f-4066-4341-b2b8-6dfb3d411ee3', 'ip6_address': '::', 'ip4_active': True, 'port_mirror_enabled': False, 'rx_vlan': 65535, 'gateway': '190.82.221.1', 'uuid': 'e735ebe4-a771-49bb-846e-d66e8ffc2891', 'vm_name': 'ctest-VM21-82535836', 'admin_state': True, 'ip_address': '190.82.221.3', 'virtual_network': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820', 'l2_active': True, 'mac_address': '02:e7:35:eb:e4:a7', 'fixed_ip4_list': ['190.82.221.3'], 'is_health_check_active': True, 'vhostuser_mode': 0} 2025-08-18 02:31:43,267 - DEBUG - VM uve shows ip address as ['190.82.221.3', '::'] 2025-08-18 02:31:43,267 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 2025-08-18 02:31:43,267 - INFO - Verifying through opserver in 10.0.0.27 2025-08-18 02:31:43,267 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820?flat 2025-08-18 02:31:43,294 - DEBUG - expected vm list 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:43,294 - DEBUG - Extracted vm list ['3063ef8f-4066-4341-b2b8-6dfb3d411ee3'] 2025-08-18 02:31:43,294 - INFO - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is present in default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 2025-08-18 02:31:43,294 - DEBUG - Verifying vm in vrouter uve 2025-08-18 02:31:43,294 - DEBUG - Getting info from collector 10.0.0.19.. 2025-08-18 02:31:43,294 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3?flat 2025-08-18 02:31:43,315 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3870-2'] 2025-08-18 02:31:43,315 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:31:43,366 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:31:43,407 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:31:43,407 - DEBUG - Validated that VM ctest-VM21-82535836 is in Vrouter an-jenkins-deploy-platform-ansible-os-3870-2 UVE 2025-08-18 02:31:43,407 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-18 02:31:43,415 - DEBUG - Expected tap interface of VM uuid 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891 2025-08-18 02:31:43,416 - DEBUG - Expected VN of VM uuid 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 2025-08-18 02:31:43,416 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:31:43,463 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:31:43,502 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:31:43,502 - INFO - tap interface default-domain:ctest-TestPolicyAcl-30486983:e735ebe4-a771-49bb-846e-d66e8ffc2891 of vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:31:43,502 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 of vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:31:43,502 - DEBUG - Verifying the 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 virtual network link through opserver 10.0.0.27 2025-08-18 02:31:43,502 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-18 02:31:43,516 - DEBUG - VM link and name as {'name': '3063ef8f-4066-4341-b2b8-6dfb3d411ee3', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3?flat'} 2025-08-18 02:31:43,516 - DEBUG - Verifying the 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 virtual network link through opserver 10.0.0.38 2025-08-18 02:31:43,516 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-18 02:31:43,530 - DEBUG - VM link and name as {'name': '3063ef8f-4066-4341-b2b8-6dfb3d411ee3', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3?flat'} 2025-08-18 02:31:43,530 - DEBUG - Verifying the 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 virtual network link through opserver 10.0.0.19 2025-08-18 02:31:43,530 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines 2025-08-18 02:31:43,545 - DEBUG - VM link and name as {'name': '3063ef8f-4066-4341-b2b8-6dfb3d411ee3', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3?flat'} 2025-08-18 02:31:43,545 - INFO - VM ctest-VM21-82535836 validations in Opserver passed 2025-08-18 02:31:43,623 - DEBUG - VM is in ACTIVE state now 2025-08-18 02:31:43,623 - INFO - VM name : ctest-VM31-19081150 2025-08-18 02:31:43,711 - DEBUG - VM ctest-VM31-19081150 ID is 7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:43,798 - DEBUG - VM is in ACTIVE state now 2025-08-18 02:31:43,798 - DEBUG - VM ctest-VM31-19081150 launched on Node an-jenkins-deploy-platform-ansible-os-3870-1 2025-08-18 02:31:43,882 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:43,898 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:43,908 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/349471d2-5e5d-4f76-94cf-48806a264a3b 2025-08-18 02:31:43,919 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:43,926 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/349471d2-5e5d-4f76-94cf-48806a264a3b 2025-08-18 02:31:43,938 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/dc5b10b6-00c2-471a-ad80-afed9c2ad55b 2025-08-18 02:31:43,949 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:31:43,949 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:43,958 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/349471d2-5e5d-4f76-94cf-48806a264a3b 2025-08-18 02:31:43,971 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/dc5b10b6-00c2-471a-ad80-afed9c2ad55b 2025-08-18 02:31:43,980 - INFO - VM ctest-VM31-19081150 verfication in all API Servers passed 2025-08-18 02:31:44,003 - DEBUG - VM ctest-VM31-19081150 Tap interface: {'index': '4', 'name': 'tap349471d2-5e', 'uuid': '349471d2-5e5d-4f76-94cf-48806a264a3b', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399:ctest-VN3-60515399', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '30', 'l2_label': '34', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'vm_uuid': '7dd15364-bbb3-4363-887e-6f4b6c979b5a', 'vm_name': 'ctest-VM31-19081150', 'ip_addr': '211.189.37.195', 'mac_addr': '02:34:94:71:d2:5e', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b', 'sg_uuid_list': ['d739d5aa-c96c-472c-8d6f-8cd55d0c0bc1'], 'static_route_list': None, 'vm_project_uuid': '24039f01-012d-4979-8738-adca3c0e4fc2', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-18 02:31:44,003 - DEBUG - Agent 10.0.0.241 vrf name: default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399:ctest-VN3-60515399 2025-08-18 02:31:44,009 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399:ctest-VN3-60515399', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'table_label': '-1', 'vxlan_id': '15', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.18:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-18 02:31:44,093 - DEBUG - VM ctest-VM31-19081150 : Tap interface tap349471d2-5e is set to Active 2025-08-18 02:31:44,093 - DEBUG - Tap interface tap349471d2-5e detail : {'index': '4', 'name': 'tap349471d2-5e', 'uuid': '349471d2-5e5d-4f76-94cf-48806a264a3b', 'vrf_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399:ctest-VN3-60515399', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '30', 'l2_label': '34', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'vm_uuid': '7dd15364-bbb3-4363-887e-6f4b6c979b5a', 'vm_name': 'ctest-VM31-19081150', 'ip_addr': '211.189.37.195', 'mac_addr': '02:34:94:71:d2:5e', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '47', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b', 'sg_uuid_list': ['d739d5aa-c96c-472c-8d6f-8cd55d0c0bc1'], 'static_route_list': None, 'vm_project_uuid': '24039f01-012d-4979-8738-adca3c0e4fc2', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-18 02:31:44,211 - DEBUG - Starting Layer 2 verification in Agent 2025-08-18 02:31:44,225 - DEBUG - Layer 2 path is seen for VM MAC 02:34:94:71:d2:5e in agent 10.0.0.241 2025-08-18 02:31:44,225 - DEBUG - Active layer 2 route in agent is present for VMI tap349471d2-5e 2025-08-18 02:31:44,225 - DEBUG - L2 label(34) matches bw route table and interface table 2025-08-18 02:31:44,235 - DEBUG - VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 is found in Agent of node 10.0.0.241 2025-08-18 02:31:44,370 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 is consistent in agent 10.0.0.241 2025-08-18 02:31:44,370 - DEBUG - Route for VM IP ['211.189.37.195'] is consistent in agent 10.0.0.241 2025-08-18 02:31:44,370 - DEBUG - VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 verification for VM ctest-VM31-19081150 in Agent 10.0.0.241 passed 2025-08-18 02:31:44,483 - DEBUG - Starting all layer 2 verification in agent 10.0.0.241 2025-08-18 02:31:44,494 - DEBUG - Route for VM MAC 02:34:94:71:d2:5e is consistent in agent 10.0.0.241 2025-08-18 02:31:45,679 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.18 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=4.55 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.177/3.864/4.552/0.687 ms') 2025-08-18 02:31:45,679 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-19081150 passed 2025-08-18 02:31:45,679 - INFO - VM ctest-VM31-19081150 verifications in Compute nodes passed 2025-08-18 02:31:45,906 - DEBUG - Validated VM route 211.189.37.195 in vrouter of 10.0.0.241 2025-08-18 02:31:45,911 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-08-18 02:31:45,911 - INFO - Validated routes of VM ctest-VM31-19081150 in all vrouters 2025-08-18 02:31:46,410 - DEBUG - Starting all layer2 verification in 10.0.0.27 Control Node 2025-08-18 02:31:46,534 - DEBUG - Layer2 route found for VM MAC 02:34:94:71:d2:5e in Control-node 10.0.0.27 2025-08-18 02:31:46,534 - DEBUG - L2 Label for VM ctest-VM31-19081150 same between Control-node 10.0.0.27 and Agent, Expected: 34, Seen: 34 2025-08-18 02:31:46,534 - DEBUG - Starting all layer2 verification in 10.0.0.19 Control Node 2025-08-18 02:31:46,653 - DEBUG - Layer2 route found for VM MAC 02:34:94:71:d2:5e in Control-node 10.0.0.19 2025-08-18 02:31:46,654 - DEBUG - L2 Label for VM ctest-VM31-19081150 same between Control-node 10.0.0.19 and Agent, Expected: 34, Seen: 34 2025-08-18 02:31:46,654 - INFO - Verification in Control-nodes for VM ctest-VM31-19081150 passed 2025-08-18 02:31:46,654 - DEBUG - Verifying the vm in opserver 2025-08-18 02:31:46,654 - DEBUG - Verifying in collector 10.0.0.19 ... 2025-08-18 02:31:46,654 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a?flat 2025-08-18 02:31:46,670 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b?flat 2025-08-18 02:31:46,693 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b?flat 2025-08-18 02:31:46,715 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a?flat 2025-08-18 02:31:46,731 - DEBUG - Verifying vm in vn uve 2025-08-18 02:31:46,731 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b?flat 2025-08-18 02:31:46,751 - DEBUG - VM uve shows interface as {'__T': 1755484277710549, 'label': 30, 'active': True, 'tx_vlan': 65535, 'ip6_active': False, 'vn_uuid': 'c40a67c7-8d02-4758-95d9-9efc38920e79', 'vm_uuid': '7dd15364-bbb3-4363-887e-6f4b6c979b5a', 'ip6_address': '::', 'ip4_active': True, 'port_mirror_enabled': False, 'rx_vlan': 65535, 'gateway': '211.189.37.193', 'uuid': '349471d2-5e5d-4f76-94cf-48806a264a3b', 'vm_name': 'ctest-VM31-19081150', 'admin_state': True, 'ip_address': '211.189.37.195', 'virtual_network': 'default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399', 'l2_active': True, 'mac_address': '02:34:94:71:d2:5e', 'fixed_ip4_list': ['211.189.37.195'], 'is_health_check_active': True, 'vhostuser_mode': 0} 2025-08-18 02:31:46,751 - DEBUG - VM uve shows ip address as ['211.189.37.195', '::'] 2025-08-18 02:31:46,751 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 2025-08-18 02:31:46,752 - INFO - Verifying through opserver in 10.0.0.27 2025-08-18 02:31:46,752 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399?flat 2025-08-18 02:31:46,780 - DEBUG - expected vm list 7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:46,780 - DEBUG - Extracted vm list ['7dd15364-bbb3-4363-887e-6f4b6c979b5a'] 2025-08-18 02:31:46,780 - INFO - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is present in default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 2025-08-18 02:31:46,780 - DEBUG - Verifying vm in vrouter uve 2025-08-18 02:31:46,780 - DEBUG - Getting info from collector 10.0.0.19.. 2025-08-18 02:31:46,780 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a?flat 2025-08-18 02:31:46,802 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3870-1'] 2025-08-18 02:31:46,802 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:31:46,861 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:31:46,899 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:46,900 - DEBUG - Validated that VM ctest-VM31-19081150 is in Vrouter an-jenkins-deploy-platform-ansible-os-3870-1 UVE 2025-08-18 02:31:46,900 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-08-18 02:31:46,909 - DEBUG - Expected tap interface of VM uuid 7dd15364-bbb3-4363-887e-6f4b6c979b5a is default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b 2025-08-18 02:31:46,909 - DEBUG - Expected VN of VM uuid 7dd15364-bbb3-4363-887e-6f4b6c979b5a is default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 2025-08-18 02:31:46,910 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:31:46,967 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:31:47,007 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:47,007 - INFO - tap interface default-domain:ctest-TestPolicyAcl-30486983:349471d2-5e5d-4f76-94cf-48806a264a3b of vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:47,007 - DEBUG - Connected network default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 of vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a is present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:31:47,007 - DEBUG - Verifying the 7dd15364-bbb3-4363-887e-6f4b6c979b5a virtual network link through opserver 10.0.0.27 2025-08-18 02:31:47,007 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-18 02:31:47,022 - DEBUG - VM link and name as {'name': '7dd15364-bbb3-4363-887e-6f4b6c979b5a', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a?flat'} 2025-08-18 02:31:47,022 - DEBUG - Verifying the 7dd15364-bbb3-4363-887e-6f4b6c979b5a virtual network link through opserver 10.0.0.38 2025-08-18 02:31:47,022 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-18 02:31:47,033 - DEBUG - VM link and name as {'name': '7dd15364-bbb3-4363-887e-6f4b6c979b5a', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a?flat'} 2025-08-18 02:31:47,033 - DEBUG - Verifying the 7dd15364-bbb3-4363-887e-6f4b6c979b5a virtual network link through opserver 10.0.0.19 2025-08-18 02:31:47,033 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines 2025-08-18 02:31:47,046 - DEBUG - VM link and name as {'name': '7dd15364-bbb3-4363-887e-6f4b6c979b5a', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a?flat'} 2025-08-18 02:31:47,046 - INFO - VM ctest-VM31-19081150 validations in Opserver passed 2025-08-18 02:31:47,046 - INFO - Waiting for VM ctest-VM11-78493763 to be up.. 2025-08-18 02:31:47,046 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:47,046 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:31:47,055 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/4c445c47-b9c9-4deb-97c1-a28f99e5a61d 2025-08-18 02:31:48,234 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=14.9 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.415 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.415/7.653/14.891/7.238 ms') 2025-08-18 02:31:48,234 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-78493763 passed 2025-08-18 02:31:48,312 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:48,312 - DEBUG - Waiting to SSH to VM ctest-VM11-78493763, IP 143.223.168.3, Port 22 2025-08-18 02:31:48,370 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-18 02:31:48,460 - DEBUG - VM ctest-VM11-78493763 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-18 02:31:53,461 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:53,462 - DEBUG - Waiting to SSH to VM ctest-VM11-78493763, IP 143.223.168.3, Port 22 2025-08-18 02:31:53,643 - DEBUG - VM ctest-VM11-78493763 is ready for SSH connections 2025-08-18 02:31:53,643 - INFO - Waiting for VM ctest-VM21-82535836 to be up.. 2025-08-18 02:31:53,644 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:53,644 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:31:53,654 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/e735ebe4-a771-49bb-846e-d66e8ffc2891 2025-08-18 02:31:54,828 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.11 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.37 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.367/2.739/3.111/0.372 ms') 2025-08-18 02:31:54,828 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-82535836 passed 2025-08-18 02:31:54,902 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:54,902 - DEBUG - Waiting to SSH to VM ctest-VM21-82535836, IP 190.82.221.3, Port 22 2025-08-18 02:31:55,075 - DEBUG - VM ctest-VM21-82535836 is ready for SSH connections 2025-08-18 02:31:55,075 - INFO - Waiting for VM ctest-VM31-19081150 to be up.. 2025-08-18 02:31:55,075 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:55,075 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:31:55,083 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/349471d2-5e5d-4f76-94cf-48806a264a3b 2025-08-18 02:31:56,242 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.42 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.10 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.098/3.259/3.420/0.161 ms') 2025-08-18 02:31:56,242 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-19081150 passed 2025-08-18 02:31:56,311 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:31:56,311 - DEBUG - Waiting to SSH to VM ctest-VM31-19081150, IP 211.189.37.195, Port 22 2025-08-18 02:31:56,369 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-08-18 02:31:56,454 - DEBUG - VM ctest-VM31-19081150 is NOT ready for SSH connections, VM status: ACTIVE 2025-08-18 02:32:01,455 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-08-18 02:32:01,455 - DEBUG - Waiting to SSH to VM ctest-VM31-19081150, IP 211.189.37.195, Port 22 2025-08-18 02:32:01,621 - DEBUG - VM ctest-VM31-19081150 is ready for SSH connections 2025-08-18 02:32:01,621 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 190.82.221.3, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123 2025-08-18 02:32:01,621 - DEBUG - ping -s 56 -c 3 -W 1 190.82.221.3 2025-08-18 02:32:20,300 - DEBUG - PING 190.82.221.3 (190.82.221.3) 56(84) bytes of data. 64 bytes from 190.82.221.3: icmp_req=1 ttl=63 time=6.04 ms 64 bytes from 190.82.221.3: icmp_req=2 ttl=63 time=1.31 ms 64 bytes from 190.82.221.3: icmp_req=3 ttl=63 time=1.19 ms --- 190.82.221.3 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2002ms rtt min/avg/max/mdev = 1.192/2.848/6.042/2.259 ms 2025-08-18 02:32:20,300 - INFO - Ping to IP 190.82.221.3 from VM ctest-VM11-78493763 passed 2025-08-18 02:32:20,300 - INFO - Test with src as VN and dst as policy PASSED 2025-08-18 02:32:20,300 - INFO - Deleting VM ctest-VM31-19081150 2025-08-18 02:32:20,360 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:32:20,360 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:32:20,371 - DEBUG - VM ID 7dd15364-bbb3-4363-887e-6f4b6c979b5a of VM ctest-VM31-19081150 is still found in API Server 2025-08-18 02:32:22,371 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:32:22,371 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:32:22,378 - DEBUG - Response Code: 404 2025-08-18 02:32:22,378 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:32:22,384 - DEBUG - Response Code: 404 2025-08-18 02:32:22,384 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/7dd15364-bbb3-4363-887e-6f4b6c979b5a 2025-08-18 02:32:22,390 - DEBUG - Response Code: 404 2025-08-18 02:32:22,390 - INFO - VM ctest-VM31-19081150 is fully removed in API-Server 2025-08-18 02:32:22,541 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-18 02:32:22,585 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 2025-08-18 02:32:22,596 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 2025-08-18 02:32:22,596 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 2025-08-18 02:32:22,596 - INFO - VM ctest-VM31-19081150 is removed in Compute, and routes are removed in all compute nodes 2025-08-18 02:32:22,841 - INFO - Routes for VM ctest-VM31-19081150 is removed in all control-nodes 2025-08-18 02:32:22,842 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:22,900 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:22,940 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:22,940 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:22,940 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:22,940 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:25,941 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:26,001 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:26,047 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:26,047 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:26,047 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:26,048 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:29,048 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:29,091 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:29,129 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:29,129 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:29,129 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:29,130 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:32,131 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:32,175 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:32,212 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:32,213 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:32,213 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:32,213 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:35,213 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:35,275 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:35,313 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:35,313 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:35,313 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:35,313 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:38,314 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:38,359 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:38,403 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:38,403 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:38,403 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:38,403 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:41,404 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:41,448 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:41,487 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:41,487 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:41,487 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:41,487 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:44,487 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:44,532 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:44,568 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:44,568 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:44,568 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:44,568 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:47,569 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:47,615 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:47,658 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:47,658 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:47,658 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:47,658 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:50,658 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:50,700 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:32:50,735 - DEBUG - VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is not present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:32:50,735 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:50,735 - DEBUG - interface for vm 7dd15364-bbb3-4363-887e-6f4b6c979b5a deleted from vrouter uve ... 2025-08-18 02:32:50,735 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:50,735 - DEBUG - Validated that VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is removed in Vrouter UVE 2025-08-18 02:32:50,735 - DEBUG - Verifying through opserver in 10.0.0.27 2025-08-18 02:32:50,736 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399?flat 2025-08-18 02:32:50,756 - DEBUG - 7dd15364-bbb3-4363-887e-6f4b6c979b5a BM not in default-domain:ctest-TestPolicyAcl-30486983:ctest-VN3-60515399 uve 2025-08-18 02:32:50,756 - DEBUG - Validated that VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is not present in the VN UVE 2025-08-18 02:32:50,756 - DEBUG - Verifying the 7dd15364-bbb3-4363-887e-6f4b6c979b5a virtual network link through opserver 10.0.0.27 2025-08-18 02:32:50,756 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-18 02:32:50,766 - INFO - 7dd15364-bbb3-4363-887e-6f4b6c979b5a vm uve deleted from opserver 2025-08-18 02:32:50,767 - DEBUG - Verifying the 7dd15364-bbb3-4363-887e-6f4b6c979b5a virtual network link through opserver 10.0.0.38 2025-08-18 02:32:50,767 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-18 02:32:50,778 - INFO - 7dd15364-bbb3-4363-887e-6f4b6c979b5a vm uve deleted from opserver 2025-08-18 02:32:50,778 - DEBUG - Verifying the 7dd15364-bbb3-4363-887e-6f4b6c979b5a virtual network link through opserver 10.0.0.19 2025-08-18 02:32:50,778 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines 2025-08-18 02:32:50,791 - INFO - 7dd15364-bbb3-4363-887e-6f4b6c979b5a vm uve deleted from opserver 2025-08-18 02:32:50,791 - INFO - Validated that VM 7dd15364-bbb3-4363-887e-6f4b6c979b5a is removed from Opserver 2025-08-18 02:32:50,791 - INFO - Deleting VM ctest-VM21-82535836 2025-08-18 02:32:50,853 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:32:50,853 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:32:50,861 - DEBUG - VM ID 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 of VM ctest-VM21-82535836 is still found in API Server 2025-08-18 02:32:52,862 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:32:52,862 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:32:52,870 - DEBUG - Response Code: 404 2025-08-18 02:32:52,870 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:32:52,878 - DEBUG - Response Code: 404 2025-08-18 02:32:52,878 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/3063ef8f-4066-4341-b2b8-6dfb3d411ee3 2025-08-18 02:32:52,885 - DEBUG - Response Code: 404 2025-08-18 02:32:52,886 - INFO - VM ctest-VM21-82535836 is fully removed in API-Server 2025-08-18 02:32:53,042 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-18 02:32:53,083 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 2025-08-18 02:32:53,093 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 2025-08-18 02:32:53,094 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 2025-08-18 02:32:53,094 - INFO - VM ctest-VM21-82535836 is removed in Compute, and routes are removed in all compute nodes 2025-08-18 02:32:53,300 - INFO - Routes for VM ctest-VM21-82535836 is removed in all control-nodes 2025-08-18 02:32:53,301 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:53,349 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:32:53,397 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:32:53,397 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:53,397 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:32:53,397 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:56,398 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:56,443 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:32:56,479 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:32:56,479 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:56,479 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:32:56,479 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:32:59,481 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:32:59,525 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:32:59,562 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:32:59,562 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:32:59,562 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:32:59,562 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:02,563 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:02,608 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:33:02,673 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:33:02,673 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:02,673 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:33:02,673 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:05,674 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:05,716 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:33:05,752 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:33:05,752 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:05,752 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:33:05,752 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:08,752 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:08,797 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:33:08,832 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:33:08,832 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:08,832 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:33:08,832 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:11,833 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:11,877 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:33:11,913 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:33:11,913 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:11,913 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:33:11,913 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:14,914 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:14,955 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:33:14,991 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:33:14,991 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:14,991 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:33:14,991 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:17,992 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-2:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:18,033 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-2?flat 2025-08-18 02:33:18,069 - DEBUG - VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3870-2 uve 2025-08-18 02:33:18,069 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:18,069 - DEBUG - interface for vm 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 deleted from vrouter uve ... 2025-08-18 02:33:18,069 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:18,069 - DEBUG - Validated that VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is removed in Vrouter UVE 2025-08-18 02:33:18,069 - DEBUG - Verifying through opserver in 10.0.0.27 2025-08-18 02:33:18,069 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820?flat 2025-08-18 02:33:18,099 - DEBUG - 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 BM not in default-domain:ctest-TestPolicyAcl-30486983:ctest-VN2-12574820 uve 2025-08-18 02:33:18,099 - DEBUG - Validated that VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is not present in the VN UVE 2025-08-18 02:33:18,099 - DEBUG - Verifying the 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 virtual network link through opserver 10.0.0.27 2025-08-18 02:33:18,099 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-18 02:33:18,123 - INFO - 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 vm uve deleted from opserver 2025-08-18 02:33:18,124 - DEBUG - Verifying the 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 virtual network link through opserver 10.0.0.38 2025-08-18 02:33:18,124 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-18 02:33:18,138 - INFO - 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 vm uve deleted from opserver 2025-08-18 02:33:18,139 - DEBUG - Verifying the 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 virtual network link through opserver 10.0.0.19 2025-08-18 02:33:18,139 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines 2025-08-18 02:33:18,151 - INFO - 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 vm uve deleted from opserver 2025-08-18 02:33:18,151 - INFO - Validated that VM 3063ef8f-4066-4341-b2b8-6dfb3d411ee3 is removed from Opserver 2025-08-18 02:33:18,151 - INFO - Deleting VM ctest-VM11-78493763 2025-08-18 02:33:18,222 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:33:18,223 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:18,231 - DEBUG - VM ID 171e8610-bfef-450c-b598-01a3259e1e95 of VM ctest-VM11-78493763 is still found in API Server 2025-08-18 02:33:20,232 - DEBUG - Verifying in api server 10.0.0.19 2025-08-18 02:33:20,233 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:20,239 - DEBUG - Response Code: 404 2025-08-18 02:33:20,239 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:20,244 - DEBUG - Response Code: 404 2025-08-18 02:33:20,244 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:20,249 - DEBUG - Response Code: 404 2025-08-18 02:33:20,249 - INFO - VM ctest-VM11-78493763 is fully removed in API-Server 2025-08-18 02:33:20,405 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-08-18 02:33:20,442 - DEBUG - Validated that vrouter 10.0.0.241 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 2025-08-18 02:33:20,452 - DEBUG - Validated that vrouter 10.0.0.41 does not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 2025-08-18 02:33:20,452 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 2025-08-18 02:33:20,452 - INFO - VM ctest-VM11-78493763 is removed in Compute, and routes are removed in all compute nodes 2025-08-18 02:33:20,636 - INFO - Routes for VM ctest-VM11-78493763 is removed in all control-nodes 2025-08-18 02:33:20,636 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:20,686 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:20,722 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:20,722 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:20,722 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:20,722 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:23,723 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:23,765 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:23,808 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:23,808 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:23,808 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:23,808 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:26,808 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:26,865 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:26,923 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:26,923 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:26,923 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:26,923 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:29,924 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:29,966 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:30,006 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:30,006 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:30,006 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:30,006 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:33,007 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:33,054 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:33,095 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:33,095 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:33,095 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:33,095 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:36,096 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:36,142 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:36,189 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:36,189 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:36,189 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:36,190 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:39,190 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:39,232 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:39,268 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:39,268 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:39,268 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:39,268 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:42,269 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:42,312 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:42,347 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:42,347 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:42,347 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:42,347 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:45,347 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:45,391 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:45,426 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is still present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:45,426 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:45,426 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:45,426 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:48,427 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3870-1:Compute:contrail-vrouter-agent:0?flat 2025-08-18 02:33:48,469 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3870-1?flat 2025-08-18 02:33:48,512 - DEBUG - VM 171e8610-bfef-450c-b598-01a3259e1e95 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3870-1 uve 2025-08-18 02:33:48,512 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-08-18 02:33:48,512 - DEBUG - interface for vm 171e8610-bfef-450c-b598-01a3259e1e95 deleted from vrouter uve ... 2025-08-18 02:33:48,512 - DEBUG - Deleted interface not in error interface list ... 2025-08-18 02:33:48,512 - DEBUG - Validated that VM 171e8610-bfef-450c-b598-01a3259e1e95 is removed in Vrouter UVE 2025-08-18 02:33:48,512 - DEBUG - Verifying through opserver in 10.0.0.27 2025-08-18 02:33:48,512 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615?flat 2025-08-18 02:33:48,537 - DEBUG - 171e8610-bfef-450c-b598-01a3259e1e95 BM not in default-domain:ctest-TestPolicyAcl-30486983:ctest-VN1-65142615 uve 2025-08-18 02:33:48,537 - DEBUG - Validated that VM 171e8610-bfef-450c-b598-01a3259e1e95 is not present in the VN UVE 2025-08-18 02:33:48,537 - DEBUG - Verifying the 171e8610-bfef-450c-b598-01a3259e1e95 virtual network link through opserver 10.0.0.27 2025-08-18 02:33:48,537 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-machines 2025-08-18 02:33:48,550 - DEBUG - No links retuned for 171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:48,550 - INFO - 171e8610-bfef-450c-b598-01a3259e1e95 vm uve deleted from opserver 2025-08-18 02:33:48,550 - DEBUG - Verifying the 171e8610-bfef-450c-b598-01a3259e1e95 virtual network link through opserver 10.0.0.38 2025-08-18 02:33:48,552 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-08-18 02:33:48,564 - DEBUG - No links retuned for 171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:48,564 - INFO - 171e8610-bfef-450c-b598-01a3259e1e95 vm uve deleted from opserver 2025-08-18 02:33:48,564 - DEBUG - Verifying the 171e8610-bfef-450c-b598-01a3259e1e95 virtual network link through opserver 10.0.0.19 2025-08-18 02:33:48,564 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-machines 2025-08-18 02:33:48,574 - DEBUG - No links retuned for 171e8610-bfef-450c-b598-01a3259e1e95 2025-08-18 02:33:48,574 - INFO - 171e8610-bfef-450c-b598-01a3259e1e95 vm uve deleted from opserver 2025-08-18 02:33:48,574 - INFO - Validated that VM 171e8610-bfef-450c-b598-01a3259e1e95 is removed from Opserver 2025-08-18 02:33:48,575 - DEBUG - Detaching the Policy for VN :ctest-VN2-12574820 2025-08-18 02:33:48,575 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:33:48,580 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:33:48,595 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:33:48,685 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c8d8bc77-ba17-43f7-a3c9-8e56e500ddbc 2025-08-18 02:33:48,700 - DEBUG - Requesting: http://10.0.0.27:8082/network-policy/beee04ab-6db4-4ca9-8bb5-ebc548386471 2025-08-18 02:33:48,848 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAcl-30486983', 'ctest-policy21-05382748']] from ctest-VN2-12574820 2025-08-18 02:33:48,848 - DEBUG - Detaching the Policy for VN :ctest-VN1-65142615 2025-08-18 02:33:48,848 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:33:48,853 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:33:48,864 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:33:48,953 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5d3dbeca-0887-4c4a-8c86-7f95df3a24db 2025-08-18 02:33:49,130 - INFO - Detached Policy from ctest-VN1-65142615 2025-08-18 02:33:49,158 - INFO - Deleted policy ctest-policy13-60813015 2025-08-18 02:33:49,187 - INFO - Deleted policy ctest-policy21-05382748 2025-08-18 02:33:49,214 - INFO - Deleted policy ctest-policy12-88175215 2025-08-18 02:33:49,214 - INFO - Deleting VN ctest-VN3-60515399 2025-08-18 02:33:49,338 - DEBUG - Response for deleting network () 2025-08-18 02:33:49,338 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fb06da96-eba7-4cc5-b1ba-668da7dfb70e 2025-08-18 02:33:49,344 - DEBUG - Response Code: 404 2025-08-18 02:33:49,344 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:33:49,349 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:33:49,360 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:33:49,458 - INFO - Validated that VN ctest-VN3-60515399 is not found in API Server 2025-08-18 02:33:49,489 - DEBUG - VN ctest-VN3-60515399 is not present in Agent 10.0.0.241 2025-08-18 02:33:49,530 - DEBUG - VN ctest-VN3-60515399 is not present in Agent 10.0.0.41 2025-08-18 02:33:49,530 - INFO - Validated that VN ctest-VN3-60515399 is not in any agent 2025-08-18 02:33:49,583 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-60515399 info 2025-08-18 02:33:49,583 - INFO - Deleting VN ctest-VN2-12574820 2025-08-18 02:33:49,735 - DEBUG - Response for deleting network () 2025-08-18 02:33:49,735 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/6bb0d005-fcdc-4dc3-816c-0a910122e5e5 2025-08-18 02:33:49,741 - DEBUG - Response Code: 404 2025-08-18 02:33:49,741 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:33:49,750 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:33:49,770 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:33:49,874 - INFO - Validated that VN ctest-VN2-12574820 is not found in API Server 2025-08-18 02:33:49,885 - DEBUG - VN ctest-VN2-12574820 is not present in Agent 10.0.0.241 2025-08-18 02:33:49,897 - DEBUG - VN ctest-VN2-12574820 is not present in Agent 10.0.0.41 2025-08-18 02:33:49,897 - INFO - Validated that VN ctest-VN2-12574820 is not in any agent 2025-08-18 02:33:49,928 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-12574820 info 2025-08-18 02:33:49,928 - INFO - Deleting VN ctest-VN1-65142615 2025-08-18 02:33:50,084 - DEBUG - Response for deleting network () 2025-08-18 02:33:50,084 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/53e35074-9384-4796-a437-2096887dcb11 2025-08-18 02:33:50,096 - DEBUG - Response Code: 404 2025-08-18 02:33:50,097 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-18 02:33:50,103 - DEBUG - Requesting: http://10.0.0.27:8082/domain/edf943fc-0622-4564-8821-4de9bd04e8a3 2025-08-18 02:33:50,158 - DEBUG - Requesting: http://10.0.0.27:8082/project/24039f01-012d-4979-8738-adca3c0e4fc2 2025-08-18 02:33:50,278 - INFO - Validated that VN ctest-VN1-65142615 is not found in API Server 2025-08-18 02:33:50,288 - DEBUG - VN ctest-VN1-65142615 is not present in Agent 10.0.0.241 2025-08-18 02:33:50,298 - DEBUG - VN ctest-VN1-65142615 is not present in Agent 10.0.0.41 2025-08-18 02:33:50,298 - INFO - Validated that VN ctest-VN1-65142615 is not in any agent 2025-08-18 02:33:50,333 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-65142615 info 2025-08-18 02:33:50,414 - INFO - IPAM: ipam3 is not found in API Server 2025-08-18 02:33:50,435 - INFO - IPAM:ipam3 is not found in control node 2025-08-18 02:33:50,562 - INFO - IPAM: ipam2 is not found in API Server 2025-08-18 02:33:50,583 - INFO - IPAM:ipam2 is not found in control node 2025-08-18 02:33:50,714 - INFO - IPAM: ipam1 is not found in API Server 2025-08-18 02:33:50,735 - INFO - IPAM:ipam1 is not found in control node 2025-08-18 02:33:52,002 - DEBUG - No XMPP flaps were noticed during the test

2025-08-18 02:33:52,003 - INFO - END TEST : test_policy_inheritance_src_vn_dst_pol : PASSED[0:03:11]

2025-08-18 02:33:52,003 - INFO - -------------------------------------------------------------------------------- 2025-08-18 02:33:52,725 - INFO - Deleted project: ctest-TestPolicyAcl-30486983, ID : 24039f01-012d-4979-8738-adca3c0e4fc2