2025-10-02 02:17:24,841 - INFO - Domain Default found not creating 2025-10-02 02:17:24,987 - INFO - Project ctest-TestPolicyAclIpv4v6-57573189 not found, creating it 2025-10-02 02:17:25,592 - INFO - Created Project:ctest-TestPolicyAclIpv4v6-57573189, ID : 7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:27,207 - INFO - ================================================================================ 2025-10-02 02:17:27,207 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-10-02 02:17:28,476 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.130': {'10.20.0.254': '0', '10.20.0.14': '0'}} with 2025-10-02 02:17:28,476 - INFO - Initial checks done. Running the testcase now 2025-10-02 02:17:28,476 - INFO - 2025-10-02 02:17:28,476 - INFO - ================================================================================ 2025-10-02 02:17:28,476 - INFO - STARTING TEST : test_policy_inheritance_src_pol_dst_any 2025-10-02 02:17:28,476 - INFO - TEST DESCRIPTION : Test cases to test policy inheritance 2025-10-02 02:17:29,731 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.130': {'10.20.0.254': '0', '10.20.0.14': '0'}} with 2025-10-02 02:17:29,731 - INFO - Initial checks done. Running the testcase now 2025-10-02 02:17:29,731 - INFO - 2025-10-02 02:17:31,014 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:31,306 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:31,332 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:31,348 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:31,445 - DEBUG - Requesting: http://10.0.0.56:8082/network-ipam/de1d12b9-709c-4f6d-972a-d25613231056 2025-10-02 02:17:31,453 - INFO - Verifications in API Server for IPAM: ipam1 passed 2025-10-02 02:17:31,458 - DEBUG - Control-node 10.0.0.56 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16004969238412152685', 'uuid-lslong': '10892749915879051350'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.128866'} 2025-10-02 02:17:31,465 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16004969238412152685', 'uuid-lslong': '10892749915879051350'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.135599'} 2025-10-02 02:17:31,470 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam1', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16004969238412152685', 'uuid-lslong': '10892749915879051350'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.137252'} 2025-10-02 02:17:31,471 - INFO - Verifications in Control node for IPAM: ipam1 passed 2025-10-02 02:17:31,471 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:31,478 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:31,492 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:31,574 - DEBUG - Requesting: http://10.0.0.56:8082/network-ipam/c8f8520a-ccb3-40bf-8cf9-93eda09a968d 2025-10-02 02:17:31,582 - INFO - Verifications in API Server for IPAM: ipam2 passed 2025-10-02 02:17:31,587 - DEBUG - Control-node 10.0.0.56 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14481414808147280063', 'uuid-lslong': '10158313083321882253'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.932098'} 2025-10-02 02:17:31,594 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14481414808147280063', 'uuid-lslong': '10158313083321882253'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.936030'} 2025-10-02 02:17:31,600 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam2', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14481414808147280063', 'uuid-lslong': '10158313083321882253'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.943484'} 2025-10-02 02:17:31,600 - INFO - Verifications in Control node for IPAM: ipam2 passed 2025-10-02 02:17:31,600 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:31,607 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:31,619 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:31,706 - DEBUG - Requesting: http://10.0.0.56:8082/network-ipam/1477f0a7-f0de-4563-8984-3d10f8fd8d7f 2025-10-02 02:17:31,713 - INFO - Verifications in API Server for IPAM: ipam3 passed 2025-10-02 02:17:31,718 - DEBUG - Control-node 10.0.0.56 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1474912007078430051', 'uuid-lslong': '9909112223228071295'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.741537'} 2025-10-02 02:17:31,724 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1474912007078430051', 'uuid-lslong': '9909112223228071295'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.743354'} 2025-10-02 02:17:31,730 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ipam3', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1474912007078430051', 'uuid-lslong': '9909112223228071295'}, 'enable': 'true', 'created': '2025-10-02T02:17:30', 'last-modified': '2025-10-02T02:17:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.746471'} 2025-10-02 02:17:31,730 - INFO - Verifications in Control node for IPAM: ipam3 passed 2025-10-02 02:17:32,053 - DEBUG - Response for create_network : {'network': {'id': 'b33ece1c-5be3-427d-b899-023239ec614b', 'name': 'ctest-VN1-20770687', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'project_id': '7a52f6a115904da89ba791b5a0fcfa55', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-VN1-20770687'], 'port_security_enabled': True, 'description': ''}} 2025-10-02 02:17:32,328 - DEBUG - Response for create_subnet : {'subnet': {'id': '933100da-6b43-4a97-87f2-bc6ce33716cd', 'name': '', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'network_id': 'b33ece1c-5be3-427d-b899-023239ec614b', 'ip_version': 4, 'cidr': '18.219.170.192/26', 'allocation_pools': [{'start': '18.219.170.194', 'end': '18.219.170.254'}], 'gateway_ip': '18.219.170.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '18.219.170.194', 'tags': [], 'project_id': '7a52f6a115904da89ba791b5a0fcfa55'}} 2025-10-02 02:17:32,621 - DEBUG - Response for create_subnet : {'subnet': {'id': '186268fd-d803-496e-9eee-a317a9e468e8', 'name': '', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'network_id': 'b33ece1c-5be3-427d-b899-023239ec614b', 'ip_version': 6, 'cidr': '2f74:ff7d:50a2:31da:2952:3879::/96', 'allocation_pools': [{'start': '2f74:ff7d:50a2:31da:2952:3879:0:2', 'end': '2f74:ff7d:50a2:31da:2952:3879:ffff:fffe'}], 'gateway_ip': '2f74:ff7d:50a2:31da:2952:3879:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2f74:ff7d:50a2:31da:2952:3879:0:2', 'tags': [], 'project_id': '7a52f6a115904da89ba791b5a0fcfa55'}} 2025-10-02 02:17:32,668 - INFO - Created VN ctest-VN1-20770687 2025-10-02 02:17:32,682 - DEBUG - VN ctest-VN1-20770687 UUID is b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:32,882 - DEBUG - Fetched VN: default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687(b33ece1c-5be3-427d-b899-023239ec614b) with subnets ['18.219.170.192/26', '2f74:ff7d:50a2:31da:2952:3879::/96'] 2025-10-02 02:17:33,215 - DEBUG - Response for create_network : {'network': {'id': '4c36f8df-a7e6-445c-b31d-5f3b6b643560', 'name': 'ctest-VN2-92450947', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'project_id': '7a52f6a115904da89ba791b5a0fcfa55', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-VN2-92450947'], 'port_security_enabled': True, 'description': ''}} 2025-10-02 02:17:33,424 - DEBUG - Response for create_subnet : {'subnet': {'id': '2bb2cde2-0ed9-4753-aedd-6419ecbb9925', 'name': '', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'network_id': '4c36f8df-a7e6-445c-b31d-5f3b6b643560', 'ip_version': 4, 'cidr': '140.32.143.64/26', 'allocation_pools': [{'start': '140.32.143.66', 'end': '140.32.143.126'}], 'gateway_ip': '140.32.143.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '140.32.143.66', 'tags': [], 'project_id': '7a52f6a115904da89ba791b5a0fcfa55'}} 2025-10-02 02:17:33,639 - DEBUG - Response for create_subnet : {'subnet': {'id': '8285a7c8-ebd2-40e6-974b-c06d83543b6c', 'name': '', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'network_id': '4c36f8df-a7e6-445c-b31d-5f3b6b643560', 'ip_version': 6, 'cidr': '30ee:9aa8:8c67:ebc9:135c:f21d::/96', 'allocation_pools': [{'start': '30ee:9aa8:8c67:ebc9:135c:f21d:0:2', 'end': '30ee:9aa8:8c67:ebc9:135c:f21d:ffff:fffe'}], 'gateway_ip': '30ee:9aa8:8c67:ebc9:135c:f21d:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30ee:9aa8:8c67:ebc9:135c:f21d:0:2', 'tags': [], 'project_id': '7a52f6a115904da89ba791b5a0fcfa55'}} 2025-10-02 02:17:33,666 - INFO - Created VN ctest-VN2-92450947 2025-10-02 02:17:33,678 - DEBUG - VN ctest-VN2-92450947 UUID is 4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:34,139 - DEBUG - Response for create_network : {'network': {'id': '0e017354-48cd-40f6-aa1c-711cd18e76cf', 'name': 'ctest-VN3-96980889', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'project_id': '7a52f6a115904da89ba791b5a0fcfa55', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-VN3-96980889'], 'port_security_enabled': True, 'description': ''}} 2025-10-02 02:17:34,385 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fec9b118-79b1-444c-a579-a7fe4e97ea13', 'name': '', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'network_id': '0e017354-48cd-40f6-aa1c-711cd18e76cf', 'ip_version': 4, 'cidr': '111.172.56.64/26', 'allocation_pools': [{'start': '111.172.56.66', 'end': '111.172.56.126'}], 'gateway_ip': '111.172.56.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.172.56.66', 'tags': [], 'project_id': '7a52f6a115904da89ba791b5a0fcfa55'}} 2025-10-02 02:17:34,589 - DEBUG - Response for create_subnet : {'subnet': {'id': '7108808e-6de4-4ee7-ace7-24acf4116735', 'name': '', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'network_id': '0e017354-48cd-40f6-aa1c-711cd18e76cf', 'ip_version': 6, 'cidr': '357a:a906:79fb:2e5f:d904:806d::/96', 'allocation_pools': [{'start': '357a:a906:79fb:2e5f:d904:806d:0:2', 'end': '357a:a906:79fb:2e5f:d904:806d:ffff:fffe'}], 'gateway_ip': '357a:a906:79fb:2e5f:d904:806d:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '357a:a906:79fb:2e5f:d904:806d:0:2', 'tags': [], 'project_id': '7a52f6a115904da89ba791b5a0fcfa55'}} 2025-10-02 02:17:34,612 - INFO - Created VN ctest-VN3-96980889 2025-10-02 02:17:34,623 - DEBUG - VN ctest-VN3-96980889 UUID is 0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:34,807 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:34,816 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:34,829 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:34,968 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:34,995 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:35,048 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a7c074f1-d63f-4aa6-b2f1-1251250abbcb 2025-10-02 02:17:35,063 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a7c074f1-d63f-4aa6-b2f1-1251250abbcb 2025-10-02 02:17:35,076 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/597b0229-8268-4c5f-bd41-73334e09dc84 2025-10-02 02:17:35,084 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-02 02:17:35,084 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:35,099 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a7c074f1-d63f-4aa6-b2f1-1251250abbcb 2025-10-02 02:17:35,119 - INFO - Verified VN network id 13 for VN b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:35,119 - INFO - Verifications in API Server for VN ctest-VN1-20770687 passed 2025-10-02 02:17:35,120 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:35,141 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a7c074f1-d63f-4aa6-b2f1-1251250abbcb 2025-10-02 02:17:35,149 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a7c074f1-d63f-4aa6-b2f1-1251250abbcb 2025-10-02 02:17:35,158 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/597b0229-8268-4c5f-bd41-73334e09dc84 2025-10-02 02:17:35,181 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12915987402541187709', 'uuid-lslong': '13301665389158883659'}, 'enable': 'true', 'created': '2025-10-02T02:17:31', 'last-modified': '2025-10-02T02:17:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.660919'} 2025-10-02 02:17:35,191 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-02 02:17:35,202 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12915987402541187709', 'uuid-lslong': '13301665389158883659'}, 'enable': 'true', 'created': '2025-10-02T02:17:31', 'last-modified': '2025-10-02T02:17:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.680125'} 2025-10-02 02:17:35,213 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-02 02:17:35,218 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12915987402541187709', 'uuid-lslong': '13301665389158883659'}, 'enable': 'true', 'created': '2025-10-02T02:17:31', 'last-modified': '2025-10-02T02:17:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.698611'} 2025-10-02 02:17:35,223 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-02 02:17:35,223 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN1-20770687 passed 2025-10-02 02:17:35,224 - DEBUG - ====Verifying policy data for ctest-VN1-20770687 in API_Server ====== 2025-10-02 02:17:35,224 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:35,241 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:35,256 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:35,361 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:35,385 - DEBUG - =>VN ctest-VN1-20770687 has no policy to be verified 2025-10-02 02:17:35,385 - DEBUG - Verifying the vn in opserver 2025-10-02 02:17:35,385 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 virtual network link through opserver 10.0.0.56 2025-10-02 02:17:35,385 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-02 02:17:35,682 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-02 02:17:35,733 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687?flat'} 2025-10-02 02:17:35,733 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 virtual network link through opserver 10.0.0.38 2025-10-02 02:17:35,733 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-02 02:17:36,023 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-02 02:17:36,080 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687?flat'} 2025-10-02 02:17:36,080 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 virtual network link through opserver 10.0.0.49 2025-10-02 02:17:36,080 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-02 02:17:36,393 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-02 02:17:36,456 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687?flat'} 2025-10-02 02:17:36,456 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is found in opserver 2025-10-02 02:17:36,477 - DEBUG - Do not have enough data to verify VN in agent 2025-10-02 02:17:36,487 - DEBUG - VRF ids for VN ctest-VN1-20770687: {} 2025-10-02 02:17:36,487 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:36,497 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:36,512 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:36,620 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:36,633 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:36,648 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/fcaf977a-a658-43e6-ae57-f1687c064990 2025-10-02 02:17:36,657 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/fcaf977a-a658-43e6-ae57-f1687c064990 2025-10-02 02:17:36,667 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/3c3f36fd-4a94-4334-9345-68f0afa357ef 2025-10-02 02:17:36,675 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-02 02:17:36,675 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:36,686 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/fcaf977a-a658-43e6-ae57-f1687c064990 2025-10-02 02:17:36,704 - INFO - Verified VN network id 14 for VN 4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:36,704 - INFO - Verifications in API Server for VN ctest-VN2-92450947 passed 2025-10-02 02:17:36,704 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:36,715 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/fcaf977a-a658-43e6-ae57-f1687c064990 2025-10-02 02:17:36,728 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/fcaf977a-a658-43e6-ae57-f1687c064990 2025-10-02 02:17:36,738 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/3c3f36fd-4a94-4334-9345-68f0afa357ef 2025-10-02 02:17:36,750 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5491850435103179868', 'uuid-lslong': '12906576815923148128'}, 'enable': 'true', 'created': '2025-10-02T02:17:33', 'last-modified': '2025-10-02T02:17:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.175253'} 2025-10-02 02:17:36,759 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-02 02:17:36,765 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5491850435103179868', 'uuid-lslong': '12906576815923148128'}, 'enable': 'true', 'created': '2025-10-02T02:17:33', 'last-modified': '2025-10-02T02:17:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.198175'} 2025-10-02 02:17:36,778 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-02 02:17:36,785 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5491850435103179868', 'uuid-lslong': '12906576815923148128'}, 'enable': 'true', 'created': '2025-10-02T02:17:33', 'last-modified': '2025-10-02T02:17:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.214344'} 2025-10-02 02:17:36,793 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-02 02:17:36,793 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN2-92450947 passed 2025-10-02 02:17:36,794 - DEBUG - ====Verifying policy data for ctest-VN2-92450947 in API_Server ====== 2025-10-02 02:17:36,794 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:36,803 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:36,817 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:36,912 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:36,928 - DEBUG - =>VN ctest-VN2-92450947 has no policy to be verified 2025-10-02 02:17:36,928 - DEBUG - Verifying the vn in opserver 2025-10-02 02:17:36,928 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 virtual network link through opserver 10.0.0.56 2025-10-02 02:17:36,928 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-02 02:17:36,991 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947?flat'} 2025-10-02 02:17:36,991 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 virtual network link through opserver 10.0.0.38 2025-10-02 02:17:36,992 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-02 02:17:37,048 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947?flat'} 2025-10-02 02:17:37,048 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 virtual network link through opserver 10.0.0.49 2025-10-02 02:17:37,048 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-02 02:17:37,102 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947?flat'} 2025-10-02 02:17:37,102 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 is found in opserver 2025-10-02 02:17:37,123 - DEBUG - Do not have enough data to verify VN in agent 2025-10-02 02:17:37,138 - DEBUG - VRF ids for VN ctest-VN2-92450947: {} 2025-10-02 02:17:37,138 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:37,144 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:37,155 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:37,261 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:37,276 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:37,286 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/2b7d683b-b78a-40c0-828f-94acd94b7b25 2025-10-02 02:17:37,296 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/2b7d683b-b78a-40c0-828f-94acd94b7b25 2025-10-02 02:17:37,310 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/08576013-8268-4eae-9d79-4793b482411c 2025-10-02 02:17:37,325 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-02 02:17:37,325 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:37,337 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/2b7d683b-b78a-40c0-828f-94acd94b7b25 2025-10-02 02:17:37,352 - INFO - Verified VN network id 15 for VN 0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:37,352 - INFO - Verifications in API Server for VN ctest-VN3-96980889 passed 2025-10-02 02:17:37,352 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:37,363 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/2b7d683b-b78a-40c0-828f-94acd94b7b25 2025-10-02 02:17:37,371 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/2b7d683b-b78a-40c0-828f-94acd94b7b25 2025-10-02 02:17:37,377 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/08576013-8268-4eae-9d79-4793b482411c 2025-10-02 02:17:37,391 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1009214597343559926', 'uuid-lslong': '12257796654384445135'}, 'enable': 'true', 'created': '2025-10-02T02:17:34', 'last-modified': '2025-10-02T02:17:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.857640'} 2025-10-02 02:17:37,398 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-02 02:17:37,404 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1009214597343559926', 'uuid-lslong': '12257796654384445135'}, 'enable': 'true', 'created': '2025-10-02T02:17:34', 'last-modified': '2025-10-02T02:17:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.867227'} 2025-10-02 02:17:37,411 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-02 02:17:37,417 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestPolicyAclIpv4v6-57573189', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1009214597343559926', 'uuid-lslong': '12257796654384445135'}, 'enable': 'true', 'created': '2025-10-02T02:17:34', 'last-modified': '2025-10-02T02:17:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.876944'} 2025-10-02 02:17:37,422 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-02 02:17:37,422 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-VN3-96980889 passed 2025-10-02 02:17:37,422 - DEBUG - ====Verifying policy data for ctest-VN3-96980889 in API_Server ====== 2025-10-02 02:17:37,422 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:37,428 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:37,440 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:37,531 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/0e017354-48cd-40f6-aa1c-711cd18e76cf 2025-10-02 02:17:37,549 - DEBUG - =>VN ctest-VN3-96980889 has no policy to be verified 2025-10-02 02:17:37,550 - DEBUG - Verifying the vn in opserver 2025-10-02 02:17:37,550 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 virtual network link through opserver 10.0.0.56 2025-10-02 02:17:37,550 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-02 02:17:37,641 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889?flat'} 2025-10-02 02:17:37,641 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 virtual network link through opserver 10.0.0.38 2025-10-02 02:17:37,641 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-02 02:17:37,709 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889?flat'} 2025-10-02 02:17:37,709 - DEBUG - Verifying the default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 virtual network link through opserver 10.0.0.49 2025-10-02 02:17:37,709 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-10-02 02:17:37,763 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889?flat'} 2025-10-02 02:17:37,763 - INFO - Validated that VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 is found in opserver 2025-10-02 02:17:37,782 - DEBUG - Do not have enough data to verify VN in agent 2025-10-02 02:17:37,791 - DEBUG - VRF ids for VN ctest-VN3-96980889: {} 2025-10-02 02:17:37,797 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = deny, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-02 02:17:38,058 - DEBUG - No source network defined 2025-10-02 02:17:38,058 - DEBUG - No source network defined 2025-10-02 02:17:38,058 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-policy13-95634000, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = None, security_group = None, network_policy = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-policy13-95634000, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-02 02:17:38,338 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = 58, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-02 02:17:38,571 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:38,577 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:38,588 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:38,693 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:17:38,706 - DEBUG - Setup step: Associating the policy to VN' 2025-10-02 02:17:38,834 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'b33ece1c-5be3-427d-b899-023239ec614b', 'name': 'ctest-VN1-20770687', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'project_id': '7a52f6a115904da89ba791b5a0fcfa55', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['933100da-6b43-4a97-87f2-bc6ce33716cd', '186268fd-d803-496e-9eee-a317a9e468e8'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-VN1-20770687'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy12-91302199'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy13-95634000']], 'subnet_ipam': [{'subnet_cidr': '18.219.170.192/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ipam1']}, {'subnet_cidr': '2f74:ff7d:50a2:31da:2952:3879::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ipam1']}], 'port_security_enabled': True, 'description': ''}} 2025-10-02 02:17:39,011 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy12-91302199'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy13-95634000']] to ctest-VN1-20770687 2025-10-02 02:17:39,012 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:17:39,018 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:17:39,031 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:17:39,129 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:17:39,144 - DEBUG - Setup step: Associating the policy to VN' 2025-10-02 02:17:39,240 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '4c36f8df-a7e6-445c-b31d-5f3b6b643560', 'name': 'ctest-VN2-92450947', 'tenant_id': '7a52f6a115904da89ba791b5a0fcfa55', 'project_id': '7a52f6a115904da89ba791b5a0fcfa55', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['2bb2cde2-0ed9-4753-aedd-6419ecbb9925', '8285a7c8-ebd2-40e6-974b-c06d83543b6c'], 'fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-VN2-92450947'], 'policys': [['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy21-45153474']], 'subnet_ipam': [{'subnet_cidr': '140.32.143.64/26', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ipam2']}, {'subnet_cidr': '30ee:9aa8:8c67:ebc9:135c:f21d::/96', 'ipam_fq_name': ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ipam2']}], 'port_security_enabled': True, 'description': ''}} 2025-10-02 02:17:39,364 - DEBUG - Associated Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy21-45153474']] to ctest-VN2-92450947 2025-10-02 02:17:39,474 - DEBUG - Services list from nova: [, , , ] 2025-10-02 02:17:40,597 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-2) 2025-10-02 02:17:42,009 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-1) 2025-10-02 02:17:43,449 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4210-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4210-2) 2025-10-02 02:17:43,538 - DEBUG - VM is in ACTIVE state now 2025-10-02 02:17:43,538 - INFO - VM name : ctest-VM11-27469117 2025-10-02 02:17:43,632 - DEBUG - VM ctest-VM11-27469117 ID is 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:17:43,729 - DEBUG - VM is in ACTIVE state now 2025-10-02 02:17:43,757 - DEBUG - VM ctest-VM11-27469117 launched on Node an-jenkins-deploy-platform-ansible-os-4210-2 2025-10-02 02:17:43,843 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:17:44,623 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:17:44,672 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:17:44,679 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/34bb8edc-1b39-4d61-9321-bc40ac21680b 2025-10-02 02:17:44,696 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:17:44,703 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/34bb8edc-1b39-4d61-9321-bc40ac21680b 2025-10-02 02:17:44,713 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/02bc763f-e10a-403c-8b13-faad6a125b8e 2025-10-02 02:17:44,722 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/344b10bb-d863-44db-98c6-b1a425ed745a 2025-10-02 02:17:44,735 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:17:44,735 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:17:44,745 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/34bb8edc-1b39-4d61-9321-bc40ac21680b 2025-10-02 02:17:44,755 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/02bc763f-e10a-403c-8b13-faad6a125b8e 2025-10-02 02:17:44,762 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/344b10bb-d863-44db-98c6-b1a425ed745a 2025-10-02 02:17:44,769 - INFO - VM ctest-VM11-27469117 verfication in all API Servers passed 2025-10-02 02:17:44,800 - DEBUG - VM ctest-VM11-27469117 Tap interface: {'index': '3', 'name': 'tap34bb8edc-1b', 'uuid': '34bb8edc-1b39-4d61-9321-bc40ac21680b', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687:ctest-VN1-20770687', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'vm_uuid': '9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592', 'vm_name': 'ctest-VM11-27469117', 'ip_addr': '18.219.170.195', 'mac_addr': '02:34:bb:8e:dc:1b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b', 'sg_uuid_list': ['cb73c5d2-587b-4e28-b06c-a94aa1a93798'], 'static_route_list': None, 'vm_project_uuid': '7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '2f74:ff7d:50a2:31da:2952:3879:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-02 02:17:44,800 - DEBUG - Agent 10.0.0.130 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687:ctest-VN1-20770687 2025-10-02 02:17:44,814 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687:ctest-VN1-20770687', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.249:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-02 02:17:44,914 - DEBUG - VM ctest-VM11-27469117 : Tap interface tap34bb8edc-1b is set to Active 2025-10-02 02:17:44,914 - DEBUG - Tap interface tap34bb8edc-1b detail : {'index': '3', 'name': 'tap34bb8edc-1b', 'uuid': '34bb8edc-1b39-4d61-9321-bc40ac21680b', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687:ctest-VN1-20770687', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'vm_uuid': '9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592', 'vm_name': 'ctest-VM11-27469117', 'ip_addr': '18.219.170.195', 'mac_addr': '02:34:bb:8e:dc:1b', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '50', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b', 'sg_uuid_list': ['cb73c5d2-587b-4e28-b06c-a94aa1a93798'], 'static_route_list': None, 'vm_project_uuid': '7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '2f74:ff7d:50a2:31da:2952:3879:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-02 02:17:45,026 - DEBUG - Starting Layer 2 verification in Agent 2025-10-02 02:17:45,082 - DEBUG - Layer 2 path is seen for VM MAC 02:34:bb:8e:dc:1b in agent 10.0.0.130 2025-10-02 02:17:45,082 - DEBUG - Active layer 2 route in agent is present for VMI tap34bb8edc-1b 2025-10-02 02:17:45,082 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-02 02:17:45,108 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is found in Agent of node 10.0.0.130 2025-10-02 02:17:45,249 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is consistent in agent 10.0.0.130 2025-10-02 02:17:45,249 - DEBUG - Route for VM IP ['18.219.170.195', '2f74:ff7d:50a2:31da:2952:3879:0:3'] is consistent in agent 10.0.0.130 2025-10-02 02:17:45,249 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 verification for VM ctest-VM11-27469117 in Agent 10.0.0.130 passed 2025-10-02 02:17:45,329 - DEBUG - Starting all layer 2 verification in agent 10.0.0.130 2025-10-02 02:17:45,347 - DEBUG - Route for VM MAC 02:34:bb:8e:dc:1b is consistent in agent 10.0.0.130 2025-10-02 02:17:48,551 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-10-02 02:17:48,551 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:17:48,564 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:17:48,564 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:17:52,645 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-02 02:17:52,645 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:17:52,659 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:17:52,660 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:17:56,749 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2025-10-02 02:17:56,750 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:17:56,763 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:17:56,763 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:00,834 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-02 02:18:00,834 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:00,849 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:00,849 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:04,935 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-10-02 02:18:04,935 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:04,948 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:04,948 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:09,030 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-02 02:18:09,030 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:09,045 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:09,045 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:13,124 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-02 02:18:13,124 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:13,138 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:13,139 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:17,224 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-02 02:18:17,224 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:17,237 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:17,237 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:21,321 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-02 02:18:21,321 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:21,335 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:21,336 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:25,416 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-02 02:18:25,417 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 failed! 2025-10-02 02:18:25,430 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 18.219.170.193 and allocation pool is NOT set 2025-10-02 02:18:25,430 - DEBUG - Gateway for vn default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 is 2f74:ff7d:50a2:31da:2952:3879:0:1 and allocation pool is NOT set 2025-10-02 02:18:27,496 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.720 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.720/3.317/5.915/2.597 ms') 2025-10-02 02:18:27,496 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 passed 2025-10-02 02:18:27,496 - INFO - VM ctest-VM11-27469117 verifications in Compute nodes passed 2025-10-02 02:18:27,736 - DEBUG - Validated VM route 18.219.170.195 in vrouter of 10.0.0.130 2025-10-02 02:18:27,740 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-02 02:18:27,740 - INFO - Validated routes of VM ctest-VM11-27469117 in all vrouters 2025-10-02 02:18:28,166 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-10-02 02:18:28,284 - DEBUG - Layer2 route found for VM MAC 02:34:bb:8e:dc:1b in Control-node 10.0.0.38 2025-10-02 02:18:28,284 - DEBUG - L2 Label for VM ctest-VM11-27469117 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2025-10-02 02:18:28,391 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.38, not supported 2025-10-02 02:18:28,391 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-10-02 02:18:28,510 - DEBUG - Layer2 route found for VM MAC 02:34:bb:8e:dc:1b in Control-node 10.0.0.49 2025-10-02 02:18:28,510 - DEBUG - L2 Label for VM ctest-VM11-27469117 same between Control-node 10.0.0.49 and Agent, Expected: 29, Seen: 29 2025-10-02 02:18:28,624 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.49, not supported 2025-10-02 02:18:28,624 - DEBUG - Starting all layer2 verification in 10.0.0.56 Control Node 2025-10-02 02:18:28,749 - DEBUG - Layer2 route found for VM MAC 02:34:bb:8e:dc:1b in Control-node 10.0.0.56 2025-10-02 02:18:28,749 - DEBUG - L2 Label for VM ctest-VM11-27469117 same between Control-node 10.0.0.56 and Agent, Expected: 29, Seen: 29 2025-10-02 02:18:28,863 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.56, not supported 2025-10-02 02:18:28,864 - INFO - Verification in Control-nodes for VM ctest-VM11-27469117 passed 2025-10-02 02:18:28,864 - DEBUG - Verifying the vm in opserver 2025-10-02 02:18:28,864 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-10-02 02:18:28,864 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592?flat 2025-10-02 02:18:28,878 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b?flat 2025-10-02 02:18:28,896 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b?flat 2025-10-02 02:18:28,914 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b?flat 2025-10-02 02:18:28,936 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592?flat 2025-10-02 02:18:28,950 - DEBUG - Verifying vm in vn uve 2025-10-02 02:18:28,950 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b?flat 2025-10-02 02:18:28,969 - DEBUG - VM uve shows interface as {'label': 25, 'fixed_ip6_list': ['2f74:ff7d:50a2:31da:2952:3879:0:3'], 'admin_state': True, 'l2_active': True, 'vm_uuid': '9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592', 'vhostuser_mode': 0, 'is_health_check_active': True, 'tx_vlan': 65535, 'ip6_address': '2f74:ff7d:50a2:31da:2952:3879:0:3', 'fixed_ip4_list': ['18.219.170.195'], 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687', 'rx_vlan': 65535, 'active': True, 'ip_address': '18.219.170.195', 'uuid': '34bb8edc-1b39-4d61-9321-bc40ac21680b', 'mac_address': '02:34:bb:8e:dc:1b', 'port_mirror_enabled': False, 'vn_uuid': 'b33ece1c-5be3-427d-b899-023239ec614b', 'ip6_active': True, 'ip4_active': True, 'gateway': '18.219.170.193', '__T': 1759371467601398, 'vm_name': 'ctest-VM11-27469117'} 2025-10-02 02:18:28,969 - DEBUG - VM uve shows ip address as ['18.219.170.195', '2f74:ff7d:50a2:31da:2952:3879:0:3'] 2025-10-02 02:18:28,969 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 2025-10-02 02:18:28,969 - INFO - Verifying through opserver in 10.0.0.56 2025-10-02 02:18:28,969 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687?flat 2025-10-02 02:18:28,989 - DEBUG - expected vm list 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:18:28,989 - DEBUG - Extracted vm list ['9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592'] 2025-10-02 02:18:28,989 - INFO - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is present in default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 2025-10-02 02:18:28,989 - DEBUG - Verifying vm in vrouter uve 2025-10-02 02:18:28,989 - DEBUG - Getting info from collector 10.0.0.49.. 2025-10-02 02:18:28,989 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592?flat 2025-10-02 02:18:29,005 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4210-2'] 2025-10-02 02:18:29,005 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:18:29,040 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:18:29,068 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:29,068 - DEBUG - Validated that VM ctest-VM11-27469117 is in Vrouter an-jenkins-deploy-platform-ansible-os-4210-2 UVE 2025-10-02 02:18:29,068 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-02 02:18:29,076 - DEBUG - Expected tap interface of VM uuid 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b 2025-10-02 02:18:29,076 - DEBUG - Expected VN of VM uuid 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 2025-10-02 02:18:29,076 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:18:29,108 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:18:29,137 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:29,137 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-57573189:34bb8edc-1b39-4d61-9321-bc40ac21680b of vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:29,137 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 of vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:29,137 - DEBUG - Verifying the 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 virtual network link through opserver 10.0.0.56 2025-10-02 02:18:29,137 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-10-02 02:18:29,148 - DEBUG - VM link and name as {'name': '9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592?flat'} 2025-10-02 02:18:29,148 - DEBUG - Verifying the 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 virtual network link through opserver 10.0.0.38 2025-10-02 02:18:29,148 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-10-02 02:18:29,159 - DEBUG - VM link and name as {'name': '9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592?flat'} 2025-10-02 02:18:29,159 - DEBUG - Verifying the 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 virtual network link through opserver 10.0.0.49 2025-10-02 02:18:29,159 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-10-02 02:18:29,170 - DEBUG - VM link and name as {'name': '9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592?flat'} 2025-10-02 02:18:29,170 - INFO - VM ctest-VM11-27469117 validations in Opserver passed 2025-10-02 02:18:29,255 - DEBUG - VM is in ACTIVE state now 2025-10-02 02:18:29,255 - INFO - VM name : ctest-VM21-09243495 2025-10-02 02:18:29,324 - DEBUG - VM ctest-VM21-09243495 ID is 549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:29,409 - DEBUG - VM is in ACTIVE state now 2025-10-02 02:18:29,409 - DEBUG - VM ctest-VM21-09243495 launched on Node an-jenkins-deploy-platform-ansible-os-4210-1 2025-10-02 02:18:29,485 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:29,496 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:29,503 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/7a2a4068-959e-40f1-bab3-57cd57467480 2025-10-02 02:18:29,512 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:29,520 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/7a2a4068-959e-40f1-bab3-57cd57467480 2025-10-02 02:18:29,531 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/9ef84a72-8e74-46f8-b871-38fe0cce568b 2025-10-02 02:18:29,543 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/f95b83a9-0d01-4b33-b846-57600fc2fd13 2025-10-02 02:18:29,551 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:18:29,551 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:29,558 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/7a2a4068-959e-40f1-bab3-57cd57467480 2025-10-02 02:18:29,567 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/9ef84a72-8e74-46f8-b871-38fe0cce568b 2025-10-02 02:18:29,574 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/f95b83a9-0d01-4b33-b846-57600fc2fd13 2025-10-02 02:18:29,584 - INFO - VM ctest-VM21-09243495 verfication in all API Servers passed 2025-10-02 02:18:29,599 - DEBUG - VM ctest-VM21-09243495 Tap interface: {'index': '3', 'name': 'tap7a2a4068-95', 'uuid': '7a2a4068-959e-40f1-bab3-57cd57467480', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947:ctest-VN2-92450947', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'vm_uuid': '549db4a5-1c58-4802-9195-216ddf981a6a', 'vm_name': 'ctest-VM21-09243495', 'ip_addr': '140.32.143.67', 'mac_addr': '02:7a:2a:40:68:95', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '44', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480', 'sg_uuid_list': ['cb73c5d2-587b-4e28-b06c-a94aa1a93798'], 'static_route_list': None, 'vm_project_uuid': '7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '30ee:9aa8:8c67:ebc9:135c:f21d:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-02 02:18:29,599 - DEBUG - Agent 10.0.0.33 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947:ctest-VN2-92450947 2025-10-02 02:18:29,603 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947:ctest-VN2-92450947', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.252:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-02 02:18:29,689 - DEBUG - VM ctest-VM21-09243495 : Tap interface tap7a2a4068-95 is set to Active 2025-10-02 02:18:29,690 - DEBUG - Tap interface tap7a2a4068-95 detail : {'index': '3', 'name': 'tap7a2a4068-95', 'uuid': '7a2a4068-959e-40f1-bab3-57cd57467480', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947:ctest-VN2-92450947', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'vm_uuid': '549db4a5-1c58-4802-9195-216ddf981a6a', 'vm_name': 'ctest-VM21-09243495', 'ip_addr': '140.32.143.67', 'mac_addr': '02:7a:2a:40:68:95', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '44', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480', 'sg_uuid_list': ['cb73c5d2-587b-4e28-b06c-a94aa1a93798'], 'static_route_list': None, 'vm_project_uuid': '7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '30ee:9aa8:8c67:ebc9:135c:f21d:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-02 02:18:29,801 - DEBUG - Starting Layer 2 verification in Agent 2025-10-02 02:18:29,811 - DEBUG - Layer 2 path is seen for VM MAC 02:7a:2a:40:68:95 in agent 10.0.0.33 2025-10-02 02:18:29,811 - DEBUG - Active layer 2 route in agent is present for VMI tap7a2a4068-95 2025-10-02 02:18:29,812 - DEBUG - L2 label(29) matches bw route table and interface table 2025-10-02 02:18:29,828 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 is found in Agent of node 10.0.0.33 2025-10-02 02:18:29,991 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 is consistent in agent 10.0.0.33 2025-10-02 02:18:29,992 - DEBUG - Route for VM IP ['30ee:9aa8:8c67:ebc9:135c:f21d:0:3', '140.32.143.67'] is consistent in agent 10.0.0.33 2025-10-02 02:18:29,992 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 verification for VM ctest-VM21-09243495 in Agent 10.0.0.33 passed 2025-10-02 02:18:30,103 - DEBUG - Starting all layer 2 verification in agent 10.0.0.33 2025-10-02 02:18:30,123 - DEBUG - Route for VM MAC 02:7a:2a:40:68:95 is consistent in agent 10.0.0.33 2025-10-02 02:18:31,306 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.08 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.48 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.084/2.282/2.480/0.198 ms') 2025-10-02 02:18:31,306 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-09243495 passed 2025-10-02 02:18:31,306 - INFO - VM ctest-VM21-09243495 verifications in Compute nodes passed 2025-10-02 02:18:31,538 - DEBUG - Validated VM route 140.32.143.67 in vrouter of 10.0.0.33 2025-10-02 02:18:31,543 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-02 02:18:31,543 - INFO - Validated routes of VM ctest-VM21-09243495 in all vrouters 2025-10-02 02:18:31,967 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-10-02 02:18:32,074 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.38, not supported 2025-10-02 02:18:32,217 - DEBUG - Layer2 route found for VM MAC 02:7a:2a:40:68:95 in Control-node 10.0.0.38 2025-10-02 02:18:32,217 - DEBUG - L2 Label for VM ctest-VM21-09243495 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2025-10-02 02:18:32,217 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-10-02 02:18:32,329 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.49, not supported 2025-10-02 02:18:32,462 - DEBUG - Layer2 route found for VM MAC 02:7a:2a:40:68:95 in Control-node 10.0.0.49 2025-10-02 02:18:32,463 - DEBUG - L2 Label for VM ctest-VM21-09243495 same between Control-node 10.0.0.49 and Agent, Expected: 29, Seen: 29 2025-10-02 02:18:32,463 - DEBUG - Starting all layer2 verification in 10.0.0.56 Control Node 2025-10-02 02:18:32,572 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.56, not supported 2025-10-02 02:18:32,691 - DEBUG - Layer2 route found for VM MAC 02:7a:2a:40:68:95 in Control-node 10.0.0.56 2025-10-02 02:18:32,691 - DEBUG - L2 Label for VM ctest-VM21-09243495 same between Control-node 10.0.0.56 and Agent, Expected: 29, Seen: 29 2025-10-02 02:18:32,691 - INFO - Verification in Control-nodes for VM ctest-VM21-09243495 passed 2025-10-02 02:18:32,692 - DEBUG - Verifying the vm in opserver 2025-10-02 02:18:32,692 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-10-02 02:18:32,692 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a?flat 2025-10-02 02:18:32,705 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480?flat 2025-10-02 02:18:32,722 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480?flat 2025-10-02 02:18:32,738 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480?flat 2025-10-02 02:18:32,753 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a?flat 2025-10-02 02:18:32,768 - DEBUG - Verifying vm in vn uve 2025-10-02 02:18:32,768 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480?flat 2025-10-02 02:18:32,788 - DEBUG - VM uve shows interface as {'label': 25, 'fixed_ip6_list': ['30ee:9aa8:8c67:ebc9:135c:f21d:0:3'], 'admin_state': True, 'l2_active': True, 'vm_uuid': '549db4a5-1c58-4802-9195-216ddf981a6a', 'vhostuser_mode': 0, 'is_health_check_active': True, 'tx_vlan': 65535, 'ip6_address': '30ee:9aa8:8c67:ebc9:135c:f21d:0:3', 'fixed_ip4_list': ['140.32.143.67'], 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947', 'rx_vlan': 65535, 'active': True, 'ip_address': '140.32.143.67', 'uuid': '7a2a4068-959e-40f1-bab3-57cd57467480', 'mac_address': '02:7a:2a:40:68:95', 'port_mirror_enabled': False, 'vn_uuid': '4c36f8df-a7e6-445c-b31d-5f3b6b643560', 'ip6_active': True, 'ip4_active': True, 'gateway': '140.32.143.65', '__T': 1759371475450612, 'vm_name': 'ctest-VM21-09243495'} 2025-10-02 02:18:32,788 - DEBUG - VM uve shows ip address as ['140.32.143.67', '30ee:9aa8:8c67:ebc9:135c:f21d:0:3'] 2025-10-02 02:18:32,788 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 2025-10-02 02:18:32,788 - INFO - Verifying through opserver in 10.0.0.56 2025-10-02 02:18:32,788 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947?flat 2025-10-02 02:18:32,808 - DEBUG - expected vm list 549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:32,808 - DEBUG - Extracted vm list ['549db4a5-1c58-4802-9195-216ddf981a6a'] 2025-10-02 02:18:32,808 - INFO - VM 549db4a5-1c58-4802-9195-216ddf981a6a is present in default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 2025-10-02 02:18:32,808 - DEBUG - Verifying vm in vrouter uve 2025-10-02 02:18:32,808 - DEBUG - Getting info from collector 10.0.0.49.. 2025-10-02 02:18:32,808 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a?flat 2025-10-02 02:18:32,824 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4210-1'] 2025-10-02 02:18:32,824 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-1:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:18:32,853 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-1?flat 2025-10-02 02:18:32,880 - DEBUG - VM 549db4a5-1c58-4802-9195-216ddf981a6a is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:18:32,880 - DEBUG - Validated that VM ctest-VM21-09243495 is in Vrouter an-jenkins-deploy-platform-ansible-os-4210-1 UVE 2025-10-02 02:18:32,880 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-02 02:18:32,887 - DEBUG - Expected tap interface of VM uuid 549db4a5-1c58-4802-9195-216ddf981a6a is default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480 2025-10-02 02:18:32,887 - DEBUG - Expected VN of VM uuid 549db4a5-1c58-4802-9195-216ddf981a6a is default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 2025-10-02 02:18:32,887 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-1:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:18:32,917 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-1?flat 2025-10-02 02:18:32,944 - DEBUG - VM 549db4a5-1c58-4802-9195-216ddf981a6a is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:18:32,944 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-57573189:7a2a4068-959e-40f1-bab3-57cd57467480 of vm 549db4a5-1c58-4802-9195-216ddf981a6a is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:18:32,944 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 of vm 549db4a5-1c58-4802-9195-216ddf981a6a is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:18:32,944 - DEBUG - Verifying the 549db4a5-1c58-4802-9195-216ddf981a6a virtual network link through opserver 10.0.0.56 2025-10-02 02:18:32,944 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-10-02 02:18:32,959 - DEBUG - VM link and name as {'name': '549db4a5-1c58-4802-9195-216ddf981a6a', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a?flat'} 2025-10-02 02:18:32,959 - DEBUG - Verifying the 549db4a5-1c58-4802-9195-216ddf981a6a virtual network link through opserver 10.0.0.38 2025-10-02 02:18:32,960 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-10-02 02:18:32,973 - DEBUG - VM link and name as {'name': '549db4a5-1c58-4802-9195-216ddf981a6a', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a?flat'} 2025-10-02 02:18:32,973 - DEBUG - Verifying the 549db4a5-1c58-4802-9195-216ddf981a6a virtual network link through opserver 10.0.0.49 2025-10-02 02:18:32,973 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-10-02 02:18:32,985 - DEBUG - VM link and name as {'name': '549db4a5-1c58-4802-9195-216ddf981a6a', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a?flat'} 2025-10-02 02:18:32,985 - INFO - VM ctest-VM21-09243495 validations in Opserver passed 2025-10-02 02:18:33,057 - DEBUG - VM is in ACTIVE state now 2025-10-02 02:18:33,058 - INFO - VM name : ctest-VM31-41455363 2025-10-02 02:18:33,137 - DEBUG - VM ctest-VM31-41455363 ID is 30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:33,207 - DEBUG - VM is in ACTIVE state now 2025-10-02 02:18:33,208 - DEBUG - VM ctest-VM31-41455363 launched on Node an-jenkins-deploy-platform-ansible-os-4210-2 2025-10-02 02:18:33,292 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:33,302 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:33,312 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/23cac766-e7e5-454a-a3d8-ec682335c9ad 2025-10-02 02:18:33,321 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:33,327 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/23cac766-e7e5-454a-a3d8-ec682335c9ad 2025-10-02 02:18:33,337 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/b8e205b1-a578-4b14-800e-cda99bd6ab9a 2025-10-02 02:18:33,347 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/baf5e3de-d6ad-471a-81c0-3e5169c5cb0e 2025-10-02 02:18:33,356 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:18:33,356 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:33,362 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/23cac766-e7e5-454a-a3d8-ec682335c9ad 2025-10-02 02:18:33,372 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/b8e205b1-a578-4b14-800e-cda99bd6ab9a 2025-10-02 02:18:33,379 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/baf5e3de-d6ad-471a-81c0-3e5169c5cb0e 2025-10-02 02:18:33,386 - INFO - VM ctest-VM31-41455363 verfication in all API Servers passed 2025-10-02 02:18:33,402 - DEBUG - VM ctest-VM31-41455363 Tap interface: {'index': '4', 'name': 'tap23cac766-e7', 'uuid': '23cac766-e7e5-454a-a3d8-ec682335c9ad', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889:ctest-VN3-96980889', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'vm_uuid': '30ac5ff2-f826-47fd-a631-4d347bae65f4', 'vm_name': 'ctest-VM31-41455363', 'ip_addr': '111.172.56.67', 'mac_addr': '02:23:ca:c7:66:e7', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad', 'sg_uuid_list': ['cb73c5d2-587b-4e28-b06c-a94aa1a93798'], 'static_route_list': None, 'vm_project_uuid': '7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '357a:a906:79fb:2e5f:d904:806d:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-02 02:18:33,402 - DEBUG - Agent 10.0.0.130 vrf name: default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889:ctest-VN3-96980889 2025-10-02 02:18:33,407 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889:ctest-VN3-96980889', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'table_label': '-1', 'vxlan_id': '15', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.249:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-02 02:18:33,504 - DEBUG - VM ctest-VM31-41455363 : Tap interface tap23cac766-e7 is set to Active 2025-10-02 02:18:33,504 - DEBUG - Tap interface tap23cac766-e7 detail : {'index': '4', 'name': 'tap23cac766-e7', 'uuid': '23cac766-e7e5-454a-a3d8-ec682335c9ad', 'vrf_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889:ctest-VN3-96980889', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Active', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Enable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '15', 'vn_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'vm_uuid': '30ac5ff2-f826-47fd-a631-4d347bae65f4', 'vm_name': 'ctest-VM31-41455363', 'ip_addr': '111.172.56.67', 'mac_addr': '02:23:ca:c7:66:e7', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '51', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad', 'sg_uuid_list': ['cb73c5d2-587b-4e28-b06c-a94aa1a93798'], 'static_route_list': None, 'vm_project_uuid': '7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '357a:a906:79fb:2e5f:d904:806d:0:3', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-02 02:18:33,615 - DEBUG - Starting Layer 2 verification in Agent 2025-10-02 02:18:33,628 - DEBUG - Layer 2 path is seen for VM MAC 02:23:ca:c7:66:e7 in agent 10.0.0.130 2025-10-02 02:18:33,628 - DEBUG - Active layer 2 route in agent is present for VMI tap23cac766-e7 2025-10-02 02:18:33,628 - DEBUG - L2 label(36) matches bw route table and interface table 2025-10-02 02:18:33,645 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 is found in Agent of node 10.0.0.130 2025-10-02 02:18:33,757 - DEBUG - VRF IDs of VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 is consistent in agent 10.0.0.130 2025-10-02 02:18:33,757 - DEBUG - Route for VM IP ['111.172.56.67', '357a:a906:79fb:2e5f:d904:806d:0:3'] is consistent in agent 10.0.0.130 2025-10-02 02:18:33,757 - DEBUG - VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 verification for VM ctest-VM31-41455363 in Agent 10.0.0.130 passed 2025-10-02 02:18:33,871 - DEBUG - Starting all layer 2 verification in agent 10.0.0.130 2025-10-02 02:18:33,883 - DEBUG - Route for VM MAC 02:23:ca:c7:66:e7 is consistent in agent 10.0.0.130 2025-10-02 02:18:35,060 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=6.69 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.568 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.568/3.628/6.689/3.060 ms') 2025-10-02 02:18:35,060 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-41455363 passed 2025-10-02 02:18:35,060 - INFO - VM ctest-VM31-41455363 verifications in Compute nodes passed 2025-10-02 02:18:35,317 - DEBUG - Validated VM route 111.172.56.67 in vrouter of 10.0.0.130 2025-10-02 02:18:35,321 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-10-02 02:18:35,321 - INFO - Validated routes of VM ctest-VM31-41455363 in all vrouters 2025-10-02 02:18:35,815 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-10-02 02:18:35,943 - DEBUG - Layer2 route found for VM MAC 02:23:ca:c7:66:e7 in Control-node 10.0.0.38 2025-10-02 02:18:35,943 - DEBUG - L2 Label for VM ctest-VM31-41455363 same between Control-node 10.0.0.38 and Agent, Expected: 36, Seen: 36 2025-10-02 02:18:36,063 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.38, not supported 2025-10-02 02:18:36,063 - DEBUG - Starting all layer2 verification in 10.0.0.49 Control Node 2025-10-02 02:18:36,197 - DEBUG - Layer2 route found for VM MAC 02:23:ca:c7:66:e7 in Control-node 10.0.0.49 2025-10-02 02:18:36,197 - DEBUG - L2 Label for VM ctest-VM31-41455363 same between Control-node 10.0.0.49 and Agent, Expected: 36, Seen: 36 2025-10-02 02:18:36,307 - DEBUG - Skipping L2 verification of v6 route on cn 10.0.0.49, not supported 2025-10-02 02:18:36,307 - INFO - Verification in Control-nodes for VM ctest-VM31-41455363 passed 2025-10-02 02:18:36,307 - DEBUG - Verifying the vm in opserver 2025-10-02 02:18:36,308 - DEBUG - Verifying in collector 10.0.0.49 ... 2025-10-02 02:18:36,308 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4?flat 2025-10-02 02:18:36,325 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad?flat 2025-10-02 02:18:36,342 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad?flat 2025-10-02 02:18:36,365 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad?flat 2025-10-02 02:18:36,387 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4?flat 2025-10-02 02:18:36,410 - DEBUG - Verifying vm in vn uve 2025-10-02 02:18:36,410 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad?flat 2025-10-02 02:18:36,443 - DEBUG - VM uve shows interface as {'label': 32, 'fixed_ip6_list': ['357a:a906:79fb:2e5f:d904:806d:0:3'], 'admin_state': True, 'l2_active': True, 'vm_uuid': '30ac5ff2-f826-47fd-a631-4d347bae65f4', 'vhostuser_mode': 0, 'is_health_check_active': True, 'tx_vlan': 65535, 'ip6_address': '357a:a906:79fb:2e5f:d904:806d:0:3', 'fixed_ip4_list': ['111.172.56.67'], 'virtual_network': 'default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889', 'rx_vlan': 65535, 'active': True, 'ip_address': '111.172.56.67', 'uuid': '23cac766-e7e5-454a-a3d8-ec682335c9ad', 'mac_address': '02:23:ca:c7:66:e7', 'port_mirror_enabled': False, 'vn_uuid': '0e017354-48cd-40f6-aa1c-711cd18e76cf', 'ip6_active': True, 'ip4_active': True, 'gateway': '111.172.56.65', '__T': 1759371467601367, 'vm_name': 'ctest-VM31-41455363'} 2025-10-02 02:18:36,443 - DEBUG - VM uve shows ip address as ['111.172.56.67', '357a:a906:79fb:2e5f:d904:806d:0:3'] 2025-10-02 02:18:36,443 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 2025-10-02 02:18:36,443 - INFO - Verifying through opserver in 10.0.0.56 2025-10-02 02:18:36,443 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889?flat 2025-10-02 02:18:36,467 - DEBUG - expected vm list 30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:36,467 - DEBUG - Extracted vm list ['30ac5ff2-f826-47fd-a631-4d347bae65f4'] 2025-10-02 02:18:36,467 - INFO - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is present in default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 2025-10-02 02:18:36,467 - DEBUG - Verifying vm in vrouter uve 2025-10-02 02:18:36,467 - DEBUG - Getting info from collector 10.0.0.49.. 2025-10-02 02:18:36,467 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4?flat 2025-10-02 02:18:36,484 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4210-2'] 2025-10-02 02:18:36,484 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:18:36,534 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:18:36,568 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:36,568 - DEBUG - Validated that VM ctest-VM31-41455363 is in Vrouter an-jenkins-deploy-platform-ansible-os-4210-2 UVE 2025-10-02 02:18:36,568 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-10-02 02:18:36,576 - DEBUG - Expected tap interface of VM uuid 30ac5ff2-f826-47fd-a631-4d347bae65f4 is default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad 2025-10-02 02:18:36,576 - DEBUG - Expected VN of VM uuid 30ac5ff2-f826-47fd-a631-4d347bae65f4 is default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 2025-10-02 02:18:36,576 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:18:36,613 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:18:36,644 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:36,644 - INFO - tap interface default-domain:ctest-TestPolicyAclIpv4v6-57573189:23cac766-e7e5-454a-a3d8-ec682335c9ad of vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:36,644 - DEBUG - Connected network default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 of vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 is present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:18:36,644 - DEBUG - Verifying the 30ac5ff2-f826-47fd-a631-4d347bae65f4 virtual network link through opserver 10.0.0.56 2025-10-02 02:18:36,644 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-10-02 02:18:36,661 - DEBUG - VM link and name as {'name': '30ac5ff2-f826-47fd-a631-4d347bae65f4', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4?flat'} 2025-10-02 02:18:36,661 - DEBUG - Verifying the 30ac5ff2-f826-47fd-a631-4d347bae65f4 virtual network link through opserver 10.0.0.38 2025-10-02 02:18:36,661 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-10-02 02:18:36,672 - DEBUG - VM link and name as {'name': '30ac5ff2-f826-47fd-a631-4d347bae65f4', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4?flat'} 2025-10-02 02:18:36,672 - DEBUG - Verifying the 30ac5ff2-f826-47fd-a631-4d347bae65f4 virtual network link through opserver 10.0.0.49 2025-10-02 02:18:36,672 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-10-02 02:18:36,683 - DEBUG - VM link and name as {'name': '30ac5ff2-f826-47fd-a631-4d347bae65f4', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4?flat'} 2025-10-02 02:18:36,683 - INFO - VM ctest-VM31-41455363 validations in Opserver passed 2025-10-02 02:18:36,683 - INFO - Waiting for VM ctest-VM11-27469117 to be up.. 2025-10-02 02:18:36,684 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:36,684 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:18:36,691 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/34bb8edc-1b39-4d61-9321-bc40ac21680b 2025-10-02 02:18:37,861 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=15.4 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.41 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.412/8.926/15.440/6.514 ms') 2025-10-02 02:18:37,861 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM11-27469117 passed 2025-10-02 02:18:37,927 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:37,927 - DEBUG - Waiting to SSH to VM ctest-VM11-27469117, IP 18.219.170.195, Port 22 2025-10-02 02:18:37,993 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-02 02:18:38,063 - DEBUG - VM ctest-VM11-27469117 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-02 02:18:43,064 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:43,064 - DEBUG - Waiting to SSH to VM ctest-VM11-27469117, IP 18.219.170.195, Port 22 2025-10-02 02:18:43,137 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-02 02:18:43,222 - DEBUG - VM ctest-VM11-27469117 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-02 02:18:48,223 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:48,223 - DEBUG - Waiting to SSH to VM ctest-VM11-27469117, IP 18.219.170.195, Port 22 2025-10-02 02:18:48,393 - DEBUG - VM ctest-VM11-27469117 is ready for SSH connections 2025-10-02 02:18:48,393 - INFO - Waiting for VM ctest-VM21-09243495 to be up.. 2025-10-02 02:18:48,393 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:48,394 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:18:48,411 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/7a2a4068-959e-40f1-bab3-57cd57467480 2025-10-02 02:18:49,571 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.99 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.365 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.365/1.677/2.989/1.312 ms') 2025-10-02 02:18:49,571 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-VM21-09243495 passed 2025-10-02 02:18:49,638 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:49,638 - DEBUG - Waiting to SSH to VM ctest-VM21-09243495, IP 140.32.143.67, Port 22 2025-10-02 02:18:49,795 - DEBUG - VM ctest-VM21-09243495 is ready for SSH connections 2025-10-02 02:18:49,795 - INFO - Waiting for VM ctest-VM31-41455363 to be up.. 2025-10-02 02:18:49,795 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:49,795 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:18:49,803 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/23cac766-e7e5-454a-a3d8-ec682335c9ad 2025-10-02 02:18:50,957 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.58 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.362 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.362/2.471/4.580/2.109 ms') 2025-10-02 02:18:50,957 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-VM31-41455363 passed 2025-10-02 02:18:51,022 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:51,023 - DEBUG - Waiting to SSH to VM ctest-VM31-41455363, IP 111.172.56.67, Port 22 2025-10-02 02:18:51,089 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-02 02:18:51,169 - DEBUG - VM ctest-VM31-41455363 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-02 02:18:56,170 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-02 02:18:56,171 - DEBUG - Waiting to SSH to VM ctest-VM31-41455363, IP 111.172.56.67, Port 22 2025-10-02 02:18:56,337 - DEBUG - VM ctest-VM31-41455363 is ready for SSH connections 2025-10-02 02:18:56,338 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 140.32.143.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-02 02:18:56,338 - DEBUG - ping -s 56 -c 3 -W 1 140.32.143.67 2025-10-02 02:19:15,315 - DEBUG - PING 140.32.143.67 (140.32.143.67) 56(84) bytes of data. 64 bytes from 140.32.143.67: icmp_req=1 ttl=63 time=5.80 ms 64 bytes from 140.32.143.67: icmp_req=2 ttl=63 time=1.25 ms 64 bytes from 140.32.143.67: icmp_req=3 ttl=63 time=0.966 ms --- 140.32.143.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 0.966/2.673/5.803/2.216 ms 2025-10-02 02:19:15,316 - INFO - Ping to IP 140.32.143.67 from VM ctest-VM11-27469117 passed 2025-10-02 02:19:15,316 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 30ee:9aa8:8c67:ebc9:135c:f21d:0:3, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2025-10-02 02:19:15,316 - DEBUG - ping6 -s 56 -c 3 -W 1 30ee:9aa8:8c67:ebc9:135c:f21d:0:3 2025-10-02 02:19:17,849 - DEBUG - PING 30ee:9aa8:8c67:ebc9:135c:f21d:0:3(30ee:9aa8:8c67:ebc9:135c:f21d:0:3) 56 data bytes 64 bytes from 30ee:9aa8:8c67:ebc9:135c:f21d:0:3: icmp_seq=1 ttl=64 time=5.85 ms 64 bytes from 30ee:9aa8:8c67:ebc9:135c:f21d:0:3: icmp_seq=2 ttl=64 time=1.28 ms 64 bytes from 30ee:9aa8:8c67:ebc9:135c:f21d:0:3: icmp_seq=3 ttl=64 time=1.14 ms --- 30ee:9aa8:8c67:ebc9:135c:f21d:0:3 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.144/2.760/5.850/2.185 ms 2025-10-02 02:19:17,849 - INFO - Ping to IP 30ee:9aa8:8c67:ebc9:135c:f21d:0:3 from VM ctest-VM11-27469117 passed 2025-10-02 02:19:17,849 - INFO - Test with src as policy and dst as any PASSED 2025-10-02 02:19:17,849 - INFO - Deleting VM ctest-VM31-41455363 2025-10-02 02:19:17,916 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:19:17,916 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:19:17,925 - DEBUG - VM ID 30ac5ff2-f826-47fd-a631-4d347bae65f4 of VM ctest-VM31-41455363 is still found in API Server 2025-10-02 02:19:19,926 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:19:19,926 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:19:19,933 - DEBUG - Response Code: 404 2025-10-02 02:19:19,933 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:19:19,939 - DEBUG - Response Code: 404 2025-10-02 02:19:19,939 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/30ac5ff2-f826-47fd-a631-4d347bae65f4 2025-10-02 02:19:19,944 - DEBUG - Response Code: 404 2025-10-02 02:19:19,944 - INFO - VM ctest-VM31-41455363 is fully removed in API-Server 2025-10-02 02:19:20,102 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-02 02:19:20,145 - DEBUG - Validated that vrouter 10.0.0.33 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 2025-10-02 02:19:20,154 - DEBUG - Validated that vrouter 10.0.0.130 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 2025-10-02 02:19:20,154 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 2025-10-02 02:19:20,154 - INFO - VM ctest-VM31-41455363 is removed in Compute, and routes are removed in all compute nodes 2025-10-02 02:19:20,385 - INFO - Routes for VM ctest-VM31-41455363 is removed in all control-nodes 2025-10-02 02:19:20,386 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:20,422 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:20,454 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:20,454 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:20,454 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:20,454 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:23,455 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:23,497 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:23,529 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:23,529 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:23,529 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:23,529 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:26,530 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:26,562 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:26,595 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:26,595 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:26,595 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:26,595 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:29,596 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:29,629 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:29,659 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:29,659 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:29,659 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:29,659 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:32,661 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:32,693 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:32,724 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:32,724 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:32,724 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:32,724 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:35,725 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:35,754 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:35,782 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:35,782 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:35,782 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:35,782 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:38,783 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:38,817 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:38,854 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:38,854 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:38,854 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:38,854 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:41,855 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:41,890 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:41,919 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:41,919 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:41,919 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:41,919 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:44,920 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:44,951 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:44,981 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:44,981 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:44,981 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:44,981 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:47,982 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:48,016 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:48,044 - DEBUG - VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:48,044 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:48,044 - DEBUG - interface for vm 30ac5ff2-f826-47fd-a631-4d347bae65f4 deleted from vrouter uve ... 2025-10-02 02:19:48,044 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:48,044 - DEBUG - Validated that VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is removed in Vrouter UVE 2025-10-02 02:19:48,044 - DEBUG - Verifying through opserver in 10.0.0.56 2025-10-02 02:19:48,044 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889?flat 2025-10-02 02:19:48,063 - DEBUG - 30ac5ff2-f826-47fd-a631-4d347bae65f4 BM not in default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN3-96980889 uve 2025-10-02 02:19:48,063 - DEBUG - Validated that VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is not present in the VN UVE 2025-10-02 02:19:48,063 - DEBUG - Verifying the 30ac5ff2-f826-47fd-a631-4d347bae65f4 virtual network link through opserver 10.0.0.56 2025-10-02 02:19:48,063 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-10-02 02:19:48,074 - INFO - 30ac5ff2-f826-47fd-a631-4d347bae65f4 vm uve deleted from opserver 2025-10-02 02:19:48,074 - DEBUG - Verifying the 30ac5ff2-f826-47fd-a631-4d347bae65f4 virtual network link through opserver 10.0.0.38 2025-10-02 02:19:48,074 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-10-02 02:19:48,086 - INFO - 30ac5ff2-f826-47fd-a631-4d347bae65f4 vm uve deleted from opserver 2025-10-02 02:19:48,086 - DEBUG - Verifying the 30ac5ff2-f826-47fd-a631-4d347bae65f4 virtual network link through opserver 10.0.0.49 2025-10-02 02:19:48,086 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-10-02 02:19:48,098 - INFO - 30ac5ff2-f826-47fd-a631-4d347bae65f4 vm uve deleted from opserver 2025-10-02 02:19:48,098 - INFO - Validated that VM 30ac5ff2-f826-47fd-a631-4d347bae65f4 is removed from Opserver 2025-10-02 02:19:48,099 - INFO - Deleting VM ctest-VM21-09243495 2025-10-02 02:19:48,173 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:19:48,173 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:19:48,182 - DEBUG - VM ID 549db4a5-1c58-4802-9195-216ddf981a6a of VM ctest-VM21-09243495 is still found in API Server 2025-10-02 02:19:50,183 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:19:50,183 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:19:50,189 - DEBUG - Response Code: 404 2025-10-02 02:19:50,190 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:19:50,195 - DEBUG - Response Code: 404 2025-10-02 02:19:50,195 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/549db4a5-1c58-4802-9195-216ddf981a6a 2025-10-02 02:19:50,200 - DEBUG - Response Code: 404 2025-10-02 02:19:50,201 - INFO - VM ctest-VM21-09243495 is fully removed in API-Server 2025-10-02 02:19:50,353 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-02 02:19:50,389 - DEBUG - Validated that vrouter 10.0.0.33 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 2025-10-02 02:19:50,397 - DEBUG - Validated that vrouter 10.0.0.130 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 2025-10-02 02:19:50,397 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 2025-10-02 02:19:50,398 - INFO - VM ctest-VM21-09243495 is removed in Compute, and routes are removed in all compute nodes 2025-10-02 02:19:50,603 - INFO - Routes for VM ctest-VM21-09243495 is removed in all control-nodes 2025-10-02 02:19:50,604 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-1:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:50,635 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-1?flat 2025-10-02 02:19:50,661 - DEBUG - VM 549db4a5-1c58-4802-9195-216ddf981a6a is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:19:50,661 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:50,661 - DEBUG - interface for vm 549db4a5-1c58-4802-9195-216ddf981a6a deleted from vrouter uve ... 2025-10-02 02:19:50,661 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:53,662 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-1:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:53,700 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-1?flat 2025-10-02 02:19:53,734 - DEBUG - VM 549db4a5-1c58-4802-9195-216ddf981a6a is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:19:53,734 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:53,734 - DEBUG - interface for vm 549db4a5-1c58-4802-9195-216ddf981a6a deleted from vrouter uve ... 2025-10-02 02:19:53,734 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:56,736 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-1:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:56,768 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-1?flat 2025-10-02 02:19:56,802 - DEBUG - VM 549db4a5-1c58-4802-9195-216ddf981a6a is not present in vrouter an-jenkins-deploy-platform-ansible-os-4210-1 uve 2025-10-02 02:19:56,802 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:56,802 - DEBUG - interface for vm 549db4a5-1c58-4802-9195-216ddf981a6a deleted from vrouter uve ... 2025-10-02 02:19:56,802 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:19:56,802 - DEBUG - Validated that VM 549db4a5-1c58-4802-9195-216ddf981a6a is removed in Vrouter UVE 2025-10-02 02:19:56,802 - DEBUG - Verifying through opserver in 10.0.0.56 2025-10-02 02:19:56,803 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947?flat 2025-10-02 02:19:56,825 - DEBUG - 549db4a5-1c58-4802-9195-216ddf981a6a BM not in default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN2-92450947 uve 2025-10-02 02:19:56,825 - DEBUG - Validated that VM 549db4a5-1c58-4802-9195-216ddf981a6a is not present in the VN UVE 2025-10-02 02:19:56,825 - DEBUG - Verifying the 549db4a5-1c58-4802-9195-216ddf981a6a virtual network link through opserver 10.0.0.56 2025-10-02 02:19:56,825 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-10-02 02:19:56,838 - INFO - 549db4a5-1c58-4802-9195-216ddf981a6a vm uve deleted from opserver 2025-10-02 02:19:56,838 - DEBUG - Verifying the 549db4a5-1c58-4802-9195-216ddf981a6a virtual network link through opserver 10.0.0.38 2025-10-02 02:19:56,838 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-10-02 02:19:56,852 - INFO - 549db4a5-1c58-4802-9195-216ddf981a6a vm uve deleted from opserver 2025-10-02 02:19:56,852 - DEBUG - Verifying the 549db4a5-1c58-4802-9195-216ddf981a6a virtual network link through opserver 10.0.0.49 2025-10-02 02:19:56,852 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-10-02 02:19:56,867 - INFO - 549db4a5-1c58-4802-9195-216ddf981a6a vm uve deleted from opserver 2025-10-02 02:19:56,867 - INFO - Validated that VM 549db4a5-1c58-4802-9195-216ddf981a6a is removed from Opserver 2025-10-02 02:19:56,867 - INFO - Deleting VM ctest-VM11-27469117 2025-10-02 02:19:56,940 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:19:56,941 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:19:56,951 - DEBUG - VM ID 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 of VM ctest-VM11-27469117 is still found in API Server 2025-10-02 02:19:58,952 - DEBUG - Verifying in api server 10.0.0.49 2025-10-02 02:19:58,952 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:19:58,958 - DEBUG - Response Code: 404 2025-10-02 02:19:58,958 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:19:58,964 - DEBUG - Response Code: 404 2025-10-02 02:19:58,964 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:19:58,969 - DEBUG - Response Code: 404 2025-10-02 02:19:58,970 - INFO - VM ctest-VM11-27469117 is fully removed in API-Server 2025-10-02 02:19:59,122 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-10-02 02:19:59,163 - DEBUG - Validated that vrouter 10.0.0.33 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 2025-10-02 02:19:59,172 - DEBUG - Validated that vrouter 10.0.0.130 does not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 2025-10-02 02:19:59,172 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 2025-10-02 02:19:59,172 - INFO - VM ctest-VM11-27469117 is removed in Compute, and routes are removed in all compute nodes 2025-10-02 02:19:59,367 - INFO - Routes for VM ctest-VM11-27469117 is removed in all control-nodes 2025-10-02 02:19:59,367 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:19:59,401 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:19:59,435 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:19:59,435 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:19:59,435 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:19:59,435 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:02,435 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:20:02,475 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:20:02,505 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:20:02,506 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:20:02,506 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:20:02,506 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:05,507 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:20:05,542 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:20:05,575 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:20:05,575 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:20:05,575 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:20:05,575 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:08,576 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:20:08,610 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:20:08,649 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:20:08,649 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:20:08,649 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:20:08,649 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:11,650 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:20:11,683 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:20:11,712 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:20:11,712 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:20:11,712 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:20:11,712 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:14,713 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:20:14,764 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:20:14,810 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:20:14,810 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:20:14,810 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:20:14,810 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:17,811 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4210-2:Compute:contrail-vrouter-agent:0?flat 2025-10-02 02:20:17,851 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4210-2?flat 2025-10-02 02:20:17,883 - DEBUG - VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4210-2 uve 2025-10-02 02:20:17,883 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-10-02 02:20:17,883 - DEBUG - interface for vm 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 deleted from vrouter uve ... 2025-10-02 02:20:17,883 - DEBUG - Deleted interface not in error interface list ... 2025-10-02 02:20:17,883 - DEBUG - Validated that VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is removed in Vrouter UVE 2025-10-02 02:20:17,883 - DEBUG - Verifying through opserver in 10.0.0.56 2025-10-02 02:20:17,883 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687?flat 2025-10-02 02:20:17,899 - DEBUG - 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 BM not in default-domain:ctest-TestPolicyAclIpv4v6-57573189:ctest-VN1-20770687 uve 2025-10-02 02:20:17,899 - DEBUG - Validated that VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is not present in the VN UVE 2025-10-02 02:20:17,899 - DEBUG - Verifying the 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 virtual network link through opserver 10.0.0.56 2025-10-02 02:20:17,899 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-10-02 02:20:17,909 - DEBUG - No links retuned for 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:20:17,909 - INFO - 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 vm uve deleted from opserver 2025-10-02 02:20:17,909 - DEBUG - Verifying the 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 virtual network link through opserver 10.0.0.38 2025-10-02 02:20:17,909 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-10-02 02:20:17,921 - DEBUG - No links retuned for 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:20:17,922 - INFO - 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 vm uve deleted from opserver 2025-10-02 02:20:17,922 - DEBUG - Verifying the 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 virtual network link through opserver 10.0.0.49 2025-10-02 02:20:17,922 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-machines 2025-10-02 02:20:17,933 - DEBUG - No links retuned for 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 2025-10-02 02:20:17,933 - INFO - 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 vm uve deleted from opserver 2025-10-02 02:20:17,933 - INFO - Validated that VM 9124ba6b-1a6f-4b88-9bac-bdbfcfaf0592 is removed from Opserver 2025-10-02 02:20:17,933 - DEBUG - Detaching the Policy for VN :ctest-VN2-92450947 2025-10-02 02:20:17,933 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:20:17,940 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:20:17,950 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:20:18,036 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/4c36f8df-a7e6-445c-b31d-5f3b6b643560 2025-10-02 02:20:18,055 - DEBUG - Requesting: http://10.0.0.56:8082/network-policy/a68be513-5fd6-4d74-8c09-fb7d2fcf797f 2025-10-02 02:20:18,212 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy21-45153474']] from ctest-VN2-92450947 2025-10-02 02:20:18,212 - DEBUG - Detaching the Policy for VN :ctest-VN1-20770687 2025-10-02 02:20:18,212 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:20:18,218 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:20:18,230 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:20:18,323 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/b33ece1c-5be3-427d-b899-023239ec614b 2025-10-02 02:20:18,349 - DEBUG - Requesting: http://10.0.0.56:8082/network-policy/54face3e-8b04-4d7a-813f-9f462cc13873 2025-10-02 02:20:18,360 - DEBUG - Requesting: http://10.0.0.56:8082/network-policy/25154576-412f-4259-97b3-54c9a4e33be1 2025-10-02 02:20:18,519 - DEBUG - Detached Policy:[['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy12-91302199'], ['default-domain', 'ctest-TestPolicyAclIpv4v6-57573189', 'ctest-policy13-95634000']] from ctest-VN1-20770687 2025-10-02 02:20:18,580 - INFO - Deleted policy ctest-policy21-45153474 2025-10-02 02:20:18,648 - INFO - Deleted policy ctest-policy12-91302199 2025-10-02 02:20:18,693 - INFO - Deleted policy ctest-policy13-95634000 2025-10-02 02:20:18,693 - INFO - Deleting VN ctest-VN3-96980889 2025-10-02 02:20:18,893 - DEBUG - Response for deleting network () 2025-10-02 02:20:18,893 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/2b7d683b-b78a-40c0-828f-94acd94b7b25 2025-10-02 02:20:18,901 - DEBUG - Response Code: 404 2025-10-02 02:20:18,901 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:20:18,907 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:20:18,920 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:20:19,001 - INFO - Validated that VN ctest-VN3-96980889 is not found in API Server 2025-10-02 02:20:19,016 - DEBUG - VN ctest-VN3-96980889 is not present in Agent 10.0.0.33 2025-10-02 02:20:19,026 - DEBUG - VN ctest-VN3-96980889 is not present in Agent 10.0.0.130 2025-10-02 02:20:19,026 - INFO - Validated that VN ctest-VN3-96980889 is not in any agent 2025-10-02 02:20:19,055 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN3-96980889 info 2025-10-02 02:20:19,055 - INFO - Deleting VN ctest-VN2-92450947 2025-10-02 02:20:19,245 - DEBUG - Response for deleting network () 2025-10-02 02:20:19,245 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/fcaf977a-a658-43e6-ae57-f1687c064990 2025-10-02 02:20:19,254 - DEBUG - Response Code: 404 2025-10-02 02:20:19,254 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:20:19,261 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:20:19,316 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:20:19,414 - INFO - Validated that VN ctest-VN2-92450947 is not found in API Server 2025-10-02 02:20:19,424 - DEBUG - VN ctest-VN2-92450947 is not present in Agent 10.0.0.33 2025-10-02 02:20:19,437 - DEBUG - VN ctest-VN2-92450947 is not present in Agent 10.0.0.130 2025-10-02 02:20:19,437 - INFO - Validated that VN ctest-VN2-92450947 is not in any agent 2025-10-02 02:20:19,477 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN2-92450947 info 2025-10-02 02:20:19,477 - INFO - Deleting VN ctest-VN1-20770687 2025-10-02 02:20:19,701 - DEBUG - Response for deleting network () 2025-10-02 02:20:19,701 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a7c074f1-d63f-4aa6-b2f1-1251250abbcb 2025-10-02 02:20:19,706 - DEBUG - Response Code: 404 2025-10-02 02:20:19,707 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-02 02:20:19,713 - DEBUG - Requesting: http://10.0.0.56:8082/domain/b0543e69-2184-4be1-8e23-ac5840233bc6 2025-10-02 02:20:19,725 - DEBUG - Requesting: http://10.0.0.56:8082/project/7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55 2025-10-02 02:20:19,825 - INFO - Validated that VN ctest-VN1-20770687 is not found in API Server 2025-10-02 02:20:19,837 - DEBUG - VN ctest-VN1-20770687 is not present in Agent 10.0.0.33 2025-10-02 02:20:19,849 - DEBUG - VN ctest-VN1-20770687 is not present in Agent 10.0.0.130 2025-10-02 02:20:19,849 - INFO - Validated that VN ctest-VN1-20770687 is not in any agent 2025-10-02 02:20:19,879 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-VN1-20770687 info 2025-10-02 02:20:19,982 - INFO - IPAM: ipam3 is not found in API Server 2025-10-02 02:20:20,003 - INFO - IPAM:ipam3 is not found in control node 2025-10-02 02:20:20,134 - INFO - IPAM: ipam2 is not found in API Server 2025-10-02 02:20:20,154 - INFO - IPAM:ipam2 is not found in control node 2025-10-02 02:20:20,286 - INFO - IPAM: ipam1 is not found in API Server 2025-10-02 02:20:20,310 - INFO - IPAM:ipam1 is not found in control node 2025-10-02 02:20:21,570 - DEBUG - No XMPP flaps were noticed during the test 2025-10-02 02:20:21,570 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:53] 2025-10-02 02:20:21,570 - INFO - -------------------------------------------------------------------------------- 2025-10-02 02:20:22,839 - DEBUG - No XMPP flaps were noticed during the test 2025-10-02 02:20:22,840 - INFO - END TEST : test_policy_inheritance_src_pol_dst_any : PASSED[0:02:55] 2025-10-02 02:20:22,840 - INFO - -------------------------------------------------------------------------------- 2025-10-02 02:20:23,552 - INFO - Deleted project: ctest-TestPolicyAclIpv4v6-57573189, ID : 7a52f6a1-1590-4da8-9ba7-91b5a0fcfa55