2024-09-12 02:27:54,631 - INFO - Domain Default found not creating 2024-09-12 02:27:54,824 - INFO - Project ctest-TestSvcRegr-40649768 not found, creating it 2024-09-12 02:27:55,348 - INFO - Created Project:ctest-TestSvcRegr-40649768, ID : cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:27:57,074 - INFO - ================================================================================ 2024-09-12 02:27:57,074 - INFO - STARTING TEST : test_svc_in_network_datapath 2024-09-12 02:27:57,336 - DEBUG - Nothing to compare xmpp stats {'10.0.0.30': {'10.20.0.13': '0'}} with 2024-09-12 02:27:57,337 - INFO - Initial checks done. Running the testcase now 2024-09-12 02:27:57,337 - INFO - 2024-09-12 02:27:58,030 - DEBUG - Response for create_network : {'network': {'id': 'c1925deb-0426-4eb6-bf11-73a8f507e969', 'name': 'ctest-mgmt_vn-24764930', 'tenant_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'project_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-mgmt_vn-24764930'], 'port_security_enabled': True, 'description': ''}} 2024-09-12 02:27:58,207 - DEBUG - Response for create_subnet : {'subnet': {'id': '3d62b0bc-9490-4ae8-89c4-567c2111d80f', 'name': '', 'tenant_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'network_id': 'c1925deb-0426-4eb6-bf11-73a8f507e969', 'ip_version': 4, 'cidr': '30.94.32.64/26', 'allocation_pools': [{'start': '30.94.32.66', 'end': '30.94.32.126'}], 'gateway_ip': '30.94.32.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.94.32.66', 'tags': [], 'project_id': 'cc6b5ad768ee46f6810070c4ab06f4dc'}} 2024-09-12 02:27:58,233 - INFO - Created VN ctest-mgmt_vn-24764930 2024-09-12 02:27:58,293 - DEBUG - VN ctest-mgmt_vn-24764930 UUID is c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:58,434 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:27:58,776 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:27:58,817 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:27:58,842 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:27:58,941 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:58,962 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:58,979 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/1e66b356-a50d-48b2-9205-0131d92f7bd1 2024-09-12 02:27:58,991 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/1e66b356-a50d-48b2-9205-0131d92f7bd1 2024-09-12 02:27:59,002 - DEBUG - Requesting: http://10.0.0.30:8082/route-target/107f3cdb-0020-4a38-adcb-814b5cc4fd3a 2024-09-12 02:27:59,012 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-12 02:27:59,012 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:59,030 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/1e66b356-a50d-48b2-9205-0131d92f7bd1 2024-09-12 02:27:59,053 - INFO - Verified VN network id 8 for VN c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:59,053 - INFO - Verifications in API Server for VN ctest-mgmt_vn-24764930 passed 2024-09-12 02:27:59,053 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:59,069 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/1e66b356-a50d-48b2-9205-0131d92f7bd1 2024-09-12 02:27:59,080 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/1e66b356-a50d-48b2-9205-0131d92f7bd1 2024-09-12 02:27:59,091 - DEBUG - Requesting: http://10.0.0.30:8082/route-target/107f3cdb-0020-4a38-adcb-814b5cc4fd3a 2024-09-12 02:27:59,107 - DEBUG - Control-node 10.0.0.30 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-40649768', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13948314259888164534', 'uuid-lslong': '13767912705350953321'}, 'enable': 'true', 'created': '2024-09-12T02:27:57', 'last-modified': '2024-09-12T02:27:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.946767'} 2024-09-12 02:27:59,114 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-12 02:27:59,114 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-24764930 passed 2024-09-12 02:27:59,114 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-24764930 in API_Server ====== 2024-09-12 02:27:59,114 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:27:59,121 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:27:59,136 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:27:59,223 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/c1925deb-0426-4eb6-bf11-73a8f507e969 2024-09-12 02:27:59,240 - DEBUG - =>VN ctest-mgmt_vn-24764930 has no policy to be verified 2024-09-12 02:27:59,240 - DEBUG - Verifying the vn in opserver 2024-09-12 02:27:59,240 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 virtual network link through opserver 10.0.0.30 2024-09-12 02:27:59,240 - DEBUG - Requesting: http://10.0.0.30:8081/analytics/uves/virtual-networks 2024-09-12 02:27:59,582 - DEBUG - Requesting: http://10.0.0.30:8081/analytics/uves/virtual-networks 2024-09-12 02:27:59,650 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930', 'href': 'http://10.0.0.30:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930?flat'} 2024-09-12 02:27:59,650 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is found in opserver 2024-09-12 02:27:59,665 - DEBUG - Do not have enough data to verify VN in agent 2024-09-12 02:27:59,672 - DEBUG - VRF ids for VN ctest-mgmt_vn-24764930: {} 2024-09-12 02:27:59,901 - DEBUG - Response for create_network : {'network': {'id': 'a9548249-8ddc-44ea-a8ba-5329dc3130c7', 'name': 'ctest-left_vn-60538135', 'tenant_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'project_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-left_vn-60538135'], 'port_security_enabled': True, 'description': ''}} 2024-09-12 02:28:00,125 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a4449deb-da18-4ed1-b39a-87a0602b4c82', 'name': '', 'tenant_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'network_id': 'a9548249-8ddc-44ea-a8ba-5329dc3130c7', 'ip_version': 4, 'cidr': '35.16.124.64/26', 'allocation_pools': [{'start': '35.16.124.66', 'end': '35.16.124.126'}], 'gateway_ip': '35.16.124.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.16.124.66', 'tags': [], 'project_id': 'cc6b5ad768ee46f6810070c4ab06f4dc'}} 2024-09-12 02:28:00,150 - INFO - Created VN ctest-left_vn-60538135 2024-09-12 02:28:00,209 - DEBUG - VN ctest-left_vn-60538135 UUID is a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,335 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:28:00,342 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:28:00,362 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:28:00,457 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,479 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,500 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/56579f10-57a1-4090-91b0-b4794ded636d 2024-09-12 02:28:00,512 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/56579f10-57a1-4090-91b0-b4794ded636d 2024-09-12 02:28:00,523 - DEBUG - Requesting: http://10.0.0.30:8082/route-target/a015fd3c-32b0-4038-997b-c9d610e70e79 2024-09-12 02:28:00,532 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-12 02:28:00,532 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,550 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/56579f10-57a1-4090-91b0-b4794ded636d 2024-09-12 02:28:00,574 - INFO - Verified VN network id 9 for VN a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,574 - INFO - Verifications in API Server for VN ctest-left_vn-60538135 passed 2024-09-12 02:28:00,574 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,592 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/56579f10-57a1-4090-91b0-b4794ded636d 2024-09-12 02:28:00,604 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/56579f10-57a1-4090-91b0-b4794ded636d 2024-09-12 02:28:00,614 - DEBUG - Requesting: http://10.0.0.30:8082/route-target/a015fd3c-32b0-4038-997b-c9d610e70e79 2024-09-12 02:28:00,631 - DEBUG - Control-node 10.0.0.30 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-40649768', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12201520542877762794', 'uuid-lslong': '12158121583293051079'}, 'enable': 'true', 'created': '2024-09-12T02:27:59', 'last-modified': '2024-09-12T02:28:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.546651'} 2024-09-12 02:28:00,638 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-12 02:28:00,638 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-60538135 passed 2024-09-12 02:28:00,639 - DEBUG - ====Verifying policy data for ctest-left_vn-60538135 in API_Server ====== 2024-09-12 02:28:00,639 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:28:00,646 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:28:00,665 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:28:00,767 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/a9548249-8ddc-44ea-a8ba-5329dc3130c7 2024-09-12 02:28:00,788 - DEBUG - =>VN ctest-left_vn-60538135 has no policy to be verified 2024-09-12 02:28:00,788 - DEBUG - Verifying the vn in opserver 2024-09-12 02:28:00,789 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135 virtual network link through opserver 10.0.0.30 2024-09-12 02:28:00,789 - DEBUG - Requesting: http://10.0.0.30:8081/analytics/uves/virtual-networks 2024-09-12 02:28:00,805 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135', 'href': 'http://10.0.0.30:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135?flat'} 2024-09-12 02:28:00,805 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135 is found in opserver 2024-09-12 02:28:00,819 - DEBUG - Do not have enough data to verify VN in agent 2024-09-12 02:28:00,826 - DEBUG - VRF ids for VN ctest-left_vn-60538135: {} 2024-09-12 02:28:01,072 - DEBUG - Response for create_network : {'network': {'id': 'd4c822da-6676-4413-8fb3-1a3053c5732b', 'name': 'ctest-right_vn-02879511', 'tenant_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'project_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-right_vn-02879511'], 'port_security_enabled': True, 'description': ''}} 2024-09-12 02:28:01,284 - DEBUG - Response for create_subnet : {'subnet': {'id': '53a88d6b-b818-465c-9bbe-e585c087896f', 'name': '', 'tenant_id': 'cc6b5ad768ee46f6810070c4ab06f4dc', 'network_id': 'd4c822da-6676-4413-8fb3-1a3053c5732b', 'ip_version': 4, 'cidr': '82.55.239.128/26', 'allocation_pools': [{'start': '82.55.239.130', 'end': '82.55.239.190'}], 'gateway_ip': '82.55.239.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '82.55.239.130', 'tags': [], 'project_id': 'cc6b5ad768ee46f6810070c4ab06f4dc'}} 2024-09-12 02:28:01,307 - INFO - Created VN ctest-right_vn-02879511 2024-09-12 02:28:01,369 - DEBUG - VN ctest-right_vn-02879511 UUID is d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,503 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:28:01,510 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:28:01,526 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:28:01,614 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,635 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,650 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/c917cf2a-0fd8-4e76-b48a-53ad693d2281 2024-09-12 02:28:01,660 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/c917cf2a-0fd8-4e76-b48a-53ad693d2281 2024-09-12 02:28:01,670 - DEBUG - Requesting: http://10.0.0.30:8082/route-target/566b4763-6cdf-40b7-b2c8-eca9f91867a6 2024-09-12 02:28:01,679 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-12 02:28:01,679 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,696 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/c917cf2a-0fd8-4e76-b48a-53ad693d2281 2024-09-12 02:28:01,722 - INFO - Verified VN network id 10 for VN d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,722 - INFO - Verifications in API Server for VN ctest-right_vn-02879511 passed 2024-09-12 02:28:01,722 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,738 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/c917cf2a-0fd8-4e76-b48a-53ad693d2281 2024-09-12 02:28:01,750 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/c917cf2a-0fd8-4e76-b48a-53ad693d2281 2024-09-12 02:28:01,762 - DEBUG - Requesting: http://10.0.0.30:8082/route-target/566b4763-6cdf-40b7-b2c8-eca9f91867a6 2024-09-12 02:28:01,780 - DEBUG - Control-node 10.0.0.30 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-40649768', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15332543252800095251', 'uuid-lslong': '10354648763121103659'}, 'enable': 'true', 'created': '2024-09-12T02:28:01', 'last-modified': '2024-09-12T02:28:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532620'} 2024-09-12 02:28:01,789 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-12 02:28:01,789 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-02879511 passed 2024-09-12 02:28:01,789 - DEBUG - ====Verifying policy data for ctest-right_vn-02879511 in API_Server ====== 2024-09-12 02:28:01,789 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:28:01,796 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:28:01,814 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:28:01,902 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-network/d4c822da-6676-4413-8fb3-1a3053c5732b 2024-09-12 02:28:01,918 - DEBUG - =>VN ctest-right_vn-02879511 has no policy to be verified 2024-09-12 02:28:01,918 - DEBUG - Verifying the vn in opserver 2024-09-12 02:28:01,918 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511 virtual network link through opserver 10.0.0.30 2024-09-12 02:28:01,918 - DEBUG - Requesting: http://10.0.0.30:8081/analytics/uves/virtual-networks 2024-09-12 02:28:01,931 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511', 'href': 'http://10.0.0.30:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511?flat'} 2024-09-12 02:28:01,931 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511 is found in opserver 2024-09-12 02:28:01,944 - DEBUG - Do not have enough data to verify VN in agent 2024-09-12 02:28:01,950 - DEBUG - VRF ids for VN ctest-right_vn-02879511: {} 2024-09-12 02:28:02,015 - DEBUG - Services list from nova: [, , ] 2024-09-12 02:28:03,202 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1903-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1903-1) 2024-09-12 02:28:04,566 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1903-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1903-1) 2024-09-12 02:28:04,567 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-01889399'] 2024-09-12 02:28:04,961 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-01889399'] created succesfully 2024-09-12 02:28:05,374 - DEBUG - Image by name cirros_in_net not found 2024-09-12 02:28:05,374 - DEBUG - Installing image cirros_in_net 2024-09-12 02:28:05,374 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'vcpath': '/images/vcenter/', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2024-09-12 02:28:05,374 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-09-12 02:28:05,374 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-09-12 02:28:05,388 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2024-09-12 02:28:05,635 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2024-09-12 02:28:05,635 - DEBUG - Unzip image 2024-09-12 02:28:05,635 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2024-09-12 02:28:05,811 - DEBUG - Try to create image in user context 2024-09-12 02:28:06,077 - DEBUG - Image has been created in user context 2024-09-12 02:28:06,078 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2024-09-12 02:28:06,094 - DEBUG - Downloaded image has been removed 2024-09-12 02:28:06,113 - DEBUG - Uploaded image status = active 2024-09-12 02:28:07,466 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1903-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1903-1) 2024-09-12 02:28:07,467 - INFO - Waiting for VM ctest-pt_svm0-42052740 to be up.. 2024-09-12 02:28:07,518 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-09-12 02:28:12,631 - DEBUG - VM is in ACTIVE state now 2024-09-12 02:28:12,631 - INFO - VM name : ctest-pt_svm0-42052740 2024-09-12 02:28:12,738 - DEBUG - VM ctest-pt_svm0-42052740 ID is ab0c1a55-4f3b-435c-9725-6865b89cc7e9 2024-09-12 02:28:12,761 - DEBUG - VM ctest-pt_svm0-42052740 launched on Node cn-jenkins-deploy-platform-ansible-os-1903-1 2024-09-12 02:28:13,055 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/ab0c1a55-4f3b-435c-9725-6865b89cc7e9 2024-09-12 02:28:13,070 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/3a8e47da-cfcc-42b4-a526-2c06a8a7eacf 2024-09-12 02:28:13,090 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/6d025012-46d2-41c1-b66e-2371da5d7dfa 2024-09-12 02:28:13,106 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/882bf840-0183-419a-bdf0-d59bfcbbd915 2024-09-12 02:28:16,417 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2024-09-12 02:28:16,417 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-42052740 failed! 2024-09-12 02:28:16,481 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is 30.94.32.65 and allocation pool is NOT set 2024-09-12 02:28:20,546 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2024-09-12 02:28:20,546 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-42052740 failed! 2024-09-12 02:28:20,609 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is 30.94.32.65 and allocation pool is NOT set 2024-09-12 02:28:24,708 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2024-09-12 02:28:24,709 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-42052740 failed! 2024-09-12 02:28:25,049 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is 30.94.32.65 and allocation pool is NOT set 2024-09-12 02:28:29,129 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2024-09-12 02:28:29,129 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-42052740 failed! 2024-09-12 02:28:29,193 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is 30.94.32.65 and allocation pool is NOT set 2024-09-12 02:28:33,287 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=10.7 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1027ms\r\nrtt min/avg/max/mdev = 10.652/10.652/10.652/0.000 ms') 2024-09-12 02:28:33,287 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-42052740 passed 2024-09-12 02:28:33,449 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:33,449 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:33,515 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-12 02:28:33,613 - DEBUG - VM ctest-pt_svm0-42052740 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-12 02:28:38,614 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:38,614 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:38,679 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-12 02:28:38,804 - DEBUG - VM ctest-pt_svm0-42052740 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-12 02:28:43,805 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:43,806 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:43,876 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-12 02:28:44,018 - DEBUG - VM ctest-pt_svm0-42052740 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-12 02:28:49,021 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:49,021 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:49,087 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-12 02:28:49,186 - DEBUG - VM ctest-pt_svm0-42052740 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-12 02:28:54,187 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:54,187 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:54,357 - DEBUG - VM ctest-pt_svm0-42052740 is ready for SSH connections 2024-09-12 02:28:54,525 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:54,525 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:54,685 - DEBUG - VM ctest-pt_svm0-42052740 is ready for SSH connections 2024-09-12 02:28:54,849 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:54,849 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-42052740, IP 30.94.32.67, Port 22 2024-09-12 02:28:55,015 - DEBUG - VM ctest-pt_svm0-42052740 is ready for SSH connections 2024-09-12 02:28:55,024 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-si-90833905'] 2024-09-12 02:28:56,013 - INFO - Waiting for VM ctest-left_vm-19673248 to be up.. 2024-09-12 02:28:56,102 - DEBUG - VM is in ACTIVE state now 2024-09-12 02:28:56,102 - INFO - VM name : ctest-left_vm-19673248 2024-09-12 02:28:56,235 - DEBUG - VM ctest-left_vm-19673248 ID is 843a7ec1-7f71-4dd1-ad11-4abcdfbf6d81 2024-09-12 02:28:56,236 - DEBUG - VM ctest-left_vm-19673248 launched on Node cn-jenkins-deploy-platform-ansible-os-1903-1 2024-09-12 02:28:56,366 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/843a7ec1-7f71-4dd1-ad11-4abcdfbf6d81 2024-09-12 02:28:56,381 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/6b50d31e-8d51-4ef6-8b0c-a127577fb09c 2024-09-12 02:28:57,653 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.47 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.483 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.483/1.978/3.473/1.495 ms') 2024-09-12 02:28:57,653 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-19673248 passed 2024-09-12 02:28:57,813 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:57,813 - DEBUG - Waiting to SSH to VM ctest-left_vm-19673248, IP 35.16.124.67, Port 22 2024-09-12 02:28:57,969 - DEBUG - VM ctest-left_vm-19673248 is ready for SSH connections 2024-09-12 02:28:57,969 - INFO - Waiting for VM ctest-right_vm-53854711 to be up.. 2024-09-12 02:28:58,074 - DEBUG - VM is in ACTIVE state now 2024-09-12 02:28:58,074 - INFO - VM name : ctest-right_vm-53854711 2024-09-12 02:28:58,172 - DEBUG - VM ctest-right_vm-53854711 ID is bf7be8fb-f860-496a-8bdd-d5251bb99260 2024-09-12 02:28:58,172 - DEBUG - VM ctest-right_vm-53854711 launched on Node cn-jenkins-deploy-platform-ansible-os-1903-1 2024-09-12 02:28:58,263 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/bf7be8fb-f860-496a-8bdd-d5251bb99260 2024-09-12 02:28:58,276 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/1bf5abe7-d50a-42db-b688-dd697803340f 2024-09-12 02:28:59,537 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.25 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.420 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.420/1.832/3.245/1.412 ms') 2024-09-12 02:28:59,537 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-53854711 passed 2024-09-12 02:28:59,709 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:28:59,709 - DEBUG - Waiting to SSH to VM ctest-right_vm-53854711, IP 82.55.239.131, Port 22 2024-09-12 02:28:59,864 - DEBUG - VM ctest-right_vm-53854711 is ready for SSH connections 2024-09-12 02:28:59,873 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-40649768:ctest-si-90833905'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2024-09-12 02:29:00,333 - INFO - Attaching policy ctest-policy-30795573 to vn ctest-left_vn-60538135 2024-09-12 02:29:00,905 - INFO - Attaching policy ctest-policy-30795573 to vn ctest-right_vn-02879511 2024-09-12 02:29:01,397 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-01889399'] created succesfully 2024-09-12 02:29:01,634 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-si-90833905'] created succesfully 2024-09-12 02:29:01,635 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:01,642 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:01,659 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:01,754 - DEBUG - Requesting: http://10.0.0.30:8082/service-instance/a020e066-3a7e-4ba2-bf13-91955f50a3c4 2024-09-12 02:29:01,771 - DEBUG - SI 'ctest-si-90833905' has service template ref to ctest-service_template_1-01889399 2024-09-12 02:29:01,771 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:01,778 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:01,793 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:01,882 - DEBUG - Requesting: http://10.0.0.30:8082/service-instance/a020e066-3a7e-4ba2-bf13-91955f50a3c4 2024-09-12 02:29:01,897 - DEBUG - Requesting: http://10.0.0.30:8082/port-tuple/5210f9ec-efe7-41c6-82ff-419987fb824f 2024-09-12 02:29:01,908 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/3a8e47da-cfcc-42b4-a526-2c06a8a7eacf 2024-09-12 02:29:01,926 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/6d025012-46d2-41c1-b66e-2371da5d7dfa 2024-09-12 02:29:01,944 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/882bf840-0183-419a-bdf0-d59bfcbbd915 2024-09-12 02:29:02,232 - DEBUG - VM is in ACTIVE state now 2024-09-12 02:29:02,753 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/ab0c1a55-4f3b-435c-9725-6865b89cc7e9 2024-09-12 02:29:02,768 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/3a8e47da-cfcc-42b4-a526-2c06a8a7eacf 2024-09-12 02:29:02,791 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/6d025012-46d2-41c1-b66e-2371da5d7dfa 2024-09-12 02:29:02,808 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/882bf840-0183-419a-bdf0-d59bfcbbd915 2024-09-12 02:29:02,825 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/9773216c-96e3-4b94-91dd-065d78cb26ad 2024-09-12 02:29:02,837 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/9b18d380-cb97-4ce1-8852-7fe50a0d1136 2024-09-12 02:29:02,848 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/bff7b57a-37c1-40b9-b399-eea07155b0a0 2024-09-12 02:29:02,858 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/087156ac-95e0-4361-abdf-a759fd78914e 2024-09-12 02:29:02,868 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/a2376567-d2cc-4ade-b53b-c35704bb011a 2024-09-12 02:29:02,879 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/db29917e-a0c9-4459-9397-3a7b760fe950 2024-09-12 02:29:02,892 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/665f44f6-b055-4394-b41a-87feed1ecf5e 2024-09-12 02:29:02,904 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/7d872f00-1328-43ae-8397-fded10b66fed 2024-09-12 02:29:02,914 - DEBUG - Requesting: http://10.0.0.30:8082/instance-ip/cfb124ce-292f-4ba8-9846-e1b5209da89f 2024-09-12 02:29:03,354 - DEBUG - VM is in ACTIVE state now 2024-09-12 02:29:03,354 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/ab0c1a55-4f3b-435c-9725-6865b89cc7e9 2024-09-12 02:29:03,367 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/3a8e47da-cfcc-42b4-a526-2c06a8a7eacf 2024-09-12 02:29:03,386 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/6d025012-46d2-41c1-b66e-2371da5d7dfa 2024-09-12 02:29:03,404 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine-interface/882bf840-0183-419a-bdf0-d59bfcbbd915 2024-09-12 02:29:04,669 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.89 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.570 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.570/1.228/1.886/0.658 ms') 2024-09-12 02:29:04,669 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-42052740 passed 2024-09-12 02:29:04,716 - DEBUG - VM ctest-pt_svm0-42052740 Tap interface: {'index': '6', 'name': 'tap882bf840-01', 'uuid': '882bf840-0183-419a-bdf0-d59bfcbbd915', 'vrf_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135:ctest-left_vn-60538135', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135', 'vm_uuid': 'ab0c1a55-4f3b-435c-9725-6865b89cc7e9', 'vm_name': 'ctest-pt_svm0-42052740', 'ip_addr': '35.16.124.68', 'mac_addr': '02:88:2b:f8:40:01', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '35', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-40649768:882bf840-0183-419a-bdf0-d59bfcbbd915', 'sg_uuid_list': ['406fb3cb-4d71-4e27-8260-e8bb62826f67'], 'static_route_list': None, 'vm_project_uuid': 'cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc', 'admin_state': 'Enabled', 'flow_key_idx': '50', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '6d025012-46d2-41c1-b66e-2371da5d7dfa', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-12 02:29:04,716 - DEBUG - Agent 10.0.0.30 vrf name: default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135:ctest-left_vn-60538135 2024-09-12 02:29:04,723 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135:ctest-left_vn-60538135', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.13:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-09-12 02:29:04,900 - DEBUG - VM ctest-pt_svm0-42052740 : Tap interface tap882bf840-01 is set to Active 2024-09-12 02:29:04,901 - DEBUG - Tap interface tap882bf840-01 detail : {'index': '6', 'name': 'tap882bf840-01', 'uuid': '882bf840-0183-419a-bdf0-d59bfcbbd915', 'vrf_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135:ctest-left_vn-60538135', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135', 'vm_uuid': 'ab0c1a55-4f3b-435c-9725-6865b89cc7e9', 'vm_name': 'ctest-pt_svm0-42052740', 'ip_addr': '35.16.124.68', 'mac_addr': '02:88:2b:f8:40:01', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '35', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-40649768:882bf840-0183-419a-bdf0-d59bfcbbd915', 'sg_uuid_list': ['406fb3cb-4d71-4e27-8260-e8bb62826f67'], 'static_route_list': None, 'vm_project_uuid': 'cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc', 'admin_state': 'Enabled', 'flow_key_idx': '50', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '6d025012-46d2-41c1-b66e-2371da5d7dfa', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-12 02:29:05,101 - DEBUG - Starting Layer 2 verification in Agent 2024-09-12 02:29:05,115 - DEBUG - Layer 2 path is seen for VM MAC 02:88:2b:f8:40:01 in agent 10.0.0.30 2024-09-12 02:29:05,116 - DEBUG - Active layer 2 route in agent is present for VMI tap882bf840-01 2024-09-12 02:29:05,116 - DEBUG - L2 label(48) matches bw route table and interface table 2024-09-12 02:29:05,122 - DEBUG - VN default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135 is found in Agent of node 10.0.0.30 2024-09-12 02:29:05,352 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135 is consistent in agent 10.0.0.30 2024-09-12 02:29:05,352 - DEBUG - Route for VM IP ['35.16.124.68'] is consistent in agent 10.0.0.30 2024-09-12 02:29:05,352 - DEBUG - VN default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135 verification for VM ctest-pt_svm0-42052740 in Agent 10.0.0.30 passed 2024-09-12 02:29:05,557 - DEBUG - Starting all layer 2 verification in agent 10.0.0.30 2024-09-12 02:29:05,572 - DEBUG - Route for VM MAC 02:88:2b:f8:40:01 is consistent in agent 10.0.0.30 2024-09-12 02:29:05,597 - DEBUG - VM ctest-pt_svm0-42052740 Tap interface: {'index': '5', 'name': 'tap3a8e47da-cf', 'uuid': '3a8e47da-cfcc-42b4-a526-2c06a8a7eacf', 'vrf_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930:ctest-mgmt_vn-24764930', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930', 'vm_uuid': 'ab0c1a55-4f3b-435c-9725-6865b89cc7e9', 'vm_name': 'ctest-pt_svm0-42052740', 'ip_addr': '30.94.32.67', 'mac_addr': '02:3a:8e:47:da:cf', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '34', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-40649768:3a8e47da-cfcc-42b4-a526-2c06a8a7eacf', 'sg_uuid_list': ['406fb3cb-4d71-4e27-8260-e8bb62826f67'], 'static_route_list': None, 'vm_project_uuid': 'cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-12 02:29:05,597 - DEBUG - Agent 10.0.0.30 vrf name: default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930:ctest-mgmt_vn-24764930 2024-09-12 02:29:05,604 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930:ctest-mgmt_vn-24764930', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.13:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-09-12 02:29:05,781 - DEBUG - VM ctest-pt_svm0-42052740 : Tap interface tap3a8e47da-cf is set to Active 2024-09-12 02:29:05,781 - DEBUG - Tap interface tap3a8e47da-cf detail : {'index': '5', 'name': 'tap3a8e47da-cf', 'uuid': '3a8e47da-cfcc-42b4-a526-2c06a8a7eacf', 'vrf_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930:ctest-mgmt_vn-24764930', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930', 'vm_uuid': 'ab0c1a55-4f3b-435c-9725-6865b89cc7e9', 'vm_name': 'ctest-pt_svm0-42052740', 'ip_addr': '30.94.32.67', 'mac_addr': '02:3a:8e:47:da:cf', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '34', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-40649768:3a8e47da-cfcc-42b4-a526-2c06a8a7eacf', 'sg_uuid_list': ['406fb3cb-4d71-4e27-8260-e8bb62826f67'], 'static_route_list': None, 'vm_project_uuid': 'cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-12 02:29:05,989 - DEBUG - Starting Layer 2 verification in Agent 2024-09-12 02:29:06,001 - DEBUG - Layer 2 path is seen for VM MAC 02:3a:8e:47:da:cf in agent 10.0.0.30 2024-09-12 02:29:06,001 - DEBUG - Active layer 2 route in agent is present for VMI tap3a8e47da-cf 2024-09-12 02:29:06,001 - DEBUG - L2 label(43) matches bw route table and interface table 2024-09-12 02:29:06,008 - DEBUG - VN default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is found in Agent of node 10.0.0.30 2024-09-12 02:29:06,233 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 is consistent in agent 10.0.0.30 2024-09-12 02:29:06,234 - DEBUG - Route for VM IP ['30.94.32.67'] is consistent in agent 10.0.0.30 2024-09-12 02:29:06,234 - DEBUG - VN default-domain:ctest-TestSvcRegr-40649768:ctest-mgmt_vn-24764930 verification for VM ctest-pt_svm0-42052740 in Agent 10.0.0.30 passed 2024-09-12 02:29:06,437 - DEBUG - Starting all layer 2 verification in agent 10.0.0.30 2024-09-12 02:29:06,457 - DEBUG - Route for VM MAC 02:3a:8e:47:da:cf is consistent in agent 10.0.0.30 2024-09-12 02:29:06,488 - DEBUG - VM ctest-pt_svm0-42052740 Tap interface: {'index': '7', 'name': 'tap6d025012-46', 'uuid': '6d025012-46d2-41c1-b66e-2371da5d7dfa', 'vrf_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511:ctest-right_vn-02879511', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511', 'vm_uuid': 'ab0c1a55-4f3b-435c-9725-6865b89cc7e9', 'vm_name': 'ctest-pt_svm0-42052740', 'ip_addr': '82.55.239.132', 'mac_addr': '02:6d:02:50:12:46', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '36', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-40649768:6d025012-46d2-41c1-b66e-2371da5d7dfa', 'sg_uuid_list': ['406fb3cb-4d71-4e27-8260-e8bb62826f67'], 'static_route_list': None, 'vm_project_uuid': 'cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '882bf840-0183-419a-bdf0-d59bfcbbd915', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-12 02:29:06,488 - DEBUG - Agent 10.0.0.30 vrf name: default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511:ctest-right_vn-02879511 2024-09-12 02:29:06,494 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511:ctest-right_vn-02879511', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.13:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-09-12 02:29:06,672 - DEBUG - VM ctest-pt_svm0-42052740 : Tap interface tap6d025012-46 is set to Active 2024-09-12 02:29:06,672 - DEBUG - Tap interface tap6d025012-46 detail : {'index': '7', 'name': 'tap6d025012-46', 'uuid': '6d025012-46d2-41c1-b66e-2371da5d7dfa', 'vrf_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511:ctest-right_vn-02879511', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511', 'vm_uuid': 'ab0c1a55-4f3b-435c-9725-6865b89cc7e9', 'vm_name': 'ctest-pt_svm0-42052740', 'ip_addr': '82.55.239.132', 'mac_addr': '02:6d:02:50:12:46', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '36', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-40649768:6d025012-46d2-41c1-b66e-2371da5d7dfa', 'sg_uuid_list': ['406fb3cb-4d71-4e27-8260-e8bb62826f67'], 'static_route_list': None, 'vm_project_uuid': 'cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '882bf840-0183-419a-bdf0-d59bfcbbd915', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-12 02:29:06,881 - DEBUG - Starting Layer 2 verification in Agent 2024-09-12 02:29:06,896 - DEBUG - Layer 2 path is seen for VM MAC 02:6d:02:50:12:46 in agent 10.0.0.30 2024-09-12 02:29:06,896 - DEBUG - Active layer 2 route in agent is present for VMI tap6d025012-46 2024-09-12 02:29:06,896 - DEBUG - L2 label(53) matches bw route table and interface table 2024-09-12 02:29:06,904 - DEBUG - VN default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511 is found in Agent of node 10.0.0.30 2024-09-12 02:29:07,143 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511 is consistent in agent 10.0.0.30 2024-09-12 02:29:07,143 - DEBUG - Route for VM IP ['82.55.239.132'] is consistent in agent 10.0.0.30 2024-09-12 02:29:07,143 - DEBUG - VN default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511 verification for VM ctest-pt_svm0-42052740 in Agent 10.0.0.30 passed 2024-09-12 02:29:07,349 - DEBUG - Starting all layer 2 verification in agent 10.0.0.30 2024-09-12 02:29:07,363 - DEBUG - Route for VM MAC 02:6d:02:50:12:46 is consistent in agent 10.0.0.30 2024-09-12 02:29:07,363 - INFO - VM ctest-pt_svm0-42052740 verifications in Compute nodes passed 2024-09-12 02:29:07,363 - DEBUG - The SVMs in the SI are : [] 2024-09-12 02:29:07,364 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/ab0c1a55-4f3b-435c-9725-6865b89cc7e9 2024-09-12 02:29:07,375 - DEBUG - Service VM for SI 'ctest-si-90833905' is launched 2024-09-12 02:29:07,375 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:07,382 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:07,398 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:07,494 - DEBUG - Requesting: http://10.0.0.30:8082/service-instance/a020e066-3a7e-4ba2-bf13-91955f50a3c4 2024-09-12 02:29:07,508 - DEBUG - SI ctest-si-90833905 has Port Tuple: ['ctest-port_tuple-74048922'] 2024-09-12 02:29:07,617 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-40649768:ctest-left_vn-60538135 2024-09-12 02:29:07,773 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-40649768:ctest-right_vn-02879511 2024-09-12 02:29:07,948 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:07,958 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:07,958 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:07,964 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:07,965 - INFO - Route to 82.55.239.131 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-1903-1, and SI ctest-si-90833905 is seen as the NH 2024-09-12 02:29:08,133 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:08,142 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:08,142 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:08,149 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:08,149 - INFO - Route to 35.16.124.67 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-1903-1, and SI ctest-si-90833905 is seen as the NH 2024-09-12 02:29:08,149 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:08,149 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-12 02:29:08,149 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 82.55.239.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.30, gateway password: c0ntrail123 2024-09-12 02:29:08,149 - DEBUG - ping -s 56 -c 3 -W 1 82.55.239.131 2024-09-12 02:29:12,210 - DEBUG - PING 82.55.239.131 (82.55.239.131): 56 data bytes 64 bytes from 82.55.239.131: seq=0 ttl=61 time=6.265 ms 64 bytes from 82.55.239.131: seq=1 ttl=61 time=1.884 ms 64 bytes from 82.55.239.131: seq=2 ttl=61 time=1.759 ms --- 82.55.239.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.759/3.302/6.265 ms 2024-09-12 02:29:12,211 - INFO - Ping to IP 82.55.239.131 from VM ctest-left_vm-19673248 passed 2024-09-12 02:29:12,211 - INFO - Dettaching policy ctest-policy-30795573 from vn ctest-right_vn-02879511 2024-09-12 02:29:12,461 - INFO - Dettaching policy ctest-policy-30795573 from vn ctest-left_vn-60538135 2024-09-12 02:29:12,767 - INFO - Deleted policy ctest-policy-30795573 2024-09-12 02:29:12,767 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-si-90833905'] 2024-09-12 02:29:12,871 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-40649768', 'ctest-si-90833905'] 2024-09-12 02:29:12,871 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:12,879 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:12,906 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:12,994 - DEBUG - Service instance ctest-si-90833905 removed from api server 2024-09-12 02:29:12,994 - DEBUG - Requesting: http://10.0.0.30:8082/virtual-machine/ab0c1a55-4f3b-435c-9725-6865b89cc7e9 2024-09-12 02:29:13,010 - DEBUG - All Service VMs unlinked from SI ctest-si-90833905 2024-09-12 02:29:13,016 - DEBUG - 0 svc intances found in all projects. They are [] 2024-09-12 02:29:13,016 - DEBUG - 0 svc intances found in current project. They are [] 2024-09-12 02:29:13,069 - DEBUG - 0 svc intances found in all projects. They are [] 2024-09-12 02:29:13,069 - DEBUG - 0 svc intances found in current project. They are [] 2024-09-12 02:29:13,069 - INFO - Deleting VM ctest-pt_svm0-42052740 2024-09-12 02:29:13,161 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-01889399'] 2024-09-12 02:29:13,285 - INFO - Service template: ['default-domain', 'ctest-service_template_1-01889399'] deleted successfully. 2024-09-12 02:29:13,285 - INFO - Deleting VM ctest-right_vm-53854711 2024-09-12 02:29:13,384 - INFO - Deleting VM ctest-left_vm-19673248 2024-09-12 02:29:13,486 - INFO - Deleting VN ctest-right_vn-02879511 2024-09-12 02:29:13,547 - DEBUG - VN d4c822da-6676-4413-8fb3-1a3053c5732b still in use: Unable to complete operation on network d4c822da-6676-4413-8fb3-1a3053c5732b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-16c01f44-1b7d-4ab5-bd67-70fcba98c11d'] 2024-09-12 02:29:13,547 - WARNING - Deleting VN ctest-right_vn-02879511 failed..Will retry 2024-09-12 02:29:15,687 - DEBUG - Response for deleting network () 2024-09-12 02:29:15,687 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/c917cf2a-0fd8-4e76-b48a-53ad693d2281 2024-09-12 02:29:15,696 - DEBUG - Response Code: 404 2024-09-12 02:29:15,697 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:15,704 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:15,763 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:15,851 - INFO - Validated that VN ctest-right_vn-02879511 is not found in API Server 2024-09-12 02:29:15,865 - DEBUG - VN ctest-right_vn-02879511 is not present in Agent 10.0.0.30 2024-09-12 02:29:15,865 - INFO - Validated that VN ctest-right_vn-02879511 is not in any agent 2024-09-12 02:29:15,882 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-02879511 info 2024-09-12 02:29:15,883 - INFO - Deleting VN ctest-left_vn-60538135 2024-09-12 02:29:15,998 - DEBUG - Response for deleting network () 2024-09-12 02:29:15,999 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/56579f10-57a1-4090-91b0-b4794ded636d 2024-09-12 02:29:16,009 - DEBUG - Response Code: 404 2024-09-12 02:29:16,010 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:16,019 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:16,077 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:16,160 - INFO - Validated that VN ctest-left_vn-60538135 is not found in API Server 2024-09-12 02:29:16,172 - DEBUG - VN ctest-left_vn-60538135 is not present in Agent 10.0.0.30 2024-09-12 02:29:16,172 - INFO - Validated that VN ctest-left_vn-60538135 is not in any agent 2024-09-12 02:29:16,191 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-60538135 info 2024-09-12 02:29:16,191 - INFO - Deleting VN ctest-mgmt_vn-24764930 2024-09-12 02:29:16,322 - DEBUG - Response for deleting network () 2024-09-12 02:29:16,323 - DEBUG - Requesting: http://10.0.0.30:8082/routing-instance/1e66b356-a50d-48b2-9205-0131d92f7bd1 2024-09-12 02:29:16,334 - DEBUG - Response Code: 404 2024-09-12 02:29:16,334 - DEBUG - Requesting: http://10.0.0.30:8082/domains 2024-09-12 02:29:16,342 - DEBUG - Requesting: http://10.0.0.30:8082/domain/5473d75d-2072-47eb-9dcd-620f886a599f 2024-09-12 02:29:16,401 - DEBUG - Requesting: http://10.0.0.30:8082/project/cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc 2024-09-12 02:29:16,493 - INFO - Validated that VN ctest-mgmt_vn-24764930 is not found in API Server 2024-09-12 02:29:16,506 - DEBUG - VN ctest-mgmt_vn-24764930 is not present in Agent 10.0.0.30 2024-09-12 02:29:16,506 - INFO - Validated that VN ctest-mgmt_vn-24764930 is not in any agent 2024-09-12 02:29:16,526 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-24764930 info 2024-09-12 02:29:17,076 - DEBUG - No XMPP flaps were noticed during the test 2024-09-12 02:29:17,077 - INFO - 2024-09-12 02:29:17,077 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:20] 2024-09-12 02:29:17,077 - INFO - -------------------------------------------------------------------------------- 2024-09-12 02:29:17,871 - INFO - Deleted project: ctest-TestSvcRegr-40649768, ID : cc6b5ad7-68ee-46f6-8100-70c4ab06f4dc