2025-03-27 03:55:56,572 - INFO - Domain Default found not creating 2025-03-27 03:55:56,775 - INFO - Project ctest-TestSvcRegr-63180058 not found, creating it 2025-03-27 03:55:57,267 - INFO - Created Project:ctest-TestSvcRegr-63180058, ID : 9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:55:59,425 - INFO - ================================================================================ 2025-03-27 03:55:59,425 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-03-27 03:55:59,688 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.20.0.20': '0'}} with 2025-03-27 03:55:59,688 - INFO - Initial checks done. Running the testcase now 2025-03-27 03:55:59,688 - INFO - 2025-03-27 03:56:00,297 - DEBUG - Response for create_network : {'network': {'id': '6afd00ee-8555-4532-be6f-709c2417d9a7', 'name': 'ctest-mgmt_vn-97609854', 'tenant_id': '9c8799eee7d2488ea961c58e0e4a9845', 'project_id': '9c8799eee7d2488ea961c58e0e4a9845', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-mgmt_vn-97609854'], 'port_security_enabled': True, 'description': ''}} 2025-03-27 03:56:00,471 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b50e236e-bfd3-4cd8-b7bf-ab950b4e3e59', 'name': '', 'tenant_id': '9c8799eee7d2488ea961c58e0e4a9845', 'network_id': '6afd00ee-8555-4532-be6f-709c2417d9a7', 'ip_version': 4, 'cidr': '20.83.160.0/26', 'allocation_pools': [{'start': '20.83.160.2', 'end': '20.83.160.62'}], 'gateway_ip': '20.83.160.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.83.160.2', 'tags': [], 'project_id': '9c8799eee7d2488ea961c58e0e4a9845'}} 2025-03-27 03:56:00,491 - INFO - Created VN ctest-mgmt_vn-97609854 2025-03-27 03:56:00,544 - DEBUG - VN ctest-mgmt_vn-97609854 UUID is 6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:00,665 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:00,958 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:00,991 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:56:01,008 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:56:01,089 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:01,101 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:01,114 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/72468ffa-ac9a-4e90-a906-a3c8d1d7c6ef 2025-03-27 03:56:01,123 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/72468ffa-ac9a-4e90-a906-a3c8d1d7c6ef 2025-03-27 03:56:01,131 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/832d9b97-c9f0-4e42-bf2f-676c243f3355 2025-03-27 03:56:01,139 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-03-27 03:56:01,139 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:01,151 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/72468ffa-ac9a-4e90-a906-a3c8d1d7c6ef 2025-03-27 03:56:01,171 - INFO - Verified VN network id 8 for VN 6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:01,171 - INFO - Verifications in API Server for VN ctest-mgmt_vn-97609854 passed 2025-03-27 03:56:01,171 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:01,182 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/72468ffa-ac9a-4e90-a906-a3c8d1d7c6ef 2025-03-27 03:56:01,191 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/72468ffa-ac9a-4e90-a906-a3c8d1d7c6ef 2025-03-27 03:56:01,202 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/832d9b97-c9f0-4e42-bf2f-676c243f3355 2025-03-27 03:56:01,217 - DEBUG - Control-node 10.0.0.40 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-63180058', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7709319161567331634', 'uuid-lslong': '13722310405543942567'}, 'enable': 'true', 'created': '2025-03-27T03:56:00', 'last-modified': '2025-03-27T03:56:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.783661'} 2025-03-27 03:56:01,225 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-03-27 03:56:01,225 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-97609854 passed 2025-03-27 03:56:01,225 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-97609854 in API_Server ====== 2025-03-27 03:56:01,225 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:01,232 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:56:01,248 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:56:01,325 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/6afd00ee-8555-4532-be6f-709c2417d9a7 2025-03-27 03:56:01,342 - DEBUG - =>VN ctest-mgmt_vn-97609854 has no policy to be verified 2025-03-27 03:56:01,342 - DEBUG - Verifying the vn in opserver 2025-03-27 03:56:01,342 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 virtual network link through opserver 10.0.0.40 2025-03-27 03:56:01,342 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2025-03-27 03:56:01,642 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2025-03-27 03:56:01,711 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854', 'href': 'http://10.0.0.40:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854?flat'} 2025-03-27 03:56:01,711 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is found in opserver 2025-03-27 03:56:01,724 - DEBUG - Do not have enough data to verify VN in agent 2025-03-27 03:56:01,730 - DEBUG - VRF ids for VN ctest-mgmt_vn-97609854: {} 2025-03-27 03:56:01,945 - DEBUG - Response for create_network : {'network': {'id': 'ee6fa7b2-5acb-4a93-9a78-56058e6e2d61', 'name': 'ctest-left_vn-45971511', 'tenant_id': '9c8799eee7d2488ea961c58e0e4a9845', 'project_id': '9c8799eee7d2488ea961c58e0e4a9845', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-left_vn-45971511'], 'port_security_enabled': True, 'description': ''}} 2025-03-27 03:56:02,174 - DEBUG - Response for create_subnet : {'subnet': {'id': '9a4f9ace-f608-4f16-85db-1bf5cfa955b6', 'name': '', 'tenant_id': '9c8799eee7d2488ea961c58e0e4a9845', 'network_id': 'ee6fa7b2-5acb-4a93-9a78-56058e6e2d61', 'ip_version': 4, 'cidr': '6.38.193.192/26', 'allocation_pools': [{'start': '6.38.193.194', 'end': '6.38.193.254'}], 'gateway_ip': '6.38.193.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.38.193.194', 'tags': [], 'project_id': '9c8799eee7d2488ea961c58e0e4a9845'}} 2025-03-27 03:56:02,194 - INFO - Created VN ctest-left_vn-45971511 2025-03-27 03:56:02,248 - DEBUG - VN ctest-left_vn-45971511 UUID is ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,373 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:02,379 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:56:02,392 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:56:02,467 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,480 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,494 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88b6ad19-1a66-4de5-a63c-c0b5d63d16ce 2025-03-27 03:56:02,503 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88b6ad19-1a66-4de5-a63c-c0b5d63d16ce 2025-03-27 03:56:02,513 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/62b1467a-77fc-4f8f-ad31-488a998650ad 2025-03-27 03:56:02,523 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-27 03:56:02,523 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,537 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88b6ad19-1a66-4de5-a63c-c0b5d63d16ce 2025-03-27 03:56:02,560 - INFO - Verified VN network id 9 for VN ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,560 - INFO - Verifications in API Server for VN ctest-left_vn-45971511 passed 2025-03-27 03:56:02,560 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,572 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88b6ad19-1a66-4de5-a63c-c0b5d63d16ce 2025-03-27 03:56:02,657 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88b6ad19-1a66-4de5-a63c-c0b5d63d16ce 2025-03-27 03:56:02,668 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/62b1467a-77fc-4f8f-ad31-488a998650ad 2025-03-27 03:56:02,688 - DEBUG - Control-node 10.0.0.40 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-63180058', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17181135487911021203', 'uuid-lslong': '11130741060910591329'}, 'enable': 'true', 'created': '2025-03-27T03:56:01', 'last-modified': '2025-03-27T03:56:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.550977'} 2025-03-27 03:56:02,697 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-03-27 03:56:02,697 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-45971511 passed 2025-03-27 03:56:02,697 - DEBUG - ====Verifying policy data for ctest-left_vn-45971511 in API_Server ====== 2025-03-27 03:56:02,697 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:02,706 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:56:02,719 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:56:02,801 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/ee6fa7b2-5acb-4a93-9a78-56058e6e2d61 2025-03-27 03:56:02,815 - DEBUG - =>VN ctest-left_vn-45971511 has no policy to be verified 2025-03-27 03:56:02,816 - DEBUG - Verifying the vn in opserver 2025-03-27 03:56:02,816 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511 virtual network link through opserver 10.0.0.40 2025-03-27 03:56:02,816 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2025-03-27 03:56:02,829 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511', 'href': 'http://10.0.0.40:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511?flat'} 2025-03-27 03:56:02,829 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511 is found in opserver 2025-03-27 03:56:02,844 - DEBUG - Do not have enough data to verify VN in agent 2025-03-27 03:56:02,851 - DEBUG - VRF ids for VN ctest-left_vn-45971511: {} 2025-03-27 03:56:03,107 - DEBUG - Response for create_network : {'network': {'id': '89925db6-2683-474e-b602-b67df5eef85a', 'name': 'ctest-right_vn-53451157', 'tenant_id': '9c8799eee7d2488ea961c58e0e4a9845', 'project_id': '9c8799eee7d2488ea961c58e0e4a9845', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-right_vn-53451157'], 'port_security_enabled': True, 'description': ''}} 2025-03-27 03:56:03,314 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e002ea6a-ad6f-4fbc-a861-f0051ff98fe5', 'name': '', 'tenant_id': '9c8799eee7d2488ea961c58e0e4a9845', 'network_id': '89925db6-2683-474e-b602-b67df5eef85a', 'ip_version': 4, 'cidr': '143.121.76.0/26', 'allocation_pools': [{'start': '143.121.76.2', 'end': '143.121.76.62'}], 'gateway_ip': '143.121.76.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.121.76.2', 'tags': [], 'project_id': '9c8799eee7d2488ea961c58e0e4a9845'}} 2025-03-27 03:56:03,336 - INFO - Created VN ctest-right_vn-53451157 2025-03-27 03:56:03,392 - DEBUG - VN ctest-right_vn-53451157 UUID is 89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,509 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:03,516 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:56:03,530 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:56:03,623 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,641 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,655 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88c74f59-b507-41e7-a847-370c2cf4a295 2025-03-27 03:56:03,664 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88c74f59-b507-41e7-a847-370c2cf4a295 2025-03-27 03:56:03,674 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/d2074f33-b68b-4cab-b917-5a7f3128d78a 2025-03-27 03:56:03,683 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-03-27 03:56:03,683 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,698 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88c74f59-b507-41e7-a847-370c2cf4a295 2025-03-27 03:56:03,718 - INFO - Verified VN network id 10 for VN 89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,718 - INFO - Verifications in API Server for VN ctest-right_vn-53451157 passed 2025-03-27 03:56:03,718 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,736 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88c74f59-b507-41e7-a847-370c2cf4a295 2025-03-27 03:56:03,748 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88c74f59-b507-41e7-a847-370c2cf4a295 2025-03-27 03:56:03,760 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/d2074f33-b68b-4cab-b917-5a7f3128d78a 2025-03-27 03:56:03,780 - DEBUG - Control-node 10.0.0.40 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-63180058', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9913088766707451726', 'uuid-lslong': '13115245716969551962'}, 'enable': 'true', 'created': '2025-03-27T03:56:03', 'last-modified': '2025-03-27T03:56:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.502697'} 2025-03-27 03:56:03,787 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-03-27 03:56:03,788 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-53451157 passed 2025-03-27 03:56:03,788 - DEBUG - ====Verifying policy data for ctest-right_vn-53451157 in API_Server ====== 2025-03-27 03:56:03,788 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:56:03,795 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:56:03,811 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:56:03,897 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/89925db6-2683-474e-b602-b67df5eef85a 2025-03-27 03:56:03,909 - DEBUG - =>VN ctest-right_vn-53451157 has no policy to be verified 2025-03-27 03:56:03,909 - DEBUG - Verifying the vn in opserver 2025-03-27 03:56:03,909 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157 virtual network link through opserver 10.0.0.40 2025-03-27 03:56:03,909 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2025-03-27 03:56:03,925 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157', 'href': 'http://10.0.0.40:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157?flat'} 2025-03-27 03:56:03,925 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157 is found in opserver 2025-03-27 03:56:03,941 - DEBUG - Do not have enough data to verify VN in agent 2025-03-27 03:56:03,948 - DEBUG - VRF ids for VN ctest-right_vn-53451157: {} 2025-03-27 03:56:04,030 - DEBUG - Services list from nova: [, , ] 2025-03-27 03:56:05,143 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2968-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2968-1) 2025-03-27 03:56:06,381 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2968-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2968-1) 2025-03-27 03:56:06,382 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-56573529'] 2025-03-27 03:56:06,764 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-56573529'] created succesfully 2025-03-27 03:56:07,109 - DEBUG - Image by name cirros_in_net not found 2025-03-27 03:56:07,110 - DEBUG - Installing image cirros_in_net 2025-03-27 03:56:07,110 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-03-27 03:56:07,110 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-03-27 03:56:07,110 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-03-27 03:56:07,124 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-03-27 03:56:07,397 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-03-27 03:56:07,397 - DEBUG - Unzip image 2025-03-27 03:56:07,397 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-03-27 03:56:07,555 - DEBUG - Try to create image in user context 2025-03-27 03:56:07,855 - DEBUG - Image has been created in user context 2025-03-27 03:56:07,855 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-03-27 03:56:07,878 - DEBUG - Downloaded image has been removed 2025-03-27 03:56:07,893 - DEBUG - Uploaded image status = active 2025-03-27 03:56:09,047 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2968-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2968-1) 2025-03-27 03:56:09,047 - INFO - Waiting for VM ctest-pt_svm0-65500655 to be up.. 2025-03-27 03:56:09,097 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-03-27 03:56:14,224 - DEBUG - VM is in ACTIVE state now 2025-03-27 03:56:14,224 - INFO - VM name : ctest-pt_svm0-65500655 2025-03-27 03:56:14,369 - DEBUG - VM ctest-pt_svm0-65500655 ID is 60e30190-91cb-4b7f-88a9-c1f20c00a31c 2025-03-27 03:56:14,396 - DEBUG - VM ctest-pt_svm0-65500655 launched on Node cn-jenkins-deploy-platform-ansible-os-2968-1 2025-03-27 03:56:14,716 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/60e30190-91cb-4b7f-88a9-c1f20c00a31c 2025-03-27 03:56:14,729 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/42cb3d6e-bad0-49e2-a2a3-ec01832df936 2025-03-27 03:56:14,740 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/da8151be-e245-4e6f-bf6b-a2d32363f619 2025-03-27 03:56:14,751 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/ea5da52e-9a3c-465a-b4df-ae1dd9eded62 2025-03-27 03:56:18,106 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-03-27 03:56:18,106 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-65500655 failed! 2025-03-27 03:56:18,164 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is 20.83.160.1 and allocation pool is NOT set 2025-03-27 03:56:22,226 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-03-27 03:56:22,226 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-65500655 failed! 2025-03-27 03:56:22,284 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is 20.83.160.1 and allocation pool is NOT set 2025-03-27 03:56:26,357 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-03-27 03:56:26,357 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-65500655 failed! 2025-03-27 03:56:26,420 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is 20.83.160.1 and allocation pool is NOT set 2025-03-27 03:56:30,485 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-03-27 03:56:30,485 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-65500655 failed! 2025-03-27 03:56:30,540 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is 20.83.160.1 and allocation pool is NOT set 2025-03-27 03:56:32,606 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.43 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.860 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.860/2.642/4.425/1.782 ms') 2025-03-27 03:56:32,606 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-65500655 passed 2025-03-27 03:56:32,768 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:32,768 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:32,834 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-27 03:56:32,927 - DEBUG - VM ctest-pt_svm0-65500655 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-27 03:56:37,928 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:37,929 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:37,988 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-27 03:56:38,077 - DEBUG - VM ctest-pt_svm0-65500655 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-27 03:56:43,078 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:43,078 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:43,137 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-27 03:56:43,244 - DEBUG - VM ctest-pt_svm0-65500655 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-27 03:56:48,245 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:48,246 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:48,314 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-03-27 03:56:48,413 - DEBUG - VM ctest-pt_svm0-65500655 is NOT ready for SSH connections, VM status: ACTIVE 2025-03-27 03:56:53,413 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:53,413 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:53,582 - DEBUG - VM ctest-pt_svm0-65500655 is ready for SSH connections 2025-03-27 03:56:53,740 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:53,740 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:53,896 - DEBUG - VM ctest-pt_svm0-65500655 is ready for SSH connections 2025-03-27 03:56:54,052 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:54,052 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-65500655, IP 20.83.160.3, Port 22 2025-03-27 03:56:54,218 - DEBUG - VM ctest-pt_svm0-65500655 is ready for SSH connections 2025-03-27 03:56:54,224 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-si-91833936'] 2025-03-27 03:56:55,140 - INFO - Waiting for VM ctest-left_vm-94875163 to be up.. 2025-03-27 03:56:55,238 - DEBUG - VM is in ACTIVE state now 2025-03-27 03:56:55,238 - INFO - VM name : ctest-left_vm-94875163 2025-03-27 03:56:55,334 - DEBUG - VM ctest-left_vm-94875163 ID is b1447251-758e-427a-8a12-2414322e0608 2025-03-27 03:56:55,334 - DEBUG - VM ctest-left_vm-94875163 launched on Node cn-jenkins-deploy-platform-ansible-os-2968-1 2025-03-27 03:56:55,425 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/b1447251-758e-427a-8a12-2414322e0608 2025-03-27 03:56:55,435 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/fa0bd5dd-19f8-4303-9a14-c1e445015829 2025-03-27 03:56:56,684 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.16 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.591 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.591/1.875/3.160/1.284 ms') 2025-03-27 03:56:56,684 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-94875163 passed 2025-03-27 03:56:56,840 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:56,840 - DEBUG - Waiting to SSH to VM ctest-left_vm-94875163, IP 6.38.193.195, Port 22 2025-03-27 03:56:57,006 - DEBUG - VM ctest-left_vm-94875163 is ready for SSH connections 2025-03-27 03:56:57,006 - INFO - Waiting for VM ctest-right_vm-37213654 to be up.. 2025-03-27 03:56:57,096 - DEBUG - VM is in ACTIVE state now 2025-03-27 03:56:57,097 - INFO - VM name : ctest-right_vm-37213654 2025-03-27 03:56:57,178 - DEBUG - VM ctest-right_vm-37213654 ID is 90637857-1fea-4bb0-910f-cd108836285d 2025-03-27 03:56:57,178 - DEBUG - VM ctest-right_vm-37213654 launched on Node cn-jenkins-deploy-platform-ansible-os-2968-1 2025-03-27 03:56:57,263 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/90637857-1fea-4bb0-910f-cd108836285d 2025-03-27 03:56:57,274 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/940f248f-a7b9-4973-b87e-8fc54d8b94e2 2025-03-27 03:56:58,528 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.82 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.407 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.407/2.111/3.816/1.704 ms') 2025-03-27 03:56:58,528 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-37213654 passed 2025-03-27 03:56:58,680 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:56:58,680 - DEBUG - Waiting to SSH to VM ctest-right_vm-37213654, IP 143.121.76.3, Port 22 2025-03-27 03:56:58,844 - DEBUG - VM ctest-right_vm-37213654 is ready for SSH connections 2025-03-27 03:56:58,851 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-63180058:ctest-si-91833936'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-03-27 03:56:59,296 - INFO - Attaching policy ctest-policy-85567372 to vn ctest-left_vn-45971511 2025-03-27 03:56:59,840 - INFO - Attaching policy ctest-policy-85567372 to vn ctest-right_vn-53451157 2025-03-27 03:57:00,324 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-56573529'] created succesfully 2025-03-27 03:57:00,556 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-si-91833936'] created succesfully 2025-03-27 03:57:00,556 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:00,564 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:00,582 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:00,660 - DEBUG - Requesting: http://10.0.0.40:8082/service-instance/d8cf02ee-3778-4c62-8dd9-b57c46ec9f06 2025-03-27 03:57:00,676 - DEBUG - SI 'ctest-si-91833936' has service template ref to ctest-service_template_1-56573529 2025-03-27 03:57:00,677 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:00,684 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:00,700 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:00,778 - DEBUG - Requesting: http://10.0.0.40:8082/service-instance/d8cf02ee-3778-4c62-8dd9-b57c46ec9f06 2025-03-27 03:57:00,791 - DEBUG - Requesting: http://10.0.0.40:8082/port-tuple/5883abe0-a5d0-4d7d-9ada-b0ae1f9ce6fa 2025-03-27 03:57:00,803 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/42cb3d6e-bad0-49e2-a2a3-ec01832df936 2025-03-27 03:57:00,817 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/da8151be-e245-4e6f-bf6b-a2d32363f619 2025-03-27 03:57:00,829 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/ea5da52e-9a3c-465a-b4df-ae1dd9eded62 2025-03-27 03:57:01,120 - DEBUG - VM is in ACTIVE state now 2025-03-27 03:57:01,616 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/60e30190-91cb-4b7f-88a9-c1f20c00a31c 2025-03-27 03:57:01,626 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/42cb3d6e-bad0-49e2-a2a3-ec01832df936 2025-03-27 03:57:01,639 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/da8151be-e245-4e6f-bf6b-a2d32363f619 2025-03-27 03:57:01,652 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/ea5da52e-9a3c-465a-b4df-ae1dd9eded62 2025-03-27 03:57:01,668 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/432b1606-59f5-4568-b8e4-f72536f110b4 2025-03-27 03:57:01,678 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/86e1b763-89d2-4bd7-a7d1-05252d6352da 2025-03-27 03:57:01,688 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/bede9232-c2a1-4b0e-8999-2503ace40735 2025-03-27 03:57:01,698 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/61a2e036-61d5-440b-bf8e-43e8baa89009 2025-03-27 03:57:01,707 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/7fac32eb-7aa4-42b9-b0e4-ba842a7dd814 2025-03-27 03:57:01,717 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/fdd1e3d0-7919-49f2-9bf5-29cbdab8b0d7 2025-03-27 03:57:01,726 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/3c7159fb-61c5-4e03-bc47-f7c3d6019fe8 2025-03-27 03:57:01,738 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/8aa7a255-748a-4456-8d9f-ed6feefe51ff 2025-03-27 03:57:01,747 - DEBUG - Requesting: http://10.0.0.40:8082/instance-ip/9c45995c-7f06-4f6a-955b-c54393538337 2025-03-27 03:57:02,207 - DEBUG - VM is in ACTIVE state now 2025-03-27 03:57:02,208 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/60e30190-91cb-4b7f-88a9-c1f20c00a31c 2025-03-27 03:57:02,218 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/42cb3d6e-bad0-49e2-a2a3-ec01832df936 2025-03-27 03:57:02,232 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/da8151be-e245-4e6f-bf6b-a2d32363f619 2025-03-27 03:57:02,245 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/ea5da52e-9a3c-465a-b4df-ae1dd9eded62 2025-03-27 03:57:03,498 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.76 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.844 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.844/1.301/1.758/0.457 ms') 2025-03-27 03:57:03,498 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-65500655 passed 2025-03-27 03:57:03,540 - DEBUG - VM ctest-pt_svm0-65500655 Tap interface: {'index': '6', 'name': 'tap42cb3d6e-ba', 'uuid': '42cb3d6e-bad0-49e2-a2a3-ec01832df936', 'vrf_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511:ctest-left_vn-45971511', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511', 'vm_uuid': '60e30190-91cb-4b7f-88a9-c1f20c00a31c', 'vm_name': 'ctest-pt_svm0-65500655', 'ip_addr': '6.38.193.196', 'mac_addr': '02:42:cb:3d:6e:ba', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-63180058:42cb3d6e-bad0-49e2-a2a3-ec01832df936', 'sg_uuid_list': ['87166b7e-6dfc-4783-a864-b4581da469fe'], 'static_route_list': None, 'vm_project_uuid': '9c8799ee-e7d2-488e-a961-c58e0e4a9845', 'admin_state': 'Enabled', 'flow_key_idx': '50', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'ea5da52e-9a3c-465a-b4df-ae1dd9eded62', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-27 03:57:03,540 - DEBUG - Agent 10.0.0.40 vrf name: default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511:ctest-left_vn-45971511 2025-03-27 03:57:03,546 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511:ctest-left_vn-45971511', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.20:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-03-27 03:57:03,714 - DEBUG - VM ctest-pt_svm0-65500655 : Tap interface tap42cb3d6e-ba is set to Active 2025-03-27 03:57:03,714 - DEBUG - Tap interface tap42cb3d6e-ba detail : {'index': '6', 'name': 'tap42cb3d6e-ba', 'uuid': '42cb3d6e-bad0-49e2-a2a3-ec01832df936', 'vrf_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511:ctest-left_vn-45971511', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511', 'vm_uuid': '60e30190-91cb-4b7f-88a9-c1f20c00a31c', 'vm_name': 'ctest-pt_svm0-65500655', 'ip_addr': '6.38.193.196', 'mac_addr': '02:42:cb:3d:6e:ba', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-63180058:42cb3d6e-bad0-49e2-a2a3-ec01832df936', 'sg_uuid_list': ['87166b7e-6dfc-4783-a864-b4581da469fe'], 'static_route_list': None, 'vm_project_uuid': '9c8799ee-e7d2-488e-a961-c58e0e4a9845', 'admin_state': 'Enabled', 'flow_key_idx': '50', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'ea5da52e-9a3c-465a-b4df-ae1dd9eded62', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-27 03:57:03,916 - DEBUG - Starting Layer 2 verification in Agent 2025-03-27 03:57:03,930 - DEBUG - Layer 2 path is seen for VM MAC 02:42:cb:3d:6e:ba in agent 10.0.0.40 2025-03-27 03:57:03,930 - DEBUG - Active layer 2 route in agent is present for VMI tap42cb3d6e-ba 2025-03-27 03:57:03,930 - DEBUG - L2 label(48) matches bw route table and interface table 2025-03-27 03:57:03,936 - DEBUG - VN default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511 is found in Agent of node 10.0.0.40 2025-03-27 03:57:04,156 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511 is consistent in agent 10.0.0.40 2025-03-27 03:57:04,156 - DEBUG - Route for VM IP ['6.38.193.196'] is consistent in agent 10.0.0.40 2025-03-27 03:57:04,156 - DEBUG - VN default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511 verification for VM ctest-pt_svm0-65500655 in Agent 10.0.0.40 passed 2025-03-27 03:57:04,352 - DEBUG - Starting all layer 2 verification in agent 10.0.0.40 2025-03-27 03:57:04,366 - DEBUG - Route for VM MAC 02:42:cb:3d:6e:ba is consistent in agent 10.0.0.40 2025-03-27 03:57:04,397 - DEBUG - VM ctest-pt_svm0-65500655 Tap interface: {'index': '5', 'name': 'tapda8151be-e2', 'uuid': 'da8151be-e245-4e6f-bf6b-a2d32363f619', 'vrf_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854:ctest-mgmt_vn-97609854', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854', 'vm_uuid': '60e30190-91cb-4b7f-88a9-c1f20c00a31c', 'vm_name': 'ctest-pt_svm0-65500655', 'ip_addr': '20.83.160.3', 'mac_addr': '02:da:81:51:be:e2', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-63180058:da8151be-e245-4e6f-bf6b-a2d32363f619', 'sg_uuid_list': ['87166b7e-6dfc-4783-a864-b4581da469fe'], 'static_route_list': None, 'vm_project_uuid': '9c8799ee-e7d2-488e-a961-c58e0e4a9845', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-27 03:57:04,397 - DEBUG - Agent 10.0.0.40 vrf name: default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854:ctest-mgmt_vn-97609854 2025-03-27 03:57:04,404 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854:ctest-mgmt_vn-97609854', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.20:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-03-27 03:57:04,576 - DEBUG - VM ctest-pt_svm0-65500655 : Tap interface tapda8151be-e2 is set to Active 2025-03-27 03:57:04,576 - DEBUG - Tap interface tapda8151be-e2 detail : {'index': '5', 'name': 'tapda8151be-e2', 'uuid': 'da8151be-e245-4e6f-bf6b-a2d32363f619', 'vrf_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854:ctest-mgmt_vn-97609854', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854', 'vm_uuid': '60e30190-91cb-4b7f-88a9-c1f20c00a31c', 'vm_name': 'ctest-pt_svm0-65500655', 'ip_addr': '20.83.160.3', 'mac_addr': '02:da:81:51:be:e2', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-63180058:da8151be-e245-4e6f-bf6b-a2d32363f619', 'sg_uuid_list': ['87166b7e-6dfc-4783-a864-b4581da469fe'], 'static_route_list': None, 'vm_project_uuid': '9c8799ee-e7d2-488e-a961-c58e0e4a9845', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-27 03:57:04,780 - DEBUG - Starting Layer 2 verification in Agent 2025-03-27 03:57:04,793 - DEBUG - Layer 2 path is seen for VM MAC 02:da:81:51:be:e2 in agent 10.0.0.40 2025-03-27 03:57:04,794 - DEBUG - Active layer 2 route in agent is present for VMI tapda8151be-e2 2025-03-27 03:57:04,794 - DEBUG - L2 label(43) matches bw route table and interface table 2025-03-27 03:57:04,801 - DEBUG - VN default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is found in Agent of node 10.0.0.40 2025-03-27 03:57:05,018 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 is consistent in agent 10.0.0.40 2025-03-27 03:57:05,018 - DEBUG - Route for VM IP ['20.83.160.3'] is consistent in agent 10.0.0.40 2025-03-27 03:57:05,019 - DEBUG - VN default-domain:ctest-TestSvcRegr-63180058:ctest-mgmt_vn-97609854 verification for VM ctest-pt_svm0-65500655 in Agent 10.0.0.40 passed 2025-03-27 03:57:05,216 - DEBUG - Starting all layer 2 verification in agent 10.0.0.40 2025-03-27 03:57:05,228 - DEBUG - Route for VM MAC 02:da:81:51:be:e2 is consistent in agent 10.0.0.40 2025-03-27 03:57:05,252 - DEBUG - VM ctest-pt_svm0-65500655 Tap interface: {'index': '7', 'name': 'tapea5da52e-9a', 'uuid': 'ea5da52e-9a3c-465a-b4df-ae1dd9eded62', 'vrf_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157:ctest-right_vn-53451157', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157', 'vm_uuid': '60e30190-91cb-4b7f-88a9-c1f20c00a31c', 'vm_name': 'ctest-pt_svm0-65500655', 'ip_addr': '143.121.76.4', 'mac_addr': '02:ea:5d:a5:2e:9a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-63180058:ea5da52e-9a3c-465a-b4df-ae1dd9eded62', 'sg_uuid_list': ['87166b7e-6dfc-4783-a864-b4581da469fe'], 'static_route_list': None, 'vm_project_uuid': '9c8799ee-e7d2-488e-a961-c58e0e4a9845', 'admin_state': 'Enabled', 'flow_key_idx': '56', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '42cb3d6e-bad0-49e2-a2a3-ec01832df936', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-27 03:57:05,253 - DEBUG - Agent 10.0.0.40 vrf name: default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157:ctest-right_vn-53451157 2025-03-27 03:57:05,260 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157:ctest-right_vn-53451157', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.20:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-03-27 03:57:05,429 - DEBUG - VM ctest-pt_svm0-65500655 : Tap interface tapea5da52e-9a is set to Active 2025-03-27 03:57:05,429 - DEBUG - Tap interface tapea5da52e-9a detail : {'index': '7', 'name': 'tapea5da52e-9a', 'uuid': 'ea5da52e-9a3c-465a-b4df-ae1dd9eded62', 'vrf_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157:ctest-right_vn-53451157', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157', 'vm_uuid': '60e30190-91cb-4b7f-88a9-c1f20c00a31c', 'vm_name': 'ctest-pt_svm0-65500655', 'ip_addr': '143.121.76.4', 'mac_addr': '02:ea:5d:a5:2e:9a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-63180058:ea5da52e-9a3c-465a-b4df-ae1dd9eded62', 'sg_uuid_list': ['87166b7e-6dfc-4783-a864-b4581da469fe'], 'static_route_list': None, 'vm_project_uuid': '9c8799ee-e7d2-488e-a961-c58e0e4a9845', 'admin_state': 'Enabled', 'flow_key_idx': '56', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '42cb3d6e-bad0-49e2-a2a3-ec01832df936', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-03-27 03:57:05,628 - DEBUG - Starting Layer 2 verification in Agent 2025-03-27 03:57:05,642 - DEBUG - Layer 2 path is seen for VM MAC 02:ea:5d:a5:2e:9a in agent 10.0.0.40 2025-03-27 03:57:05,642 - DEBUG - Active layer 2 route in agent is present for VMI tapea5da52e-9a 2025-03-27 03:57:05,642 - DEBUG - L2 label(53) matches bw route table and interface table 2025-03-27 03:57:05,649 - DEBUG - VN default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157 is found in Agent of node 10.0.0.40 2025-03-27 03:57:05,867 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157 is consistent in agent 10.0.0.40 2025-03-27 03:57:05,867 - DEBUG - Route for VM IP ['143.121.76.4'] is consistent in agent 10.0.0.40 2025-03-27 03:57:05,867 - DEBUG - VN default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157 verification for VM ctest-pt_svm0-65500655 in Agent 10.0.0.40 passed 2025-03-27 03:57:06,068 - DEBUG - Starting all layer 2 verification in agent 10.0.0.40 2025-03-27 03:57:06,083 - DEBUG - Route for VM MAC 02:ea:5d:a5:2e:9a is consistent in agent 10.0.0.40 2025-03-27 03:57:06,083 - INFO - VM ctest-pt_svm0-65500655 verifications in Compute nodes passed 2025-03-27 03:57:06,083 - DEBUG - The SVMs in the SI are : [] 2025-03-27 03:57:06,083 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/60e30190-91cb-4b7f-88a9-c1f20c00a31c 2025-03-27 03:57:06,093 - DEBUG - Service VM for SI 'ctest-si-91833936' is launched 2025-03-27 03:57:06,093 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:06,099 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:06,117 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:06,195 - DEBUG - Requesting: http://10.0.0.40:8082/service-instance/d8cf02ee-3778-4c62-8dd9-b57c46ec9f06 2025-03-27 03:57:06,205 - DEBUG - SI ctest-si-91833936 has Port Tuple: ['ctest-port_tuple-40295125'] 2025-03-27 03:57:06,316 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-63180058:ctest-left_vn-45971511 2025-03-27 03:57:06,472 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-63180058:ctest-right_vn-53451157 2025-03-27 03:57:06,632 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,641 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,641 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,649 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,649 - INFO - Route to 143.121.76.3 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-2968-1, and SI ctest-si-91833936 is seen as the NH 2025-03-27 03:57:06,813 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,823 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,824 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,835 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,835 - INFO - Route to 6.38.193.195 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-2968-1, and SI ctest-si-91833936 is seen as the NH 2025-03-27 03:57:06,835 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,836 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-03-27 03:57:06,836 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 143.121.76.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-03-27 03:57:06,836 - DEBUG - ping -s 56 -c 3 -W 1 143.121.76.3 2025-03-27 03:57:10,497 - DEBUG - PING 143.121.76.3 (143.121.76.3): 56 data bytes 64 bytes from 143.121.76.3: seq=0 ttl=61 time=6.180 ms 64 bytes from 143.121.76.3: seq=1 ttl=61 time=2.064 ms 64 bytes from 143.121.76.3: seq=2 ttl=61 time=1.689 ms --- 143.121.76.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.689/3.311/6.180 ms 2025-03-27 03:57:10,498 - INFO - Ping to IP 143.121.76.3 from VM ctest-left_vm-94875163 passed 2025-03-27 03:57:10,498 - INFO - Dettaching policy ctest-policy-85567372 from vn ctest-right_vn-53451157 2025-03-27 03:57:10,724 - INFO - Dettaching policy ctest-policy-85567372 from vn ctest-left_vn-45971511 2025-03-27 03:57:11,015 - INFO - Deleted policy ctest-policy-85567372 2025-03-27 03:57:11,015 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-si-91833936'] 2025-03-27 03:57:11,133 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-63180058', 'ctest-si-91833936'] 2025-03-27 03:57:11,133 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:11,139 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:11,156 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:11,228 - DEBUG - Service instance ctest-si-91833936 removed from api server 2025-03-27 03:57:11,229 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/60e30190-91cb-4b7f-88a9-c1f20c00a31c 2025-03-27 03:57:11,238 - DEBUG - All Service VMs unlinked from SI ctest-si-91833936 2025-03-27 03:57:11,245 - DEBUG - 0 svc intances found in all projects. They are [] 2025-03-27 03:57:11,245 - DEBUG - 0 svc intances found in current project. They are [] 2025-03-27 03:57:11,292 - DEBUG - 0 svc intances found in all projects. They are [] 2025-03-27 03:57:11,292 - DEBUG - 0 svc intances found in current project. They are [] 2025-03-27 03:57:11,292 - INFO - Deleting VM ctest-pt_svm0-65500655 2025-03-27 03:57:11,389 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-56573529'] 2025-03-27 03:57:11,476 - INFO - Service template: ['default-domain', 'ctest-service_template_1-56573529'] deleted successfully. 2025-03-27 03:57:11,476 - INFO - Deleting VM ctest-right_vm-37213654 2025-03-27 03:57:11,559 - INFO - Deleting VM ctest-left_vm-94875163 2025-03-27 03:57:11,650 - INFO - Deleting VN ctest-right_vn-53451157 2025-03-27 03:57:11,691 - DEBUG - VN 89925db6-2683-474e-b602-b67df5eef85a still in use: Unable to complete operation on network 89925db6-2683-474e-b602-b67df5eef85a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c6109429-c247-4263-a3ce-bdc89ab5958c'] 2025-03-27 03:57:11,691 - WARNING - Deleting VN ctest-right_vn-53451157 failed..Will retry 2025-03-27 03:57:13,812 - DEBUG - Response for deleting network () 2025-03-27 03:57:13,813 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88c74f59-b507-41e7-a847-370c2cf4a295 2025-03-27 03:57:13,820 - DEBUG - Response Code: 404 2025-03-27 03:57:13,821 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:13,829 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:13,885 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:13,963 - INFO - Validated that VN ctest-right_vn-53451157 is not found in API Server 2025-03-27 03:57:13,975 - DEBUG - VN ctest-right_vn-53451157 is not present in Agent 10.0.0.40 2025-03-27 03:57:13,975 - INFO - Validated that VN ctest-right_vn-53451157 is not in any agent 2025-03-27 03:57:13,992 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-53451157 info 2025-03-27 03:57:13,992 - INFO - Deleting VN ctest-left_vn-45971511 2025-03-27 03:57:14,116 - DEBUG - Response for deleting network () 2025-03-27 03:57:14,116 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/88b6ad19-1a66-4de5-a63c-c0b5d63d16ce 2025-03-27 03:57:14,125 - DEBUG - Response Code: 404 2025-03-27 03:57:14,126 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:14,133 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:14,191 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:14,263 - INFO - Validated that VN ctest-left_vn-45971511 is not found in API Server 2025-03-27 03:57:14,276 - DEBUG - VN ctest-left_vn-45971511 is not present in Agent 10.0.0.40 2025-03-27 03:57:14,276 - INFO - Validated that VN ctest-left_vn-45971511 is not in any agent 2025-03-27 03:57:14,300 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-45971511 info 2025-03-27 03:57:14,300 - INFO - Deleting VN ctest-mgmt_vn-97609854 2025-03-27 03:57:14,426 - DEBUG - Response for deleting network () 2025-03-27 03:57:14,426 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/72468ffa-ac9a-4e90-a906-a3c8d1d7c6ef 2025-03-27 03:57:14,436 - DEBUG - Response Code: 404 2025-03-27 03:57:14,436 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-03-27 03:57:14,447 - DEBUG - Requesting: http://10.0.0.40:8082/domain/ca30c62f-2eec-4273-83ff-f72d188cdb78 2025-03-27 03:57:14,502 - DEBUG - Requesting: http://10.0.0.40:8082/project/9c8799ee-e7d2-488e-a961-c58e0e4a9845 2025-03-27 03:57:14,576 - INFO - Validated that VN ctest-mgmt_vn-97609854 is not found in API Server 2025-03-27 03:57:14,588 - DEBUG - VN ctest-mgmt_vn-97609854 is not present in Agent 10.0.0.40 2025-03-27 03:57:14,588 - INFO - Validated that VN ctest-mgmt_vn-97609854 is not in any agent 2025-03-27 03:57:14,605 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-97609854 info 2025-03-27 03:57:14,878 - DEBUG - No XMPP flaps were noticed during the test 2025-03-27 03:57:14,878 - INFO -
2025-03-27 03:57:14,878 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:15]
2025-03-27 03:57:14,878 - INFO - -------------------------------------------------------------------------------- 2025-03-27 03:57:15,598 - INFO - Deleted project: ctest-TestSvcRegr-63180058, ID : 9c8799ee-e7d2-488e-a961-c58e0e4a9845