2024-10-24 16:20:29,016 - INFO - Domain Default found not creating 2024-10-24 16:20:29,253 - INFO - Project ctest-TestSvcRegr-33645646 not found, creating it 2024-10-24 16:20:29,798 - INFO - Created Project:ctest-TestSvcRegr-33645646, ID : 322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:31,486 - INFO - ================================================================================ 2024-10-24 16:20:31,486 - INFO - STARTING TEST : test_svc_in_network_datapath 2024-10-24 16:20:31,746 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.10': '0'}} with 2024-10-24 16:20:31,746 - INFO - Initial checks done. Running the testcase now 2024-10-24 16:20:31,746 - INFO - 2024-10-24 16:20:32,437 - DEBUG - Response for create_network : {'network': {'id': '2e6da088-e20e-4813-9b1a-72fb412a88c6', 'name': 'ctest-mgmt_vn-92359881', 'tenant_id': '322d24df509f45d3b4a5ff8bfc665498', 'project_id': '322d24df509f45d3b4a5ff8bfc665498', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-mgmt_vn-92359881'], 'port_security_enabled': True, 'description': ''}} 2024-10-24 16:20:32,621 - DEBUG - Response for create_subnet : {'subnet': {'id': '8f7f4725-3cfb-4923-afdb-216769c74b26', 'name': '', 'tenant_id': '322d24df509f45d3b4a5ff8bfc665498', 'network_id': '2e6da088-e20e-4813-9b1a-72fb412a88c6', 'ip_version': 4, 'cidr': '191.238.0.64/26', 'allocation_pools': [{'start': '191.238.0.66', 'end': '191.238.0.126'}], 'gateway_ip': '191.238.0.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.238.0.66', 'tags': [], 'project_id': '322d24df509f45d3b4a5ff8bfc665498'}} 2024-10-24 16:20:32,645 - INFO - Created VN ctest-mgmt_vn-92359881 2024-10-24 16:20:32,703 - DEBUG - VN ctest-mgmt_vn-92359881 UUID is 2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:32,842 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:33,155 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:33,195 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:20:33,213 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:33,309 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:33,328 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:33,345 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7b89b8cb-de81-477f-a27d-8bed058ba96d 2024-10-24 16:20:33,356 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7b89b8cb-de81-477f-a27d-8bed058ba96d 2024-10-24 16:20:33,369 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/b52ff382-9614-4d18-9382-d3ff3847529c 2024-10-24 16:20:33,380 - DEBUG - Route Targets: ['target:64512:8000004'] 2024-10-24 16:20:33,380 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:33,398 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7b89b8cb-de81-477f-a27d-8bed058ba96d 2024-10-24 16:20:33,423 - INFO - Verified VN network id 7 for VN 2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:33,423 - INFO - Verifications in API Server for VN ctest-mgmt_vn-92359881 passed 2024-10-24 16:20:33,423 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:33,442 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7b89b8cb-de81-477f-a27d-8bed058ba96d 2024-10-24 16:20:33,454 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7b89b8cb-de81-477f-a27d-8bed058ba96d 2024-10-24 16:20:33,464 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/b52ff382-9614-4d18-9382-d3ff3847529c 2024-10-24 16:20:33,480 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33645646', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3345506607974729747', 'uuid-lslong': '11176371848728971462'}, 'enable': 'true', 'created': '2024-10-24T16:20:32', 'last-modified': '2024-10-24T16:20:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.901442'} 2024-10-24 16:20:33,489 - DEBUG - Route Targets: ['target:64512:8000004'] 2024-10-24 16:20:33,489 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-92359881 passed 2024-10-24 16:20:33,490 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-92359881 in API_Server ====== 2024-10-24 16:20:33,490 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:33,497 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:20:33,513 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:33,608 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/2e6da088-e20e-4813-9b1a-72fb412a88c6 2024-10-24 16:20:33,625 - DEBUG - =>VN ctest-mgmt_vn-92359881 has no policy to be verified 2024-10-24 16:20:33,625 - DEBUG - Verifying the vn in opserver 2024-10-24 16:20:33,625 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 virtual network link through opserver 10.0.0.27 2024-10-24 16:20:33,626 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-10-24 16:20:33,933 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-10-24 16:20:34,012 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881?flat'} 2024-10-24 16:20:34,012 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is found in opserver 2024-10-24 16:20:34,024 - DEBUG - Do not have enough data to verify VN in agent 2024-10-24 16:20:34,031 - DEBUG - VRF ids for VN ctest-mgmt_vn-92359881: {} 2024-10-24 16:20:34,278 - DEBUG - Response for create_network : {'network': {'id': '61cb39f8-6e7a-42f9-bd26-74507222eb78', 'name': 'ctest-left_vn-37146926', 'tenant_id': '322d24df509f45d3b4a5ff8bfc665498', 'project_id': '322d24df509f45d3b4a5ff8bfc665498', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926'], 'port_security_enabled': True, 'description': ''}} 2024-10-24 16:20:34,516 - DEBUG - Response for create_subnet : {'subnet': {'id': '170ba35b-ef29-470e-b7c3-d8878553c608', 'name': '', 'tenant_id': '322d24df509f45d3b4a5ff8bfc665498', 'network_id': '61cb39f8-6e7a-42f9-bd26-74507222eb78', 'ip_version': 4, 'cidr': '107.40.247.192/26', 'allocation_pools': [{'start': '107.40.247.194', 'end': '107.40.247.254'}], 'gateway_ip': '107.40.247.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '107.40.247.194', 'tags': [], 'project_id': '322d24df509f45d3b4a5ff8bfc665498'}} 2024-10-24 16:20:34,543 - INFO - Created VN ctest-left_vn-37146926 2024-10-24 16:20:34,611 - DEBUG - VN ctest-left_vn-37146926 UUID is 61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:34,746 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:34,754 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:20:34,772 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:34,869 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:34,887 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:34,904 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/699162dd-eb6f-4273-b423-806d99634ad9 2024-10-24 16:20:34,915 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/699162dd-eb6f-4273-b423-806d99634ad9 2024-10-24 16:20:34,926 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5bf75f73-45ec-4d39-b099-94f4cede3159 2024-10-24 16:20:34,936 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-24 16:20:34,936 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:34,952 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/699162dd-eb6f-4273-b423-806d99634ad9 2024-10-24 16:20:34,976 - INFO - Verified VN network id 8 for VN 61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:34,977 - INFO - Verifications in API Server for VN ctest-left_vn-37146926 passed 2024-10-24 16:20:34,977 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:34,994 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/699162dd-eb6f-4273-b423-806d99634ad9 2024-10-24 16:20:35,006 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/699162dd-eb6f-4273-b423-806d99634ad9 2024-10-24 16:20:35,017 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5bf75f73-45ec-4d39-b099-94f4cede3159 2024-10-24 16:20:35,034 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33645646', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7046789781119451897', 'uuid-lslong': '13629709211144481656'}, 'enable': 'true', 'created': '2024-10-24T16:20:34', 'last-modified': '2024-10-24T16:20:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.583081'} 2024-10-24 16:20:35,042 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-24 16:20:35,042 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-37146926 passed 2024-10-24 16:20:35,042 - DEBUG - ====Verifying policy data for ctest-left_vn-37146926 in API_Server ====== 2024-10-24 16:20:35,042 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:35,051 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:20:35,067 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:35,161 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/61cb39f8-6e7a-42f9-bd26-74507222eb78 2024-10-24 16:20:35,178 - DEBUG - =>VN ctest-left_vn-37146926 has no policy to be verified 2024-10-24 16:20:35,179 - DEBUG - Verifying the vn in opserver 2024-10-24 16:20:35,179 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926 virtual network link through opserver 10.0.0.27 2024-10-24 16:20:35,179 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-10-24 16:20:35,192 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926?flat'} 2024-10-24 16:20:35,192 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926 is found in opserver 2024-10-24 16:20:35,205 - DEBUG - Do not have enough data to verify VN in agent 2024-10-24 16:20:35,211 - DEBUG - VRF ids for VN ctest-left_vn-37146926: {} 2024-10-24 16:20:35,437 - DEBUG - Response for create_network : {'network': {'id': '7abbe994-7af0-4d1d-88fe-7fe1d614b452', 'name': 'ctest-right_vn-69535800', 'tenant_id': '322d24df509f45d3b4a5ff8bfc665498', 'project_id': '322d24df509f45d3b4a5ff8bfc665498', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-right_vn-69535800'], 'port_security_enabled': True, 'description': ''}} 2024-10-24 16:20:35,634 - DEBUG - Response for create_subnet : {'subnet': {'id': '0d5f781c-68b6-4b10-a07a-942df2d81204', 'name': '', 'tenant_id': '322d24df509f45d3b4a5ff8bfc665498', 'network_id': '7abbe994-7af0-4d1d-88fe-7fe1d614b452', 'ip_version': 4, 'cidr': '198.117.253.0/26', 'allocation_pools': [{'start': '198.117.253.2', 'end': '198.117.253.62'}], 'gateway_ip': '198.117.253.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.117.253.2', 'tags': [], 'project_id': '322d24df509f45d3b4a5ff8bfc665498'}} 2024-10-24 16:20:35,659 - INFO - Created VN ctest-right_vn-69535800 2024-10-24 16:20:35,724 - DEBUG - VN ctest-right_vn-69535800 UUID is 7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:35,860 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:35,868 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:20:35,883 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:35,971 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:35,989 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:36,004 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b314842d-18ae-4698-882a-2ed05de814bf 2024-10-24 16:20:36,015 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b314842d-18ae-4698-882a-2ed05de814bf 2024-10-24 16:20:36,028 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/716e1f3a-f791-445f-84b7-7edac198d1d3 2024-10-24 16:20:36,039 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-10-24 16:20:36,039 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:36,056 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b314842d-18ae-4698-882a-2ed05de814bf 2024-10-24 16:20:36,084 - INFO - Verified VN network id 9 for VN 7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:36,084 - INFO - Verifications in API Server for VN ctest-right_vn-69535800 passed 2024-10-24 16:20:36,084 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:36,104 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b314842d-18ae-4698-882a-2ed05de814bf 2024-10-24 16:20:36,115 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b314842d-18ae-4698-882a-2ed05de814bf 2024-10-24 16:20:36,126 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/716e1f3a-f791-445f-84b7-7edac198d1d3 2024-10-24 16:20:36,144 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-33645646', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8843919117199101213', 'uuid-lslong': '9871468041178756178'}, 'enable': 'true', 'created': '2024-10-24T16:20:35', 'last-modified': '2024-10-24T16:20:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.556292'} 2024-10-24 16:20:36,153 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-10-24 16:20:36,154 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-69535800 passed 2024-10-24 16:20:36,154 - DEBUG - ====Verifying policy data for ctest-right_vn-69535800 in API_Server ====== 2024-10-24 16:20:36,154 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:20:36,162 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:20:36,179 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:20:36,268 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7abbe994-7af0-4d1d-88fe-7fe1d614b452 2024-10-24 16:20:36,284 - DEBUG - =>VN ctest-right_vn-69535800 has no policy to be verified 2024-10-24 16:20:36,284 - DEBUG - Verifying the vn in opserver 2024-10-24 16:20:36,284 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800 virtual network link through opserver 10.0.0.27 2024-10-24 16:20:36,284 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-10-24 16:20:36,300 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800?flat'} 2024-10-24 16:20:36,300 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800 is found in opserver 2024-10-24 16:20:36,313 - DEBUG - Do not have enough data to verify VN in agent 2024-10-24 16:20:36,320 - DEBUG - VRF ids for VN ctest-right_vn-69535800: {} 2024-10-24 16:20:36,391 - DEBUG - Services list from nova: [, , ] 2024-10-24 16:20:37,563 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2143-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2143-1) 2024-10-24 16:20:38,919 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2143-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2143-1) 2024-10-24 16:20:38,920 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-09195581'] 2024-10-24 16:20:39,315 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09195581'] created succesfully 2024-10-24 16:20:39,701 - DEBUG - Image by name cirros_in_net not found 2024-10-24 16:20:39,701 - DEBUG - Installing image cirros_in_net 2024-10-24 16:20:39,701 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'vcpath': '/images/vcenter/', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2024-10-24 16:20:39,702 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-10-24 16:20:39,702 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-10-24 16:20:39,718 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2024-10-24 16:20:40,026 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2024-10-24 16:20:40,026 - DEBUG - Unzip image 2024-10-24 16:20:40,027 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2024-10-24 16:20:40,188 - DEBUG - Try to create image in user context 2024-10-24 16:20:40,469 - DEBUG - Image has been created in user context 2024-10-24 16:20:40,469 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2024-10-24 16:20:40,487 - DEBUG - Downloaded image has been removed 2024-10-24 16:20:40,506 - DEBUG - Uploaded image status = active 2024-10-24 16:20:41,841 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2143-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2143-1) 2024-10-24 16:20:41,842 - INFO - Waiting for VM ctest-pt_svm0-77213148 to be up.. 2024-10-24 16:20:41,900 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-24 16:20:47,017 - DEBUG - VM is in ACTIVE state now 2024-10-24 16:20:47,017 - INFO - VM name : ctest-pt_svm0-77213148 2024-10-24 16:20:47,127 - DEBUG - VM ctest-pt_svm0-77213148 ID is 3ad13ee7-d04d-488d-8207-eaffdb6b8ce2 2024-10-24 16:20:47,156 - DEBUG - VM ctest-pt_svm0-77213148 launched on Node cn-jenkins-deploy-platform-ansible-os-2143-1 2024-10-24 16:20:47,491 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3ad13ee7-d04d-488d-8207-eaffdb6b8ce2 2024-10-24 16:20:47,504 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/2bd4a258-702e-40c4-b635-ee9a276a8007 2024-10-24 16:20:47,522 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/64b603da-b4d7-4639-bc17-81d3d98e2e88 2024-10-24 16:20:47,543 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/be7ca800-331d-48e0-9005-10515ff6ebcc 2024-10-24 16:20:50,870 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2024-10-24 16:20:50,870 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-77213148 failed! 2024-10-24 16:20:50,939 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is 191.238.0.65 and allocation pool is NOT set 2024-10-24 16:20:55,035 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2024-10-24 16:20:55,035 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-77213148 failed! 2024-10-24 16:20:55,099 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is 191.238.0.65 and allocation pool is NOT set 2024-10-24 16:20:59,166 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2024-10-24 16:20:59,166 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-77213148 failed! 2024-10-24 16:20:59,231 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is 191.238.0.65 and allocation pool is NOT set 2024-10-24 16:21:03,317 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2024-10-24 16:21:03,317 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-77213148 failed! 2024-10-24 16:21:03,379 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is 191.238.0.65 and allocation pool is NOT set 2024-10-24 16:21:05,438 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=5.00 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.889 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.889/2.946/5.004/2.057 ms') 2024-10-24 16:21:05,438 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-77213148 passed 2024-10-24 16:21:05,607 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:05,607 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:05,673 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-24 16:21:05,795 - DEBUG - VM ctest-pt_svm0-77213148 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-24 16:21:10,796 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:10,796 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:10,861 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-24 16:21:10,967 - DEBUG - VM ctest-pt_svm0-77213148 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-24 16:21:15,968 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:15,968 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:16,038 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-24 16:21:16,156 - DEBUG - VM ctest-pt_svm0-77213148 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-24 16:21:21,157 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:21,157 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:21,229 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-24 16:21:21,342 - DEBUG - VM ctest-pt_svm0-77213148 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-24 16:21:26,342 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:26,343 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:26,515 - DEBUG - VM ctest-pt_svm0-77213148 is ready for SSH connections 2024-10-24 16:21:26,687 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:26,687 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:26,859 - DEBUG - VM ctest-pt_svm0-77213148 is ready for SSH connections 2024-10-24 16:21:27,027 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:27,027 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-77213148, IP 191.238.0.67, Port 22 2024-10-24 16:21:27,202 - DEBUG - VM ctest-pt_svm0-77213148 is ready for SSH connections 2024-10-24 16:21:27,211 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-si-88656612'] 2024-10-24 16:21:28,203 - INFO - Waiting for VM ctest-left_vm-88738273 to be up.. 2024-10-24 16:21:28,306 - DEBUG - VM is in ACTIVE state now 2024-10-24 16:21:28,306 - INFO - VM name : ctest-left_vm-88738273 2024-10-24 16:21:28,411 - DEBUG - VM ctest-left_vm-88738273 ID is 1231fc94-4888-4a1e-98cd-e6f01b8ec43e 2024-10-24 16:21:28,411 - DEBUG - VM ctest-left_vm-88738273 launched on Node cn-jenkins-deploy-platform-ansible-os-2143-1 2024-10-24 16:21:28,531 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/1231fc94-4888-4a1e-98cd-e6f01b8ec43e 2024-10-24 16:21:28,542 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/9e9502e3-a565-482c-bb21-b9ffd90678a3 2024-10-24 16:21:29,812 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.71 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.421 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.421/2.067/3.714/1.646 ms') 2024-10-24 16:21:29,812 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-88738273 passed 2024-10-24 16:21:29,975 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:29,975 - DEBUG - Waiting to SSH to VM ctest-left_vm-88738273, IP 107.40.247.195, Port 22 2024-10-24 16:21:30,141 - DEBUG - VM ctest-left_vm-88738273 is ready for SSH connections 2024-10-24 16:21:30,141 - INFO - Waiting for VM ctest-right_vm-63188524 to be up.. 2024-10-24 16:21:30,240 - DEBUG - VM is in ACTIVE state now 2024-10-24 16:21:30,240 - INFO - VM name : ctest-right_vm-63188524 2024-10-24 16:21:30,343 - DEBUG - VM ctest-right_vm-63188524 ID is b464ffdf-e70a-4d27-8d0b-a880a8dbef8a 2024-10-24 16:21:30,343 - DEBUG - VM ctest-right_vm-63188524 launched on Node cn-jenkins-deploy-platform-ansible-os-2143-1 2024-10-24 16:21:30,434 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/b464ffdf-e70a-4d27-8d0b-a880a8dbef8a 2024-10-24 16:21:30,445 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/eed1082a-2cde-48a8-b08e-374546d23df2 2024-10-24 16:21:31,708 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.08 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.678 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.678/1.876/3.075/1.198 ms') 2024-10-24 16:21:31,708 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-63188524 passed 2024-10-24 16:21:31,879 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-24 16:21:31,879 - DEBUG - Waiting to SSH to VM ctest-right_vm-63188524, IP 198.117.253.3, Port 22 2024-10-24 16:21:32,057 - DEBUG - VM ctest-right_vm-63188524 is ready for SSH connections 2024-10-24 16:21:32,065 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-33645646:ctest-si-88656612'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2024-10-24 16:21:32,527 - INFO - Attaching policy ctest-policy-12424979 to vn ctest-left_vn-37146926 2024-10-24 16:21:33,104 - INFO - Attaching policy ctest-policy-12424979 to vn ctest-right_vn-69535800 2024-10-24 16:21:33,591 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09195581'] created succesfully 2024-10-24 16:21:33,839 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-si-88656612'] created succesfully 2024-10-24 16:21:33,839 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:21:33,848 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:21:33,866 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:21:33,959 - DEBUG - Requesting: http://10.0.0.27:8082/service-instance/4d267457-994c-43e3-92e8-b5b569df29ad 2024-10-24 16:21:33,973 - DEBUG - SI 'ctest-si-88656612' has service template ref to ctest-service_template_1-09195581 2024-10-24 16:21:33,973 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:21:33,981 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:21:33,998 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:21:34,090 - DEBUG - Requesting: http://10.0.0.27:8082/service-instance/4d267457-994c-43e3-92e8-b5b569df29ad 2024-10-24 16:21:34,102 - DEBUG - Requesting: http://10.0.0.27:8082/port-tuple/40de9be5-77a2-4b8f-9870-f28a98fdc535 2024-10-24 16:21:34,112 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/2bd4a258-702e-40c4-b635-ee9a276a8007 2024-10-24 16:21:34,128 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/64b603da-b4d7-4639-bc17-81d3d98e2e88 2024-10-24 16:21:34,146 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/be7ca800-331d-48e0-9005-10515ff6ebcc 2024-10-24 16:21:34,375 - DEBUG - VM is in ACTIVE state now 2024-10-24 16:21:34,879 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3ad13ee7-d04d-488d-8207-eaffdb6b8ce2 2024-10-24 16:21:34,894 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/2bd4a258-702e-40c4-b635-ee9a276a8007 2024-10-24 16:21:34,911 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/64b603da-b4d7-4639-bc17-81d3d98e2e88 2024-10-24 16:21:34,929 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/be7ca800-331d-48e0-9005-10515ff6ebcc 2024-10-24 16:21:34,947 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/ef45bc46-a4b4-412c-96e5-14539bf24d65 2024-10-24 16:21:34,962 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/13f6901f-c2f6-4437-aa3d-d1d687531240 2024-10-24 16:21:34,974 - DEBUG - Requesting: http://10.0.0.27:8082/instance-ip/1a87afc9-107b-4e1d-899f-e9d99834c52f 2024-10-24 16:21:35,444 - DEBUG - VM is in ACTIVE state now 2024-10-24 16:21:35,445 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3ad13ee7-d04d-488d-8207-eaffdb6b8ce2 2024-10-24 16:21:35,456 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/2bd4a258-702e-40c4-b635-ee9a276a8007 2024-10-24 16:21:35,477 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/64b603da-b4d7-4639-bc17-81d3d98e2e88 2024-10-24 16:21:35,495 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/be7ca800-331d-48e0-9005-10515ff6ebcc 2024-10-24 16:21:36,776 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.68 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.688 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.688/1.183/1.679/0.495 ms') 2024-10-24 16:21:36,776 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-77213148 passed 2024-10-24 16:21:36,822 - DEBUG - VM ctest-pt_svm0-77213148 Tap interface: {'index': '6', 'name': 'tapbe7ca800-33', 'uuid': 'be7ca800-331d-48e0-9005-10515ff6ebcc', 'vrf_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926:ctest-left_vn-37146926', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926', 'vm_uuid': '3ad13ee7-d04d-488d-8207-eaffdb6b8ce2', 'vm_name': 'ctest-pt_svm0-77213148', 'ip_addr': '107.40.247.196', 'mac_addr': '02:be:7c:a8:00:33', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-33645646:be7ca800-331d-48e0-9005-10515ff6ebcc', 'sg_uuid_list': ['9e0ae013-95fa-4f97-b1ea-ca4e3b2f7225'], 'static_route_list': None, 'vm_project_uuid': '322d24df-509f-45d3-b4a5-ff8bfc665498', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2bd4a258-702e-40c4-b635-ee9a276a8007', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-24 16:21:36,822 - DEBUG - Agent 10.0.0.27 vrf name: default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926:ctest-left_vn-37146926 2024-10-24 16:21:36,832 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926:ctest-left_vn-37146926', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.10:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-10-24 16:21:37,011 - DEBUG - VM ctest-pt_svm0-77213148 : Tap interface tapbe7ca800-33 is set to Active 2024-10-24 16:21:37,011 - DEBUG - Tap interface tapbe7ca800-33 detail : {'index': '6', 'name': 'tapbe7ca800-33', 'uuid': 'be7ca800-331d-48e0-9005-10515ff6ebcc', 'vrf_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926:ctest-left_vn-37146926', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926', 'vm_uuid': '3ad13ee7-d04d-488d-8207-eaffdb6b8ce2', 'vm_name': 'ctest-pt_svm0-77213148', 'ip_addr': '107.40.247.196', 'mac_addr': '02:be:7c:a8:00:33', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-33645646:be7ca800-331d-48e0-9005-10515ff6ebcc', 'sg_uuid_list': ['9e0ae013-95fa-4f97-b1ea-ca4e3b2f7225'], 'static_route_list': None, 'vm_project_uuid': '322d24df-509f-45d3-b4a5-ff8bfc665498', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '2bd4a258-702e-40c4-b635-ee9a276a8007', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-24 16:21:37,219 - DEBUG - Starting Layer 2 verification in Agent 2024-10-24 16:21:37,233 - DEBUG - Layer 2 path is seen for VM MAC 02:be:7c:a8:00:33 in agent 10.0.0.27 2024-10-24 16:21:37,234 - DEBUG - Active layer 2 route in agent is present for VMI tapbe7ca800-33 2024-10-24 16:21:37,234 - DEBUG - L2 label(48) matches bw route table and interface table 2024-10-24 16:21:37,240 - DEBUG - VN default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926 is found in Agent of node 10.0.0.27 2024-10-24 16:21:37,464 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926 is consistent in agent 10.0.0.27 2024-10-24 16:21:37,464 - DEBUG - Route for VM IP ['107.40.247.196'] is consistent in agent 10.0.0.27 2024-10-24 16:21:37,465 - DEBUG - VN default-domain:ctest-TestSvcRegr-33645646:ctest-left_vn-37146926 verification for VM ctest-pt_svm0-77213148 in Agent 10.0.0.27 passed 2024-10-24 16:21:37,675 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2024-10-24 16:21:37,694 - DEBUG - Route for VM MAC 02:be:7c:a8:00:33 is consistent in agent 10.0.0.27 2024-10-24 16:21:37,728 - DEBUG - VM ctest-pt_svm0-77213148 Tap interface: {'index': '5', 'name': 'tap64b603da-b4', 'uuid': '64b603da-b4d7-4639-bc17-81d3d98e2e88', 'vrf_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881:ctest-mgmt_vn-92359881', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881', 'vm_uuid': '3ad13ee7-d04d-488d-8207-eaffdb6b8ce2', 'vm_name': 'ctest-pt_svm0-77213148', 'ip_addr': '191.238.0.67', 'mac_addr': '02:64:b6:03:da:b4', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '26', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-33645646:64b603da-b4d7-4639-bc17-81d3d98e2e88', 'sg_uuid_list': ['9e0ae013-95fa-4f97-b1ea-ca4e3b2f7225'], 'static_route_list': None, 'vm_project_uuid': '322d24df-509f-45d3-b4a5-ff8bfc665498', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-24 16:21:37,728 - DEBUG - Agent 10.0.0.27 vrf name: default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881:ctest-mgmt_vn-92359881 2024-10-24 16:21:37,735 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881:ctest-mgmt_vn-92359881', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.10:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-10-24 16:21:37,912 - DEBUG - VM ctest-pt_svm0-77213148 : Tap interface tap64b603da-b4 is set to Active 2024-10-24 16:21:37,913 - DEBUG - Tap interface tap64b603da-b4 detail : {'index': '5', 'name': 'tap64b603da-b4', 'uuid': '64b603da-b4d7-4639-bc17-81d3d98e2e88', 'vrf_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881:ctest-mgmt_vn-92359881', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881', 'vm_uuid': '3ad13ee7-d04d-488d-8207-eaffdb6b8ce2', 'vm_name': 'ctest-pt_svm0-77213148', 'ip_addr': '191.238.0.67', 'mac_addr': '02:64:b6:03:da:b4', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '26', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-33645646:64b603da-b4d7-4639-bc17-81d3d98e2e88', 'sg_uuid_list': ['9e0ae013-95fa-4f97-b1ea-ca4e3b2f7225'], 'static_route_list': None, 'vm_project_uuid': '322d24df-509f-45d3-b4a5-ff8bfc665498', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-24 16:21:38,127 - DEBUG - Starting Layer 2 verification in Agent 2024-10-24 16:21:38,140 - DEBUG - Layer 2 path is seen for VM MAC 02:64:b6:03:da:b4 in agent 10.0.0.27 2024-10-24 16:21:38,140 - DEBUG - Active layer 2 route in agent is present for VMI tap64b603da-b4 2024-10-24 16:21:38,141 - DEBUG - L2 label(43) matches bw route table and interface table 2024-10-24 16:21:38,148 - DEBUG - VN default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is found in Agent of node 10.0.0.27 2024-10-24 16:21:38,383 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 is consistent in agent 10.0.0.27 2024-10-24 16:21:38,383 - DEBUG - Route for VM IP ['191.238.0.67'] is consistent in agent 10.0.0.27 2024-10-24 16:21:38,383 - DEBUG - VN default-domain:ctest-TestSvcRegr-33645646:ctest-mgmt_vn-92359881 verification for VM ctest-pt_svm0-77213148 in Agent 10.0.0.27 passed 2024-10-24 16:21:38,599 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2024-10-24 16:21:38,611 - DEBUG - Route for VM MAC 02:64:b6:03:da:b4 is consistent in agent 10.0.0.27 2024-10-24 16:21:38,638 - DEBUG - VM ctest-pt_svm0-77213148 Tap interface: {'index': '7', 'name': 'tap2bd4a258-70', 'uuid': '2bd4a258-702e-40c4-b635-ee9a276a8007', 'vrf_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800:ctest-right_vn-69535800', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800', 'vm_uuid': '3ad13ee7-d04d-488d-8207-eaffdb6b8ce2', 'vm_name': 'ctest-pt_svm0-77213148', 'ip_addr': '198.117.253.4', 'mac_addr': '02:2b:d4:a2:58:70', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-33645646:2bd4a258-702e-40c4-b635-ee9a276a8007', 'sg_uuid_list': ['9e0ae013-95fa-4f97-b1ea-ca4e3b2f7225'], 'static_route_list': None, 'vm_project_uuid': '322d24df-509f-45d3-b4a5-ff8bfc665498', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'be7ca800-331d-48e0-9005-10515ff6ebcc', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-24 16:21:38,638 - DEBUG - Agent 10.0.0.27 vrf name: default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800:ctest-right_vn-69535800 2024-10-24 16:21:38,646 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800:ctest-right_vn-69535800', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.10:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-10-24 16:21:38,821 - DEBUG - VM ctest-pt_svm0-77213148 : Tap interface tap2bd4a258-70 is set to Active 2024-10-24 16:21:38,821 - DEBUG - Tap interface tap2bd4a258-70 detail : {'index': '7', 'name': 'tap2bd4a258-70', 'uuid': '2bd4a258-702e-40c4-b635-ee9a276a8007', 'vrf_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800:ctest-right_vn-69535800', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800', 'vm_uuid': '3ad13ee7-d04d-488d-8207-eaffdb6b8ce2', 'vm_name': 'ctest-pt_svm0-77213148', 'ip_addr': '198.117.253.4', 'mac_addr': '02:2b:d4:a2:58:70', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-33645646:2bd4a258-702e-40c4-b635-ee9a276a8007', 'sg_uuid_list': ['9e0ae013-95fa-4f97-b1ea-ca4e3b2f7225'], 'static_route_list': None, 'vm_project_uuid': '322d24df-509f-45d3-b4a5-ff8bfc665498', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'be7ca800-331d-48e0-9005-10515ff6ebcc', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-24 16:21:39,036 - DEBUG - Starting Layer 2 verification in Agent 2024-10-24 16:21:39,054 - DEBUG - Layer 2 path is seen for VM MAC 02:2b:d4:a2:58:70 in agent 10.0.0.27 2024-10-24 16:21:39,054 - DEBUG - Active layer 2 route in agent is present for VMI tap2bd4a258-70 2024-10-24 16:21:39,054 - DEBUG - L2 label(53) matches bw route table and interface table 2024-10-24 16:21:39,062 - DEBUG - VN default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800 is found in Agent of node 10.0.0.27 2024-10-24 16:21:39,284 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800 is consistent in agent 10.0.0.27 2024-10-24 16:21:39,284 - DEBUG - Route for VM IP ['198.117.253.4'] is consistent in agent 10.0.0.27 2024-10-24 16:21:39,285 - DEBUG - VN default-domain:ctest-TestSvcRegr-33645646:ctest-right_vn-69535800 verification for VM ctest-pt_svm0-77213148 in Agent 10.0.0.27 passed 2024-10-24 16:21:39,496 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2024-10-24 16:21:39,510 - DEBUG - Route for VM MAC 02:2b:d4:a2:58:70 is consistent in agent 10.0.0.27 2024-10-24 16:21:39,510 - INFO - VM ctest-pt_svm0-77213148 verifications in Compute nodes passed 2024-10-24 16:21:39,511 - DEBUG - The SVMs in the SI are : [] 2024-10-24 16:21:39,511 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3ad13ee7-d04d-488d-8207-eaffdb6b8ce2 2024-10-24 16:21:39,523 - DEBUG - Service VM for SI 'ctest-si-88656612' is launched 2024-10-24 16:21:39,523 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:21:39,534 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:21:39,603 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:21:39,700 - DEBUG - Requesting: http://10.0.0.27:8082/service-instance/4d267457-994c-43e3-92e8-b5b569df29ad 2024-10-24 16:21:39,713 - DEBUG - SI ctest-si-88656612 has Port Tuple: ['ctest-port_tuple-76590680'] 2024-10-24 16:21:39,827 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:21:44,944 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:21:50,055 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:21:55,171 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:00,283 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:05,395 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:10,511 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:15,627 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:20,747 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:25,859 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:30,972 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:36,088 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:41,199 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:46,311 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:51,423 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:56,535 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:22:56,537 - INFO - Dettaching policy ctest-policy-12424979 from vn ctest-right_vn-69535800 2024-10-24 16:22:56,807 - INFO - Dettaching policy ctest-policy-12424979 from vn ctest-left_vn-37146926 2024-10-24 16:22:57,100 - INFO - Deleted policy ctest-policy-12424979 2024-10-24 16:22:57,100 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-si-88656612'] 2024-10-24 16:22:57,200 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-si-88656612'] 2024-10-24 16:22:57,201 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:22:57,210 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:22:57,225 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:22:57,311 - DEBUG - Service instance ctest-si-88656612 removed from api server 2024-10-24 16:22:57,311 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/3ad13ee7-d04d-488d-8207-eaffdb6b8ce2 2024-10-24 16:22:57,321 - DEBUG - All Service VMs unlinked from SI ctest-si-88656612 2024-10-24 16:22:57,328 - DEBUG - 0 svc intances found in all projects. They are [] 2024-10-24 16:22:57,328 - DEBUG - 0 svc intances found in current project. They are [] 2024-10-24 16:22:57,375 - DEBUG - 0 svc intances found in all projects. They are [] 2024-10-24 16:22:57,376 - DEBUG - 0 svc intances found in current project. They are [] 2024-10-24 16:22:57,376 - INFO - Deleting VM ctest-pt_svm0-77213148 2024-10-24 16:22:57,457 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-09195581'] 2024-10-24 16:22:57,563 - INFO - Service template: ['default-domain', 'ctest-service_template_1-09195581'] deleted successfully. 2024-10-24 16:22:57,563 - INFO - Deleting VM ctest-right_vm-63188524 2024-10-24 16:22:57,659 - INFO - Deleting VM ctest-left_vm-88738273 2024-10-24 16:22:57,765 - INFO - Deleting VN ctest-right_vn-69535800 2024-10-24 16:22:57,825 - DEBUG - VN 7abbe994-7af0-4d1d-88fe-7fe1d614b452 still in use: Unable to complete operation on network 7abbe994-7af0-4d1d-88fe-7fe1d614b452. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-057e7fe9-fbf7-4a5c-bcb3-096dd9401d40'] 2024-10-24 16:22:57,825 - WARNING - Deleting VN ctest-right_vn-69535800 failed..Will retry 2024-10-24 16:22:59,961 - DEBUG - Response for deleting network () 2024-10-24 16:22:59,961 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b314842d-18ae-4698-882a-2ed05de814bf 2024-10-24 16:22:59,969 - DEBUG - Response Code: 404 2024-10-24 16:22:59,969 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:22:59,976 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:23:00,036 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:23:00,122 - INFO - Validated that VN ctest-right_vn-69535800 is not found in API Server 2024-10-24 16:23:00,136 - DEBUG - VN ctest-right_vn-69535800 is not present in Agent 10.0.0.27 2024-10-24 16:23:00,136 - INFO - Validated that VN ctest-right_vn-69535800 is not in any agent 2024-10-24 16:23:00,157 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-69535800 info 2024-10-24 16:23:00,157 - INFO - Deleting VN ctest-left_vn-37146926 2024-10-24 16:23:00,301 - DEBUG - Response for deleting network () 2024-10-24 16:23:00,301 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/699162dd-eb6f-4273-b423-806d99634ad9 2024-10-24 16:23:00,309 - DEBUG - Response Code: 404 2024-10-24 16:23:00,310 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:23:00,318 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:23:00,378 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:23:00,467 - INFO - Validated that VN ctest-left_vn-37146926 is not found in API Server 2024-10-24 16:23:00,481 - DEBUG - VN ctest-left_vn-37146926 is not present in Agent 10.0.0.27 2024-10-24 16:23:00,481 - INFO - Validated that VN ctest-left_vn-37146926 is not in any agent 2024-10-24 16:23:00,504 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-37146926 info 2024-10-24 16:23:00,505 - INFO - Deleting VN ctest-mgmt_vn-92359881 2024-10-24 16:23:00,635 - DEBUG - Response for deleting network () 2024-10-24 16:23:00,635 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/7b89b8cb-de81-477f-a27d-8bed058ba96d 2024-10-24 16:23:00,643 - DEBUG - Response Code: 404 2024-10-24 16:23:00,644 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-10-24 16:23:00,656 - DEBUG - Requesting: http://10.0.0.27:8082/domain/601ceeaf-5dea-4ead-99e3-6ec9647d577d 2024-10-24 16:23:00,719 - DEBUG - Requesting: http://10.0.0.27:8082/project/322d24df-509f-45d3-b4a5-ff8bfc665498 2024-10-24 16:23:00,815 - INFO - Validated that VN ctest-mgmt_vn-92359881 is not found in API Server 2024-10-24 16:23:00,833 - DEBUG - VN ctest-mgmt_vn-92359881 is not present in Agent 10.0.0.27 2024-10-24 16:23:00,833 - INFO - Validated that VN ctest-mgmt_vn-92359881 is not in any agent 2024-10-24 16:23:00,857 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-92359881 info 2024-10-24 16:23:01,111 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Thu Oct 24 16:22:56 2024 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 79 log.info('Initial checks done. Running the testcase now') 80 log.info('') 81 result = function(self, *args, **kwargs) 82 if self.inputs.upgrade: 83 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/svc_firewall/test_svc_fw.py in test_svc_in_network_datapath(self=) 31 def test_svc_in_network_datapath(self): 32 return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network', 33 create_svms=True) 34 35 create_svms undefined /contrail-test/common/servicechain/verify.py in verify_svc_chain(self=, *args=(), **kwargs={'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'}) 344 if not evpn: 345 result, msg = self.validate_vn(left_vn_fq_name) 346 assert result, msg 347 right_vn = True if st_fixture.service_mode == 'in-network-nat' else False 348 result, msg = self.validate_vn(right_vn_fq_name, right_vn=right_vn) result = False msg = "RI refs is none for RI ['default-domain', 'ctest...test-left_vn-37146926', 'ctest-left_vn-37146926']" AssertionError: RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ("RI refs is none for RI ['default-domain', 'ctest...test-left_vn-37146926', 'ctest-left_vn-37146926']",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 81, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 33, in test_svc_in_network_datapath create_svms=True) File "/contrail-test/common/servicechain/verify.py", line 346, in verify_svc_chain assert result, msg AssertionError: RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-33645646', 'ctest-left_vn-37146926', 'ctest-left_vn-37146926'] 2024-10-24 16:23:01,119 - DEBUG - No XMPP flaps were noticed during the test 2024-10-24 16:23:01,119 - INFO -
2024-10-24 16:23:01,119 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:02:30]
2024-10-24 16:23:01,119 - INFO - -------------------------------------------------------------------------------- 2024-10-24 16:23:01,931 - INFO - Deleted project: ctest-TestSvcRegr-33645646, ID : 322d24df-509f-45d3-b4a5-ff8bfc665498