2024-09-04 23:19:34,996 - INFO - Domain Default found not creating 2024-09-04 23:19:35,440 - INFO - Project ctest-TestSvcRegr-22100837 not found, creating it 2024-09-04 23:19:36,266 - INFO - Created Project:ctest-TestSvcRegr-22100837, ID : 54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:38,458 - INFO - ================================================================================ 2024-09-04 23:19:38,458 - INFO - STARTING TEST : test_svc_in_network_datapath 2024-09-04 23:19:38,777 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.20.0.5': '0'}} with 2024-09-04 23:19:38,777 - INFO - Initial checks done. Running the testcase now 2024-09-04 23:19:38,777 - INFO - 2024-09-04 23:19:39,694 - DEBUG - Response for create_network : {'network': {'id': 'fd074c80-4c57-4322-9b93-21cf4106513d', 'name': 'ctest-mgmt_vn-83947504', 'tenant_id': '54e0c4b3175944af9d7e6b794252e0b2', 'project_id': '54e0c4b3175944af9d7e6b794252e0b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-mgmt_vn-83947504'], 'port_security_enabled': True, 'description': ''}} 2024-09-04 23:19:40,066 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a05d4d23-884a-490b-a2d5-6db484e4f96c', 'name': '', 'tenant_id': '54e0c4b3175944af9d7e6b794252e0b2', 'network_id': 'fd074c80-4c57-4322-9b93-21cf4106513d', 'ip_version': 4, 'cidr': '31.229.119.0/26', 'allocation_pools': [{'start': '31.229.119.2', 'end': '31.229.119.62'}], 'gateway_ip': '31.229.119.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.229.119.2', 'tags': [], 'project_id': '54e0c4b3175944af9d7e6b794252e0b2'}} 2024-09-04 23:19:40,132 - INFO - Created VN ctest-mgmt_vn-83947504 2024-09-04 23:19:40,199 - DEBUG - VN ctest-mgmt_vn-83947504 UUID is fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:40,392 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:40,758 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:40,829 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:19:40,866 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:41,003 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:41,040 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:41,068 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/8e1310cc-82e2-45db-a4d4-808d9f97ab15 2024-09-04 23:19:41,089 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/8e1310cc-82e2-45db-a4d4-808d9f97ab15 2024-09-04 23:19:41,104 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/d03eafbe-0023-48b1-8632-3e4b08fe73f6 2024-09-04 23:19:41,120 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-04 23:19:41,120 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:41,140 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/8e1310cc-82e2-45db-a4d4-808d9f97ab15 2024-09-04 23:19:41,169 - INFO - Verified VN network id 8 for VN fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:41,170 - INFO - Verifications in API Server for VN ctest-mgmt_vn-83947504 passed 2024-09-04 23:19:41,170 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:41,192 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/8e1310cc-82e2-45db-a4d4-808d9f97ab15 2024-09-04 23:19:41,216 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/8e1310cc-82e2-45db-a4d4-808d9f97ab15 2024-09-04 23:19:41,232 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/d03eafbe-0023-48b1-8632-3e4b08fe73f6 2024-09-04 23:19:41,263 - DEBUG - Control-node 10.0.0.28 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-22100837', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18232625730353054498', 'uuid-lslong': '11210341071488176445'}, 'enable': 'true', 'created': '2024-09-04T23:19:39', 'last-modified': '2024-09-04T23:19:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.303146'} 2024-09-04 23:19:41,287 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-04 23:19:41,287 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-83947504 passed 2024-09-04 23:19:41,288 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-83947504 in API_Server ====== 2024-09-04 23:19:41,288 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:41,308 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:19:41,347 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:41,460 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/fd074c80-4c57-4322-9b93-21cf4106513d 2024-09-04 23:19:41,489 - DEBUG - =>VN ctest-mgmt_vn-83947504 has no policy to be verified 2024-09-04 23:19:41,489 - DEBUG - Verifying the vn in opserver 2024-09-04 23:19:41,489 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 virtual network link through opserver 10.0.0.28 2024-09-04 23:19:41,490 - DEBUG - Requesting: http://10.0.0.28:8081/analytics/uves/virtual-networks 2024-09-04 23:19:41,832 - DEBUG - Requesting: http://10.0.0.28:8081/analytics/uves/virtual-networks 2024-09-04 23:19:41,950 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504', 'href': 'http://10.0.0.28:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504?flat'} 2024-09-04 23:19:41,950 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is found in opserver 2024-09-04 23:19:41,979 - DEBUG - Do not have enough data to verify VN in agent 2024-09-04 23:19:41,986 - DEBUG - VRF ids for VN ctest-mgmt_vn-83947504: {} 2024-09-04 23:19:42,326 - DEBUG - Response for create_network : {'network': {'id': 'f62c3acf-08ce-42eb-87f1-d47190bf5332', 'name': 'ctest-left_vn-82023620', 'tenant_id': '54e0c4b3175944af9d7e6b794252e0b2', 'project_id': '54e0c4b3175944af9d7e6b794252e0b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-left_vn-82023620'], 'port_security_enabled': True, 'description': ''}} 2024-09-04 23:19:42,557 - DEBUG - Response for create_subnet : {'subnet': {'id': '24a0e8b7-a7a1-44ef-8f32-d33546b1acdf', 'name': '', 'tenant_id': '54e0c4b3175944af9d7e6b794252e0b2', 'network_id': 'f62c3acf-08ce-42eb-87f1-d47190bf5332', 'ip_version': 4, 'cidr': '43.30.67.0/26', 'allocation_pools': [{'start': '43.30.67.2', 'end': '43.30.67.62'}], 'gateway_ip': '43.30.67.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.30.67.2', 'tags': [], 'project_id': '54e0c4b3175944af9d7e6b794252e0b2'}} 2024-09-04 23:19:42,595 - INFO - Created VN ctest-left_vn-82023620 2024-09-04 23:19:42,659 - DEBUG - VN ctest-left_vn-82023620 UUID is f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:42,876 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:42,891 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:19:42,934 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:43,066 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:43,095 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:43,121 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/130c475c-2c78-496a-97c6-1bc8ee2a2d34 2024-09-04 23:19:43,142 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/130c475c-2c78-496a-97c6-1bc8ee2a2d34 2024-09-04 23:19:43,162 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/6f4015c8-6466-431f-8768-a0780f634eb9 2024-09-04 23:19:43,186 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-04 23:19:43,187 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:43,219 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/130c475c-2c78-496a-97c6-1bc8ee2a2d34 2024-09-04 23:19:43,256 - INFO - Verified VN network id 9 for VN f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:43,257 - INFO - Verifications in API Server for VN ctest-left_vn-82023620 passed 2024-09-04 23:19:43,257 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:43,283 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/130c475c-2c78-496a-97c6-1bc8ee2a2d34 2024-09-04 23:19:43,303 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/130c475c-2c78-496a-97c6-1bc8ee2a2d34 2024-09-04 23:19:43,324 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/6f4015c8-6466-431f-8768-a0780f634eb9 2024-09-04 23:19:43,361 - DEBUG - Control-node 10.0.0.28 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-22100837', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17738617693185917675', 'uuid-lslong': '9795844248732390194'}, 'enable': 'true', 'created': '2024-09-04T23:19:42', 'last-modified': '2024-09-04T23:19:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.860514'} 2024-09-04 23:19:43,383 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-09-04 23:19:43,384 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-82023620 passed 2024-09-04 23:19:43,384 - DEBUG - ====Verifying policy data for ctest-left_vn-82023620 in API_Server ====== 2024-09-04 23:19:43,384 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:43,401 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:19:43,440 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:43,570 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/f62c3acf-08ce-42eb-87f1-d47190bf5332 2024-09-04 23:19:43,595 - DEBUG - =>VN ctest-left_vn-82023620 has no policy to be verified 2024-09-04 23:19:43,596 - DEBUG - Verifying the vn in opserver 2024-09-04 23:19:43,596 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620 virtual network link through opserver 10.0.0.28 2024-09-04 23:19:43,596 - DEBUG - Requesting: http://10.0.0.28:8081/analytics/uves/virtual-networks 2024-09-04 23:19:43,632 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620', 'href': 'http://10.0.0.28:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620?flat'} 2024-09-04 23:19:43,632 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620 is found in opserver 2024-09-04 23:19:43,675 - DEBUG - Do not have enough data to verify VN in agent 2024-09-04 23:19:43,694 - DEBUG - VRF ids for VN ctest-left_vn-82023620: {} 2024-09-04 23:19:44,142 - DEBUG - Response for create_network : {'network': {'id': 'd1d2a4d6-2a24-41b9-89df-b8d97c5f6b52', 'name': 'ctest-right_vn-70836856', 'tenant_id': '54e0c4b3175944af9d7e6b794252e0b2', 'project_id': '54e0c4b3175944af9d7e6b794252e0b2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-right_vn-70836856'], 'port_security_enabled': True, 'description': ''}} 2024-09-04 23:19:44,451 - DEBUG - Response for create_subnet : {'subnet': {'id': '79603536-c493-474a-b8f2-b7ae6f6d0cae', 'name': '', 'tenant_id': '54e0c4b3175944af9d7e6b794252e0b2', 'network_id': 'd1d2a4d6-2a24-41b9-89df-b8d97c5f6b52', 'ip_version': 4, 'cidr': '196.223.82.64/26', 'allocation_pools': [{'start': '196.223.82.66', 'end': '196.223.82.126'}], 'gateway_ip': '196.223.82.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '196.223.82.66', 'tags': [], 'project_id': '54e0c4b3175944af9d7e6b794252e0b2'}} 2024-09-04 23:19:44,510 - INFO - Created VN ctest-right_vn-70836856 2024-09-04 23:19:44,575 - DEBUG - VN ctest-right_vn-70836856 UUID is d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:44,783 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:44,803 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:19:44,844 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:44,984 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:45,004 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:45,021 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/5e7af08d-2064-45f5-84fb-822b26d3fc3a 2024-09-04 23:19:45,033 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/5e7af08d-2064-45f5-84fb-822b26d3fc3a 2024-09-04 23:19:45,048 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/fb83c190-cd60-4f33-9eeb-86b626bb29f1 2024-09-04 23:19:45,061 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-04 23:19:45,061 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:45,078 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/5e7af08d-2064-45f5-84fb-822b26d3fc3a 2024-09-04 23:19:45,102 - INFO - Verified VN network id 10 for VN d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:45,102 - INFO - Verifications in API Server for VN ctest-right_vn-70836856 passed 2024-09-04 23:19:45,102 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:45,118 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/5e7af08d-2064-45f5-84fb-822b26d3fc3a 2024-09-04 23:19:45,132 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/5e7af08d-2064-45f5-84fb-822b26d3fc3a 2024-09-04 23:19:45,144 - DEBUG - Requesting: http://10.0.0.28:8082/route-target/fb83c190-cd60-4f33-9eeb-86b626bb29f1 2024-09-04 23:19:45,172 - DEBUG - Control-node 10.0.0.28 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-22100837', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15119328138773152185', 'uuid-lslong': '9934862547236645714'}, 'enable': 'true', 'created': '2024-09-04T23:19:44', 'last-modified': '2024-09-04T23:19:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.803812'} 2024-09-04 23:19:45,187 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-04 23:19:45,187 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-70836856 passed 2024-09-04 23:19:45,188 - DEBUG - ====Verifying policy data for ctest-right_vn-70836856 in API_Server ====== 2024-09-04 23:19:45,188 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:19:45,205 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:19:45,240 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:19:45,349 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-network/d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 2024-09-04 23:19:45,371 - DEBUG - =>VN ctest-right_vn-70836856 has no policy to be verified 2024-09-04 23:19:45,371 - DEBUG - Verifying the vn in opserver 2024-09-04 23:19:45,371 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856 virtual network link through opserver 10.0.0.28 2024-09-04 23:19:45,371 - DEBUG - Requesting: http://10.0.0.28:8081/analytics/uves/virtual-networks 2024-09-04 23:19:45,393 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856', 'href': 'http://10.0.0.28:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856?flat'} 2024-09-04 23:19:45,393 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856 is found in opserver 2024-09-04 23:19:45,419 - DEBUG - Do not have enough data to verify VN in agent 2024-09-04 23:19:45,430 - DEBUG - VRF ids for VN ctest-right_vn-70836856: {} 2024-09-04 23:19:45,544 - DEBUG - Services list from nova: [, , ] 2024-09-04 23:19:47,388 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1849-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1849-1) 2024-09-04 23:19:48,943 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1849-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1849-1) 2024-09-04 23:19:48,943 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-20698017'] 2024-09-04 23:19:49,371 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-20698017'] created succesfully 2024-09-04 23:19:49,815 - DEBUG - Image by name cirros_in_net not found 2024-09-04 23:19:49,815 - DEBUG - Installing image cirros_in_net 2024-09-04 23:19:49,816 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'vcpath': '/images/vcenter/', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2024-09-04 23:19:49,816 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-09-04 23:19:49,816 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-09-04 23:19:49,831 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2024-09-04 23:19:50,271 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2024-09-04 23:19:50,272 - DEBUG - Unzip image 2024-09-04 23:19:50,272 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2024-09-04 23:19:50,443 - DEBUG - Try to create image in user context 2024-09-04 23:19:50,736 - DEBUG - Image has been created in user context 2024-09-04 23:19:50,736 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2024-09-04 23:19:50,760 - DEBUG - Downloaded image has been removed 2024-09-04 23:19:50,782 - DEBUG - Uploaded image status = active 2024-09-04 23:19:52,364 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1849-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1849-1) 2024-09-04 23:19:52,364 - INFO - Waiting for VM ctest-pt_svm0-04358173 to be up.. 2024-09-04 23:19:52,431 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-09-04 23:19:57,605 - DEBUG - VM is in ACTIVE state now 2024-09-04 23:19:57,605 - INFO - VM name : ctest-pt_svm0-04358173 2024-09-04 23:19:57,743 - DEBUG - VM ctest-pt_svm0-04358173 ID is 17301c00-4f18-4dfe-973d-66f768a0451a 2024-09-04 23:19:57,778 - DEBUG - VM ctest-pt_svm0-04358173 launched on Node cn-jenkins-deploy-platform-ansible-os-1849-1 2024-09-04 23:19:58,238 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/17301c00-4f18-4dfe-973d-66f768a0451a 2024-09-04 23:19:58,254 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/b9bb9173-a633-4aac-a21e-b4bcf96590f0 2024-09-04 23:19:58,266 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4 2024-09-04 23:19:58,279 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ed8b4b0f-456c-4c05-90ea-8e58da508028 2024-09-04 23:20:01,623 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2024-09-04 23:20:01,624 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-04358173 failed! 2024-09-04 23:20:01,683 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is 31.229.119.1 and allocation pool is NOT set 2024-09-04 23:20:05,762 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2024-09-04 23:20:05,762 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-04358173 failed! 2024-09-04 23:20:05,836 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is 31.229.119.1 and allocation pool is NOT set 2024-09-04 23:20:09,915 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2024-09-04 23:20:09,915 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-04358173 failed! 2024-09-04 23:20:09,983 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is 31.229.119.1 and allocation pool is NOT set 2024-09-04 23:20:14,069 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2024-09-04 23:20:14,069 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-04358173 failed! 2024-09-04 23:20:14,135 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is 31.229.119.1 and allocation pool is NOT set 2024-09-04 23:20:18,236 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=9.01 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1031ms\r\nrtt min/avg/max/mdev = 9.008/9.008/9.008/0.000 ms') 2024-09-04 23:20:18,237 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-04358173 passed 2024-09-04 23:20:18,432 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:18,433 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:18,528 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-04 23:20:18,784 - DEBUG - VM ctest-pt_svm0-04358173 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-04 23:20:23,785 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:23,786 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:23,870 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-04 23:20:24,128 - DEBUG - VM ctest-pt_svm0-04358173 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-04 23:20:29,129 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:29,130 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:29,199 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-04 23:20:29,424 - DEBUG - VM ctest-pt_svm0-04358173 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-04 23:20:34,424 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:34,425 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:34,505 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-04 23:20:34,733 - DEBUG - VM ctest-pt_svm0-04358173 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-04 23:20:39,735 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:39,735 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:39,954 - DEBUG - VM ctest-pt_svm0-04358173 is ready for SSH connections 2024-09-04 23:20:40,128 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:40,128 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:40,330 - DEBUG - VM ctest-pt_svm0-04358173 is ready for SSH connections 2024-09-04 23:20:40,519 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:40,519 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-04358173, IP 31.229.119.3, Port 22 2024-09-04 23:20:40,723 - DEBUG - VM ctest-pt_svm0-04358173 is ready for SSH connections 2024-09-04 23:20:40,740 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-si-87654643'] 2024-09-04 23:20:41,822 - INFO - Waiting for VM ctest-left_vm-15889378 to be up.. 2024-09-04 23:20:41,905 - DEBUG - VM is in ACTIVE state now 2024-09-04 23:20:41,905 - INFO - VM name : ctest-left_vm-15889378 2024-09-04 23:20:41,990 - DEBUG - VM ctest-left_vm-15889378 ID is 0b7212bb-3fb4-4b91-bf3c-ea73414bd155 2024-09-04 23:20:41,990 - DEBUG - VM ctest-left_vm-15889378 launched on Node cn-jenkins-deploy-platform-ansible-os-1849-1 2024-09-04 23:20:42,111 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/0b7212bb-3fb4-4b91-bf3c-ea73414bd155 2024-09-04 23:20:42,123 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/cfca87f9-d731-451a-a325-46594a407c94 2024-09-04 23:20:43,407 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.35 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.728 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.728/3.539/6.350/2.811 ms') 2024-09-04 23:20:43,407 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-15889378 passed 2024-09-04 23:20:43,599 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:43,600 - DEBUG - Waiting to SSH to VM ctest-left_vm-15889378, IP 43.30.67.3, Port 22 2024-09-04 23:20:43,805 - DEBUG - VM ctest-left_vm-15889378 is ready for SSH connections 2024-09-04 23:20:43,805 - INFO - Waiting for VM ctest-right_vm-33975123 to be up.. 2024-09-04 23:20:44,035 - DEBUG - VM is in ACTIVE state now 2024-09-04 23:20:44,036 - INFO - VM name : ctest-right_vm-33975123 2024-09-04 23:20:44,257 - DEBUG - VM ctest-right_vm-33975123 ID is 64ffedd2-4775-4236-81f3-59f807b9b4eb 2024-09-04 23:20:44,257 - DEBUG - VM ctest-right_vm-33975123 launched on Node cn-jenkins-deploy-platform-ansible-os-1849-1 2024-09-04 23:20:44,488 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/64ffedd2-4775-4236-81f3-59f807b9b4eb 2024-09-04 23:20:44,518 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/fd9c3310-1150-4bdf-9036-c98e0c9015cb 2024-09-04 23:20:45,872 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=9.15 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.739 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.739/4.944/9.150/4.205 ms') 2024-09-04 23:20:45,873 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-33975123 passed 2024-09-04 23:20:46,064 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:46,064 - DEBUG - Waiting to SSH to VM ctest-right_vm-33975123, IP 196.223.82.67, Port 22 2024-09-04 23:20:46,259 - DEBUG - VM ctest-right_vm-33975123 is ready for SSH connections 2024-09-04 23:20:46,274 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-22100837:ctest-si-87654643'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2024-09-04 23:20:46,763 - INFO - Attaching policy ctest-policy-91852531 to vn ctest-left_vn-82023620 2024-09-04 23:20:47,367 - INFO - Attaching policy ctest-policy-91852531 to vn ctest-right_vn-70836856 2024-09-04 23:20:47,955 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-20698017'] created succesfully 2024-09-04 23:20:48,203 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-si-87654643'] created succesfully 2024-09-04 23:20:48,203 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:20:48,213 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:20:48,254 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:20:48,349 - DEBUG - Requesting: http://10.0.0.28:8082/service-instance/9bb5acd8-0c81-4cb8-9212-d83deb116cd1 2024-09-04 23:20:48,368 - DEBUG - SI 'ctest-si-87654643' has service template ref to ctest-service_template_1-20698017 2024-09-04 23:20:48,368 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:20:48,380 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:20:48,411 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:20:48,507 - DEBUG - Requesting: http://10.0.0.28:8082/service-instance/9bb5acd8-0c81-4cb8-9212-d83deb116cd1 2024-09-04 23:20:48,524 - DEBUG - Requesting: http://10.0.0.28:8082/port-tuple/a7f43b1b-3375-4bdd-917f-d76a7613784e 2024-09-04 23:20:48,535 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/b9bb9173-a633-4aac-a21e-b4bcf96590f0 2024-09-04 23:20:48,551 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4 2024-09-04 23:20:48,579 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ed8b4b0f-456c-4c05-90ea-8e58da508028 2024-09-04 23:20:48,888 - DEBUG - VM is in ACTIVE state now 2024-09-04 23:20:49,515 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/17301c00-4f18-4dfe-973d-66f768a0451a 2024-09-04 23:20:49,537 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/b9bb9173-a633-4aac-a21e-b4bcf96590f0 2024-09-04 23:20:49,569 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4 2024-09-04 23:20:49,598 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ed8b4b0f-456c-4c05-90ea-8e58da508028 2024-09-04 23:20:49,626 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/37db1811-5247-40d2-9112-1bd1d82ee7fa 2024-09-04 23:20:49,652 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/5d17878e-ccea-4a79-964b-e8089bc8e3ce 2024-09-04 23:20:49,669 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/f16c10dc-e806-4623-963c-5bfe97a16b60 2024-09-04 23:20:49,686 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/5dd39c1c-07f2-40d1-9d03-270aba66dd3c 2024-09-04 23:20:49,702 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/df4dedaa-69fe-4d44-861a-e94eefae26f8 2024-09-04 23:20:49,721 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/f4043cd8-b106-4c60-81db-5b86ea6ad2ee 2024-09-04 23:20:49,742 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/12024887-64d5-4a51-bb3d-e8297c777e40 2024-09-04 23:20:49,756 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/56ef0ae5-2c25-45d3-895f-9fe998eb4b2a 2024-09-04 23:20:49,771 - DEBUG - Requesting: http://10.0.0.28:8082/instance-ip/a0a0b7b1-4a9b-4283-88d7-3fb120b4383a 2024-09-04 23:20:50,658 - DEBUG - VM is in ACTIVE state now 2024-09-04 23:20:50,659 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/17301c00-4f18-4dfe-973d-66f768a0451a 2024-09-04 23:20:50,681 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/b9bb9173-a633-4aac-a21e-b4bcf96590f0 2024-09-04 23:20:50,707 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4 2024-09-04 23:20:50,735 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine-interface/ed8b4b0f-456c-4c05-90ea-8e58da508028 2024-09-04 23:20:52,095 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=2.37 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=1.03 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.027/1.699/2.372/0.672 ms') 2024-09-04 23:20:52,095 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-04358173 passed 2024-09-04 23:20:52,221 - DEBUG - VM ctest-pt_svm0-04358173 Tap interface: {'index': '6', 'name': 'tapba10926d-0f', 'uuid': 'ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4', 'vrf_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620:ctest-left_vn-82023620', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620', 'vm_uuid': '17301c00-4f18-4dfe-973d-66f768a0451a', 'vm_name': 'ctest-pt_svm0-04358173', 'ip_addr': '43.30.67.4', 'mac_addr': '02:ba:10:92:6d:0f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-22100837:ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4', 'sg_uuid_list': ['8cacae4f-0e19-4e10-bf05-c19a6603e79a'], 'static_route_list': None, 'vm_project_uuid': '54e0c4b3-1759-44af-9d7e-6b794252e0b2', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'b9bb9173-a633-4aac-a21e-b4bcf96590f0', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-04 23:20:52,221 - DEBUG - Agent 10.0.0.28 vrf name: default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620:ctest-left_vn-82023620 2024-09-04 23:20:52,243 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620:ctest-left_vn-82023620', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.5:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-09-04 23:20:52,476 - DEBUG - VM ctest-pt_svm0-04358173 : Tap interface tapba10926d-0f is set to Active 2024-09-04 23:20:52,476 - DEBUG - Tap interface tapba10926d-0f detail : {'index': '6', 'name': 'tapba10926d-0f', 'uuid': 'ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4', 'vrf_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620:ctest-left_vn-82023620', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620', 'vm_uuid': '17301c00-4f18-4dfe-973d-66f768a0451a', 'vm_name': 'ctest-pt_svm0-04358173', 'ip_addr': '43.30.67.4', 'mac_addr': '02:ba:10:92:6d:0f', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-22100837:ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4', 'sg_uuid_list': ['8cacae4f-0e19-4e10-bf05-c19a6603e79a'], 'static_route_list': None, 'vm_project_uuid': '54e0c4b3-1759-44af-9d7e-6b794252e0b2', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'b9bb9173-a633-4aac-a21e-b4bcf96590f0', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-04 23:20:52,667 - DEBUG - Starting Layer 2 verification in Agent 2024-09-04 23:20:52,699 - DEBUG - Layer 2 path is seen for VM MAC 02:ba:10:92:6d:0f in agent 10.0.0.28 2024-09-04 23:20:52,700 - DEBUG - Active layer 2 route in agent is present for VMI tapba10926d-0f 2024-09-04 23:20:52,700 - DEBUG - L2 label(48) matches bw route table and interface table 2024-09-04 23:20:52,712 - DEBUG - VN default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620 is found in Agent of node 10.0.0.28 2024-09-04 23:20:52,947 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620 is consistent in agent 10.0.0.28 2024-09-04 23:20:52,947 - DEBUG - Route for VM IP ['43.30.67.4'] is consistent in agent 10.0.0.28 2024-09-04 23:20:52,948 - DEBUG - VN default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620 verification for VM ctest-pt_svm0-04358173 in Agent 10.0.0.28 passed 2024-09-04 23:20:53,144 - DEBUG - Starting all layer 2 verification in agent 10.0.0.28 2024-09-04 23:20:53,186 - DEBUG - Route for VM MAC 02:ba:10:92:6d:0f is consistent in agent 10.0.0.28 2024-09-04 23:20:53,259 - DEBUG - VM ctest-pt_svm0-04358173 Tap interface: {'index': '5', 'name': 'taped8b4b0f-45', 'uuid': 'ed8b4b0f-456c-4c05-90ea-8e58da508028', 'vrf_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504:ctest-mgmt_vn-83947504', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504', 'vm_uuid': '17301c00-4f18-4dfe-973d-66f768a0451a', 'vm_name': 'ctest-pt_svm0-04358173', 'ip_addr': '31.229.119.3', 'mac_addr': '02:ed:8b:4b:0f:45', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-22100837:ed8b4b0f-456c-4c05-90ea-8e58da508028', 'sg_uuid_list': ['8cacae4f-0e19-4e10-bf05-c19a6603e79a'], 'static_route_list': None, 'vm_project_uuid': '54e0c4b3-1759-44af-9d7e-6b794252e0b2', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-04 23:20:53,260 - DEBUG - Agent 10.0.0.28 vrf name: default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504:ctest-mgmt_vn-83947504 2024-09-04 23:20:53,280 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504:ctest-mgmt_vn-83947504', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.5:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-09-04 23:20:53,502 - DEBUG - VM ctest-pt_svm0-04358173 : Tap interface taped8b4b0f-45 is set to Active 2024-09-04 23:20:53,503 - DEBUG - Tap interface taped8b4b0f-45 detail : {'index': '5', 'name': 'taped8b4b0f-45', 'uuid': 'ed8b4b0f-456c-4c05-90ea-8e58da508028', 'vrf_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504:ctest-mgmt_vn-83947504', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504', 'vm_uuid': '17301c00-4f18-4dfe-973d-66f768a0451a', 'vm_name': 'ctest-pt_svm0-04358173', 'ip_addr': '31.229.119.3', 'mac_addr': '02:ed:8b:4b:0f:45', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-22100837:ed8b4b0f-456c-4c05-90ea-8e58da508028', 'sg_uuid_list': ['8cacae4f-0e19-4e10-bf05-c19a6603e79a'], 'static_route_list': None, 'vm_project_uuid': '54e0c4b3-1759-44af-9d7e-6b794252e0b2', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-04 23:20:53,739 - DEBUG - Starting Layer 2 verification in Agent 2024-09-04 23:20:53,777 - DEBUG - Layer 2 path is seen for VM MAC 02:ed:8b:4b:0f:45 in agent 10.0.0.28 2024-09-04 23:20:53,778 - DEBUG - Active layer 2 route in agent is present for VMI taped8b4b0f-45 2024-09-04 23:20:53,778 - DEBUG - L2 label(43) matches bw route table and interface table 2024-09-04 23:20:53,797 - DEBUG - VN default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is found in Agent of node 10.0.0.28 2024-09-04 23:20:54,031 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 is consistent in agent 10.0.0.28 2024-09-04 23:20:54,032 - DEBUG - Route for VM IP ['31.229.119.3'] is consistent in agent 10.0.0.28 2024-09-04 23:20:54,032 - DEBUG - VN default-domain:ctest-TestSvcRegr-22100837:ctest-mgmt_vn-83947504 verification for VM ctest-pt_svm0-04358173 in Agent 10.0.0.28 passed 2024-09-04 23:20:54,259 - DEBUG - Starting all layer 2 verification in agent 10.0.0.28 2024-09-04 23:20:54,296 - DEBUG - Route for VM MAC 02:ed:8b:4b:0f:45 is consistent in agent 10.0.0.28 2024-09-04 23:20:54,344 - DEBUG - VM ctest-pt_svm0-04358173 Tap interface: {'index': '7', 'name': 'tapb9bb9173-a6', 'uuid': 'b9bb9173-a633-4aac-a21e-b4bcf96590f0', 'vrf_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856:ctest-right_vn-70836856', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856', 'vm_uuid': '17301c00-4f18-4dfe-973d-66f768a0451a', 'vm_name': 'ctest-pt_svm0-04358173', 'ip_addr': '196.223.82.68', 'mac_addr': '02:b9:bb:91:73:a6', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-22100837:b9bb9173-a633-4aac-a21e-b4bcf96590f0', 'sg_uuid_list': ['8cacae4f-0e19-4e10-bf05-c19a6603e79a'], 'static_route_list': None, 'vm_project_uuid': '54e0c4b3-1759-44af-9d7e-6b794252e0b2', 'admin_state': 'Enabled', 'flow_key_idx': '56', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-04 23:20:54,344 - DEBUG - Agent 10.0.0.28 vrf name: default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856:ctest-right_vn-70836856 2024-09-04 23:20:54,352 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856:ctest-right_vn-70836856', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.5:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-09-04 23:20:54,567 - DEBUG - VM ctest-pt_svm0-04358173 : Tap interface tapb9bb9173-a6 is set to Active 2024-09-04 23:20:54,568 - DEBUG - Tap interface tapb9bb9173-a6 detail : {'index': '7', 'name': 'tapb9bb9173-a6', 'uuid': 'b9bb9173-a633-4aac-a21e-b4bcf96590f0', 'vrf_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856:ctest-right_vn-70836856', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856', 'vm_uuid': '17301c00-4f18-4dfe-973d-66f768a0451a', 'vm_name': 'ctest-pt_svm0-04358173', 'ip_addr': '196.223.82.68', 'mac_addr': '02:b9:bb:91:73:a6', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '30', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-22100837:b9bb9173-a633-4aac-a21e-b4bcf96590f0', 'sg_uuid_list': ['8cacae4f-0e19-4e10-bf05-c19a6603e79a'], 'static_route_list': None, 'vm_project_uuid': '54e0c4b3-1759-44af-9d7e-6b794252e0b2', 'admin_state': 'Enabled', 'flow_key_idx': '56', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'ba10926d-0f2c-4bd9-aff8-9e8ccdaf81b4', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-09-04 23:20:54,748 - DEBUG - Starting Layer 2 verification in Agent 2024-09-04 23:20:54,783 - DEBUG - Layer 2 path is seen for VM MAC 02:b9:bb:91:73:a6 in agent 10.0.0.28 2024-09-04 23:20:54,784 - DEBUG - Active layer 2 route in agent is present for VMI tapb9bb9173-a6 2024-09-04 23:20:54,784 - DEBUG - L2 label(53) matches bw route table and interface table 2024-09-04 23:20:54,803 - DEBUG - VN default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856 is found in Agent of node 10.0.0.28 2024-09-04 23:20:55,049 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856 is consistent in agent 10.0.0.28 2024-09-04 23:20:55,049 - DEBUG - Route for VM IP ['196.223.82.68'] is consistent in agent 10.0.0.28 2024-09-04 23:20:55,049 - DEBUG - VN default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856 verification for VM ctest-pt_svm0-04358173 in Agent 10.0.0.28 passed 2024-09-04 23:20:55,263 - DEBUG - Starting all layer 2 verification in agent 10.0.0.28 2024-09-04 23:20:55,286 - DEBUG - Route for VM MAC 02:b9:bb:91:73:a6 is consistent in agent 10.0.0.28 2024-09-04 23:20:55,286 - INFO - VM ctest-pt_svm0-04358173 verifications in Compute nodes passed 2024-09-04 23:20:55,286 - DEBUG - The SVMs in the SI are : [] 2024-09-04 23:20:55,286 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/17301c00-4f18-4dfe-973d-66f768a0451a 2024-09-04 23:20:55,300 - DEBUG - Service VM for SI 'ctest-si-87654643' is launched 2024-09-04 23:20:55,300 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:20:55,314 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:20:55,357 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:20:55,480 - DEBUG - Requesting: http://10.0.0.28:8082/service-instance/9bb5acd8-0c81-4cb8-9212-d83deb116cd1 2024-09-04 23:20:55,498 - DEBUG - SI ctest-si-87654643 has Port Tuple: ['ctest-port_tuple-24504120'] 2024-09-04 23:20:55,623 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-22100837:ctest-left_vn-82023620 2024-09-04 23:20:55,787 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-22100837:ctest-right_vn-70836856 2024-09-04 23:20:55,995 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,023 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,023 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,038 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,038 - INFO - Route to 196.223.82.67 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-1849-1, and SI ctest-si-87654643 is seen as the NH 2024-09-04 23:20:56,192 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,224 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,224 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,242 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,242 - INFO - Route to 43.30.67.3 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-1849-1, and SI ctest-si-87654643 is seen as the NH 2024-09-04 23:20:56,243 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,243 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-04 23:20:56,243 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 196.223.82.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.28, gateway password: c0ntrail123 2024-09-04 23:20:56,243 - DEBUG - ping -s 56 -c 3 -W 1 196.223.82.67 2024-09-04 23:21:00,522 - DEBUG - PING 196.223.82.67 (196.223.82.67): 56 data bytes 64 bytes from 196.223.82.67: seq=0 ttl=61 time=9.092 ms 64 bytes from 196.223.82.67: seq=1 ttl=61 time=3.549 ms 64 bytes from 196.223.82.67: seq=2 ttl=61 time=3.220 ms --- 196.223.82.67 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 3.220/5.287/9.092 ms 2024-09-04 23:21:00,522 - INFO - Ping to IP 196.223.82.67 from VM ctest-left_vm-15889378 passed 2024-09-04 23:21:00,523 - INFO - Dettaching policy ctest-policy-91852531 from vn ctest-right_vn-70836856 2024-09-04 23:21:00,772 - INFO - Dettaching policy ctest-policy-91852531 from vn ctest-left_vn-82023620 2024-09-04 23:21:01,153 - INFO - Deleted policy ctest-policy-91852531 2024-09-04 23:21:01,154 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-si-87654643'] 2024-09-04 23:21:01,335 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-22100837', 'ctest-si-87654643'] 2024-09-04 23:21:01,335 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:21:01,348 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:21:01,397 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:21:01,491 - DEBUG - Service instance ctest-si-87654643 removed from api server 2024-09-04 23:21:01,491 - DEBUG - Requesting: http://10.0.0.28:8082/virtual-machine/17301c00-4f18-4dfe-973d-66f768a0451a 2024-09-04 23:21:01,505 - DEBUG - All Service VMs unlinked from SI ctest-si-87654643 2024-09-04 23:21:01,512 - DEBUG - 0 svc intances found in all projects. They are [] 2024-09-04 23:21:01,513 - DEBUG - 0 svc intances found in current project. They are [] 2024-09-04 23:21:01,562 - DEBUG - 0 svc intances found in all projects. They are [] 2024-09-04 23:21:01,562 - DEBUG - 0 svc intances found in current project. They are [] 2024-09-04 23:21:01,563 - INFO - Deleting VM ctest-pt_svm0-04358173 2024-09-04 23:21:01,630 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-20698017'] 2024-09-04 23:21:01,738 - INFO - Service template: ['default-domain', 'ctest-service_template_1-20698017'] deleted successfully. 2024-09-04 23:21:01,739 - INFO - Deleting VM ctest-right_vm-33975123 2024-09-04 23:21:01,810 - INFO - Deleting VM ctest-left_vm-15889378 2024-09-04 23:21:01,909 - INFO - Deleting VN ctest-right_vn-70836856 2024-09-04 23:21:01,964 - DEBUG - VN d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52 still in use: Unable to complete operation on network d1d2a4d6-2a24-41b9-89df-b8d97c5f6b52. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c093f9ac-4e7c-4b49-a6f1-2b0f9984e94b'] 2024-09-04 23:21:01,964 - WARNING - Deleting VN ctest-right_vn-70836856 failed..Will retry 2024-09-04 23:21:04,264 - DEBUG - Response for deleting network () 2024-09-04 23:21:04,265 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/5e7af08d-2064-45f5-84fb-822b26d3fc3a 2024-09-04 23:21:04,280 - DEBUG - Response Code: 404 2024-09-04 23:21:04,280 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:21:04,294 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:21:04,328 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:21:04,462 - INFO - Validated that VN ctest-right_vn-70836856 is not found in API Server 2024-09-04 23:21:04,486 - DEBUG - VN ctest-right_vn-70836856 is not present in Agent 10.0.0.28 2024-09-04 23:21:04,486 - INFO - Validated that VN ctest-right_vn-70836856 is not in any agent 2024-09-04 23:21:04,524 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-70836856 info 2024-09-04 23:21:04,524 - INFO - Deleting VN ctest-left_vn-82023620 2024-09-04 23:21:04,779 - DEBUG - Response for deleting network () 2024-09-04 23:21:04,779 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/130c475c-2c78-496a-97c6-1bc8ee2a2d34 2024-09-04 23:21:04,787 - DEBUG - Response Code: 404 2024-09-04 23:21:04,787 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:21:04,795 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:21:04,816 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:21:04,927 - INFO - Validated that VN ctest-left_vn-82023620 is not found in API Server 2024-09-04 23:21:04,961 - DEBUG - VN ctest-left_vn-82023620 is not present in Agent 10.0.0.28 2024-09-04 23:21:04,962 - INFO - Validated that VN ctest-left_vn-82023620 is not in any agent 2024-09-04 23:21:05,016 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-82023620 info 2024-09-04 23:21:05,016 - INFO - Deleting VN ctest-mgmt_vn-83947504 2024-09-04 23:21:05,283 - DEBUG - Response for deleting network () 2024-09-04 23:21:05,284 - DEBUG - Requesting: http://10.0.0.28:8082/routing-instance/8e1310cc-82e2-45db-a4d4-808d9f97ab15 2024-09-04 23:21:05,297 - DEBUG - Response Code: 404 2024-09-04 23:21:05,298 - DEBUG - Requesting: http://10.0.0.28:8082/domains 2024-09-04 23:21:05,309 - DEBUG - Requesting: http://10.0.0.28:8082/domain/a87246bd-bf12-4d0d-8deb-82b8ce51ffe9 2024-09-04 23:21:05,336 - DEBUG - Requesting: http://10.0.0.28:8082/project/54e0c4b3-1759-44af-9d7e-6b794252e0b2 2024-09-04 23:21:05,443 - INFO - Validated that VN ctest-mgmt_vn-83947504 is not found in API Server 2024-09-04 23:21:05,476 - DEBUG - VN ctest-mgmt_vn-83947504 is not present in Agent 10.0.0.28 2024-09-04 23:21:05,476 - INFO - Validated that VN ctest-mgmt_vn-83947504 is not in any agent 2024-09-04 23:21:05,529 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-83947504 info 2024-09-04 23:21:05,878 - DEBUG - No XMPP flaps were noticed during the test 2024-09-04 23:21:05,878 - INFO - 2024-09-04 23:21:05,879 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:27] 2024-09-04 23:21:05,879 - INFO - -------------------------------------------------------------------------------- 2024-09-04 23:21:06,839 - INFO - Deleted project: ctest-TestSvcRegr-22100837, ID : 54e0c4b3-1759-44af-9d7e-6b794252e0b2