2024-10-23 13:56:43,976 - INFO - Domain Default found not creating 2024-10-23 13:56:44,168 - INFO - Project ctest-TestSvcRegr-42119199 not found, creating it 2024-10-23 13:56:44,685 - INFO - Created Project:ctest-TestSvcRegr-42119199, ID : 32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:46,258 - INFO - ================================================================================ 2024-10-23 13:56:46,259 - INFO - STARTING TEST : test_svc_in_network_datapath 2024-10-23 13:56:46,533 - DEBUG - Nothing to compare xmpp stats {'10.0.0.35': {'10.20.0.5': '0'}} with 2024-10-23 13:56:46,534 - INFO - Initial checks done. Running the testcase now 2024-10-23 13:56:46,534 - INFO - 2024-10-23 13:56:47,142 - DEBUG - Response for create_network : {'network': {'id': '4cfe49b3-eeaf-4246-910e-c67d5966bed5', 'name': 'ctest-mgmt_vn-50507719', 'tenant_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'project_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-mgmt_vn-50507719'], 'port_security_enabled': True, 'description': ''}} 2024-10-23 13:56:47,400 - DEBUG - Response for create_subnet : {'subnet': {'id': '3c8f6759-13b5-41cd-a183-34152bb5c782', 'name': '', 'tenant_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'network_id': '4cfe49b3-eeaf-4246-910e-c67d5966bed5', 'ip_version': 4, 'cidr': '30.112.99.128/26', 'allocation_pools': [{'start': '30.112.99.130', 'end': '30.112.99.190'}], 'gateway_ip': '30.112.99.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.112.99.130', 'tags': [], 'project_id': '32d5f7d53f0a4c1eb90bf92de3c27597'}} 2024-10-23 13:56:47,422 - INFO - Created VN ctest-mgmt_vn-50507719 2024-10-23 13:56:47,480 - DEBUG - VN ctest-mgmt_vn-50507719 UUID is 4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:47,607 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:47,919 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:47,957 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:56:47,973 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:48,060 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:48,076 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:48,094 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/8fb1c656-1c40-4592-8a67-b5d8f7eeeb5c 2024-10-23 13:56:48,107 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/8fb1c656-1c40-4592-8a67-b5d8f7eeeb5c 2024-10-23 13:56:48,118 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/77e5f262-352d-4460-97fa-14a82a16bd63 2024-10-23 13:56:48,126 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-23 13:56:48,126 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:48,141 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/8fb1c656-1c40-4592-8a67-b5d8f7eeeb5c 2024-10-23 13:56:48,163 - INFO - Verified VN network id 7 for VN 4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:48,163 - INFO - Verifications in API Server for VN ctest-mgmt_vn-50507719 passed 2024-10-23 13:56:48,163 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:48,177 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/8fb1c656-1c40-4592-8a67-b5d8f7eeeb5c 2024-10-23 13:56:48,187 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/8fb1c656-1c40-4592-8a67-b5d8f7eeeb5c 2024-10-23 13:56:48,195 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/77e5f262-352d-4460-97fa-14a82a16bd63 2024-10-23 13:56:48,213 - DEBUG - Control-node 10.0.0.35 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-42119199', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5547952828119466566', 'uuid-lslong': '10452510026846617301'}, 'enable': 'true', 'created': '2024-10-23T13:56:47', 'last-modified': '2024-10-23T13:56:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.858806'} 2024-10-23 13:56:48,221 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-23 13:56:48,221 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-50507719 passed 2024-10-23 13:56:48,221 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-50507719 in API_Server ====== 2024-10-23 13:56:48,221 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:48,228 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:56:48,245 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:48,336 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/4cfe49b3-eeaf-4246-910e-c67d5966bed5 2024-10-23 13:56:48,354 - DEBUG - =>VN ctest-mgmt_vn-50507719 has no policy to be verified 2024-10-23 13:56:48,354 - DEBUG - Verifying the vn in opserver 2024-10-23 13:56:48,354 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 virtual network link through opserver 10.0.0.35 2024-10-23 13:56:48,354 - DEBUG - Requesting: http://10.0.0.35:8081/analytics/uves/virtual-networks 2024-10-23 13:56:48,652 - DEBUG - Requesting: http://10.0.0.35:8081/analytics/uves/virtual-networks 2024-10-23 13:56:48,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719', 'href': 'http://10.0.0.35:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719?flat'} 2024-10-23 13:56:48,722 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is found in opserver 2024-10-23 13:56:48,733 - DEBUG - Do not have enough data to verify VN in agent 2024-10-23 13:56:48,738 - DEBUG - VRF ids for VN ctest-mgmt_vn-50507719: {} 2024-10-23 13:56:48,949 - DEBUG - Response for create_network : {'network': {'id': '3f39af25-9e19-44cb-893a-bd17c76bcc06', 'name': 'ctest-left_vn-11800827', 'tenant_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'project_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827'], 'port_security_enabled': True, 'description': ''}} 2024-10-23 13:56:49,198 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c6d05948-b1d3-4ac8-a849-d5e695c58dba', 'name': '', 'tenant_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'network_id': '3f39af25-9e19-44cb-893a-bd17c76bcc06', 'ip_version': 4, 'cidr': '112.49.199.128/26', 'allocation_pools': [{'start': '112.49.199.130', 'end': '112.49.199.190'}], 'gateway_ip': '112.49.199.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '112.49.199.130', 'tags': [], 'project_id': '32d5f7d53f0a4c1eb90bf92de3c27597'}} 2024-10-23 13:56:49,222 - INFO - Created VN ctest-left_vn-11800827 2024-10-23 13:56:49,284 - DEBUG - VN ctest-left_vn-11800827 UUID is 3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,390 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:49,400 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:56:49,414 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:49,494 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,510 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,526 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/fd5f39ad-330c-46e3-bbb0-7ec1348d31a5 2024-10-23 13:56:49,539 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/fd5f39ad-330c-46e3-bbb0-7ec1348d31a5 2024-10-23 13:56:49,551 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/dc402ad2-428e-43d6-bda9-acfa0804b418 2024-10-23 13:56:49,564 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-10-23 13:56:49,564 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,585 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/fd5f39ad-330c-46e3-bbb0-7ec1348d31a5 2024-10-23 13:56:49,611 - INFO - Verified VN network id 8 for VN 3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,611 - INFO - Verifications in API Server for VN ctest-left_vn-11800827 passed 2024-10-23 13:56:49,611 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,633 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/fd5f39ad-330c-46e3-bbb0-7ec1348d31a5 2024-10-23 13:56:49,647 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/fd5f39ad-330c-46e3-bbb0-7ec1348d31a5 2024-10-23 13:56:49,661 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/dc402ad2-428e-43d6-bda9-acfa0804b418 2024-10-23 13:56:49,683 - DEBUG - Control-node 10.0.0.35 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-42119199', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4555865074163074251', 'uuid-lslong': '9888423841672973318'}, 'enable': 'true', 'created': '2024-10-23T13:56:48', 'last-modified': '2024-10-23T13:56:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.539909'} 2024-10-23 13:56:49,695 - DEBUG - Route Targets: ['target:64512:8000006'] 2024-10-23 13:56:49,695 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-11800827 passed 2024-10-23 13:56:49,696 - DEBUG - ====Verifying policy data for ctest-left_vn-11800827 in API_Server ====== 2024-10-23 13:56:49,696 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:49,706 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:56:49,725 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:49,810 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/3f39af25-9e19-44cb-893a-bd17c76bcc06 2024-10-23 13:56:49,825 - DEBUG - =>VN ctest-left_vn-11800827 has no policy to be verified 2024-10-23 13:56:49,825 - DEBUG - Verifying the vn in opserver 2024-10-23 13:56:49,825 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827 virtual network link through opserver 10.0.0.35 2024-10-23 13:56:49,825 - DEBUG - Requesting: http://10.0.0.35:8081/analytics/uves/virtual-networks 2024-10-23 13:56:49,837 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827', 'href': 'http://10.0.0.35:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827?flat'} 2024-10-23 13:56:49,837 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827 is found in opserver 2024-10-23 13:56:49,851 - DEBUG - Do not have enough data to verify VN in agent 2024-10-23 13:56:49,859 - DEBUG - VRF ids for VN ctest-left_vn-11800827: {} 2024-10-23 13:56:50,085 - DEBUG - Response for create_network : {'network': {'id': '7bb778af-0d4e-48e3-8f93-6d78538b131d', 'name': 'ctest-right_vn-32900022', 'tenant_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'project_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-right_vn-32900022'], 'port_security_enabled': True, 'description': ''}} 2024-10-23 13:56:50,283 - DEBUG - Response for create_subnet : {'subnet': {'id': '1b0c45e0-6893-42d3-801e-8ed0ee5dad6c', 'name': '', 'tenant_id': '32d5f7d53f0a4c1eb90bf92de3c27597', 'network_id': '7bb778af-0d4e-48e3-8f93-6d78538b131d', 'ip_version': 4, 'cidr': '103.245.126.0/26', 'allocation_pools': [{'start': '103.245.126.2', 'end': '103.245.126.62'}], 'gateway_ip': '103.245.126.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.245.126.2', 'tags': [], 'project_id': '32d5f7d53f0a4c1eb90bf92de3c27597'}} 2024-10-23 13:56:50,307 - INFO - Created VN ctest-right_vn-32900022 2024-10-23 13:56:50,368 - DEBUG - VN ctest-right_vn-32900022 UUID is 7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,500 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:50,507 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:56:50,521 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:50,610 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,626 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,641 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/01b5fae8-a144-4761-a944-92dd549c552a 2024-10-23 13:56:50,651 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/01b5fae8-a144-4761-a944-92dd549c552a 2024-10-23 13:56:50,662 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/12a0ad10-ca7c-4492-a4f2-d126fe8321f8 2024-10-23 13:56:50,673 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-10-23 13:56:50,673 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,690 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/01b5fae8-a144-4761-a944-92dd549c552a 2024-10-23 13:56:50,714 - INFO - Verified VN network id 9 for VN 7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,714 - INFO - Verifications in API Server for VN ctest-right_vn-32900022 passed 2024-10-23 13:56:50,714 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,730 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/01b5fae8-a144-4761-a944-92dd549c552a 2024-10-23 13:56:50,740 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/01b5fae8-a144-4761-a944-92dd549c552a 2024-10-23 13:56:50,750 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/12a0ad10-ca7c-4492-a4f2-d126fe8321f8 2024-10-23 13:56:50,766 - DEBUG - Control-node 10.0.0.35 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-42119199', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8914726680641030371', 'uuid-lslong': '10345733132565287709'}, 'enable': 'true', 'created': '2024-10-23T13:56:50', 'last-modified': '2024-10-23T13:56:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.533782'} 2024-10-23 13:56:50,774 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-10-23 13:56:50,775 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-32900022 passed 2024-10-23 13:56:50,775 - DEBUG - ====Verifying policy data for ctest-right_vn-32900022 in API_Server ====== 2024-10-23 13:56:50,775 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:56:50,783 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:56:50,800 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:56:50,889 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/7bb778af-0d4e-48e3-8f93-6d78538b131d 2024-10-23 13:56:50,905 - DEBUG - =>VN ctest-right_vn-32900022 has no policy to be verified 2024-10-23 13:56:50,905 - DEBUG - Verifying the vn in opserver 2024-10-23 13:56:50,906 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022 virtual network link through opserver 10.0.0.35 2024-10-23 13:56:50,906 - DEBUG - Requesting: http://10.0.0.35:8081/analytics/uves/virtual-networks 2024-10-23 13:56:50,919 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022', 'href': 'http://10.0.0.35:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022?flat'} 2024-10-23 13:56:50,919 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022 is found in opserver 2024-10-23 13:56:50,934 - DEBUG - Do not have enough data to verify VN in agent 2024-10-23 13:56:50,942 - DEBUG - VRF ids for VN ctest-right_vn-32900022: {} 2024-10-23 13:56:51,007 - DEBUG - Services list from nova: [, , ] 2024-10-23 13:56:52,125 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2129-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2129-1) 2024-10-23 13:56:53,362 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2129-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2129-1) 2024-10-23 13:56:53,362 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-02448508'] 2024-10-23 13:56:53,743 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-02448508'] created succesfully 2024-10-23 13:56:54,104 - DEBUG - Image by name cirros_in_net not found 2024-10-23 13:56:54,104 - DEBUG - Installing image cirros_in_net 2024-10-23 13:56:54,104 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'vcpath': '/images/vcenter/', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2024-10-23 13:56:54,104 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-10-23 13:56:54,105 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2024-10-23 13:56:54,121 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2024-10-23 13:56:54,521 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2024-10-23 13:56:54,522 - DEBUG - Unzip image 2024-10-23 13:56:54,522 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2024-10-23 13:56:54,690 - DEBUG - Try to create image in user context 2024-10-23 13:56:54,938 - DEBUG - Image has been created in user context 2024-10-23 13:56:54,938 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2024-10-23 13:56:54,956 - DEBUG - Downloaded image has been removed 2024-10-23 13:56:54,971 - DEBUG - Uploaded image status = active 2024-10-23 13:56:56,210 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2129-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2129-1) 2024-10-23 13:56:56,210 - INFO - Waiting for VM ctest-pt_svm0-66232535 to be up.. 2024-10-23 13:56:56,263 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-23 13:57:01,371 - DEBUG - VM is in ACTIVE state now 2024-10-23 13:57:01,372 - INFO - VM name : ctest-pt_svm0-66232535 2024-10-23 13:57:01,485 - DEBUG - VM ctest-pt_svm0-66232535 ID is 081cba75-052c-4f0f-bedd-5f39d67dc1f0 2024-10-23 13:57:01,510 - DEBUG - VM ctest-pt_svm0-66232535 launched on Node cn-jenkins-deploy-platform-ansible-os-2129-1 2024-10-23 13:57:01,860 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/081cba75-052c-4f0f-bedd-5f39d67dc1f0 2024-10-23 13:57:01,875 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/6cf10119-8c8d-4393-a7b0-2b7971f2b8fe 2024-10-23 13:57:01,895 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/88930b91-7747-43bd-a988-31f602a04897 2024-10-23 13:57:01,916 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/c7108f78-210d-4f46-a14e-fd1445b6e81c 2024-10-23 13:57:05,261 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2024-10-23 13:57:05,262 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66232535 failed! 2024-10-23 13:57:05,328 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is 30.112.99.129 and allocation pool is NOT set 2024-10-23 13:57:09,427 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2024-10-23 13:57:09,427 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66232535 failed! 2024-10-23 13:57:09,492 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is 30.112.99.129 and allocation pool is NOT set 2024-10-23 13:57:13,586 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2024-10-23 13:57:13,586 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66232535 failed! 2024-10-23 13:57:13,648 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is 30.112.99.129 and allocation pool is NOT set 2024-10-23 13:57:17,745 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2024-10-23 13:57:17,746 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66232535 failed! 2024-10-23 13:57:17,812 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is 30.112.99.129 and allocation pool is NOT set 2024-10-23 13:57:19,879 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.17 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.826 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.826/2.499/4.173/1.673 ms') 2024-10-23 13:57:19,879 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66232535 passed 2024-10-23 13:57:20,040 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:20,040 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:20,106 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-23 13:57:20,214 - DEBUG - VM ctest-pt_svm0-66232535 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-23 13:57:25,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:25,215 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:25,271 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-23 13:57:25,366 - DEBUG - VM ctest-pt_svm0-66232535 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-23 13:57:30,367 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:30,367 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:30,434 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-23 13:57:30,541 - DEBUG - VM ctest-pt_svm0-66232535 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-23 13:57:35,542 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:35,542 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:35,610 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-23 13:57:35,714 - DEBUG - VM ctest-pt_svm0-66232535 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-23 13:57:40,714 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:40,715 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:40,871 - DEBUG - VM ctest-pt_svm0-66232535 is ready for SSH connections 2024-10-23 13:57:41,032 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:41,032 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:41,202 - DEBUG - VM ctest-pt_svm0-66232535 is ready for SSH connections 2024-10-23 13:57:41,372 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:41,372 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66232535, IP 30.112.99.131, Port 22 2024-10-23 13:57:41,535 - DEBUG - VM ctest-pt_svm0-66232535 is ready for SSH connections 2024-10-23 13:57:41,542 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-si-94944762'] 2024-10-23 13:57:42,520 - INFO - Waiting for VM ctest-left_vm-26377158 to be up.. 2024-10-23 13:57:42,618 - DEBUG - VM is in ACTIVE state now 2024-10-23 13:57:42,618 - INFO - VM name : ctest-left_vm-26377158 2024-10-23 13:57:42,716 - DEBUG - VM ctest-left_vm-26377158 ID is 32f0a381-5221-436e-8e68-8a53e191b653 2024-10-23 13:57:42,716 - DEBUG - VM ctest-left_vm-26377158 launched on Node cn-jenkins-deploy-platform-ansible-os-2129-1 2024-10-23 13:57:42,818 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/32f0a381-5221-436e-8e68-8a53e191b653 2024-10-23 13:57:42,830 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/f7911fdf-fbab-470a-8819-b73e134fdf30 2024-10-23 13:57:44,100 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.60 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.465 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.465/2.031/3.598/1.566 ms') 2024-10-23 13:57:44,100 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-26377158 passed 2024-10-23 13:57:44,264 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:44,264 - DEBUG - Waiting to SSH to VM ctest-left_vm-26377158, IP 112.49.199.131, Port 22 2024-10-23 13:57:44,419 - DEBUG - VM ctest-left_vm-26377158 is ready for SSH connections 2024-10-23 13:57:44,419 - INFO - Waiting for VM ctest-right_vm-58047989 to be up.. 2024-10-23 13:57:44,511 - DEBUG - VM is in ACTIVE state now 2024-10-23 13:57:44,511 - INFO - VM name : ctest-right_vm-58047989 2024-10-23 13:57:44,602 - DEBUG - VM ctest-right_vm-58047989 ID is 8fefc9c1-9001-4db3-a183-dfefb0f07640 2024-10-23 13:57:44,602 - DEBUG - VM ctest-right_vm-58047989 launched on Node cn-jenkins-deploy-platform-ansible-os-2129-1 2024-10-23 13:57:44,693 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/8fefc9c1-9001-4db3-a183-dfefb0f07640 2024-10-23 13:57:44,703 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/b9d1ae29-bfd6-49bd-a889-77a32bfd4c89 2024-10-23 13:57:45,960 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.06 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.662 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.662/1.862/3.062/1.200 ms') 2024-10-23 13:57:45,961 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-58047989 passed 2024-10-23 13:57:46,120 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-23 13:57:46,120 - DEBUG - Waiting to SSH to VM ctest-right_vm-58047989, IP 103.245.126.3, Port 22 2024-10-23 13:57:46,294 - DEBUG - VM ctest-right_vm-58047989 is ready for SSH connections 2024-10-23 13:57:46,302 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-42119199:ctest-si-94944762'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2024-10-23 13:57:46,764 - INFO - Attaching policy ctest-policy-14498953 to vn ctest-left_vn-11800827 2024-10-23 13:57:47,339 - INFO - Attaching policy ctest-policy-14498953 to vn ctest-right_vn-32900022 2024-10-23 13:57:47,824 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-02448508'] created succesfully 2024-10-23 13:57:48,060 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-si-94944762'] created succesfully 2024-10-23 13:57:48,060 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:57:48,071 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:57:48,089 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:57:48,172 - DEBUG - Requesting: http://10.0.0.35:8082/service-instance/5e16c33a-7454-4cf8-a9d8-37b563f3fbd4 2024-10-23 13:57:48,185 - DEBUG - SI 'ctest-si-94944762' has service template ref to ctest-service_template_1-02448508 2024-10-23 13:57:48,185 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:57:48,192 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:57:48,207 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:57:48,298 - DEBUG - Requesting: http://10.0.0.35:8082/service-instance/5e16c33a-7454-4cf8-a9d8-37b563f3fbd4 2024-10-23 13:57:48,312 - DEBUG - Requesting: http://10.0.0.35:8082/port-tuple/dbbb2a75-5033-4dd5-8f00-98217695a3cb 2024-10-23 13:57:48,322 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/6cf10119-8c8d-4393-a7b0-2b7971f2b8fe 2024-10-23 13:57:48,340 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/88930b91-7747-43bd-a988-31f602a04897 2024-10-23 13:57:48,358 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/c7108f78-210d-4f46-a14e-fd1445b6e81c 2024-10-23 13:57:48,581 - DEBUG - VM is in ACTIVE state now 2024-10-23 13:57:49,072 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/081cba75-052c-4f0f-bedd-5f39d67dc1f0 2024-10-23 13:57:49,084 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/6cf10119-8c8d-4393-a7b0-2b7971f2b8fe 2024-10-23 13:57:49,099 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/88930b91-7747-43bd-a988-31f602a04897 2024-10-23 13:57:49,115 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/c7108f78-210d-4f46-a14e-fd1445b6e81c 2024-10-23 13:57:49,130 - DEBUG - Requesting: http://10.0.0.35:8082/instance-ip/67fe79f6-cddf-4dd5-8dbb-f994ac7736ff 2024-10-23 13:57:49,141 - DEBUG - Requesting: http://10.0.0.35:8082/instance-ip/693e9859-b176-45dd-8a9b-917c009cfc40 2024-10-23 13:57:49,153 - DEBUG - Requesting: http://10.0.0.35:8082/instance-ip/ad46fa0d-7c48-4bb5-b8ef-140ddf490750 2024-10-23 13:57:49,596 - DEBUG - VM is in ACTIVE state now 2024-10-23 13:57:49,596 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/081cba75-052c-4f0f-bedd-5f39d67dc1f0 2024-10-23 13:57:49,607 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/6cf10119-8c8d-4393-a7b0-2b7971f2b8fe 2024-10-23 13:57:49,623 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/88930b91-7747-43bd-a988-31f602a04897 2024-10-23 13:57:49,640 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/c7108f78-210d-4f46-a14e-fd1445b6e81c 2024-10-23 13:57:50,913 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.08 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.567 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.567/0.822/1.077/0.255 ms') 2024-10-23 13:57:50,913 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-66232535 passed 2024-10-23 13:57:50,960 - DEBUG - VM ctest-pt_svm0-66232535 Tap interface: {'index': '6', 'name': 'tap88930b91-77', 'uuid': '88930b91-7747-43bd-a988-31f602a04897', 'vrf_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827:ctest-left_vn-11800827', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827', 'vm_uuid': '081cba75-052c-4f0f-bedd-5f39d67dc1f0', 'vm_name': 'ctest-pt_svm0-66232535', 'ip_addr': '112.49.199.132', 'mac_addr': '02:88:93:0b:91:77', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-42119199:88930b91-7747-43bd-a988-31f602a04897', 'sg_uuid_list': ['38c8648c-9d9a-4587-818f-7ac2316fc383'], 'static_route_list': None, 'vm_project_uuid': '32d5f7d5-3f0a-4c1e-b90b-f92de3c27597', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'c7108f78-210d-4f46-a14e-fd1445b6e81c', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-23 13:57:50,960 - DEBUG - Agent 10.0.0.35 vrf name: default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827:ctest-left_vn-11800827 2024-10-23 13:57:50,967 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827:ctest-left_vn-11800827', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.5:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-10-23 13:57:51,139 - DEBUG - VM ctest-pt_svm0-66232535 : Tap interface tap88930b91-77 is set to Active 2024-10-23 13:57:51,139 - DEBUG - Tap interface tap88930b91-77 detail : {'index': '6', 'name': 'tap88930b91-77', 'uuid': '88930b91-7747-43bd-a988-31f602a04897', 'vrf_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827:ctest-left_vn-11800827', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827', 'vm_uuid': '081cba75-052c-4f0f-bedd-5f39d67dc1f0', 'vm_name': 'ctest-pt_svm0-66232535', 'ip_addr': '112.49.199.132', 'mac_addr': '02:88:93:0b:91:77', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-42119199:88930b91-7747-43bd-a988-31f602a04897', 'sg_uuid_list': ['38c8648c-9d9a-4587-818f-7ac2316fc383'], 'static_route_list': None, 'vm_project_uuid': '32d5f7d5-3f0a-4c1e-b90b-f92de3c27597', 'admin_state': 'Enabled', 'flow_key_idx': '42', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'c7108f78-210d-4f46-a14e-fd1445b6e81c', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-23 13:57:51,340 - DEBUG - Starting Layer 2 verification in Agent 2024-10-23 13:57:51,353 - DEBUG - Layer 2 path is seen for VM MAC 02:88:93:0b:91:77 in agent 10.0.0.35 2024-10-23 13:57:51,353 - DEBUG - Active layer 2 route in agent is present for VMI tap88930b91-77 2024-10-23 13:57:51,354 - DEBUG - L2 label(48) matches bw route table and interface table 2024-10-23 13:57:51,361 - DEBUG - VN default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827 is found in Agent of node 10.0.0.35 2024-10-23 13:57:51,584 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827 is consistent in agent 10.0.0.35 2024-10-23 13:57:51,584 - DEBUG - Route for VM IP ['112.49.199.132'] is consistent in agent 10.0.0.35 2024-10-23 13:57:51,584 - DEBUG - VN default-domain:ctest-TestSvcRegr-42119199:ctest-left_vn-11800827 verification for VM ctest-pt_svm0-66232535 in Agent 10.0.0.35 passed 2024-10-23 13:57:51,788 - DEBUG - Starting all layer 2 verification in agent 10.0.0.35 2024-10-23 13:57:51,807 - DEBUG - Route for VM MAC 02:88:93:0b:91:77 is consistent in agent 10.0.0.35 2024-10-23 13:57:51,833 - DEBUG - VM ctest-pt_svm0-66232535 Tap interface: {'index': '5', 'name': 'tap6cf10119-8c', 'uuid': '6cf10119-8c8d-4393-a7b0-2b7971f2b8fe', 'vrf_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719:ctest-mgmt_vn-50507719', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719', 'vm_uuid': '081cba75-052c-4f0f-bedd-5f39d67dc1f0', 'vm_name': 'ctest-pt_svm0-66232535', 'ip_addr': '30.112.99.131', 'mac_addr': '02:6c:f1:01:19:8c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '26', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-42119199:6cf10119-8c8d-4393-a7b0-2b7971f2b8fe', 'sg_uuid_list': ['38c8648c-9d9a-4587-818f-7ac2316fc383'], 'static_route_list': None, 'vm_project_uuid': '32d5f7d5-3f0a-4c1e-b90b-f92de3c27597', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-23 13:57:51,833 - DEBUG - Agent 10.0.0.35 vrf name: default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719:ctest-mgmt_vn-50507719 2024-10-23 13:57:51,840 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719:ctest-mgmt_vn-50507719', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.5:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-10-23 13:57:52,013 - DEBUG - VM ctest-pt_svm0-66232535 : Tap interface tap6cf10119-8c is set to Active 2024-10-23 13:57:52,013 - DEBUG - Tap interface tap6cf10119-8c detail : {'index': '5', 'name': 'tap6cf10119-8c', 'uuid': '6cf10119-8c8d-4393-a7b0-2b7971f2b8fe', 'vrf_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719:ctest-mgmt_vn-50507719', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719', 'vm_uuid': '081cba75-052c-4f0f-bedd-5f39d67dc1f0', 'vm_name': 'ctest-pt_svm0-66232535', 'ip_addr': '30.112.99.131', 'mac_addr': '02:6c:f1:01:19:8c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '26', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-42119199:6cf10119-8c8d-4393-a7b0-2b7971f2b8fe', 'sg_uuid_list': ['38c8648c-9d9a-4587-818f-7ac2316fc383'], 'static_route_list': None, 'vm_project_uuid': '32d5f7d5-3f0a-4c1e-b90b-f92de3c27597', 'admin_state': 'Enabled', 'flow_key_idx': '43', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-23 13:57:52,228 - DEBUG - Starting Layer 2 verification in Agent 2024-10-23 13:57:52,241 - DEBUG - Layer 2 path is seen for VM MAC 02:6c:f1:01:19:8c in agent 10.0.0.35 2024-10-23 13:57:52,241 - DEBUG - Active layer 2 route in agent is present for VMI tap6cf10119-8c 2024-10-23 13:57:52,241 - DEBUG - L2 label(43) matches bw route table and interface table 2024-10-23 13:57:52,248 - DEBUG - VN default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is found in Agent of node 10.0.0.35 2024-10-23 13:57:52,483 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 is consistent in agent 10.0.0.35 2024-10-23 13:57:52,484 - DEBUG - Route for VM IP ['30.112.99.131'] is consistent in agent 10.0.0.35 2024-10-23 13:57:52,484 - DEBUG - VN default-domain:ctest-TestSvcRegr-42119199:ctest-mgmt_vn-50507719 verification for VM ctest-pt_svm0-66232535 in Agent 10.0.0.35 passed 2024-10-23 13:57:52,688 - DEBUG - Starting all layer 2 verification in agent 10.0.0.35 2024-10-23 13:57:52,699 - DEBUG - Route for VM MAC 02:6c:f1:01:19:8c is consistent in agent 10.0.0.35 2024-10-23 13:57:52,722 - DEBUG - VM ctest-pt_svm0-66232535 Tap interface: {'index': '7', 'name': 'tapc7108f78-21', 'uuid': 'c7108f78-210d-4f46-a14e-fd1445b6e81c', 'vrf_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022:ctest-right_vn-32900022', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022', 'vm_uuid': '081cba75-052c-4f0f-bedd-5f39d67dc1f0', 'vm_name': 'ctest-pt_svm0-66232535', 'ip_addr': '103.245.126.4', 'mac_addr': '02:c7:10:8f:78:21', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-42119199:c7108f78-210d-4f46-a14e-fd1445b6e81c', 'sg_uuid_list': ['38c8648c-9d9a-4587-818f-7ac2316fc383'], 'static_route_list': None, 'vm_project_uuid': '32d5f7d5-3f0a-4c1e-b90b-f92de3c27597', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '88930b91-7747-43bd-a988-31f602a04897', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-23 13:57:52,722 - DEBUG - Agent 10.0.0.35 vrf name: default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022:ctest-right_vn-32900022 2024-10-23 13:57:52,728 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022:ctest-right_vn-32900022', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.5:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2024-10-23 13:57:52,898 - DEBUG - VM ctest-pt_svm0-66232535 : Tap interface tapc7108f78-21 is set to Active 2024-10-23 13:57:52,899 - DEBUG - Tap interface tapc7108f78-21 detail : {'index': '7', 'name': 'tapc7108f78-21', 'uuid': 'c7108f78-210d-4f46-a14e-fd1445b6e81c', 'vrf_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022:ctest-right_vn-32900022', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022', 'vm_uuid': '081cba75-052c-4f0f-bedd-5f39d67dc1f0', 'vm_name': 'ctest-pt_svm0-66232535', 'ip_addr': '103.245.126.4', 'mac_addr': '02:c7:10:8f:78:21', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-42119199:c7108f78-210d-4f46-a14e-fd1445b6e81c', 'sg_uuid_list': ['38c8648c-9d9a-4587-818f-7ac2316fc383'], 'static_route_list': None, 'vm_project_uuid': '32d5f7d5-3f0a-4c1e-b90b-f92de3c27597', 'admin_state': 'Enabled', 'flow_key_idx': '28', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '88930b91-7747-43bd-a988-31f602a04897', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2024-10-23 13:57:53,100 - DEBUG - Starting Layer 2 verification in Agent 2024-10-23 13:57:53,114 - DEBUG - Layer 2 path is seen for VM MAC 02:c7:10:8f:78:21 in agent 10.0.0.35 2024-10-23 13:57:53,114 - DEBUG - Active layer 2 route in agent is present for VMI tapc7108f78-21 2024-10-23 13:57:53,114 - DEBUG - L2 label(53) matches bw route table and interface table 2024-10-23 13:57:53,121 - DEBUG - VN default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022 is found in Agent of node 10.0.0.35 2024-10-23 13:57:53,339 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022 is consistent in agent 10.0.0.35 2024-10-23 13:57:53,339 - DEBUG - Route for VM IP ['103.245.126.4'] is consistent in agent 10.0.0.35 2024-10-23 13:57:53,340 - DEBUG - VN default-domain:ctest-TestSvcRegr-42119199:ctest-right_vn-32900022 verification for VM ctest-pt_svm0-66232535 in Agent 10.0.0.35 passed 2024-10-23 13:57:53,540 - DEBUG - Starting all layer 2 verification in agent 10.0.0.35 2024-10-23 13:57:53,554 - DEBUG - Route for VM MAC 02:c7:10:8f:78:21 is consistent in agent 10.0.0.35 2024-10-23 13:57:53,554 - INFO - VM ctest-pt_svm0-66232535 verifications in Compute nodes passed 2024-10-23 13:57:53,554 - DEBUG - The SVMs in the SI are : [] 2024-10-23 13:57:53,555 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/081cba75-052c-4f0f-bedd-5f39d67dc1f0 2024-10-23 13:57:53,567 - DEBUG - Service VM for SI 'ctest-si-94944762' is launched 2024-10-23 13:57:53,567 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:57:53,573 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:57:53,590 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:57:53,673 - DEBUG - Requesting: http://10.0.0.35:8082/service-instance/5e16c33a-7454-4cf8-a9d8-37b563f3fbd4 2024-10-23 13:57:53,684 - DEBUG - SI ctest-si-94944762 has Port Tuple: ['ctest-port_tuple-98667044'] 2024-10-23 13:57:53,796 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:57:58,908 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:04,024 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:09,140 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:14,252 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:19,364 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:24,476 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:29,584 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:34,696 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:39,803 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:44,916 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:50,024 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:58:55,136 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:59:00,244 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:59:05,356 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:59:10,468 - WARNING - RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:59:10,470 - INFO - Dettaching policy ctest-policy-14498953 from vn ctest-right_vn-32900022 2024-10-23 13:59:10,756 - INFO - Dettaching policy ctest-policy-14498953 from vn ctest-left_vn-11800827 2024-10-23 13:59:11,042 - INFO - Deleted policy ctest-policy-14498953 2024-10-23 13:59:11,042 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-si-94944762'] 2024-10-23 13:59:11,150 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-si-94944762'] 2024-10-23 13:59:11,150 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:59:11,160 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:59:11,211 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:59:11,301 - DEBUG - Service instance ctest-si-94944762 removed from api server 2024-10-23 13:59:11,301 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/081cba75-052c-4f0f-bedd-5f39d67dc1f0 2024-10-23 13:59:11,310 - DEBUG - All Service VMs unlinked from SI ctest-si-94944762 2024-10-23 13:59:11,317 - DEBUG - 0 svc intances found in all projects. They are [] 2024-10-23 13:59:11,317 - DEBUG - 0 svc intances found in current project. They are [] 2024-10-23 13:59:11,363 - DEBUG - 0 svc intances found in all projects. They are [] 2024-10-23 13:59:11,364 - DEBUG - 0 svc intances found in current project. They are [] 2024-10-23 13:59:11,364 - INFO - Deleting VM ctest-pt_svm0-66232535 2024-10-23 13:59:11,454 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-02448508'] 2024-10-23 13:59:11,548 - INFO - Service template: ['default-domain', 'ctest-service_template_1-02448508'] deleted successfully. 2024-10-23 13:59:11,548 - INFO - Deleting VM ctest-right_vm-58047989 2024-10-23 13:59:11,683 - INFO - Deleting VM ctest-left_vm-26377158 2024-10-23 13:59:11,766 - INFO - Deleting VN ctest-right_vn-32900022 2024-10-23 13:59:11,819 - DEBUG - VN 7bb778af-0d4e-48e3-8f93-6d78538b131d still in use: Unable to complete operation on network 7bb778af-0d4e-48e3-8f93-6d78538b131d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1e7135b2-fa56-40fd-ac5f-8ee61e57df8a'] 2024-10-23 13:59:11,819 - WARNING - Deleting VN ctest-right_vn-32900022 failed..Will retry 2024-10-23 13:59:13,978 - DEBUG - Response for deleting network () 2024-10-23 13:59:13,978 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/01b5fae8-a144-4761-a944-92dd549c552a 2024-10-23 13:59:13,988 - DEBUG - Response Code: 404 2024-10-23 13:59:13,988 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:59:13,996 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:59:14,061 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:59:14,150 - INFO - Validated that VN ctest-right_vn-32900022 is not found in API Server 2024-10-23 13:59:14,165 - DEBUG - VN ctest-right_vn-32900022 is not present in Agent 10.0.0.35 2024-10-23 13:59:14,165 - INFO - Validated that VN ctest-right_vn-32900022 is not in any agent 2024-10-23 13:59:14,187 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-32900022 info 2024-10-23 13:59:14,188 - INFO - Deleting VN ctest-left_vn-11800827 2024-10-23 13:59:14,355 - DEBUG - Response for deleting network () 2024-10-23 13:59:14,355 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/fd5f39ad-330c-46e3-bbb0-7ec1348d31a5 2024-10-23 13:59:14,364 - DEBUG - Response Code: 404 2024-10-23 13:59:14,364 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:59:14,372 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:59:14,401 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:59:14,488 - INFO - Validated that VN ctest-left_vn-11800827 is not found in API Server 2024-10-23 13:59:14,501 - DEBUG - VN ctest-left_vn-11800827 is not present in Agent 10.0.0.35 2024-10-23 13:59:14,501 - INFO - Validated that VN ctest-left_vn-11800827 is not in any agent 2024-10-23 13:59:14,521 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-11800827 info 2024-10-23 13:59:14,522 - INFO - Deleting VN ctest-mgmt_vn-50507719 2024-10-23 13:59:14,658 - DEBUG - Response for deleting network () 2024-10-23 13:59:14,658 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/8fb1c656-1c40-4592-8a67-b5d8f7eeeb5c 2024-10-23 13:59:14,667 - DEBUG - Response Code: 404 2024-10-23 13:59:14,667 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2024-10-23 13:59:14,681 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2c9b2cc8-4d87-4657-9de6-5f24fe7aba5e 2024-10-23 13:59:14,738 - DEBUG - Requesting: http://10.0.0.35:8082/project/32d5f7d5-3f0a-4c1e-b90b-f92de3c27597 2024-10-23 13:59:14,828 - INFO - Validated that VN ctest-mgmt_vn-50507719 is not found in API Server 2024-10-23 13:59:14,839 - DEBUG - VN ctest-mgmt_vn-50507719 is not present in Agent 10.0.0.35 2024-10-23 13:59:14,839 - INFO - Validated that VN ctest-mgmt_vn-50507719 is not in any agent 2024-10-23 13:59:14,861 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-50507719 info 2024-10-23 13:59:15,116 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Wed Oct 23 13:59:10 2024 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 79 log.info('Initial checks done. Running the testcase now') 80 log.info('') 81 result = function(self, *args, **kwargs) 82 if self.inputs.upgrade: 83 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/svc_firewall/test_svc_fw.py in test_svc_in_network_datapath(self=) 31 def test_svc_in_network_datapath(self): 32 return self.verify_svc_chain(svc_img_name='cirros_in_net', service_mode='in-network', 33 create_svms=True) 34 35 create_svms undefined /contrail-test/common/servicechain/verify.py in verify_svc_chain(self=, *args=(), **kwargs={'create_svms': True, 'service_mode': 'in-network', 'svc_img_name': 'cirros_in_net'}) 344 if not evpn: 345 result, msg = self.validate_vn(left_vn_fq_name) 346 assert result, msg 347 right_vn = True if st_fixture.service_mode == 'in-network-nat' else False 348 result, msg = self.validate_vn(right_vn_fq_name, right_vn=right_vn) result = False msg = "RI refs is none for RI ['default-domain', 'ctest...test-left_vn-11800827', 'ctest-left_vn-11800827']" AssertionError: RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ("RI refs is none for RI ['default-domain', 'ctest...test-left_vn-11800827', 'ctest-left_vn-11800827']",) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 81, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 33, in test_svc_in_network_datapath create_svms=True) File "/contrail-test/common/servicechain/verify.py", line 346, in verify_svc_chain assert result, msg AssertionError: RI refs is none for RI ['default-domain', 'ctest-TestSvcRegr-42119199', 'ctest-left_vn-11800827', 'ctest-left_vn-11800827'] 2024-10-23 13:59:15,124 - DEBUG - No XMPP flaps were noticed during the test 2024-10-23 13:59:15,124 - INFO - 2024-10-23 13:59:15,125 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:02:29] 2024-10-23 13:59:15,125 - INFO - -------------------------------------------------------------------------------- 2024-10-23 13:59:15,923 - INFO - Deleted project: ctest-TestSvcRegr-42119199, ID : 32d5f7d5-3f0a-4c1e-b90b-f92de3c27597