2025-04-15 16:20:28,347 - INFO - Domain Default found not creating 2025-04-15 16:20:28,567 - INFO - Project ctest-TestSvcRegr-66504854 not found, creating it 2025-04-15 16:20:29,207 - INFO - Created Project:ctest-TestSvcRegr-66504854, ID : 60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:30,617 - INFO - ================================================================================ 2025-04-15 16:20:30,617 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-04-15 16:20:30,876 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.65': '0'}} with 2025-04-15 16:20:30,876 - INFO - Initial checks done. Running the testcase now 2025-04-15 16:20:30,876 - INFO - 2025-04-15 16:20:31,483 - DEBUG - Response for create_network : {'network': {'id': '458af7e0-41bf-4ad3-b517-b0da93e2ad0b', 'name': 'ctest-mgmt_vn-54961926', 'tenant_id': '60a170304a2e4c05a6e7147892664522', 'project_id': '60a170304a2e4c05a6e7147892664522', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-mgmt_vn-54961926'], 'port_security_enabled': True, 'description': ''}} 2025-04-15 16:20:31,651 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e032380f-af2b-49c0-a1b9-b05cd6ed272c', 'name': '', 'tenant_id': '60a170304a2e4c05a6e7147892664522', 'network_id': '458af7e0-41bf-4ad3-b517-b0da93e2ad0b', 'ip_version': 4, 'cidr': '109.186.218.64/26', 'allocation_pools': [{'start': '109.186.218.66', 'end': '109.186.218.126'}], 'gateway_ip': '109.186.218.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '109.186.218.66', 'tags': [], 'project_id': '60a170304a2e4c05a6e7147892664522'}} 2025-04-15 16:20:31,669 - INFO - Created VN ctest-mgmt_vn-54961926 2025-04-15 16:20:31,719 - DEBUG - VN ctest-mgmt_vn-54961926 UUID is 458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:31,824 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:32,120 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:32,148 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:32,159 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:32,240 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:32,250 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:32,259 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/df3a1dc5-fd52-4b84-bc56-6c444dc65482 2025-04-15 16:20:32,267 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/df3a1dc5-fd52-4b84-bc56-6c444dc65482 2025-04-15 16:20:32,276 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/fc4c3386-d644-4402-b281-d0bf5058b0d2 2025-04-15 16:20:32,282 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-04-15 16:20:32,283 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:32,291 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/df3a1dc5-fd52-4b84-bc56-6c444dc65482 2025-04-15 16:20:32,304 - INFO - Verified VN network id 7 for VN 458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:32,304 - INFO - Verifications in API Server for VN ctest-mgmt_vn-54961926 passed 2025-04-15 16:20:32,304 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:32,312 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/df3a1dc5-fd52-4b84-bc56-6c444dc65482 2025-04-15 16:20:32,320 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/df3a1dc5-fd52-4b84-bc56-6c444dc65482 2025-04-15 16:20:32,327 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/fc4c3386-d644-4402-b281-d0bf5058b0d2 2025-04-15 16:20:32,341 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66504854', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5011090077950888659', 'uuid-lslong': '13049092898159766795'}, 'enable': 'true', 'created': '2025-04-15T16:20:31', 'last-modified': '2025-04-15T16:20:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.715457'} 2025-04-15 16:20:32,347 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-04-15 16:20:32,347 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-54961926 passed 2025-04-15 16:20:32,347 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-54961926 in API_Server ====== 2025-04-15 16:20:32,347 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:32,353 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:32,367 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:32,441 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/458af7e0-41bf-4ad3-b517-b0da93e2ad0b 2025-04-15 16:20:32,449 - DEBUG - =>VN ctest-mgmt_vn-54961926 has no policy to be verified 2025-04-15 16:20:32,449 - DEBUG - Verifying the vn in opserver 2025-04-15 16:20:32,449 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:32,449 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:32,737 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:35,796 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:35,797 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:35,809 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926?flat'} 2025-04-15 16:20:35,809 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is found in opserver 2025-04-15 16:20:35,819 - DEBUG - Do not have enough data to verify VN in agent 2025-04-15 16:20:35,824 - DEBUG - VRF ids for VN ctest-mgmt_vn-54961926: {} 2025-04-15 16:20:36,109 - DEBUG - Response for create_network : {'network': {'id': 'b23a32cf-0e62-4df4-808b-5ed4c125b53e', 'name': 'ctest-left_vn-50489265', 'tenant_id': '60a170304a2e4c05a6e7147892664522', 'project_id': '60a170304a2e4c05a6e7147892664522', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-left_vn-50489265'], 'port_security_enabled': True, 'description': ''}} 2025-04-15 16:20:36,306 - DEBUG - Response for create_subnet : {'subnet': {'id': '17e9b122-8aa7-4703-bd38-00198caab5bc', 'name': '', 'tenant_id': '60a170304a2e4c05a6e7147892664522', 'network_id': 'b23a32cf-0e62-4df4-808b-5ed4c125b53e', 'ip_version': 4, 'cidr': '101.215.22.128/26', 'allocation_pools': [{'start': '101.215.22.130', 'end': '101.215.22.190'}], 'gateway_ip': '101.215.22.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '101.215.22.130', 'tags': [], 'project_id': '60a170304a2e4c05a6e7147892664522'}} 2025-04-15 16:20:36,326 - INFO - Created VN ctest-left_vn-50489265 2025-04-15 16:20:36,379 - DEBUG - VN ctest-left_vn-50489265 UUID is b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,492 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:36,497 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:36,509 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:36,577 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,589 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,598 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8a36fc23-3631-470a-bf18-fccc4c1c8fce 2025-04-15 16:20:36,605 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8a36fc23-3631-470a-bf18-fccc4c1c8fce 2025-04-15 16:20:36,613 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/0ef4321e-3f1b-496b-a9ff-1b71a12d2850 2025-04-15 16:20:36,619 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-04-15 16:20:36,619 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,628 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8a36fc23-3631-470a-bf18-fccc4c1c8fce 2025-04-15 16:20:36,642 - INFO - Verified VN network id 8 for VN b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,642 - INFO - Verifications in API Server for VN ctest-left_vn-50489265 passed 2025-04-15 16:20:36,642 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,652 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8a36fc23-3631-470a-bf18-fccc4c1c8fce 2025-04-15 16:20:36,660 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8a36fc23-3631-470a-bf18-fccc4c1c8fce 2025-04-15 16:20:36,669 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/0ef4321e-3f1b-496b-a9ff-1b71a12d2850 2025-04-15 16:20:36,680 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66504854', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12842633152281333236', 'uuid-lslong': '9262601326484108606'}, 'enable': 'true', 'created': '2025-04-15T16:20:36', 'last-modified': '2025-04-15T16:20:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415113'} 2025-04-15 16:20:36,685 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-04-15 16:20:36,685 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-50489265 passed 2025-04-15 16:20:36,685 - DEBUG - ====Verifying policy data for ctest-left_vn-50489265 in API_Server ====== 2025-04-15 16:20:36,685 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:36,690 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:36,699 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:36,771 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/b23a32cf-0e62-4df4-808b-5ed4c125b53e 2025-04-15 16:20:36,780 - DEBUG - =>VN ctest-left_vn-50489265 has no policy to be verified 2025-04-15 16:20:36,780 - DEBUG - Verifying the vn in opserver 2025-04-15 16:20:36,780 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:36,780 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:39,789 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:39,790 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:42,800 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:42,800 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:45,811 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:45,812 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:45,823 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265?flat'} 2025-04-15 16:20:45,823 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 is found in opserver 2025-04-15 16:20:45,832 - DEBUG - Do not have enough data to verify VN in agent 2025-04-15 16:20:45,836 - DEBUG - VRF ids for VN ctest-left_vn-50489265: {} 2025-04-15 16:20:46,040 - DEBUG - Response for create_network : {'network': {'id': '6b74d04b-e9dc-4412-9e95-0e094df06250', 'name': 'ctest-right_vn-94867985', 'tenant_id': '60a170304a2e4c05a6e7147892664522', 'project_id': '60a170304a2e4c05a6e7147892664522', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-right_vn-94867985'], 'port_security_enabled': True, 'description': ''}} 2025-04-15 16:20:46,202 - DEBUG - Response for create_subnet : {'subnet': {'id': '2184e780-2fc1-4cb5-90b6-725f54730ae8', 'name': '', 'tenant_id': '60a170304a2e4c05a6e7147892664522', 'network_id': '6b74d04b-e9dc-4412-9e95-0e094df06250', 'ip_version': 4, 'cidr': '75.110.33.64/26', 'allocation_pools': [{'start': '75.110.33.66', 'end': '75.110.33.126'}], 'gateway_ip': '75.110.33.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '75.110.33.66', 'tags': [], 'project_id': '60a170304a2e4c05a6e7147892664522'}} 2025-04-15 16:20:46,222 - INFO - Created VN ctest-right_vn-94867985 2025-04-15 16:20:46,275 - DEBUG - VN ctest-right_vn-94867985 UUID is 6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:46,383 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:46,388 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:46,399 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:46,472 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:46,484 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:46,494 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:46,502 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:46,508 - DEBUG - Route Targets: [] 2025-04-15 16:20:46,508 - DEBUG - RT names not yet present for VN ctest-right_vn-94867985 2025-04-15 16:20:51,509 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:51,515 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:51,525 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:51,602 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:51,611 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:51,620 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:51,629 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:51,636 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/867e9f16-5466-4663-aa52-2f28e3499be9 2025-04-15 16:20:51,643 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-04-15 16:20:51,643 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:51,655 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:51,675 - INFO - Verified VN network id 9 for VN 6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:51,676 - INFO - Verifications in API Server for VN ctest-right_vn-94867985 passed 2025-04-15 16:20:51,676 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:51,687 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:51,695 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:20:51,703 - DEBUG - Requesting: http://10.0.0.65:8082/route-target/867e9f16-5466-4663-aa52-2f28e3499be9 2025-04-15 16:20:51,715 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-66504854', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7743042683821376530', 'uuid-lslong': '11427055062647595600'}, 'enable': 'true', 'created': '2025-04-15T16:20:46', 'last-modified': '2025-04-15T16:20:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.553453'} 2025-04-15 16:20:51,722 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-04-15 16:20:51,722 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-94867985 passed 2025-04-15 16:20:51,722 - DEBUG - ====Verifying policy data for ctest-right_vn-94867985 in API_Server ====== 2025-04-15 16:20:51,722 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:20:51,728 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:20:51,739 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:20:51,815 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-network/6b74d04b-e9dc-4412-9e95-0e094df06250 2025-04-15 16:20:51,824 - DEBUG - =>VN ctest-right_vn-94867985 has no policy to be verified 2025-04-15 16:20:51,824 - DEBUG - Verifying the vn in opserver 2025-04-15 16:20:51,824 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:51,824 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:54,835 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 virtual network link through opserver 10.0.0.65 2025-04-15 16:20:54,835 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-04-15 16:20:54,846 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985?flat'} 2025-04-15 16:20:54,846 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 is found in opserver 2025-04-15 16:20:54,856 - DEBUG - Do not have enough data to verify VN in agent 2025-04-15 16:20:54,860 - DEBUG - VRF ids for VN ctest-right_vn-94867985: {} 2025-04-15 16:20:54,929 - DEBUG - Services list from nova: [, , ] 2025-04-15 16:20:56,061 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3120-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3120-1) 2025-04-15 16:20:57,349 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3120-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3120-1) 2025-04-15 16:20:57,350 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-00777142'] 2025-04-15 16:20:57,723 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-00777142'] created succesfully 2025-04-15 16:20:58,113 - DEBUG - Image by name cirros_in_net not found 2025-04-15 16:20:58,113 - DEBUG - Installing image cirros_in_net 2025-04-15 16:20:58,113 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-04-15 16:20:58,114 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-04-15 16:20:58,114 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-04-15 16:20:58,128 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-04-15 16:20:58,246 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-04-15 16:20:58,247 - DEBUG - Unzip image 2025-04-15 16:20:58,247 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-04-15 16:20:58,439 - DEBUG - Try to create image in user context 2025-04-15 16:20:58,703 - DEBUG - Image has been created in user context 2025-04-15 16:20:58,703 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-04-15 16:20:58,722 - DEBUG - Downloaded image has been removed 2025-04-15 16:20:58,743 - DEBUG - Uploaded image status = active 2025-04-15 16:21:00,128 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3120-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3120-1) 2025-04-15 16:21:00,128 - INFO - Waiting for VM ctest-pt_svm0-48508038 to be up.. 2025-04-15 16:21:00,173 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-04-15 16:21:05,282 - DEBUG - VM is in ACTIVE state now 2025-04-15 16:21:05,282 - INFO - VM name : ctest-pt_svm0-48508038 2025-04-15 16:21:05,390 - DEBUG - VM ctest-pt_svm0-48508038 ID is 45e6a28b-c61a-4a82-a333-33b9f689c202 2025-04-15 16:21:05,416 - DEBUG - VM ctest-pt_svm0-48508038 launched on Node cn-jenkins-deploy-platform-ansible-os-3120-1. 2025-04-15 16:21:05,713 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/45e6a28b-c61a-4a82-a333-33b9f689c202 2025-04-15 16:21:05,725 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/22cf419a-4c0d-4aff-8a4a-0ac7e8996c85 2025-04-15 16:21:05,736 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/2e57fe72-8669-407c-a513-7fe69bfa78ad 2025-04-15 16:21:05,754 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/aea1ecca-c406-44ff-aa27-9c5138949dd5 2025-04-15 16:21:09,077 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-04-15 16:21:09,077 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48508038 failed! 2025-04-15 16:21:09,139 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is 109.186.218.65 and allocation pool is NOT set 2025-04-15 16:21:13,205 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-04-15 16:21:13,206 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48508038 failed! 2025-04-15 16:21:13,263 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is 109.186.218.65 and allocation pool is NOT set 2025-04-15 16:21:17,336 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-04-15 16:21:17,336 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48508038 failed! 2025-04-15 16:21:17,391 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is 109.186.218.65 and allocation pool is NOT set 2025-04-15 16:21:21,463 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-04-15 16:21:21,463 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48508038 failed! 2025-04-15 16:21:21,519 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is 109.186.218.65 and allocation pool is NOT set 2025-04-15 16:21:23,576 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=10.0 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=1.17 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.167/5.582/9.998/4.415 ms') 2025-04-15 16:21:23,576 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-48508038 passed 2025-04-15 16:21:23,727 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:23,727 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:23,797 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-15 16:21:23,898 - DEBUG - VM ctest-pt_svm0-48508038 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-15 16:21:28,898 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:28,898 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:28,954 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-15 16:21:29,049 - DEBUG - VM ctest-pt_svm0-48508038 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-15 16:21:34,050 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:34,051 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:34,107 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-15 16:21:34,206 - DEBUG - VM ctest-pt_svm0-48508038 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-15 16:21:39,207 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:39,208 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:39,273 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-04-15 16:21:39,380 - DEBUG - VM ctest-pt_svm0-48508038 is NOT ready for SSH connections, VM status: ACTIVE 2025-04-15 16:21:44,380 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:44,380 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:44,535 - DEBUG - VM ctest-pt_svm0-48508038 is ready for SSH connections 2025-04-15 16:21:44,687 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:44,687 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:44,839 - DEBUG - VM ctest-pt_svm0-48508038 is ready for SSH connections 2025-04-15 16:21:44,987 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:44,987 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-48508038, IP 109.186.218.67, Port 22 2025-04-15 16:21:45,150 - DEBUG - VM ctest-pt_svm0-48508038 is ready for SSH connections 2025-04-15 16:21:45,155 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-si-10344888'] 2025-04-15 16:21:46,055 - INFO - Waiting for VM ctest-left_vm-82765051 to be up.. 2025-04-15 16:21:46,158 - DEBUG - VM is in ACTIVE state now 2025-04-15 16:21:46,158 - INFO - VM name : ctest-left_vm-82765051 2025-04-15 16:21:46,268 - DEBUG - VM ctest-left_vm-82765051 ID is 36f1ef35-fa23-46c6-9229-ccb7c03bf4e4 2025-04-15 16:21:46,268 - DEBUG - VM ctest-left_vm-82765051 launched on Node cn-jenkins-deploy-platform-ansible-os-3120-1. 2025-04-15 16:21:46,361 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/36f1ef35-fa23-46c6-9229-ccb7c03bf4e4 2025-04-15 16:21:46,370 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/6a38299e-0f41-4187-8158-131d7d6e5ed4 2025-04-15 16:21:47,635 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.00 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.396 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.396/2.699/5.003/2.303 ms') 2025-04-15 16:21:47,635 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-82765051 passed 2025-04-15 16:21:47,787 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:47,787 - DEBUG - Waiting to SSH to VM ctest-left_vm-82765051, IP 101.215.22.131, Port 22 2025-04-15 16:21:47,952 - DEBUG - VM ctest-left_vm-82765051 is ready for SSH connections 2025-04-15 16:21:47,953 - INFO - Waiting for VM ctest-right_vm-83916423 to be up.. 2025-04-15 16:21:48,045 - DEBUG - VM is in ACTIVE state now 2025-04-15 16:21:48,045 - INFO - VM name : ctest-right_vm-83916423 2025-04-15 16:21:48,134 - DEBUG - VM ctest-right_vm-83916423 ID is 04b0019d-ff00-4e30-8c14-73bcb3668cf9 2025-04-15 16:21:48,134 - DEBUG - VM ctest-right_vm-83916423 launched on Node cn-jenkins-deploy-platform-ansible-os-3120-1. 2025-04-15 16:21:48,233 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/04b0019d-ff00-4e30-8c14-73bcb3668cf9 2025-04-15 16:21:48,243 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/3393f3e2-ce5d-401f-afa4-72258fd41827 2025-04-15 16:21:49,484 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.29 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.418 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.418/2.352/4.287/1.934 ms') 2025-04-15 16:21:49,484 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-83916423 passed 2025-04-15 16:21:49,631 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:49,631 - DEBUG - Waiting to SSH to VM ctest-right_vm-83916423, IP 75.110.33.67, Port 22 2025-04-15 16:21:49,796 - DEBUG - VM ctest-right_vm-83916423 is ready for SSH connections 2025-04-15 16:21:49,801 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-66504854:ctest-si-10344888'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-04-15 16:21:50,231 - INFO - Attaching policy ctest-policy-70422925 to vn ctest-left_vn-50489265 2025-04-15 16:21:50,787 - INFO - Attaching policy ctest-policy-70422925 to vn ctest-right_vn-94867985 2025-04-15 16:21:51,267 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-00777142'] created succesfully 2025-04-15 16:21:51,491 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-si-10344888'] created succesfully 2025-04-15 16:21:51,491 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:21:51,496 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:21:51,508 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:21:51,596 - DEBUG - Requesting: http://10.0.0.65:8082/service-instance/fe899db8-b06b-406f-8edb-c4a3e326eba8 2025-04-15 16:21:51,607 - DEBUG - SI 'ctest-si-10344888' has service template ref to ctest-service_template_1-00777142 2025-04-15 16:21:51,607 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:21:51,613 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:21:51,624 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:21:51,696 - DEBUG - Requesting: http://10.0.0.65:8082/service-instance/fe899db8-b06b-406f-8edb-c4a3e326eba8 2025-04-15 16:21:51,705 - DEBUG - Requesting: http://10.0.0.65:8082/port-tuple/ee83412e-4cc7-43e9-81dd-8e8dd0970fc5 2025-04-15 16:21:51,716 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/22cf419a-4c0d-4aff-8a4a-0ac7e8996c85 2025-04-15 16:21:51,729 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/2e57fe72-8669-407c-a513-7fe69bfa78ad 2025-04-15 16:21:51,738 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/aea1ecca-c406-44ff-aa27-9c5138949dd5 2025-04-15 16:21:51,992 - DEBUG - VM is in ACTIVE state now 2025-04-15 16:21:52,435 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/45e6a28b-c61a-4a82-a333-33b9f689c202 2025-04-15 16:21:52,442 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/22cf419a-4c0d-4aff-8a4a-0ac7e8996c85 2025-04-15 16:21:52,452 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/2e57fe72-8669-407c-a513-7fe69bfa78ad 2025-04-15 16:21:52,460 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/aea1ecca-c406-44ff-aa27-9c5138949dd5 2025-04-15 16:21:52,472 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/020549d1-eebd-44a3-8f8a-09b4ac9921ac 2025-04-15 16:21:52,480 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/bfd4b5c9-2f30-4015-afd7-ca8f580454c3 2025-04-15 16:21:52,490 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/c2c594f5-7618-4919-84ab-91ba75118a43 2025-04-15 16:21:52,499 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/533f99dd-79fd-4a86-aed2-4711524b3957 2025-04-15 16:21:52,507 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/8f2dca26-9bde-4f03-8821-0d27356fe8b1 2025-04-15 16:21:52,514 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/a78a696f-3979-47dc-95d9-44d1fb8564f7 2025-04-15 16:21:52,521 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/16c3aef6-fc22-4c53-a77f-72ded69f69bd 2025-04-15 16:21:52,528 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/25c62563-bde9-4ea4-af23-4086255fc2a8 2025-04-15 16:21:52,534 - DEBUG - Requesting: http://10.0.0.65:8082/instance-ip/967e435c-bde3-451a-b660-979d0732a58e 2025-04-15 16:21:52,960 - DEBUG - VM is in ACTIVE state now 2025-04-15 16:21:52,960 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/45e6a28b-c61a-4a82-a333-33b9f689c202 2025-04-15 16:21:52,967 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/22cf419a-4c0d-4aff-8a4a-0ac7e8996c85 2025-04-15 16:21:52,976 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/2e57fe72-8669-407c-a513-7fe69bfa78ad 2025-04-15 16:21:52,985 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine-interface/aea1ecca-c406-44ff-aa27-9c5138949dd5 2025-04-15 16:21:54,220 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.13 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.468 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.468/0.801/1.134/0.333 ms') 2025-04-15 16:21:54,220 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-48508038 passed 2025-04-15 16:21:54,264 - DEBUG - VM ctest-pt_svm0-48508038 Tap interface: {'index': '6', 'name': 'tapaea1ecca-c4', 'uuid': 'aea1ecca-c406-44ff-aa27-9c5138949dd5', 'vrf_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265:ctest-left_vn-50489265', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265', 'vm_uuid': '45e6a28b-c61a-4a82-a333-33b9f689c202', 'vm_name': 'ctest-pt_svm0-48508038', 'ip_addr': '101.215.22.132', 'mac_addr': '02:ae:a1:ec:ca:c4', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-66504854:aea1ecca-c406-44ff-aa27-9c5138949dd5', 'sg_uuid_list': ['a0a31aa1-fcc7-4b64-867e-03364cc92069'], 'static_route_list': None, 'vm_project_uuid': '60a17030-4a2e-4c05-a6e7-147892664522', 'admin_state': 'Enabled', 'flow_key_idx': '45', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '22cf419a-4c0d-4aff-8a4a-0ac7e8996c85', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-15 16:21:54,264 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265:ctest-left_vn-50489265 2025-04-15 16:21:54,272 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265:ctest-left_vn-50489265', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.0.0.65:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-04-15 16:21:54,434 - DEBUG - VM ctest-pt_svm0-48508038 : Tap interface tapaea1ecca-c4 is set to Active 2025-04-15 16:21:54,435 - DEBUG - Tap interface tapaea1ecca-c4 detail : {'index': '6', 'name': 'tapaea1ecca-c4', 'uuid': 'aea1ecca-c406-44ff-aa27-9c5138949dd5', 'vrf_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265:ctest-left_vn-50489265', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265', 'vm_uuid': '45e6a28b-c61a-4a82-a333-33b9f689c202', 'vm_name': 'ctest-pt_svm0-48508038', 'ip_addr': '101.215.22.132', 'mac_addr': '02:ae:a1:ec:ca:c4', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-66504854:aea1ecca-c406-44ff-aa27-9c5138949dd5', 'sg_uuid_list': ['a0a31aa1-fcc7-4b64-867e-03364cc92069'], 'static_route_list': None, 'vm_project_uuid': '60a17030-4a2e-4c05-a6e7-147892664522', 'admin_state': 'Enabled', 'flow_key_idx': '45', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '22cf419a-4c0d-4aff-8a4a-0ac7e8996c85', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-15 16:21:54,627 - DEBUG - Starting Layer 2 verification in Agent 2025-04-15 16:21:54,638 - DEBUG - Layer 2 path is seen for VM MAC 02:ae:a1:ec:ca:c4 in agent 10.0.0.65 2025-04-15 16:21:54,639 - DEBUG - Active layer 2 route in agent is present for VMI tapaea1ecca-c4 2025-04-15 16:21:54,639 - DEBUG - L2 label(48) matches bw route table and interface table 2025-04-15 16:21:54,645 - DEBUG - VN default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 is found in Agent of node 10.0.0.65 2025-04-15 16:21:54,855 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 is consistent in agent 10.0.0.65 2025-04-15 16:21:54,856 - DEBUG - Route for VM IP ['101.215.22.132'] is consistent in agent 10.0.0.65 2025-04-15 16:21:54,856 - DEBUG - VN default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 verification for VM ctest-pt_svm0-48508038 in Agent 10.0.0.65 passed 2025-04-15 16:21:55,055 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-04-15 16:21:55,074 - DEBUG - Route for VM MAC 02:ae:a1:ec:ca:c4 is consistent in agent 10.0.0.65 2025-04-15 16:21:55,097 - DEBUG - VM ctest-pt_svm0-48508038 Tap interface: {'index': '5', 'name': 'tap2e57fe72-86', 'uuid': '2e57fe72-8669-407c-a513-7fe69bfa78ad', 'vrf_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926:ctest-mgmt_vn-54961926', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926', 'vm_uuid': '45e6a28b-c61a-4a82-a333-33b9f689c202', 'vm_name': 'ctest-pt_svm0-48508038', 'ip_addr': '109.186.218.67', 'mac_addr': '02:2e:57:fe:72:86', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-66504854:2e57fe72-8669-407c-a513-7fe69bfa78ad', 'sg_uuid_list': ['a0a31aa1-fcc7-4b64-867e-03364cc92069'], 'static_route_list': None, 'vm_project_uuid': '60a17030-4a2e-4c05-a6e7-147892664522', 'admin_state': 'Enabled', 'flow_key_idx': '46', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-15 16:21:55,097 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926:ctest-mgmt_vn-54961926 2025-04-15 16:21:55,105 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926:ctest-mgmt_vn-54961926', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926', 'table_label': '-1', 'vxlan_id': '7', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.0.0.65:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-04-15 16:21:55,265 - DEBUG - VM ctest-pt_svm0-48508038 : Tap interface tap2e57fe72-86 is set to Active 2025-04-15 16:21:55,265 - DEBUG - Tap interface tap2e57fe72-86 detail : {'index': '5', 'name': 'tap2e57fe72-86', 'uuid': '2e57fe72-8669-407c-a513-7fe69bfa78ad', 'vrf_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926:ctest-mgmt_vn-54961926', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '7', 'vn_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926', 'vm_uuid': '45e6a28b-c61a-4a82-a333-33b9f689c202', 'vm_name': 'ctest-pt_svm0-48508038', 'ip_addr': '109.186.218.67', 'mac_addr': '02:2e:57:fe:72:86', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-66504854:2e57fe72-8669-407c-a513-7fe69bfa78ad', 'sg_uuid_list': ['a0a31aa1-fcc7-4b64-867e-03364cc92069'], 'static_route_list': None, 'vm_project_uuid': '60a17030-4a2e-4c05-a6e7-147892664522', 'admin_state': 'Enabled', 'flow_key_idx': '46', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-15 16:21:55,459 - DEBUG - Starting Layer 2 verification in Agent 2025-04-15 16:21:55,468 - DEBUG - Layer 2 path is seen for VM MAC 02:2e:57:fe:72:86 in agent 10.0.0.65 2025-04-15 16:21:55,468 - DEBUG - Active layer 2 route in agent is present for VMI tap2e57fe72-86 2025-04-15 16:21:55,468 - DEBUG - L2 label(43) matches bw route table and interface table 2025-04-15 16:21:55,473 - DEBUG - VN default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is found in Agent of node 10.0.0.65 2025-04-15 16:21:55,684 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 is consistent in agent 10.0.0.65 2025-04-15 16:21:55,684 - DEBUG - Route for VM IP ['109.186.218.67'] is consistent in agent 10.0.0.65 2025-04-15 16:21:55,684 - DEBUG - VN default-domain:ctest-TestSvcRegr-66504854:ctest-mgmt_vn-54961926 verification for VM ctest-pt_svm0-48508038 in Agent 10.0.0.65 passed 2025-04-15 16:21:55,883 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-04-15 16:21:55,893 - DEBUG - Route for VM MAC 02:2e:57:fe:72:86 is consistent in agent 10.0.0.65 2025-04-15 16:21:55,929 - DEBUG - VM ctest-pt_svm0-48508038 Tap interface: {'index': '7', 'name': 'tap22cf419a-4c', 'uuid': '22cf419a-4c0d-4aff-8a4a-0ac7e8996c85', 'vrf_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985:ctest-right_vn-94867985', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985', 'vm_uuid': '45e6a28b-c61a-4a82-a333-33b9f689c202', 'vm_name': 'ctest-pt_svm0-48508038', 'ip_addr': '75.110.33.68', 'mac_addr': '02:22:cf:41:9a:4c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-66504854:22cf419a-4c0d-4aff-8a4a-0ac7e8996c85', 'sg_uuid_list': ['a0a31aa1-fcc7-4b64-867e-03364cc92069'], 'static_route_list': None, 'vm_project_uuid': '60a17030-4a2e-4c05-a6e7-147892664522', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'aea1ecca-c406-44ff-aa27-9c5138949dd5', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-15 16:21:55,930 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985:ctest-right_vn-94867985 2025-04-15 16:21:55,936 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985:ctest-right_vn-94867985', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.0.0.65:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-04-15 16:21:56,108 - DEBUG - VM ctest-pt_svm0-48508038 : Tap interface tap22cf419a-4c is set to Active 2025-04-15 16:21:56,108 - DEBUG - Tap interface tap22cf419a-4c detail : {'index': '7', 'name': 'tap22cf419a-4c', 'uuid': '22cf419a-4c0d-4aff-8a4a-0ac7e8996c85', 'vrf_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985:ctest-right_vn-94867985', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985', 'vm_uuid': '45e6a28b-c61a-4a82-a333-33b9f689c202', 'vm_name': 'ctest-pt_svm0-48508038', 'ip_addr': '75.110.33.68', 'mac_addr': '02:22:cf:41:9a:4c', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-66504854:22cf419a-4c0d-4aff-8a4a-0ac7e8996c85', 'sg_uuid_list': ['a0a31aa1-fcc7-4b64-867e-03364cc92069'], 'static_route_list': None, 'vm_project_uuid': '60a17030-4a2e-4c05-a6e7-147892664522', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'aea1ecca-c406-44ff-aa27-9c5138949dd5', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-04-15 16:21:56,307 - DEBUG - Starting Layer 2 verification in Agent 2025-04-15 16:21:56,320 - DEBUG - Layer 2 path is seen for VM MAC 02:22:cf:41:9a:4c in agent 10.0.0.65 2025-04-15 16:21:56,320 - DEBUG - Active layer 2 route in agent is present for VMI tap22cf419a-4c 2025-04-15 16:21:56,320 - DEBUG - L2 label(53) matches bw route table and interface table 2025-04-15 16:21:56,328 - DEBUG - VN default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 is found in Agent of node 10.0.0.65 2025-04-15 16:21:56,543 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 is consistent in agent 10.0.0.65 2025-04-15 16:21:56,543 - DEBUG - Route for VM IP ['75.110.33.68'] is consistent in agent 10.0.0.65 2025-04-15 16:21:56,543 - DEBUG - VN default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 verification for VM ctest-pt_svm0-48508038 in Agent 10.0.0.65 passed 2025-04-15 16:21:56,739 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2025-04-15 16:21:56,752 - DEBUG - Route for VM MAC 02:22:cf:41:9a:4c is consistent in agent 10.0.0.65 2025-04-15 16:21:56,753 - INFO - VM ctest-pt_svm0-48508038 verifications in Compute nodes passed 2025-04-15 16:21:56,753 - DEBUG - The SVMs in the SI are : [] 2025-04-15 16:21:56,753 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/45e6a28b-c61a-4a82-a333-33b9f689c202 2025-04-15 16:21:56,764 - DEBUG - Service VM for SI 'ctest-si-10344888' is launched 2025-04-15 16:21:56,764 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:21:56,772 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:21:56,786 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:21:56,865 - DEBUG - Requesting: http://10.0.0.65:8082/service-instance/fe899db8-b06b-406f-8edb-c4a3e326eba8 2025-04-15 16:21:56,875 - DEBUG - SI ctest-si-10344888 has Port Tuple: ['ctest-port_tuple-95904780'] 2025-04-15 16:21:56,983 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-66504854:ctest-left_vn-50489265 2025-04-15 16:21:57,131 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-66504854:ctest-right_vn-94867985 2025-04-15 16:21:57,296 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,308 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,308 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,317 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,317 - INFO - Route to 75.110.33.67 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-3120-1.englab.juniper.net, and SI ctest-si-10344888 is seen as the NH 2025-04-15 16:21:57,472 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,484 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,484 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,493 - INFO - Route to 101.215.22.131 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-3120-1.englab.juniper.net, and SI ctest-si-10344888 is seen as the NH 2025-04-15 16:21:57,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-15 16:21:57,493 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 75.110.33.67, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2025-04-15 16:21:57,493 - DEBUG - ping -s 56 -c 3 -W 1 75.110.33.67 2025-04-15 16:22:01,494 - DEBUG - PING 75.110.33.67 (75.110.33.67): 56 data bytes 64 bytes from 75.110.33.67: seq=0 ttl=61 time=6.583 ms 64 bytes from 75.110.33.67: seq=1 ttl=61 time=1.837 ms 64 bytes from 75.110.33.67: seq=2 ttl=61 time=1.785 ms --- 75.110.33.67 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.785/3.401/6.583 ms 2025-04-15 16:22:01,494 - INFO - Ping to IP 75.110.33.67 from VM ctest-left_vm-82765051 passed 2025-04-15 16:22:01,494 - INFO - Dettaching policy ctest-policy-70422925 from vn ctest-right_vn-94867985 2025-04-15 16:22:01,751 - INFO - Dettaching policy ctest-policy-70422925 from vn ctest-left_vn-50489265 2025-04-15 16:22:02,034 - INFO - Deleted policy ctest-policy-70422925 2025-04-15 16:22:02,034 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-si-10344888'] 2025-04-15 16:22:02,134 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-66504854', 'ctest-si-10344888'] 2025-04-15 16:22:02,134 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:22:02,140 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:22:02,158 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:22:02,258 - DEBUG - Service instance ctest-si-10344888 removed from api server 2025-04-15 16:22:02,258 - DEBUG - Requesting: http://10.0.0.65:8082/virtual-machine/45e6a28b-c61a-4a82-a333-33b9f689c202 2025-04-15 16:22:02,267 - DEBUG - All Service VMs unlinked from SI ctest-si-10344888 2025-04-15 16:22:02,272 - DEBUG - 0 svc intances found in all projects. They are [] 2025-04-15 16:22:02,272 - DEBUG - 0 svc intances found in current project. They are [] 2025-04-15 16:22:02,319 - DEBUG - 0 svc intances found in all projects. They are [] 2025-04-15 16:22:02,319 - DEBUG - 0 svc intances found in current project. They are [] 2025-04-15 16:22:02,319 - INFO - Deleting VM ctest-pt_svm0-48508038 2025-04-15 16:22:02,435 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-00777142'] 2025-04-15 16:22:02,571 - INFO - Service template: ['default-domain', 'ctest-service_template_1-00777142'] deleted successfully. 2025-04-15 16:22:02,571 - INFO - Deleting VM ctest-right_vm-83916423 2025-04-15 16:22:02,680 - INFO - Deleting VM ctest-left_vm-82765051 2025-04-15 16:22:02,798 - INFO - Deleting VN ctest-right_vn-94867985 2025-04-15 16:22:02,833 - DEBUG - VN 6b74d04b-e9dc-4412-9e95-0e094df06250 still in use: Unable to complete operation on network 6b74d04b-e9dc-4412-9e95-0e094df06250. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-43f72808-69e3-4857-8839-86f0fa6a4848'] 2025-04-15 16:22:02,833 - WARNING - Deleting VN ctest-right_vn-94867985 failed..Will retry 2025-04-15 16:22:04,946 - DEBUG - Response for deleting network () 2025-04-15 16:22:04,947 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/158b9252-69d7-415b-87e7-38c52b216e5f 2025-04-15 16:22:04,952 - DEBUG - Response Code: 404 2025-04-15 16:22:04,952 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:22:04,957 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:22:05,019 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:22:05,087 - INFO - Validated that VN ctest-right_vn-94867985 is not found in API Server 2025-04-15 16:22:05,095 - DEBUG - VN ctest-right_vn-94867985 is not present in Agent 10.0.0.65 2025-04-15 16:22:05,095 - INFO - Validated that VN ctest-right_vn-94867985 is not in any agent 2025-04-15 16:22:05,108 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-94867985 info 2025-04-15 16:22:05,109 - INFO - Deleting VN ctest-left_vn-50489265 2025-04-15 16:22:05,253 - DEBUG - Response for deleting network () 2025-04-15 16:22:05,253 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/8a36fc23-3631-470a-bf18-fccc4c1c8fce 2025-04-15 16:22:05,276 - DEBUG - Response Code: 404 2025-04-15 16:22:05,277 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:22:05,284 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:22:05,299 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:22:05,379 - INFO - Validated that VN ctest-left_vn-50489265 is not found in API Server 2025-04-15 16:22:05,390 - DEBUG - VN ctest-left_vn-50489265 is not present in Agent 10.0.0.65 2025-04-15 16:22:05,390 - INFO - Validated that VN ctest-left_vn-50489265 is not in any agent 2025-04-15 16:22:05,408 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-50489265 info 2025-04-15 16:22:05,408 - INFO - Deleting VN ctest-mgmt_vn-54961926 2025-04-15 16:22:05,533 - DEBUG - Response for deleting network () 2025-04-15 16:22:05,534 - DEBUG - Requesting: http://10.0.0.65:8082/routing-instance/df3a1dc5-fd52-4b84-bc56-6c444dc65482 2025-04-15 16:22:05,542 - DEBUG - Response Code: 404 2025-04-15 16:22:05,542 - DEBUG - Requesting: http://10.0.0.65:8082/domains 2025-04-15 16:22:05,552 - DEBUG - Requesting: http://10.0.0.65:8082/domain/29ed20a0-debe-424b-8fd5-2b37b09e2008 2025-04-15 16:22:05,608 - DEBUG - Requesting: http://10.0.0.65:8082/project/60a17030-4a2e-4c05-a6e7-147892664522 2025-04-15 16:22:05,689 - INFO - Validated that VN ctest-mgmt_vn-54961926 is not found in API Server 2025-04-15 16:22:05,700 - DEBUG - VN ctest-mgmt_vn-54961926 is not present in Agent 10.0.0.65 2025-04-15 16:22:05,700 - INFO - Validated that VN ctest-mgmt_vn-54961926 is not in any agent 2025-04-15 16:22:05,718 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-54961926 info 2025-04-15 16:22:05,988 - DEBUG - No XMPP flaps were noticed during the test 2025-04-15 16:22:05,988 - INFO -
2025-04-15 16:22:05,989 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:35]
2025-04-15 16:22:05,989 - INFO - -------------------------------------------------------------------------------- 2025-04-15 16:22:06,738 - INFO - Deleted project: ctest-TestSvcRegr-66504854, ID : 60a17030-4a2e-4c05-a6e7-147892664522