2025-06-30 16:35:35,773 - INFO - Domain Default found not creating 2025-06-30 16:35:35,944 - INFO - Project ctest-TestSvcRegr-52329836 not found, creating it 2025-06-30 16:35:36,467 - INFO - Created Project:ctest-TestSvcRegr-52329836, ID : 83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:38,071 - INFO - ================================================================================ 2025-06-30 16:35:38,071 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-06-30 16:35:38,343 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.38': '0'}} with 2025-06-30 16:35:38,343 - INFO - Initial checks done. Running the testcase now 2025-06-30 16:35:38,343 - INFO - 2025-06-30 16:35:38,966 - DEBUG - Response for create_network : {'network': {'id': 'c602b60b-bc0e-447f-869a-625bae709da8', 'name': 'ctest-mgmt_vn-89433459', 'tenant_id': '83e1f49768dc4a1fbb3cf64556073546', 'project_id': '83e1f49768dc4a1fbb3cf64556073546', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-mgmt_vn-89433459'], 'port_security_enabled': True, 'description': ''}} 2025-06-30 16:35:39,190 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b879db12-3e4d-446a-9f8b-7d1cf1eee516', 'name': '', 'tenant_id': '83e1f49768dc4a1fbb3cf64556073546', 'network_id': 'c602b60b-bc0e-447f-869a-625bae709da8', 'ip_version': 4, 'cidr': '60.20.66.0/26', 'allocation_pools': [{'start': '60.20.66.2', 'end': '60.20.66.62'}], 'gateway_ip': '60.20.66.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '60.20.66.2', 'tags': [], 'project_id': '83e1f49768dc4a1fbb3cf64556073546'}} 2025-06-30 16:35:39,219 - INFO - Created VN ctest-mgmt_vn-89433459 2025-06-30 16:35:39,276 - DEBUG - VN ctest-mgmt_vn-89433459 UUID is c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:39,392 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:39,691 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:39,722 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:35:39,736 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:39,817 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:39,829 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:39,839 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1968448-4271-4765-ad7f-095a7b60749b 2025-06-30 16:35:39,846 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1968448-4271-4765-ad7f-095a7b60749b 2025-06-30 16:35:39,860 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/72d30a20-fb15-4b75-a3e1-f189607739d1 2025-06-30 16:35:39,869 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-30 16:35:39,869 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:39,881 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1968448-4271-4765-ad7f-095a7b60749b 2025-06-30 16:35:39,896 - INFO - Verified VN network id 8 for VN c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:39,896 - INFO - Verifications in API Server for VN ctest-mgmt_vn-89433459 passed 2025-06-30 16:35:39,896 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:39,910 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1968448-4271-4765-ad7f-095a7b60749b 2025-06-30 16:35:39,918 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1968448-4271-4765-ad7f-095a7b60749b 2025-06-30 16:35:39,927 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/72d30a20-fb15-4b75-a3e1-f189607739d1 2025-06-30 16:35:39,941 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52329836', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14268166730979099775', 'uuid-lslong': '9699172893403946408'}, 'enable': 'true', 'created': '2025-06-30T16:35:38', 'last-modified': '2025-06-30T16:35:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.784775'} 2025-06-30 16:35:39,948 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-30 16:35:39,948 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-89433459 passed 2025-06-30 16:35:39,949 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-89433459 in API_Server ====== 2025-06-30 16:35:39,949 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:39,955 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:35:39,966 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:40,054 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c602b60b-bc0e-447f-869a-625bae709da8 2025-06-30 16:35:40,067 - DEBUG - =>VN ctest-mgmt_vn-89433459 has no policy to be verified 2025-06-30 16:35:40,067 - DEBUG - Verifying the vn in opserver 2025-06-30 16:35:40,067 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:40,067 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:40,370 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:43,442 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:43,442 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:43,464 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459?flat'} 2025-06-30 16:35:43,465 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is found in opserver 2025-06-30 16:35:43,488 - DEBUG - Do not have enough data to verify VN in agent 2025-06-30 16:35:43,497 - DEBUG - VRF ids for VN ctest-mgmt_vn-89433459: {} 2025-06-30 16:35:43,722 - DEBUG - Response for create_network : {'network': {'id': '0b7912e7-5888-4df3-8ef4-f0a03f8a37f2', 'name': 'ctest-left_vn-22202000', 'tenant_id': '83e1f49768dc4a1fbb3cf64556073546', 'project_id': '83e1f49768dc4a1fbb3cf64556073546', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-left_vn-22202000'], 'port_security_enabled': True, 'description': ''}} 2025-06-30 16:35:43,976 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c7d6051f-1f50-4eed-847a-ecac16d68c0c', 'name': '', 'tenant_id': '83e1f49768dc4a1fbb3cf64556073546', 'network_id': '0b7912e7-5888-4df3-8ef4-f0a03f8a37f2', 'ip_version': 4, 'cidr': '214.200.42.64/26', 'allocation_pools': [{'start': '214.200.42.66', 'end': '214.200.42.126'}], 'gateway_ip': '214.200.42.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '214.200.42.66', 'tags': [], 'project_id': '83e1f49768dc4a1fbb3cf64556073546'}} 2025-06-30 16:35:43,997 - INFO - Created VN ctest-left_vn-22202000 2025-06-30 16:35:44,054 - DEBUG - VN ctest-left_vn-22202000 UUID is 0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,169 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:44,176 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:35:44,188 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:44,268 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,281 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,291 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/756bac37-b24c-42a3-9b79-1b1265d82bde 2025-06-30 16:35:44,299 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/756bac37-b24c-42a3-9b79-1b1265d82bde 2025-06-30 16:35:44,306 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/b9006bac-8461-408a-a53c-0e7dcd721c79 2025-06-30 16:35:44,314 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-06-30 16:35:44,314 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,325 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/756bac37-b24c-42a3-9b79-1b1265d82bde 2025-06-30 16:35:44,341 - INFO - Verified VN network id 9 for VN 0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,341 - INFO - Verifications in API Server for VN ctest-left_vn-22202000 passed 2025-06-30 16:35:44,341 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,352 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/756bac37-b24c-42a3-9b79-1b1265d82bde 2025-06-30 16:35:44,366 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/756bac37-b24c-42a3-9b79-1b1265d82bde 2025-06-30 16:35:44,374 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/b9006bac-8461-408a-a53c-0e7dcd721c79 2025-06-30 16:35:44,386 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52329836', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '826712791431269875', 'uuid-lslong': '10301122818754623474'}, 'enable': 'true', 'created': '2025-06-30T16:35:43', 'last-modified': '2025-06-30T16:35:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449724'} 2025-06-30 16:35:44,392 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-06-30 16:35:44,392 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-22202000 passed 2025-06-30 16:35:44,393 - DEBUG - ====Verifying policy data for ctest-left_vn-22202000 in API_Server ====== 2025-06-30 16:35:44,393 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:44,398 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:35:44,409 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:44,498 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0b7912e7-5888-4df3-8ef4-f0a03f8a37f2 2025-06-30 16:35:44,507 - DEBUG - =>VN ctest-left_vn-22202000 has no policy to be verified 2025-06-30 16:35:44,507 - DEBUG - Verifying the vn in opserver 2025-06-30 16:35:44,507 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:44,507 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:47,519 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:47,519 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:50,536 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:50,536 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:53,553 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:53,554 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:53,568 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000?flat'} 2025-06-30 16:35:53,569 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 is found in opserver 2025-06-30 16:35:53,587 - DEBUG - Do not have enough data to verify VN in agent 2025-06-30 16:35:53,592 - DEBUG - VRF ids for VN ctest-left_vn-22202000: {} 2025-06-30 16:35:53,794 - DEBUG - Response for create_network : {'network': {'id': '66107acc-6547-4b9c-916a-3953a0a0651e', 'name': 'ctest-right_vn-95245102', 'tenant_id': '83e1f49768dc4a1fbb3cf64556073546', 'project_id': '83e1f49768dc4a1fbb3cf64556073546', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-right_vn-95245102'], 'port_security_enabled': True, 'description': ''}} 2025-06-30 16:35:53,991 - DEBUG - Response for create_subnet : {'subnet': {'id': '2fb8ffda-a1c7-4ba6-a22f-0abb0b2e58af', 'name': '', 'tenant_id': '83e1f49768dc4a1fbb3cf64556073546', 'network_id': '66107acc-6547-4b9c-916a-3953a0a0651e', 'ip_version': 4, 'cidr': '196.84.28.0/26', 'allocation_pools': [{'start': '196.84.28.2', 'end': '196.84.28.62'}], 'gateway_ip': '196.84.28.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '196.84.28.2', 'tags': [], 'project_id': '83e1f49768dc4a1fbb3cf64556073546'}} 2025-06-30 16:35:54,012 - INFO - Created VN ctest-right_vn-95245102 2025-06-30 16:35:54,066 - DEBUG - VN ctest-right_vn-95245102 UUID is 66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,179 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:54,186 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:35:54,198 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:54,273 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,286 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,303 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6cf833ef-fc9f-4d65-89cd-093152d9b853 2025-06-30 16:35:54,315 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6cf833ef-fc9f-4d65-89cd-093152d9b853 2025-06-30 16:35:54,324 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/d8df3718-9295-467d-8c9f-9d467177ab2b 2025-06-30 16:35:54,333 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-06-30 16:35:54,333 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,345 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6cf833ef-fc9f-4d65-89cd-093152d9b853 2025-06-30 16:35:54,371 - INFO - Verified VN network id 10 for VN 66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,371 - INFO - Verifications in API Server for VN ctest-right_vn-95245102 passed 2025-06-30 16:35:54,371 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,383 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6cf833ef-fc9f-4d65-89cd-093152d9b853 2025-06-30 16:35:54,393 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6cf833ef-fc9f-4d65-89cd-093152d9b853 2025-06-30 16:35:54,411 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/d8df3718-9295-467d-8c9f-9d467177ab2b 2025-06-30 16:35:54,426 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-52329836', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7354513209787108252', 'uuid-lslong': '10478250514370815262'}, 'enable': 'true', 'created': '2025-06-30T16:35:53', 'last-modified': '2025-06-30T16:35:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485775'} 2025-06-30 16:35:54,436 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-06-30 16:35:54,436 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-95245102 passed 2025-06-30 16:35:54,437 - DEBUG - ====Verifying policy data for ctest-right_vn-95245102 in API_Server ====== 2025-06-30 16:35:54,437 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:35:54,444 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:35:54,462 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:35:54,552 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/66107acc-6547-4b9c-916a-3953a0a0651e 2025-06-30 16:35:54,561 - DEBUG - =>VN ctest-right_vn-95245102 has no policy to be verified 2025-06-30 16:35:54,561 - DEBUG - Verifying the vn in opserver 2025-06-30 16:35:54,561 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:54,561 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:35:57,572 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:35:57,573 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:36:00,587 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:36:00,587 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:36:03,601 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:36:03,601 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:36:06,617 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:36:06,618 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:36:09,630 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:36:09,630 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:36:12,644 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 virtual network link through opserver 10.0.0.38 2025-06-30 16:36:12,644 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:36:12,655 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102?flat'} 2025-06-30 16:36:12,655 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 is found in opserver 2025-06-30 16:36:12,667 - DEBUG - Do not have enough data to verify VN in agent 2025-06-30 16:36:12,673 - DEBUG - VRF ids for VN ctest-right_vn-95245102: {} 2025-06-30 16:36:12,734 - DEBUG - Services list from nova: [, , ] 2025-06-30 16:36:13,921 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:36:15,175 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:36:15,176 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-48719204'] 2025-06-30 16:36:15,557 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-48719204'] created succesfully 2025-06-30 16:36:15,876 - DEBUG - Image by name cirros_in_net not found 2025-06-30 16:36:15,876 - DEBUG - Installing image cirros_in_net 2025-06-30 16:36:15,876 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-06-30 16:36:15,889 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-06-30 16:36:15,889 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2025-06-30 16:36:15,908 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2025-06-30 16:36:16,073 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2025-06-30 16:36:16,073 - DEBUG - Unzip image 2025-06-30 16:36:16,073 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2025-06-30 16:36:16,304 - DEBUG - Try to create image in user context 2025-06-30 16:36:16,574 - DEBUG - Image has been created in user context 2025-06-30 16:36:16,574 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2025-06-30 16:36:16,598 - DEBUG - Downloaded image has been removed 2025-06-30 16:36:16,620 - DEBUG - Uploaded image status = active 2025-06-30 16:36:17,961 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:36:17,962 - INFO - Waiting for VM ctest-pt_svm0-66870082 to be up.. 2025-06-30 16:36:18,021 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-06-30 16:36:23,157 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:36:23,157 - INFO - VM name : ctest-pt_svm0-66870082 2025-06-30 16:36:23,264 - DEBUG - VM ctest-pt_svm0-66870082 ID is 25eef7cc-92b3-4c3b-86ff-afdac8fd0991 2025-06-30 16:36:23,292 - DEBUG - VM ctest-pt_svm0-66870082 launched on Node cn-jenkins-deploy-platform-ansible-os-3582-1. 2025-06-30 16:36:23,594 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/25eef7cc-92b3-4c3b-86ff-afdac8fd0991 2025-06-30 16:36:23,603 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/1fbfc276-624f-42c0-8b19-40c96b468817 2025-06-30 16:36:23,616 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/38402545-3885-410d-bcab-f406f311a636 2025-06-30 16:36:23,630 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be 2025-06-30 16:36:26,986 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-06-30 16:36:26,986 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66870082 failed! 2025-06-30 16:36:27,046 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is 60.20.66.1 and allocation pool is NOT set 2025-06-30 16:36:31,108 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-06-30 16:36:31,108 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66870082 failed! 2025-06-30 16:36:31,162 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is 60.20.66.1 and allocation pool is NOT set 2025-06-30 16:36:35,245 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-06-30 16:36:35,245 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66870082 failed! 2025-06-30 16:36:35,302 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is 60.20.66.1 and allocation pool is NOT set 2025-06-30 16:36:39,400 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2025-06-30 16:36:39,401 - DEBUG - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66870082 failed! 2025-06-30 16:36:39,466 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is 60.20.66.1 and allocation pool is NOT set 2025-06-30 16:36:41,530 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=10.1 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.58 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.583/6.364/10.145/3.781 ms') 2025-06-30 16:36:41,530 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-66870082 passed 2025-06-30 16:36:41,695 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:36:41,695 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:36:41,773 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:36:41,889 - DEBUG - VM ctest-pt_svm0-66870082 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:36:46,890 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:36:46,890 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:36:46,970 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:36:47,068 - DEBUG - VM ctest-pt_svm0-66870082 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:36:52,069 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:36:52,069 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:36:52,135 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:36:52,256 - DEBUG - VM ctest-pt_svm0-66870082 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:36:57,257 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:36:57,257 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:36:57,324 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:36:57,414 - DEBUG - VM ctest-pt_svm0-66870082 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:37:02,415 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:02,416 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:37:02,487 - DEBUG - Error on ssh to cirros@169.254.0.5:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.5/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.5/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.5/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:37:02,613 - DEBUG - VM ctest-pt_svm0-66870082 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:37:07,614 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:07,614 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:37:07,780 - DEBUG - VM ctest-pt_svm0-66870082 is ready for SSH connections 2025-06-30 16:37:07,934 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:07,934 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:37:08,085 - DEBUG - VM ctest-pt_svm0-66870082 is ready for SSH connections 2025-06-30 16:37:08,238 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:08,238 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-66870082, IP 60.20.66.3, Port 22 2025-06-30 16:37:08,431 - DEBUG - VM ctest-pt_svm0-66870082 is ready for SSH connections 2025-06-30 16:37:08,438 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-si-23594200'] 2025-06-30 16:37:09,409 - INFO - Waiting for VM ctest-left_vm-92510891 to be up.. 2025-06-30 16:37:09,510 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:37:09,510 - INFO - VM name : ctest-left_vm-92510891 2025-06-30 16:37:09,599 - DEBUG - VM ctest-left_vm-92510891 ID is 0eaa206e-e536-4d56-be05-f89cfd647f2d 2025-06-30 16:37:09,599 - DEBUG - VM ctest-left_vm-92510891 launched on Node cn-jenkins-deploy-platform-ansible-os-3582-1. 2025-06-30 16:37:09,686 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/0eaa206e-e536-4d56-be05-f89cfd647f2d 2025-06-30 16:37:09,697 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/084a3be6-40c5-4485-b619-09b7971de2a9 2025-06-30 16:37:10,942 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.412 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.412/2.158/3.904/1.746 ms') 2025-06-30 16:37:10,943 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-92510891 passed 2025-06-30 16:37:11,098 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:11,098 - DEBUG - Waiting to SSH to VM ctest-left_vm-92510891, IP 214.200.42.67, Port 22 2025-06-30 16:37:11,276 - DEBUG - VM ctest-left_vm-92510891 is ready for SSH connections 2025-06-30 16:37:11,276 - INFO - Waiting for VM ctest-right_vm-62116772 to be up.. 2025-06-30 16:37:11,384 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:37:11,384 - INFO - VM name : ctest-right_vm-62116772 2025-06-30 16:37:11,482 - DEBUG - VM ctest-right_vm-62116772 ID is 815a4db9-d0fd-4dba-9dfc-e2d0f6cc6764 2025-06-30 16:37:11,482 - DEBUG - VM ctest-right_vm-62116772 launched on Node cn-jenkins-deploy-platform-ansible-os-3582-1. 2025-06-30 16:37:11,565 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/815a4db9-d0fd-4dba-9dfc-e2d0f6cc6764 2025-06-30 16:37:11,573 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/15f0cc50-db27-49a1-a556-9fcf35a3b862 2025-06-30 16:37:12,808 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.89 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.362 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.362/2.123/3.885/1.761 ms') 2025-06-30 16:37:12,808 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-right_vm-62116772 passed 2025-06-30 16:37:12,958 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:12,958 - DEBUG - Waiting to SSH to VM ctest-right_vm-62116772, IP 196.84.28.3, Port 22 2025-06-30 16:37:13,125 - DEBUG - VM ctest-right_vm-62116772 is ready for SSH connections 2025-06-30 16:37:13,134 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-52329836:ctest-si-23594200'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-06-30 16:37:13,574 - INFO - Attaching policy ctest-policy-29415127 to vn ctest-left_vn-22202000 2025-06-30 16:37:14,129 - INFO - Attaching policy ctest-policy-29415127 to vn ctest-right_vn-95245102 2025-06-30 16:37:14,602 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-48719204'] created succesfully 2025-06-30 16:37:14,834 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-si-23594200'] created succesfully 2025-06-30 16:37:14,835 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:14,842 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:14,857 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:14,942 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/465b33b9-b8ae-46fc-bb38-1b479a5cfd53 2025-06-30 16:37:14,952 - DEBUG - SI 'ctest-si-23594200' has service template ref to ctest-service_template_1-48719204 2025-06-30 16:37:14,952 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:14,961 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:14,983 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:15,070 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/465b33b9-b8ae-46fc-bb38-1b479a5cfd53 2025-06-30 16:37:15,078 - DEBUG - Requesting: http://10.0.0.38:8082/port-tuple/172cb14f-3534-4fd9-a9c1-75ac3b0bbfb2 2025-06-30 16:37:15,085 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/1fbfc276-624f-42c0-8b19-40c96b468817 2025-06-30 16:37:15,101 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/38402545-3885-410d-bcab-f406f311a636 2025-06-30 16:37:15,111 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be 2025-06-30 16:37:15,347 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:37:15,890 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/25eef7cc-92b3-4c3b-86ff-afdac8fd0991 2025-06-30 16:37:15,899 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/1fbfc276-624f-42c0-8b19-40c96b468817 2025-06-30 16:37:15,911 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/38402545-3885-410d-bcab-f406f311a636 2025-06-30 16:37:15,920 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be 2025-06-30 16:37:15,930 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/0d3faaee-cdc0-4afd-854b-93585b60ae46 2025-06-30 16:37:15,941 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/1d796e57-3c95-459c-afda-9e96a52d7359 2025-06-30 16:37:15,954 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/5e0e009a-be08-4fbf-a81c-688dd73dfe75 2025-06-30 16:37:15,966 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/0e982f93-61f7-49b9-9690-6618f5b1cc21 2025-06-30 16:37:15,974 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/3dd6f511-cc82-4d15-98ad-c3926f1082d1 2025-06-30 16:37:15,983 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/69018ab6-92bb-42b8-afee-2176529b5c61 2025-06-30 16:37:15,991 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/500f3b2b-7ef4-4da2-a906-883ee6d192e3 2025-06-30 16:37:16,000 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/7b42988b-3f34-4312-8f7c-585bd08a2070 2025-06-30 16:37:16,008 - DEBUG - Requesting: http://10.0.0.38:8082/instance-ip/cd12fc10-f1bb-431f-960b-eb7aa4d4e54e 2025-06-30 16:37:16,412 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:37:16,413 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/25eef7cc-92b3-4c3b-86ff-afdac8fd0991 2025-06-30 16:37:16,421 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/1fbfc276-624f-42c0-8b19-40c96b468817 2025-06-30 16:37:16,432 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/38402545-3885-410d-bcab-f406f311a636 2025-06-30 16:37:16,453 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be 2025-06-30 16:37:17,714 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=63 time=1.93 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=63 time=0.612 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.612/1.268/1.925/0.656 ms') 2025-06-30 16:37:17,715 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-66870082 passed 2025-06-30 16:37:17,761 - DEBUG - VM ctest-pt_svm0-66870082 Tap interface: {'index': '6', 'name': 'tap1fbfc276-62', 'uuid': '1fbfc276-624f-42c0-8b19-40c96b468817', 'vrf_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000:ctest-left_vn-22202000', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000', 'vm_uuid': '25eef7cc-92b3-4c3b-86ff-afdac8fd0991', 'vm_name': 'ctest-pt_svm0-66870082', 'ip_addr': '214.200.42.68', 'mac_addr': '02:1f:bf:c2:76:62', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-52329836:1fbfc276-624f-42c0-8b19-40c96b468817', 'sg_uuid_list': ['dd158a6c-2369-44c4-9399-734c6613d6d2'], 'static_route_list': None, 'vm_project_uuid': '83e1f497-68dc-4a1f-bb3c-f64556073546', 'admin_state': 'Enabled', 'flow_key_idx': '45', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '38402545-3885-410d-bcab-f406f311a636', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-30 16:37:17,762 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000:ctest-left_vn-22202000 2025-06-30 16:37:17,766 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000:ctest-left_vn-22202000', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000', 'table_label': '-1', 'vxlan_id': '9', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.0.0.38:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-06-30 16:37:17,946 - DEBUG - VM ctest-pt_svm0-66870082 : Tap interface tap1fbfc276-62 is set to Active 2025-06-30 16:37:17,946 - DEBUG - Tap interface tap1fbfc276-62 detail : {'index': '6', 'name': 'tap1fbfc276-62', 'uuid': '1fbfc276-624f-42c0-8b19-40c96b468817', 'vrf_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000:ctest-left_vn-22202000', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '9', 'vn_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000', 'vm_uuid': '25eef7cc-92b3-4c3b-86ff-afdac8fd0991', 'vm_name': 'ctest-pt_svm0-66870082', 'ip_addr': '214.200.42.68', 'mac_addr': '02:1f:bf:c2:76:62', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '28', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-52329836:1fbfc276-624f-42c0-8b19-40c96b468817', 'sg_uuid_list': ['dd158a6c-2369-44c4-9399-734c6613d6d2'], 'static_route_list': None, 'vm_project_uuid': '83e1f497-68dc-4a1f-bb3c-f64556073546', 'admin_state': 'Enabled', 'flow_key_idx': '45', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '38402545-3885-410d-bcab-f406f311a636', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-30 16:37:18,143 - DEBUG - Starting Layer 2 verification in Agent 2025-06-30 16:37:18,164 - DEBUG - Layer 2 path is seen for VM MAC 02:1f:bf:c2:76:62 in agent 10.0.0.38 2025-06-30 16:37:18,164 - DEBUG - Active layer 2 route in agent is present for VMI tap1fbfc276-62 2025-06-30 16:37:18,164 - DEBUG - L2 label(48) matches bw route table and interface table 2025-06-30 16:37:18,174 - DEBUG - VN default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 is found in Agent of node 10.0.0.38 2025-06-30 16:37:18,370 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 is consistent in agent 10.0.0.38 2025-06-30 16:37:18,370 - DEBUG - Route for VM IP ['214.200.42.68'] is consistent in agent 10.0.0.38 2025-06-30 16:37:18,370 - DEBUG - VN default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 verification for VM ctest-pt_svm0-66870082 in Agent 10.0.0.38 passed 2025-06-30 16:37:18,562 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38 2025-06-30 16:37:18,572 - DEBUG - Route for VM MAC 02:1f:bf:c2:76:62 is consistent in agent 10.0.0.38 2025-06-30 16:37:18,600 - DEBUG - VM ctest-pt_svm0-66870082 Tap interface: {'index': '5', 'name': 'tapce3f50d5-dd', 'uuid': 'ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be', 'vrf_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459:ctest-mgmt_vn-89433459', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459', 'vm_uuid': '25eef7cc-92b3-4c3b-86ff-afdac8fd0991', 'vm_name': 'ctest-pt_svm0-66870082', 'ip_addr': '60.20.66.3', 'mac_addr': '02:ce:3f:50:d5:dd', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-52329836:ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be', 'sg_uuid_list': ['dd158a6c-2369-44c4-9399-734c6613d6d2'], 'static_route_list': None, 'vm_project_uuid': '83e1f497-68dc-4a1f-bb3c-f64556073546', 'admin_state': 'Enabled', 'flow_key_idx': '46', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-30 16:37:18,600 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459:ctest-mgmt_vn-89433459 2025-06-30 16:37:18,610 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459:ctest-mgmt_vn-89433459', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459', 'table_label': '-1', 'vxlan_id': '8', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.0.0.38:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-06-30 16:37:18,783 - DEBUG - VM ctest-pt_svm0-66870082 : Tap interface tapce3f50d5-dd is set to Active 2025-06-30 16:37:18,784 - DEBUG - Tap interface tapce3f50d5-dd detail : {'index': '5', 'name': 'tapce3f50d5-dd', 'uuid': 'ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be', 'vrf_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459:ctest-mgmt_vn-89433459', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '8', 'vn_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459', 'vm_uuid': '25eef7cc-92b3-4c3b-86ff-afdac8fd0991', 'vm_name': 'ctest-pt_svm0-66870082', 'ip_addr': '60.20.66.3', 'mac_addr': '02:ce:3f:50:d5:dd', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '27', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-52329836:ce3f50d5-dd29-4bd3-9ea1-82aa9b97d9be', 'sg_uuid_list': ['dd158a6c-2369-44c4-9399-734c6613d6d2'], 'static_route_list': None, 'vm_project_uuid': '83e1f497-68dc-4a1f-bb3c-f64556073546', 'admin_state': 'Enabled', 'flow_key_idx': '46', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-30 16:37:18,982 - DEBUG - Starting Layer 2 verification in Agent 2025-06-30 16:37:18,995 - DEBUG - Layer 2 path is seen for VM MAC 02:ce:3f:50:d5:dd in agent 10.0.0.38 2025-06-30 16:37:18,995 - DEBUG - Active layer 2 route in agent is present for VMI tapce3f50d5-dd 2025-06-30 16:37:18,995 - DEBUG - L2 label(43) matches bw route table and interface table 2025-06-30 16:37:19,002 - DEBUG - VN default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is found in Agent of node 10.0.0.38 2025-06-30 16:37:19,236 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 is consistent in agent 10.0.0.38 2025-06-30 16:37:19,237 - DEBUG - Route for VM IP ['60.20.66.3'] is consistent in agent 10.0.0.38 2025-06-30 16:37:19,237 - DEBUG - VN default-domain:ctest-TestSvcRegr-52329836:ctest-mgmt_vn-89433459 verification for VM ctest-pt_svm0-66870082 in Agent 10.0.0.38 passed 2025-06-30 16:37:19,438 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38 2025-06-30 16:37:19,450 - DEBUG - Route for VM MAC 02:ce:3f:50:d5:dd is consistent in agent 10.0.0.38 2025-06-30 16:37:19,473 - DEBUG - VM ctest-pt_svm0-66870082 Tap interface: {'index': '7', 'name': 'tap38402545-38', 'uuid': '38402545-3885-410d-bcab-f406f311a636', 'vrf_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102:ctest-right_vn-95245102', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102', 'vm_uuid': '25eef7cc-92b3-4c3b-86ff-afdac8fd0991', 'vm_name': 'ctest-pt_svm0-66870082', 'ip_addr': '196.84.28.4', 'mac_addr': '02:38:40:25:45:38', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-52329836:38402545-3885-410d-bcab-f406f311a636', 'sg_uuid_list': ['dd158a6c-2369-44c4-9399-734c6613d6d2'], 'static_route_list': None, 'vm_project_uuid': '83e1f497-68dc-4a1f-bb3c-f64556073546', 'admin_state': 'Enabled', 'flow_key_idx': '59', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '1fbfc276-624f-42c0-8b19-40c96b468817', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-30 16:37:19,474 - DEBUG - Agent 10.0.0.38 vrf name: default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102:ctest-right_vn-95245102 2025-06-30 16:37:19,479 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102:ctest-right_vn-95245102', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102', 'table_label': '-1', 'vxlan_id': '10', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.0.0.38:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-06-30 16:37:19,649 - DEBUG - VM ctest-pt_svm0-66870082 : Tap interface tap38402545-38 is set to Active 2025-06-30 16:37:19,650 - DEBUG - Tap interface tap38402545-38 detail : {'index': '7', 'name': 'tap38402545-38', 'uuid': '38402545-3885-410d-bcab-f406f311a636', 'vrf_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102:ctest-right_vn-95245102', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '49', 'l2_label': '53', 'vxlan_id': '10', 'vn_name': 'default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102', 'vm_uuid': '25eef7cc-92b3-4c3b-86ff-afdac8fd0991', 'vm_name': 'ctest-pt_svm0-66870082', 'ip_addr': '196.84.28.4', 'mac_addr': '02:38:40:25:45:38', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '29', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-52329836:38402545-3885-410d-bcab-f406f311a636', 'sg_uuid_list': ['dd158a6c-2369-44c4-9399-734c6613d6d2'], 'static_route_list': None, 'vm_project_uuid': '83e1f497-68dc-4a1f-bb3c-f64556073546', 'admin_state': 'Enabled', 'flow_key_idx': '59', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '1fbfc276-624f-42c0-8b19-40c96b468817', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-06-30 16:37:19,841 - DEBUG - Starting Layer 2 verification in Agent 2025-06-30 16:37:19,852 - DEBUG - Layer 2 path is seen for VM MAC 02:38:40:25:45:38 in agent 10.0.0.38 2025-06-30 16:37:19,852 - DEBUG - Active layer 2 route in agent is present for VMI tap38402545-38 2025-06-30 16:37:19,852 - DEBUG - L2 label(53) matches bw route table and interface table 2025-06-30 16:37:19,857 - DEBUG - VN default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 is found in Agent of node 10.0.0.38 2025-06-30 16:37:20,078 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 is consistent in agent 10.0.0.38 2025-06-30 16:37:20,078 - DEBUG - Route for VM IP ['196.84.28.4'] is consistent in agent 10.0.0.38 2025-06-30 16:37:20,079 - DEBUG - VN default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 verification for VM ctest-pt_svm0-66870082 in Agent 10.0.0.38 passed 2025-06-30 16:37:20,277 - DEBUG - Starting all layer 2 verification in agent 10.0.0.38 2025-06-30 16:37:20,288 - DEBUG - Route for VM MAC 02:38:40:25:45:38 is consistent in agent 10.0.0.38 2025-06-30 16:37:20,289 - INFO - VM ctest-pt_svm0-66870082 verifications in Compute nodes passed 2025-06-30 16:37:20,289 - DEBUG - The SVMs in the SI are : [] 2025-06-30 16:37:20,289 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/25eef7cc-92b3-4c3b-86ff-afdac8fd0991 2025-06-30 16:37:20,297 - DEBUG - Service VM for SI 'ctest-si-23594200' is launched 2025-06-30 16:37:20,297 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:20,302 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:20,315 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:20,391 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/465b33b9-b8ae-46fc-bb38-1b479a5cfd53 2025-06-30 16:37:20,402 - DEBUG - SI ctest-si-23594200 has Port Tuple: ['ctest-port_tuple-15551308'] 2025-06-30 16:37:20,506 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-52329836:ctest-left_vn-22202000 2025-06-30 16:37:20,650 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-52329836:ctest-right_vn-95245102 2025-06-30 16:37:20,814 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:20,831 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:20,832 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:20,842 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:20,842 - INFO - Route to 196.84.28.3 seen in VRF:5 on cn-jenkins-deploy-platform-ansible-os-3582-1.englab.juniper.net, and SI ctest-si-23594200 is seen as the NH 2025-06-30 16:37:21,000 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:21,008 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:21,009 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:21,015 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:21,015 - INFO - Route to 214.200.42.67 seen in VRF:6 on cn-jenkins-deploy-platform-ansible-os-3582-1.englab.juniper.net, and SI ctest-si-23594200 is seen as the NH 2025-06-30 16:37:21,016 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:21,016 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:37:21,016 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 196.84.28.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-06-30 16:37:21,016 - DEBUG - ping -s 56 -c 3 -W 1 196.84.28.3 2025-06-30 16:37:24,762 - DEBUG - PING 196.84.28.3 (196.84.28.3): 56 data bytes 64 bytes from 196.84.28.3: seq=0 ttl=61 time=6.422 ms 64 bytes from 196.84.28.3: seq=1 ttl=61 time=2.787 ms 64 bytes from 196.84.28.3: seq=2 ttl=61 time=1.990 ms --- 196.84.28.3 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.990/3.733/6.422 ms 2025-06-30 16:37:24,762 - INFO - Ping to IP 196.84.28.3 from VM ctest-left_vm-92510891 passed 2025-06-30 16:37:24,762 - INFO - Dettaching policy ctest-policy-29415127 from vn ctest-right_vn-95245102 2025-06-30 16:37:24,941 - INFO - Dettaching policy ctest-policy-29415127 from vn ctest-left_vn-22202000 2025-06-30 16:37:25,216 - INFO - Deleted policy ctest-policy-29415127 2025-06-30 16:37:25,216 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-si-23594200'] 2025-06-30 16:37:25,368 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-52329836', 'ctest-si-23594200'] 2025-06-30 16:37:25,368 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:25,377 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:25,407 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:25,520 - DEBUG - Service instance ctest-si-23594200 removed from api server 2025-06-30 16:37:25,520 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/25eef7cc-92b3-4c3b-86ff-afdac8fd0991 2025-06-30 16:37:25,534 - DEBUG - All Service VMs unlinked from SI ctest-si-23594200 2025-06-30 16:37:25,539 - DEBUG - 0 svc intances found in all projects. They are [] 2025-06-30 16:37:25,539 - DEBUG - 0 svc intances found in current project. They are [] 2025-06-30 16:37:25,589 - DEBUG - 0 svc intances found in all projects. They are [] 2025-06-30 16:37:25,589 - DEBUG - 0 svc intances found in current project. They are [] 2025-06-30 16:37:25,589 - INFO - Deleting VM ctest-pt_svm0-66870082 2025-06-30 16:37:25,700 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-48719204'] 2025-06-30 16:37:25,825 - INFO - Service template: ['default-domain', 'ctest-service_template_1-48719204'] deleted successfully. 2025-06-30 16:37:25,825 - INFO - Deleting VM ctest-right_vm-62116772 2025-06-30 16:37:25,958 - INFO - Deleting VM ctest-left_vm-92510891 2025-06-30 16:37:26,078 - INFO - Deleting VN ctest-right_vn-95245102 2025-06-30 16:37:26,133 - DEBUG - VN 66107acc-6547-4b9c-916a-3953a0a0651e still in use: Unable to complete operation on network 66107acc-6547-4b9c-916a-3953a0a0651e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-bd14e2ec-2ea5-4d21-98aa-58e91da2c030'] 2025-06-30 16:37:26,134 - WARNING - Deleting VN ctest-right_vn-95245102 failed..Will retry 2025-06-30 16:37:28,282 - DEBUG - Response for deleting network () 2025-06-30 16:37:28,282 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6cf833ef-fc9f-4d65-89cd-093152d9b853 2025-06-30 16:37:28,289 - DEBUG - Response Code: 404 2025-06-30 16:37:28,289 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:28,295 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:28,353 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:28,434 - INFO - Validated that VN ctest-right_vn-95245102 is not found in API Server 2025-06-30 16:37:28,459 - DEBUG - VN ctest-right_vn-95245102 is not present in Agent 10.0.0.38 2025-06-30 16:37:28,459 - INFO - Validated that VN ctest-right_vn-95245102 is not in any agent 2025-06-30 16:37:28,489 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-95245102 info 2025-06-30 16:37:28,489 - INFO - Deleting VN ctest-left_vn-22202000 2025-06-30 16:37:28,621 - DEBUG - Response for deleting network () 2025-06-30 16:37:28,621 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/756bac37-b24c-42a3-9b79-1b1265d82bde 2025-06-30 16:37:28,630 - DEBUG - Response Code: 404 2025-06-30 16:37:28,630 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:28,637 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:28,693 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:28,765 - INFO - Validated that VN ctest-left_vn-22202000 is not found in API Server 2025-06-30 16:37:28,774 - DEBUG - VN ctest-left_vn-22202000 is not present in Agent 10.0.0.38 2025-06-30 16:37:28,774 - INFO - Validated that VN ctest-left_vn-22202000 is not in any agent 2025-06-30 16:37:28,791 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-22202000 info 2025-06-30 16:37:28,792 - INFO - Deleting VN ctest-mgmt_vn-89433459 2025-06-30 16:37:28,903 - DEBUG - Response for deleting network () 2025-06-30 16:37:28,903 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e1968448-4271-4765-ad7f-095a7b60749b 2025-06-30 16:37:28,911 - DEBUG - Response Code: 404 2025-06-30 16:37:28,911 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:37:28,916 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:37:28,972 - DEBUG - Requesting: http://10.0.0.38:8082/project/83e1f497-68dc-4a1f-bb3c-f64556073546 2025-06-30 16:37:29,050 - INFO - Validated that VN ctest-mgmt_vn-89433459 is not found in API Server 2025-06-30 16:37:29,061 - DEBUG - VN ctest-mgmt_vn-89433459 is not present in Agent 10.0.0.38 2025-06-30 16:37:29,061 - INFO - Validated that VN ctest-mgmt_vn-89433459 is not in any agent 2025-06-30 16:37:29,076 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-89433459 info 2025-06-30 16:37:29,345 - DEBUG - No XMPP flaps were noticed during the test 2025-06-30 16:37:29,346 - INFO -
2025-06-30 16:37:29,346 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:51]
2025-06-30 16:37:29,346 - INFO - -------------------------------------------------------------------------------- 2025-06-30 16:37:30,080 - INFO - Deleted project: ctest-TestSvcRegr-52329836, ID : 83e1f497-68dc-4a1f-bb3c-f64556073546