2026-01-23 13:41:23,988 - INFO - Domain Default found not creating 2026-01-23 13:41:24,176 - INFO - Project ctest-TestSvcRegr-95532178 not found, creating it 2026-01-23 13:41:24,766 - INFO - Created Project:ctest-TestSvcRegr-95532178, ID : 46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:26,425 - INFO - ================================================================================ 2026-01-23 13:41:26,425 - INFO - STARTING TEST : test_svc_in_network_datapath 2026-01-23 13:41:27,717 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.192': '0', '10.20.0.252': '0'}, '10.0.0.65': {'10.20.0.192': '0', '10.20.0.252': '0'}} with 2026-01-23 13:41:27,718 - INFO - Initial checks done. Running the testcase now 2026-01-23 13:41:27,718 - INFO - 2026-01-23 13:41:28,402 - DEBUG - Response for create_network : {'network': {'id': '8660fc82-5665-446e-8094-1841e2556825', 'name': 'ctest-mgmt_vn-56880473', 'tenant_id': '46278765d9314a3283ab915ded17df48', 'project_id': '46278765d9314a3283ab915ded17df48', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-mgmt_vn-56880473'], 'port_security_enabled': True, 'description': ''}} 2026-01-23 13:41:28,669 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dc2d87a5-0285-4ad5-bf93-b99e83880d24', 'name': '', 'tenant_id': '46278765d9314a3283ab915ded17df48', 'network_id': '8660fc82-5665-446e-8094-1841e2556825', 'ip_version': 4, 'cidr': '179.242.57.192/26', 'allocation_pools': [{'start': '179.242.57.194', 'end': '179.242.57.254'}], 'gateway_ip': '179.242.57.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '179.242.57.194', 'tags': [], 'project_id': '46278765d9314a3283ab915ded17df48'}} 2026-01-23 13:41:28,697 - INFO - Created VN ctest-mgmt_vn-56880473 2026-01-23 13:41:28,710 - DEBUG - VN ctest-mgmt_vn-56880473 UUID is 8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:28,784 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:29,100 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:29,131 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:41:29,147 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:29,250 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:29,269 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:29,282 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/b2aef02c-f118-40f6-a3ea-0bd36c122023 2026-01-23 13:41:29,294 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/b2aef02c-f118-40f6-a3ea-0bd36c122023 2026-01-23 13:41:29,312 - DEBUG - Requesting: http://10.0.0.241:8082/route-target/56fba508-9121-4888-859d-641b5debb97a 2026-01-23 13:41:29,319 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-23 13:41:29,319 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:29,331 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/b2aef02c-f118-40f6-a3ea-0bd36c122023 2026-01-23 13:41:29,346 - INFO - Verified VN network id 11 for VN 8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:29,348 - INFO - Verifications in API Server for VN ctest-mgmt_vn-56880473 passed 2026-01-23 13:41:29,348 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:29,360 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/b2aef02c-f118-40f6-a3ea-0bd36c122023 2026-01-23 13:41:29,368 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/b2aef02c-f118-40f6-a3ea-0bd36c122023 2026-01-23 13:41:29,376 - DEBUG - Requesting: http://10.0.0.241:8082/route-target/56fba508-9121-4888-859d-641b5debb97a 2026-01-23 13:41:29,389 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9683016835571991662', 'uuid-lslong': '9265057004657141797'}, 'enable': 'true', 'created': '2026-01-23T13:41:28', 'last-modified': '2026-01-23T13:41:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.769276'} 2026-01-23 13:41:29,397 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-23 13:41:29,404 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9683016835571991662', 'uuid-lslong': '9265057004657141797'}, 'enable': 'true', 'created': '2026-01-23T13:41:28', 'last-modified': '2026-01-23T13:41:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.797534'} 2026-01-23 13:41:29,411 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-23 13:41:29,416 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9683016835571991662', 'uuid-lslong': '9265057004657141797'}, 'enable': 'true', 'created': '2026-01-23T13:41:28', 'last-modified': '2026-01-23T13:41:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.800706'} 2026-01-23 13:41:29,422 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-01-23 13:41:29,423 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-56880473 passed 2026-01-23 13:41:29,423 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-56880473 in API_Server ====== 2026-01-23 13:41:29,423 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:29,430 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:41:29,441 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:29,569 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/8660fc82-5665-446e-8094-1841e2556825 2026-01-23 13:41:29,582 - DEBUG - =>VN ctest-mgmt_vn-56880473 has no policy to be verified 2026-01-23 13:41:29,582 - DEBUG - Verifying the vn in opserver 2026-01-23 13:41:29,582 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 virtual network link through opserver 10.0.0.241 2026-01-23 13:41:29,582 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks 2026-01-23 13:41:29,878 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks 2026-01-23 13:41:29,938 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473?flat'} 2026-01-23 13:41:29,938 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 virtual network link through opserver 10.0.0.242 2026-01-23 13:41:29,938 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-01-23 13:41:30,229 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-01-23 13:41:30,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473?flat'} 2026-01-23 13:41:30,308 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 virtual network link through opserver 10.0.0.240 2026-01-23 13:41:30,309 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-23 13:41:30,606 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-23 13:41:30,668 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473?flat'} 2026-01-23 13:41:30,668 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is found in opserver 2026-01-23 13:41:30,688 - DEBUG - Do not have enough data to verify VN in agent 2026-01-23 13:41:30,697 - DEBUG - VRF ids for VN ctest-mgmt_vn-56880473: {} 2026-01-23 13:41:30,989 - DEBUG - Response for create_network : {'network': {'id': '66c1c6f1-008d-4cc8-8943-ada63019e5d0', 'name': 'ctest-left_vn-75462442', 'tenant_id': '46278765d9314a3283ab915ded17df48', 'project_id': '46278765d9314a3283ab915ded17df48', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-left_vn-75462442'], 'port_security_enabled': True, 'description': ''}} 2026-01-23 13:41:31,245 - DEBUG - Response for create_subnet : {'subnet': {'id': '14b8f8ed-0735-40bd-8a7a-d728f6ef8116', 'name': '', 'tenant_id': '46278765d9314a3283ab915ded17df48', 'network_id': '66c1c6f1-008d-4cc8-8943-ada63019e5d0', 'ip_version': 4, 'cidr': '141.13.203.192/26', 'allocation_pools': [{'start': '141.13.203.194', 'end': '141.13.203.254'}], 'gateway_ip': '141.13.203.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '141.13.203.194', 'tags': [], 'project_id': '46278765d9314a3283ab915ded17df48'}} 2026-01-23 13:41:31,266 - INFO - Created VN ctest-left_vn-75462442 2026-01-23 13:41:31,279 - DEBUG - VN ctest-left_vn-75462442 UUID is 66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,362 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:31,369 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:41:31,381 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:31,478 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,492 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,502 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/8b09618b-622b-4988-b8b4-b612f35fba68 2026-01-23 13:41:31,513 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/8b09618b-622b-4988-b8b4-b612f35fba68 2026-01-23 13:41:31,524 - DEBUG - Requesting: http://10.0.0.241:8082/route-target/34f411b8-fede-406a-b3c9-ece160715439 2026-01-23 13:41:31,533 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-23 13:41:31,533 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,543 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/8b09618b-622b-4988-b8b4-b612f35fba68 2026-01-23 13:41:31,561 - INFO - Verified VN network id 12 for VN 66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,561 - INFO - Verifications in API Server for VN ctest-left_vn-75462442 passed 2026-01-23 13:41:31,561 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,571 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/8b09618b-622b-4988-b8b4-b612f35fba68 2026-01-23 13:41:31,579 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/8b09618b-622b-4988-b8b4-b612f35fba68 2026-01-23 13:41:31,590 - DEBUG - Requesting: http://10.0.0.241:8082/route-target/34f411b8-fede-406a-b3c9-ece160715439 2026-01-23 13:41:31,608 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7404418000772484296', 'uuid-lslong': '9890940135918921168'}, 'enable': 'true', 'created': '2026-01-23T13:41:30', 'last-modified': '2026-01-23T13:41:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420228'} 2026-01-23 13:41:31,615 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-23 13:41:31,623 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7404418000772484296', 'uuid-lslong': '9890940135918921168'}, 'enable': 'true', 'created': '2026-01-23T13:41:30', 'last-modified': '2026-01-23T13:41:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453219'} 2026-01-23 13:41:31,631 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-23 13:41:31,637 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7404418000772484296', 'uuid-lslong': '9890940135918921168'}, 'enable': 'true', 'created': '2026-01-23T13:41:30', 'last-modified': '2026-01-23T13:41:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448688'} 2026-01-23 13:41:31,643 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-01-23 13:41:31,643 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-75462442 passed 2026-01-23 13:41:31,643 - DEBUG - ====Verifying policy data for ctest-left_vn-75462442 in API_Server ====== 2026-01-23 13:41:31,643 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:31,650 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:41:31,667 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:31,763 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/66c1c6f1-008d-4cc8-8943-ada63019e5d0 2026-01-23 13:41:31,775 - DEBUG - =>VN ctest-left_vn-75462442 has no policy to be verified 2026-01-23 13:41:31,775 - DEBUG - Verifying the vn in opserver 2026-01-23 13:41:31,775 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 virtual network link through opserver 10.0.0.241 2026-01-23 13:41:31,775 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks 2026-01-23 13:41:31,849 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442?flat'} 2026-01-23 13:41:31,850 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 virtual network link through opserver 10.0.0.242 2026-01-23 13:41:31,850 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-01-23 13:41:31,921 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442?flat'} 2026-01-23 13:41:31,922 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 virtual network link through opserver 10.0.0.240 2026-01-23 13:41:31,922 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-23 13:41:31,996 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442?flat'} 2026-01-23 13:41:31,996 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 is found in opserver 2026-01-23 13:41:32,016 - DEBUG - Do not have enough data to verify VN in agent 2026-01-23 13:41:32,026 - DEBUG - VRF ids for VN ctest-left_vn-75462442: {} 2026-01-23 13:41:32,337 - DEBUG - Response for create_network : {'network': {'id': '6b7592e4-0c34-4f20-8e8f-7c9b09548a13', 'name': 'ctest-right_vn-61594386', 'tenant_id': '46278765d9314a3283ab915ded17df48', 'project_id': '46278765d9314a3283ab915ded17df48', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-right_vn-61594386'], 'port_security_enabled': True, 'description': ''}} 2026-01-23 13:41:32,602 - DEBUG - Response for create_subnet : {'subnet': {'id': '65705c04-eaa9-4d54-b5a4-3905763db6d1', 'name': '', 'tenant_id': '46278765d9314a3283ab915ded17df48', 'network_id': '6b7592e4-0c34-4f20-8e8f-7c9b09548a13', 'ip_version': 4, 'cidr': '105.159.244.128/26', 'allocation_pools': [{'start': '105.159.244.130', 'end': '105.159.244.190'}], 'gateway_ip': '105.159.244.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '105.159.244.130', 'tags': [], 'project_id': '46278765d9314a3283ab915ded17df48'}} 2026-01-23 13:41:32,626 - INFO - Created VN ctest-right_vn-61594386 2026-01-23 13:41:32,639 - DEBUG - VN ctest-right_vn-61594386 UUID is 6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:32,716 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:32,722 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:41:32,734 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:32,826 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:32,838 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:32,847 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/665e6e6b-0561-486d-b7c4-413bbeeaa3bf 2026-01-23 13:41:32,853 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/665e6e6b-0561-486d-b7c4-413bbeeaa3bf 2026-01-23 13:41:32,861 - DEBUG - Requesting: http://10.0.0.241:8082/route-target/45111b1a-d6a5-409c-8684-c6c77d6e7c74 2026-01-23 13:41:32,867 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-23 13:41:32,867 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:32,877 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/665e6e6b-0561-486d-b7c4-413bbeeaa3bf 2026-01-23 13:41:32,891 - INFO - Verified VN network id 13 for VN 6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:32,891 - INFO - Verifications in API Server for VN ctest-right_vn-61594386 passed 2026-01-23 13:41:32,891 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:32,903 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/665e6e6b-0561-486d-b7c4-413bbeeaa3bf 2026-01-23 13:41:32,917 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/665e6e6b-0561-486d-b7c4-413bbeeaa3bf 2026-01-23 13:41:32,928 - DEBUG - Requesting: http://10.0.0.241:8082/route-target/45111b1a-d6a5-409c-8684-c6c77d6e7c74 2026-01-23 13:41:32,942 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7743256642488389408', 'uuid-lslong': '10272566280373701139'}, 'enable': 'true', 'created': '2026-01-23T13:41:32', 'last-modified': '2026-01-23T13:41:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407073'} 2026-01-23 13:41:32,947 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-23 13:41:32,953 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7743256642488389408', 'uuid-lslong': '10272566280373701139'}, 'enable': 'true', 'created': '2026-01-23T13:41:32', 'last-modified': '2026-01-23T13:41:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422711'} 2026-01-23 13:41:32,959 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-23 13:41:32,965 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-95532178', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7743256642488389408', 'uuid-lslong': '10272566280373701139'}, 'enable': 'true', 'created': '2026-01-23T13:41:32', 'last-modified': '2026-01-23T13:41:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428415'} 2026-01-23 13:41:32,971 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-01-23 13:41:32,972 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-61594386 passed 2026-01-23 13:41:32,972 - DEBUG - ====Verifying policy data for ctest-right_vn-61594386 in API_Server ====== 2026-01-23 13:41:32,972 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:41:32,978 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:41:32,990 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:41:33,098 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-network/6b7592e4-0c34-4f20-8e8f-7c9b09548a13 2026-01-23 13:41:33,108 - DEBUG - =>VN ctest-right_vn-61594386 has no policy to be verified 2026-01-23 13:41:33,108 - DEBUG - Verifying the vn in opserver 2026-01-23 13:41:33,108 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 virtual network link through opserver 10.0.0.241 2026-01-23 13:41:33,108 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks 2026-01-23 13:41:33,187 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386?flat'} 2026-01-23 13:41:33,187 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 virtual network link through opserver 10.0.0.242 2026-01-23 13:41:33,187 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-01-23 13:41:33,249 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386?flat'} 2026-01-23 13:41:33,249 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 virtual network link through opserver 10.0.0.240 2026-01-23 13:41:33,249 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-01-23 13:41:33,306 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386?flat'} 2026-01-23 13:41:33,306 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 is found in opserver 2026-01-23 13:41:33,327 - DEBUG - Do not have enough data to verify VN in agent 2026-01-23 13:41:33,337 - DEBUG - VRF ids for VN ctest-right_vn-61594386: {} 2026-01-23 13:41:33,393 - DEBUG - Services list from nova: [, , , ] 2026-01-23 13:41:34,561 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5069-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5069-2) 2026-01-23 13:41:35,834 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5069-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5069-1) 2026-01-23 13:41:35,834 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-98122803'] 2026-01-23 13:41:36,148 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-98122803'] created succesfully 2026-01-23 13:41:36,537 - DEBUG - Image by name cirros_in_net not found 2026-01-23 13:41:36,537 - DEBUG - Installing image cirros_in_net 2026-01-23 13:41:36,537 - DEBUG - Image info {'name': 'cirros-in-net.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'gocubsgo', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-01-23 13:41:36,537 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2026-01-23 13:41:36,537 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz 2026-01-23 13:41:36,565 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-in-net.vmdk.gz -O /contrail-test/images/cirros-in-net.vmdk.gz 2026-01-23 13:41:36,772 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-in-net.vmdk.gz 2026-01-23 13:41:36,773 - DEBUG - Unzip image 2026-01-23 13:41:36,773 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-in-net.vmdk.gz 2026-01-23 13:41:36,935 - DEBUG - Try to create image in user context 2026-01-23 13:41:37,231 - DEBUG - Image has been created in user context 2026-01-23 13:41:37,231 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-in-net.vmdk 2026-01-23 13:41:37,248 - DEBUG - Downloaded image has been removed 2026-01-23 13:41:37,263 - DEBUG - Uploaded image status = active 2026-01-23 13:41:38,476 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5069-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5069-2) 2026-01-23 13:41:38,476 - INFO - Waiting for VM ctest-pt_svm0-88697157 to be up.. 2026-01-23 13:41:38,533 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-01-23 13:41:43,655 - DEBUG - VM is in ACTIVE state now 2026-01-23 13:41:43,655 - INFO - VM name : ctest-pt_svm0-88697157 2026-01-23 13:41:43,765 - DEBUG - VM ctest-pt_svm0-88697157 ID is 8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:41:43,793 - DEBUG - VM ctest-pt_svm0-88697157 launched on Node an-jenkins-deploy-platform-ansible-os-5069-2 2026-01-23 13:41:44,105 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:41:44,403 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:41:44,438 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/4c610623-9ac3-4ffa-b3d0-170dff5e1832 2026-01-23 13:41:44,448 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c3b0051c-4968-4ea0-8b3f-f6c8488e6145 2026-01-23 13:41:44,457 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/d91b5560-e380-48fa-a72b-1ec2118e0a92 2026-01-23 13:41:47,703 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2026-01-23 13:41:47,703 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-88697157 failed! 2026-01-23 13:41:47,719 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is 179.242.57.193 and allocation pool is NOT set 2026-01-23 13:41:51,794 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2026-01-23 13:41:51,794 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-88697157 failed! 2026-01-23 13:41:51,810 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is 179.242.57.193 and allocation pool is NOT set 2026-01-23 13:41:55,893 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2026-01-23 13:41:55,893 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-88697157 failed! 2026-01-23 13:41:55,907 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is 179.242.57.193 and allocation pool is NOT set 2026-01-23 13:41:59,992 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2026-01-23 13:41:59,992 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-88697157 failed! 2026-01-23 13:42:00,007 - DEBUG - Gateway for vn default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is 179.242.57.193 and allocation pool is NOT set 2026-01-23 13:42:02,078 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=11.4 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.06 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.061/6.210/11.360/5.149 ms') 2026-01-23 13:42:02,078 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-88697157 passed 2026-01-23 13:42:02,187 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:02,187 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:02,252 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-23 13:42:02,349 - DEBUG - VM ctest-pt_svm0-88697157 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-23 13:42:07,350 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:07,350 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:07,406 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-23 13:42:07,505 - DEBUG - VM ctest-pt_svm0-88697157 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-23 13:42:12,506 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:12,506 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:12,576 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-23 13:42:12,694 - DEBUG - VM ctest-pt_svm0-88697157 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-23 13:42:17,695 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:17,695 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:17,760 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-01-23 13:42:17,863 - DEBUG - VM ctest-pt_svm0-88697157 is NOT ready for SSH connections, VM status: ACTIVE 2026-01-23 13:42:22,863 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:22,863 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:23,026 - DEBUG - VM ctest-pt_svm0-88697157 is ready for SSH connections 2026-01-23 13:42:23,135 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:23,136 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:23,286 - DEBUG - VM ctest-pt_svm0-88697157 is ready for SSH connections 2026-01-23 13:42:23,401 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:23,401 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-88697157, IP 179.242.57.195, Port 22 2026-01-23 13:42:23,559 - DEBUG - VM ctest-pt_svm0-88697157 is ready for SSH connections 2026-01-23 13:42:23,567 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-si-98951908'] 2026-01-23 13:42:24,450 - INFO - Waiting for VM ctest-left_vm-38484947 to be up.. 2026-01-23 13:42:24,596 - DEBUG - VM is in ACTIVE state now 2026-01-23 13:42:24,597 - INFO - VM name : ctest-left_vm-38484947 2026-01-23 13:42:24,738 - DEBUG - VM ctest-left_vm-38484947 ID is 486ce277-a3c6-4066-be24-276994d51b16 2026-01-23 13:42:24,738 - DEBUG - VM ctest-left_vm-38484947 launched on Node an-jenkins-deploy-platform-ansible-os-5069-2 2026-01-23 13:42:24,843 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/486ce277-a3c6-4066-be24-276994d51b16 2026-01-23 13:42:24,859 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/3955bbd2-b09c-4e92-a204-440f77502ed0 2026-01-23 13:42:26,062 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.01 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.407 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.407/1.710/3.013/1.303 ms') 2026-01-23 13:42:26,062 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-38484947 passed 2026-01-23 13:42:26,178 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:26,178 - DEBUG - Waiting to SSH to VM ctest-left_vm-38484947, IP 141.13.203.195, Port 22 2026-01-23 13:42:26,337 - DEBUG - VM ctest-left_vm-38484947 is ready for SSH connections 2026-01-23 13:42:26,337 - INFO - Waiting for VM ctest-right_vm-70378771 to be up.. 2026-01-23 13:42:26,423 - DEBUG - VM is in ACTIVE state now 2026-01-23 13:42:26,424 - INFO - VM name : ctest-right_vm-70378771 2026-01-23 13:42:26,514 - DEBUG - VM ctest-right_vm-70378771 ID is afb3368d-5711-4b73-ae0a-2791892e6289 2026-01-23 13:42:26,514 - DEBUG - VM ctest-right_vm-70378771 launched on Node an-jenkins-deploy-platform-ansible-os-5069-1 2026-01-23 13:42:26,690 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/afb3368d-5711-4b73-ae0a-2791892e6289 2026-01-23 13:42:26,699 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/40be7b8e-9d59-4e82-b523-528697b9f49e 2026-01-23 13:42:27,899 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.28 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.414 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.414/1.848/3.283/1.434 ms') 2026-01-23 13:42:27,899 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-70378771 passed 2026-01-23 13:42:28,020 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:28,020 - DEBUG - Waiting to SSH to VM ctest-right_vm-70378771, IP 105.159.244.131, Port 22 2026-01-23 13:42:28,177 - DEBUG - VM ctest-right_vm-70378771 is ready for SSH connections 2026-01-23 13:42:28,184 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = ['default-domain:ctest-TestSvcRegr-95532178:ctest-si-98951908'], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-01-23 13:42:28,529 - INFO - Attaching policy ctest-policy-25926427 to vn ctest-left_vn-75462442 2026-01-23 13:42:28,909 - INFO - Attaching policy ctest-policy-25926427 to vn ctest-right_vn-61594386 2026-01-23 13:42:29,245 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-98122803'] created succesfully 2026-01-23 13:42:29,451 - DEBUG - Service instance: ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-si-98951908'] created succesfully 2026-01-23 13:42:29,452 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:29,460 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:29,480 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:29,579 - DEBUG - Requesting: http://10.0.0.241:8082/service-instance/a66f2623-c6c1-4252-8a3a-c2629245d160 2026-01-23 13:42:29,618 - DEBUG - SI 'ctest-si-98951908' has service template ref to ctest-service_template_1-98122803 2026-01-23 13:42:29,618 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:29,627 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:29,645 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:29,776 - DEBUG - Requesting: http://10.0.0.241:8082/service-instance/a66f2623-c6c1-4252-8a3a-c2629245d160 2026-01-23 13:42:29,786 - DEBUG - Requesting: http://10.0.0.241:8082/port-tuple/6c105bde-3ffc-4b6e-bb15-96756fb171e9 2026-01-23 13:42:29,800 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/4c610623-9ac3-4ffa-b3d0-170dff5e1832 2026-01-23 13:42:29,821 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/c3b0051c-4968-4ea0-8b3f-f6c8488e6145 2026-01-23 13:42:29,835 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/d91b5560-e380-48fa-a72b-1ec2118e0a92 2026-01-23 13:42:30,300 - DEBUG - VM is in ACTIVE state now 2026-01-23 13:42:30,795 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:42:30,803 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/4c610623-9ac3-4ffa-b3d0-170dff5e1832 2026-01-23 13:42:30,816 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c3b0051c-4968-4ea0-8b3f-f6c8488e6145 2026-01-23 13:42:30,829 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/d91b5560-e380-48fa-a72b-1ec2118e0a92 2026-01-23 13:42:30,841 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/912cd96d-1cb8-497a-8e27-76ed0db66b81 2026-01-23 13:42:30,852 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/937a6598-5fb8-419b-a952-5cd8bcbb452f 2026-01-23 13:42:30,860 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/a24aa0a1-af7d-426d-96fd-f56d6526eae8 2026-01-23 13:42:30,871 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/13a7aef1-ee18-4298-813b-f77fd2a1e127 2026-01-23 13:42:30,881 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/291826b3-572d-4b3f-b6f1-a7ed8dfbf4db 2026-01-23 13:42:30,893 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/cb1db1b1-3f70-4588-a437-2fa5e2707851 2026-01-23 13:42:30,902 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/6fba43e5-f171-4216-82c4-c192d6cdf351 2026-01-23 13:42:30,911 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/aa5b9415-313f-4f39-b54d-9d927852fcb8 2026-01-23 13:42:30,922 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/eaa1a70b-ee43-44d4-8b44-894b52965011 2026-01-23 13:42:31,398 - DEBUG - VM is in ACTIVE state now 2026-01-23 13:42:31,398 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:42:31,407 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/4c610623-9ac3-4ffa-b3d0-170dff5e1832 2026-01-23 13:42:31,419 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/c3b0051c-4968-4ea0-8b3f-f6c8488e6145 2026-01-23 13:42:31,432 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/d91b5560-e380-48fa-a72b-1ec2118e0a92 2026-01-23 13:42:32,637 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=1.41 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.463 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.463/0.938/1.414/0.475 ms') 2026-01-23 13:42:32,637 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-pt_svm0-88697157 passed 2026-01-23 13:42:32,670 - DEBUG - VM ctest-pt_svm0-88697157 Tap interface: {'index': '5', 'name': 'tap4c610623-9a', 'uuid': '4c610623-9ac3-4ffa-b3d0-170dff5e1832', 'vrf_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442:ctest-left_vn-75462442', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'vm_uuid': '8dc38b97-ba02-416e-b324-954a98841883', 'vm_name': 'ctest-pt_svm0-88697157', 'ip_addr': '141.13.203.196', 'mac_addr': '02:4c:61:06:23:9a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '34', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-95532178:4c610623-9ac3-4ffa-b3d0-170dff5e1832', 'sg_uuid_list': ['68f459fd-febf-40f5-a0aa-201f4f4a7654'], 'static_route_list': None, 'vm_project_uuid': '46278765-d931-4a32-83ab-915ded17df48', 'admin_state': 'Enabled', 'flow_key_idx': '50', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'd91b5560-e380-48fa-a72b-1ec2118e0a92', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-23 13:42:32,670 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442:ctest-left_vn-75462442 2026-01-23 13:42:32,676 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442:ctest-left_vn-75462442', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.19:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-23 13:42:32,814 - DEBUG - VM ctest-pt_svm0-88697157 : Tap interface tap4c610623-9a is set to Active 2026-01-23 13:42:32,815 - DEBUG - Tap interface tap4c610623-9a detail : {'index': '5', 'name': 'tap4c610623-9a', 'uuid': '4c610623-9ac3-4ffa-b3d0-170dff5e1832', 'vrf_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442:ctest-left_vn-75462442', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '39', 'l2_label': '43', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442', 'vm_uuid': '8dc38b97-ba02-416e-b324-954a98841883', 'vm_name': 'ctest-pt_svm0-88697157', 'ip_addr': '141.13.203.196', 'mac_addr': '02:4c:61:06:23:9a', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.5', 'service_vlan_list': None, 'os_ifindex': '34', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-95532178:4c610623-9ac3-4ffa-b3d0-170dff5e1832', 'sg_uuid_list': ['68f459fd-febf-40f5-a0aa-201f4f4a7654'], 'static_route_list': None, 'vm_project_uuid': '46278765-d931-4a32-83ab-915ded17df48', 'admin_state': 'Enabled', 'flow_key_idx': '50', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': 'd91b5560-e380-48fa-a72b-1ec2118e0a92', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-23 13:42:32,973 - DEBUG - Starting Layer 2 verification in Agent 2026-01-23 13:42:32,987 - DEBUG - Layer 2 path is seen for VM MAC 02:4c:61:06:23:9a in agent 10.0.0.65 2026-01-23 13:42:32,987 - DEBUG - Active layer 2 route in agent is present for VMI tap4c610623-9a 2026-01-23 13:42:32,987 - DEBUG - L2 label(43) matches bw route table and interface table 2026-01-23 13:42:33,004 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 is found in Agent of node 10.0.0.65 2026-01-23 13:42:33,188 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 is consistent in agent 10.0.0.65 2026-01-23 13:42:33,189 - DEBUG - Route for VM IP ['141.13.203.196'] is consistent in agent 10.0.0.65 2026-01-23 13:42:33,189 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 verification for VM ctest-pt_svm0-88697157 in Agent 10.0.0.65 passed 2026-01-23 13:42:33,342 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2026-01-23 13:42:33,355 - DEBUG - Route for VM MAC 02:4c:61:06:23:9a is consistent in agent 10.0.0.65 2026-01-23 13:42:33,376 - DEBUG - VM ctest-pt_svm0-88697157 Tap interface: {'index': '4', 'name': 'tapc3b0051c-49', 'uuid': 'c3b0051c-4968-4ea0-8b3f-f6c8488e6145', 'vrf_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473:ctest-mgmt_vn-56880473', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '34', 'l2_label': '38', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'vm_uuid': '8dc38b97-ba02-416e-b324-954a98841883', 'vm_name': 'ctest-pt_svm0-88697157', 'ip_addr': '179.242.57.195', 'mac_addr': '02:c3:b0:05:1c:49', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '33', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-95532178:c3b0051c-4968-4ea0-8b3f-f6c8488e6145', 'sg_uuid_list': ['68f459fd-febf-40f5-a0aa-201f4f4a7654'], 'static_route_list': None, 'vm_project_uuid': '46278765-d931-4a32-83ab-915ded17df48', 'admin_state': 'Enabled', 'flow_key_idx': '45', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-23 13:42:33,377 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473:ctest-mgmt_vn-56880473 2026-01-23 13:42:33,382 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473:ctest-mgmt_vn-56880473', 'ucindex': '4', 'mcindex': '4', 'l2index': '4', 'source': 'Config; ', 'uc6index': '4', 'vn': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '4', 'brindex': '4', 'mplsindex': '0', 'RD': '10.20.0.19:4', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-23 13:42:33,551 - DEBUG - VM ctest-pt_svm0-88697157 : Tap interface tapc3b0051c-49 is set to Active 2026-01-23 13:42:33,551 - DEBUG - Tap interface tapc3b0051c-49 detail : {'index': '4', 'name': 'tapc3b0051c-49', 'uuid': 'c3b0051c-4968-4ea0-8b3f-f6c8488e6145', 'vrf_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473:ctest-mgmt_vn-56880473', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '34', 'l2_label': '38', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473', 'vm_uuid': '8dc38b97-ba02-416e-b324-954a98841883', 'vm_name': 'ctest-pt_svm0-88697157', 'ip_addr': '179.242.57.195', 'mac_addr': '02:c3:b0:05:1c:49', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '33', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-95532178:c3b0051c-4968-4ea0-8b3f-f6c8488e6145', 'sg_uuid_list': ['68f459fd-febf-40f5-a0aa-201f4f4a7654'], 'static_route_list': None, 'vm_project_uuid': '46278765-d931-4a32-83ab-915ded17df48', 'admin_state': 'Enabled', 'flow_key_idx': '45', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-23 13:42:33,710 - DEBUG - Starting Layer 2 verification in Agent 2026-01-23 13:42:33,720 - DEBUG - Layer 2 path is seen for VM MAC 02:c3:b0:05:1c:49 in agent 10.0.0.65 2026-01-23 13:42:33,720 - DEBUG - Active layer 2 route in agent is present for VMI tapc3b0051c-49 2026-01-23 13:42:33,720 - DEBUG - L2 label(38) matches bw route table and interface table 2026-01-23 13:42:33,732 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is found in Agent of node 10.0.0.65 2026-01-23 13:42:33,901 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 is consistent in agent 10.0.0.65 2026-01-23 13:42:33,901 - DEBUG - Route for VM IP ['179.242.57.195'] is consistent in agent 10.0.0.65 2026-01-23 13:42:33,901 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-mgmt_vn-56880473 verification for VM ctest-pt_svm0-88697157 in Agent 10.0.0.65 passed 2026-01-23 13:42:34,055 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2026-01-23 13:42:34,065 - DEBUG - Route for VM MAC 02:c3:b0:05:1c:49 is consistent in agent 10.0.0.65 2026-01-23 13:42:34,084 - DEBUG - VM ctest-pt_svm0-88697157 Tap interface: {'index': '6', 'name': 'tapd91b5560-e3', 'uuid': 'd91b5560-e380-48fa-a72b-1ec2118e0a92', 'vrf_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386:ctest-right_vn-61594386', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'vm_uuid': '8dc38b97-ba02-416e-b324-954a98841883', 'vm_name': 'ctest-pt_svm0-88697157', 'ip_addr': '105.159.244.132', 'mac_addr': '02:d9:1b:55:60:e3', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '35', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-95532178:d91b5560-e380-48fa-a72b-1ec2118e0a92', 'sg_uuid_list': ['68f459fd-febf-40f5-a0aa-201f4f4a7654'], 'static_route_list': None, 'vm_project_uuid': '46278765-d931-4a32-83ab-915ded17df48', 'admin_state': 'Enabled', 'flow_key_idx': '36', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '4c610623-9ac3-4ffa-b3d0-170dff5e1832', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-23 13:42:34,084 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386:ctest-right_vn-61594386 2026-01-23 13:42:34,089 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386:ctest-right_vn-61594386', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.19:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-01-23 13:42:34,266 - DEBUG - VM ctest-pt_svm0-88697157 : Tap interface tapd91b5560-e3 is set to Active 2026-01-23 13:42:34,267 - DEBUG - Tap interface tapd91b5560-e3 detail : {'index': '6', 'name': 'tapd91b5560-e3', 'uuid': 'd91b5560-e380-48fa-a72b-1ec2118e0a92', 'vrf_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386:ctest-right_vn-61594386', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '44', 'l2_label': '48', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386', 'vm_uuid': '8dc38b97-ba02-416e-b324-954a98841883', 'vm_name': 'ctest-pt_svm0-88697157', 'ip_addr': '105.159.244.132', 'mac_addr': '02:d9:1b:55:60:e3', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '35', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSvcRegr-95532178:d91b5560-e380-48fa-a72b-1ec2118e0a92', 'sg_uuid_list': ['68f459fd-febf-40f5-a0aa-201f4f4a7654'], 'static_route_list': None, 'vm_project_uuid': '46278765-d931-4a32-83ab-915ded17df48', 'admin_state': 'Enabled', 'flow_key_idx': '36', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '4c610623-9ac3-4ffa-b3d0-170dff5e1832', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-01-23 13:42:34,420 - DEBUG - Starting Layer 2 verification in Agent 2026-01-23 13:42:34,431 - DEBUG - Layer 2 path is seen for VM MAC 02:d9:1b:55:60:e3 in agent 10.0.0.65 2026-01-23 13:42:34,431 - DEBUG - Active layer 2 route in agent is present for VMI tapd91b5560-e3 2026-01-23 13:42:34,431 - DEBUG - L2 label(48) matches bw route table and interface table 2026-01-23 13:42:34,436 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 is found in Agent of node 10.0.0.19 2026-01-23 13:42:34,604 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 is consistent in agent 10.0.0.19 2026-01-23 13:42:34,605 - DEBUG - Route for VM IP ['105.159.244.132'] is consistent in agent 10.0.0.19 2026-01-23 13:42:34,605 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 verification for VM ctest-pt_svm0-88697157 in Agent 10.0.0.19 passed 2026-01-23 13:42:34,759 - DEBUG - Starting all layer 2 verification in agent 10.0.0.19 2026-01-23 13:42:34,770 - DEBUG - Route for VM MAC 02:d9:1b:55:60:e3 is consistent in agent 10.0.0.19 2026-01-23 13:42:34,775 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 is found in Agent of node 10.0.0.65 2026-01-23 13:42:34,959 - DEBUG - VRF IDs of VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 is consistent in agent 10.0.0.65 2026-01-23 13:42:34,960 - DEBUG - Route for VM IP ['105.159.244.132'] is consistent in agent 10.0.0.65 2026-01-23 13:42:34,960 - DEBUG - VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 verification for VM ctest-pt_svm0-88697157 in Agent 10.0.0.65 passed 2026-01-23 13:42:35,115 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2026-01-23 13:42:35,127 - DEBUG - Route for VM MAC 02:d9:1b:55:60:e3 is consistent in agent 10.0.0.65 2026-01-23 13:42:35,127 - INFO - VM ctest-pt_svm0-88697157 verifications in Compute nodes passed 2026-01-23 13:42:35,127 - DEBUG - The SVMs in the SI are : [] 2026-01-23 13:42:35,127 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:42:35,137 - DEBUG - Service VM for SI 'ctest-si-98951908' is launched 2026-01-23 13:42:35,137 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:35,143 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:35,154 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:35,256 - DEBUG - Requesting: http://10.0.0.241:8082/service-instance/a66f2623-c6c1-4252-8a3a-c2629245d160 2026-01-23 13:42:35,268 - DEBUG - SI ctest-si-98951908 has Port Tuple: ['ctest-port_tuple-84999359'] 2026-01-23 13:42:35,288 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-95532178:ctest-left_vn-75462442 2026-01-23 13:42:35,357 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSvcRegr-95532178:ctest-right_vn-61594386 2026-01-23 13:42:35,438 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,448 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,448 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,453 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,453 - INFO - Route to 105.159.244.131 seen in VRF:5 on an-jenkins-deploy-platform-ansible-os-5069-2, and SI ctest-si-98951908 is seen as the NH 2026-01-23 13:42:35,529 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,538 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,539 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,544 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,545 - INFO - Route to 141.13.203.195 seen in VRF:6 on an-jenkins-deploy-platform-ansible-os-5069-2, and SI ctest-si-98951908 is seen as the NH 2026-01-23 13:42:35,545 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,545 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-23 13:42:35,545 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 105.159.244.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2026-01-23 13:42:35,545 - DEBUG - ping -s 56 -c 3 -W 1 105.159.244.131 2026-01-23 13:42:39,620 - DEBUG - PING 105.159.244.131 (105.159.244.131): 56 data bytes 64 bytes from 105.159.244.131: seq=0 ttl=61 time=11.305 ms 64 bytes from 105.159.244.131: seq=1 ttl=61 time=2.011 ms 64 bytes from 105.159.244.131: seq=2 ttl=61 time=2.134 ms --- 105.159.244.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 2.011/5.150/11.305 ms 2026-01-23 13:42:39,620 - INFO - Ping to IP 105.159.244.131 from VM ctest-left_vm-38484947 passed 2026-01-23 13:42:39,620 - INFO - Dettaching policy ctest-policy-25926427 from vn ctest-right_vn-61594386 2026-01-23 13:42:39,793 - INFO - Dettaching policy ctest-policy-25926427 from vn ctest-left_vn-75462442 2026-01-23 13:42:40,078 - INFO - Deleted policy ctest-policy-25926427 2026-01-23 13:42:40,078 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-si-98951908'] 2026-01-23 13:42:40,256 - INFO - Deleted SI ['default-domain', 'ctest-TestSvcRegr-95532178', 'ctest-si-98951908'] 2026-01-23 13:42:40,256 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:40,263 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:40,281 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:40,388 - DEBUG - Service instance ctest-si-98951908 removed from api server 2026-01-23 13:42:40,388 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/8dc38b97-ba02-416e-b324-954a98841883 2026-01-23 13:42:40,405 - DEBUG - All Service VMs unlinked from SI ctest-si-98951908 2026-01-23 13:42:40,418 - DEBUG - 0 svc intances found in all projects. They are [] 2026-01-23 13:42:40,419 - DEBUG - 0 svc intances found in current project. They are [] 2026-01-23 13:42:40,482 - DEBUG - 0 svc intances found in all projects. They are [] 2026-01-23 13:42:40,482 - DEBUG - 0 svc intances found in current project. They are [] 2026-01-23 13:42:40,482 - INFO - Deleting VM ctest-pt_svm0-88697157 2026-01-23 13:42:40,634 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-98122803'] 2026-01-23 13:42:40,752 - INFO - Service template: ['default-domain', 'ctest-service_template_1-98122803'] deleted successfully. 2026-01-23 13:42:40,752 - INFO - Deleting VM ctest-right_vm-70378771 2026-01-23 13:42:40,871 - INFO - Deleting VM ctest-left_vm-38484947 2026-01-23 13:42:40,958 - INFO - Deleting VN ctest-right_vn-61594386 2026-01-23 13:42:41,018 - DEBUG - VN 6b7592e4-0c34-4f20-8e8f-7c9b09548a13 still in use: Unable to complete operation on network 6b7592e4-0c34-4f20-8e8f-7c9b09548a13. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-17cda173-ae02-404b-95ff-206dfafe2a41'] 2026-01-23 13:42:41,018 - WARNING - Deleting VN ctest-right_vn-61594386 failed..Will retry 2026-01-23 13:42:43,205 - DEBUG - Response for deleting network () 2026-01-23 13:42:43,205 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/665e6e6b-0561-486d-b7c4-413bbeeaa3bf 2026-01-23 13:42:43,212 - DEBUG - Response Code: 404 2026-01-23 13:42:43,212 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:43,218 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:43,275 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:43,378 - INFO - Validated that VN ctest-right_vn-61594386 is not found in API Server 2026-01-23 13:42:43,394 - DEBUG - VN ctest-right_vn-61594386 is not present in Agent 10.0.0.19 2026-01-23 13:42:43,406 - DEBUG - VN ctest-right_vn-61594386 is not present in Agent 10.0.0.65 2026-01-23 13:42:43,406 - INFO - Validated that VN ctest-right_vn-61594386 is not in any agent 2026-01-23 13:42:43,440 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-61594386 info 2026-01-23 13:42:43,441 - INFO - Deleting VN ctest-left_vn-75462442 2026-01-23 13:42:43,631 - DEBUG - Response for deleting network () 2026-01-23 13:42:43,632 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/8b09618b-622b-4988-b8b4-b612f35fba68 2026-01-23 13:42:43,642 - DEBUG - Response Code: 404 2026-01-23 13:42:43,643 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:43,664 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:43,683 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:43,782 - INFO - Validated that VN ctest-left_vn-75462442 is not found in API Server 2026-01-23 13:42:43,797 - DEBUG - VN ctest-left_vn-75462442 is not present in Agent 10.0.0.19 2026-01-23 13:42:43,807 - DEBUG - VN ctest-left_vn-75462442 is not present in Agent 10.0.0.65 2026-01-23 13:42:43,807 - INFO - Validated that VN ctest-left_vn-75462442 is not in any agent 2026-01-23 13:42:43,840 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-75462442 info 2026-01-23 13:42:43,840 - INFO - Deleting VN ctest-mgmt_vn-56880473 2026-01-23 13:42:44,015 - DEBUG - Response for deleting network () 2026-01-23 13:42:44,015 - DEBUG - Requesting: http://10.0.0.241:8082/routing-instance/b2aef02c-f118-40f6-a3ea-0bd36c122023 2026-01-23 13:42:44,021 - DEBUG - Response Code: 404 2026-01-23 13:42:44,022 - DEBUG - Requesting: http://10.0.0.241:8082/domains 2026-01-23 13:42:44,033 - DEBUG - Requesting: http://10.0.0.241:8082/domain/f15a1bbf-817f-4eb9-b7ab-0dfe5138c0ca 2026-01-23 13:42:44,051 - DEBUG - Requesting: http://10.0.0.241:8082/project/46278765-d931-4a32-83ab-915ded17df48 2026-01-23 13:42:44,170 - INFO - Validated that VN ctest-mgmt_vn-56880473 is not found in API Server 2026-01-23 13:42:44,185 - DEBUG - VN ctest-mgmt_vn-56880473 is not present in Agent 10.0.0.19 2026-01-23 13:42:44,198 - DEBUG - VN ctest-mgmt_vn-56880473 is not present in Agent 10.0.0.65 2026-01-23 13:42:44,198 - INFO - Validated that VN ctest-mgmt_vn-56880473 is not in any agent 2026-01-23 13:42:44,243 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-56880473 info 2026-01-23 13:42:45,589 - DEBUG - No XMPP flaps were noticed during the test 2026-01-23 13:42:45,589 - INFO -
2026-01-23 13:42:45,589 - INFO - END TEST : test_svc_in_network_datapath : PASSED[0:01:19]
2026-01-23 13:42:45,589 - INFO - -------------------------------------------------------------------------------- 2026-01-23 13:42:46,313 - INFO - Deleted project: ctest-TestSvcRegr-95532178, ID : 46278765-d931-4a32-83ab-915ded17df48