2025-07-24 04:12:49,061 - INFO - Domain Default found not creating 2025-07-24 04:12:49,236 - INFO - Project ctest-TestSvcRegr-04549529 not found, creating it 2025-07-24 04:12:49,795 - INFO - Created Project:ctest-TestSvcRegr-04549529, ID : 8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:12:51,425 - INFO - ================================================================================ 2025-07-24 04:12:51,425 - INFO - STARTING TEST : test_svc_in_net_nat_with_static_routes 2025-07-24 04:12:52,713 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-07-24 04:12:52,713 - INFO - Initial checks done. Running the testcase now 2025-07-24 04:12:52,713 - INFO - 2025-07-24 04:12:53,510 - DEBUG - Response for create_network : {'network': {'id': '99eda805-154a-40fd-8bf0-ef6f0b4aff61', 'name': 'ctest-third-vn-12910650', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-third-vn-12910650'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:12:53,795 - DEBUG - Response for create_subnet : {'subnet': {'id': '971ccf10-a644-4671-b2c7-1bb0614bf9ef', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '99eda805-154a-40fd-8bf0-ef6f0b4aff61', 'ip_version': 4, 'cidr': '94.238.84.64/26', 'allocation_pools': [{'start': '94.238.84.66', 'end': '94.238.84.126'}], 'gateway_ip': '94.238.84.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '94.238.84.66', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:12:53,821 - INFO - Created VN ctest-third-vn-12910650 2025-07-24 04:12:53,836 - DEBUG - VN ctest-third-vn-12910650 UUID is 99eda805-154a-40fd-8bf0-ef6f0b4aff61 2025-07-24 04:12:54,000 - DEBUG - Services list from nova: [, , , ] 2025-07-24 04:12:55,350 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1) 2025-07-24 04:12:55,412 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-24 04:13:00,521 - DEBUG - VM is in ACTIVE state now 2025-07-24 04:13:01,107 - DEBUG - Response for create_network : {'network': {'id': 'd12e0b9d-092d-48e1-ad97-0807f8eb1d7b', 'name': 'ctest-mgmt_vn-10347105', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-mgmt_vn-10347105'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:01,483 - DEBUG - Response for create_subnet : {'subnet': {'id': '4d8aaed7-5b84-4bbd-8754-d83b4a85b0ab', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': 'd12e0b9d-092d-48e1-ad97-0807f8eb1d7b', 'ip_version': 4, 'cidr': '206.47.133.64/26', 'allocation_pools': [{'start': '206.47.133.66', 'end': '206.47.133.126'}], 'gateway_ip': '206.47.133.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.47.133.66', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:01,523 - INFO - Created VN ctest-mgmt_vn-10347105 2025-07-24 04:13:01,540 - DEBUG - VN ctest-mgmt_vn-10347105 UUID is d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:01,693 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:02,069 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:02,127 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:02,151 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:02,307 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:02,333 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:02,351 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/5ecc240f-6627-43f7-b211-530212bf03f7 2025-07-24 04:13:02,364 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/5ecc240f-6627-43f7-b211-530212bf03f7 2025-07-24 04:13:02,372 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/74a047f2-1aaa-4997-b0d3-527962a65b49 2025-07-24 04:13:02,381 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:02,381 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:02,394 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/5ecc240f-6627-43f7-b211-530212bf03f7 2025-07-24 04:13:02,419 - INFO - Verified VN network id 12 for VN d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:02,420 - INFO - Verifications in API Server for VN ctest-mgmt_vn-10347105 passed 2025-07-24 04:13:02,420 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:02,437 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/5ecc240f-6627-43f7-b211-530212bf03f7 2025-07-24 04:13:02,449 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/5ecc240f-6627-43f7-b211-530212bf03f7 2025-07-24 04:13:02,470 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/74a047f2-1aaa-4997-b0d3-527962a65b49 2025-07-24 04:13:02,501 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15072997771947362529', 'uuid-lslong': '12508475320378793339'}, 'enable': 'true', 'created': '2025-07-24T04:13:01', 'last-modified': '2025-07-24T04:13:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.110960'} 2025-07-24 04:13:02,509 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:02,523 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15072997771947362529', 'uuid-lslong': '12508475320378793339'}, 'enable': 'true', 'created': '2025-07-24T04:13:01', 'last-modified': '2025-07-24T04:13:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.129180'} 2025-07-24 04:13:02,539 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:02,547 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15072997771947362529', 'uuid-lslong': '12508475320378793339'}, 'enable': 'true', 'created': '2025-07-24T04:13:01', 'last-modified': '2025-07-24T04:13:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.166186'} 2025-07-24 04:13:02,555 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:02,555 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-10347105 passed 2025-07-24 04:13:02,555 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-10347105 in API_Server ====== 2025-07-24 04:13:02,555 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:02,565 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:02,582 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:02,739 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/d12e0b9d-092d-48e1-ad97-0807f8eb1d7b 2025-07-24 04:13:02,764 - DEBUG - =>VN ctest-mgmt_vn-10347105 has no policy to be verified 2025-07-24 04:13:02,764 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:02,764 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:02,764 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:03,107 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:03,204 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105?flat'} 2025-07-24 04:13:03,204 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:03,205 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:03,524 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:03,616 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105?flat'} 2025-07-24 04:13:03,616 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:03,616 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:03,967 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:04,048 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105?flat'} 2025-07-24 04:13:04,048 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-10347105 is found in opserver 2025-07-24 04:13:04,079 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:04,095 - DEBUG - VRF ids for VN ctest-mgmt_vn-10347105: {} 2025-07-24 04:13:04,448 - DEBUG - Response for create_network : {'network': {'id': '73aa6214-c0d3-49cd-906e-6c9c4c5f9d60', 'name': 'ctest-left_vn-43932688', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-left_vn-43932688'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:04,731 - DEBUG - Response for create_subnet : {'subnet': {'id': '75a1c1cd-8b84-4611-8f6e-ca4c7c93c97c', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '73aa6214-c0d3-49cd-906e-6c9c4c5f9d60', 'ip_version': 4, 'cidr': '222.161.159.128/26', 'allocation_pools': [{'start': '222.161.159.130', 'end': '222.161.159.190'}], 'gateway_ip': '222.161.159.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '222.161.159.130', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:04,766 - INFO - Created VN ctest-left_vn-43932688 2025-07-24 04:13:04,788 - DEBUG - VN ctest-left_vn-43932688 UUID is 73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:04,898 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:04,908 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:04,927 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:05,052 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:05,078 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:05,092 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4480c507-58f8-45de-b948-90885111f7b5 2025-07-24 04:13:05,111 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4480c507-58f8-45de-b948-90885111f7b5 2025-07-24 04:13:05,124 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/66a3975c-2577-4bd6-979f-1cc1447267b9 2025-07-24 04:13:05,136 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:05,136 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:05,159 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4480c507-58f8-45de-b948-90885111f7b5 2025-07-24 04:13:05,184 - INFO - Verified VN network id 13 for VN 73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:05,185 - INFO - Verifications in API Server for VN ctest-left_vn-43932688 passed 2025-07-24 04:13:05,185 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:05,201 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4480c507-58f8-45de-b948-90885111f7b5 2025-07-24 04:13:05,211 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4480c507-58f8-45de-b948-90885111f7b5 2025-07-24 04:13:05,222 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/66a3975c-2577-4bd6-979f-1cc1447267b9 2025-07-24 04:13:05,242 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8334581901676464589', 'uuid-lslong': '10407375207451827552'}, 'enable': 'true', 'created': '2025-07-24T04:13:04', 'last-modified': '2025-07-24T04:13:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.572451'} 2025-07-24 04:13:05,252 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:05,259 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8334581901676464589', 'uuid-lslong': '10407375207451827552'}, 'enable': 'true', 'created': '2025-07-24T04:13:04', 'last-modified': '2025-07-24T04:13:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.592164'} 2025-07-24 04:13:05,266 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:05,274 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8334581901676464589', 'uuid-lslong': '10407375207451827552'}, 'enable': 'true', 'created': '2025-07-24T04:13:04', 'last-modified': '2025-07-24T04:13:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.602329'} 2025-07-24 04:13:05,283 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:05,283 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-43932688 passed 2025-07-24 04:13:05,284 - DEBUG - ====Verifying policy data for ctest-left_vn-43932688 in API_Server ====== 2025-07-24 04:13:05,284 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:05,292 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:05,309 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:05,436 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/73aa6214-c0d3-49cd-906e-6c9c4c5f9d60 2025-07-24 04:13:05,451 - DEBUG - =>VN ctest-left_vn-43932688 has no policy to be verified 2025-07-24 04:13:05,451 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:05,451 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:05,452 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:05,554 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688?flat'} 2025-07-24 04:13:05,554 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:05,554 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:05,634 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688?flat'} 2025-07-24 04:13:05,634 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:05,634 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:05,708 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688?flat'} 2025-07-24 04:13:05,708 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-43932688 is found in opserver 2025-07-24 04:13:05,736 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:05,751 - DEBUG - VRF ids for VN ctest-left_vn-43932688: {} 2025-07-24 04:13:06,079 - DEBUG - Response for create_network : {'network': {'id': '0b144d68-9b1a-43f6-a139-71763de1f38e', 'name': 'ctest-right_vn-70303807', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-right_vn-70303807'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:06,382 - DEBUG - Response for create_subnet : {'subnet': {'id': '51d3b752-7f59-4fa0-b85a-c6e4c12074f4', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '0b144d68-9b1a-43f6-a139-71763de1f38e', 'ip_version': 4, 'cidr': '115.125.84.0/26', 'allocation_pools': [{'start': '115.125.84.2', 'end': '115.125.84.62'}], 'gateway_ip': '115.125.84.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '115.125.84.2', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:06,408 - INFO - Created VN ctest-right_vn-70303807 2025-07-24 04:13:06,425 - DEBUG - VN ctest-right_vn-70303807 UUID is 0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,510 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:06,518 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:06,534 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:06,629 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,646 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,658 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b499c146-58cf-412d-abbb-bac320d38d95 2025-07-24 04:13:06,670 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b499c146-58cf-412d-abbb-bac320d38d95 2025-07-24 04:13:06,681 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/13a7ed60-f2a8-4315-a25b-1b51c5e8fbec 2025-07-24 04:13:06,690 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:06,691 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,703 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b499c146-58cf-412d-abbb-bac320d38d95 2025-07-24 04:13:06,725 - INFO - Verified VN network id 14 for VN 0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,725 - INFO - Verifications in API Server for VN ctest-right_vn-70303807 passed 2025-07-24 04:13:06,726 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,738 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b499c146-58cf-412d-abbb-bac320d38d95 2025-07-24 04:13:06,747 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b499c146-58cf-412d-abbb-bac320d38d95 2025-07-24 04:13:06,758 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/13a7ed60-f2a8-4315-a25b-1b51c5e8fbec 2025-07-24 04:13:06,776 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '798348145625547766', 'uuid-lslong': '11617441466437202830'}, 'enable': 'true', 'created': '2025-07-24T04:13:05', 'last-modified': '2025-07-24T04:13:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462427'} 2025-07-24 04:13:06,787 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:06,795 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '798348145625547766', 'uuid-lslong': '11617441466437202830'}, 'enable': 'true', 'created': '2025-07-24T04:13:05', 'last-modified': '2025-07-24T04:13:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482589'} 2025-07-24 04:13:06,803 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:06,813 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '798348145625547766', 'uuid-lslong': '11617441466437202830'}, 'enable': 'true', 'created': '2025-07-24T04:13:05', 'last-modified': '2025-07-24T04:13:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496884'} 2025-07-24 04:13:06,822 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:06,822 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-70303807 passed 2025-07-24 04:13:06,822 - DEBUG - ====Verifying policy data for ctest-right_vn-70303807 in API_Server ====== 2025-07-24 04:13:06,822 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:06,831 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:06,848 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:06,965 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/0b144d68-9b1a-43f6-a139-71763de1f38e 2025-07-24 04:13:06,979 - DEBUG - =>VN ctest-right_vn-70303807 has no policy to be verified 2025-07-24 04:13:06,979 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:06,979 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:06,979 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:07,052 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807?flat'} 2025-07-24 04:13:07,052 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:07,052 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:07,070 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807?flat'} 2025-07-24 04:13:07,070 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:07,070 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:07,088 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807?flat'} 2025-07-24 04:13:07,088 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-70303807 is found in opserver 2025-07-24 04:13:07,116 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:07,131 - DEBUG - VRF ids for VN ctest-right_vn-70303807: {} 2025-07-24 04:13:08,532 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-2) 2025-07-24 04:13:10,156 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1) 2025-07-24 04:13:10,156 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-72234582'] 2025-07-24 04:13:10,495 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-72234582'] created succesfully 2025-07-24 04:13:11,052 - DEBUG - Image by name tiny_nat_fw not found 2025-07-24 04:13:11,052 - DEBUG - Installing image tiny_nat_fw 2025-07-24 04:13:11,052 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-24 04:13:11,052 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-07-24 04:13:11,052 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-07-24 04:13:11,075 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:13:11,161 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:13:11,162 - DEBUG - Unzip image 2025-07-24 04:13:11,162 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:13:11,200 - DEBUG - Try to create image in user context 2025-07-24 04:13:11,271 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-72234582'] 2025-07-24 04:13:11,388 - INFO - Service template: ['default-domain', 'ctest-service_template_1-72234582'] deleted successfully. 2025-07-24 04:13:11,388 - INFO - Skip interface_detach for VM ctest-right_vm-20543343 in state BUILD 2025-07-24 04:13:11,388 - INFO - Deleting VM ctest-right_vm-20543343 2025-07-24 04:13:11,420 - ERROR - VM ctest-right_vm-20543343 has failed to come up 2025-07-24 04:13:11,421 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:11,422 - ERROR - VM ctest-right_vm-20543343 has failed to come up 2025-07-24 04:13:11,422 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:11,491 - INFO - Skip interface_detach for VM ctest-left_vm-09729937 in state BUILD 2025-07-24 04:13:11,491 - INFO - Deleting VM ctest-left_vm-09729937 2025-07-24 04:13:11,491 - ERROR - VM ctest-left_vm-09729937 has failed to come up 2025-07-24 04:13:11,491 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:11,491 - ERROR - VM ctest-left_vm-09729937 has failed to come up 2025-07-24 04:13:11,491 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:11,564 - INFO - Deleting VN ctest-right_vn-70303807 2025-07-24 04:13:11,612 - DEBUG - VN 0b144d68-9b1a-43f6-a139-71763de1f38e still in use: Unable to complete operation on network 0b144d68-9b1a-43f6-a139-71763de1f38e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-9dce1d89-a608-44d2-83a7-ad9a577749d4'] 2025-07-24 04:13:11,612 - WARNING - Deleting VN ctest-right_vn-70303807 failed..Will retry 2025-07-24 04:13:13,804 - DEBUG - Response for deleting network () 2025-07-24 04:13:13,804 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b499c146-58cf-412d-abbb-bac320d38d95 2025-07-24 04:13:13,814 - DEBUG - Response Code: 404 2025-07-24 04:13:13,814 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:13,833 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:13,860 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:14,001 - INFO - Validated that VN ctest-right_vn-70303807 is not found in API Server 2025-07-24 04:13:14,025 - DEBUG - VN ctest-right_vn-70303807 is not present in Agent 10.0.0.57 2025-07-24 04:13:14,039 - DEBUG - VN ctest-right_vn-70303807 is not present in Agent 10.0.0.23 2025-07-24 04:13:14,039 - INFO - Validated that VN ctest-right_vn-70303807 is not in any agent 2025-07-24 04:13:14,090 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-70303807 info 2025-07-24 04:13:14,090 - INFO - Deleting VN ctest-left_vn-43932688 2025-07-24 04:13:14,271 - DEBUG - Response for deleting network () 2025-07-24 04:13:14,271 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4480c507-58f8-45de-b948-90885111f7b5 2025-07-24 04:13:14,286 - DEBUG - Response Code: 404 2025-07-24 04:13:14,286 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:14,296 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:14,312 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:14,437 - INFO - Validated that VN ctest-left_vn-43932688 is not found in API Server 2025-07-24 04:13:14,460 - DEBUG - VN ctest-left_vn-43932688 is not present in Agent 10.0.0.57 2025-07-24 04:13:14,476 - DEBUG - VN ctest-left_vn-43932688 is not present in Agent 10.0.0.23 2025-07-24 04:13:14,476 - INFO - Validated that VN ctest-left_vn-43932688 is not in any agent 2025-07-24 04:13:14,524 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-43932688 info 2025-07-24 04:13:14,525 - INFO - Deleting VN ctest-mgmt_vn-10347105 2025-07-24 04:13:14,686 - DEBUG - Response for deleting network () 2025-07-24 04:13:14,687 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/5ecc240f-6627-43f7-b211-530212bf03f7 2025-07-24 04:13:14,696 - DEBUG - Response Code: 404 2025-07-24 04:13:14,696 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:14,721 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:14,765 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:14,857 - INFO - Validated that VN ctest-mgmt_vn-10347105 is not found in API Server 2025-07-24 04:13:14,879 - DEBUG - VN ctest-mgmt_vn-10347105 is not present in Agent 10.0.0.57 2025-07-24 04:13:14,894 - DEBUG - VN ctest-mgmt_vn-10347105 is not present in Agent 10.0.0.23 2025-07-24 04:13:14,895 - INFO - Validated that VN ctest-mgmt_vn-10347105 is not in any agent 2025-07-24 04:13:14,946 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-10347105 info 2025-07-24 04:13:14,946 - INFO - Deleting VM ctest-vm-in-third-vn-37122779 2025-07-24 04:13:15,025 - INFO - Deleting VN ctest-third-vn-12910650 2025-07-24 04:13:15,086 - DEBUG - VN 99eda805-154a-40fd-8bf0-ef6f0b4aff61 still in use: Unable to complete operation on network 99eda805-154a-40fd-8bf0-ef6f0b4aff61. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8f470364-e5eb-4bb3-a815-499cda0c9bc2'] 2025-07-24 04:13:15,086 - WARNING - Deleting VN ctest-third-vn-12910650 failed..Will retry 2025-07-24 04:13:17,277 - DEBUG - Response for deleting network () 2025-07-24 04:13:18,559 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 49, in test_svc_in_net_nat_with_static_routes
    static_route={'left': routes})
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
2025-07-24 04:13:18,576 - DEBUG - No XMPP flaps were noticed during the test 2025-07-24 04:13:18,576 - INFO - 2025-07-24 04:13:18,576 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : FAILED[0:00:27] 2025-07-24 04:13:18,576 - INFO - -------------------------------------------------------------------------------- 2025-07-24 04:13:18,585 - INFO - ================================================================================ 2025-07-24 04:13:18,585 - INFO - STARTING TEST : test_svc_v2_transparent_datapath 2025-07-24 04:13:19,881 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-07-24 04:13:19,881 - INFO - Initial checks done. Running the testcase now 2025-07-24 04:13:19,881 - INFO - 2025-07-24 04:13:20,185 - DEBUG - Response for create_network : {'network': {'id': '8c0cbf04-87d3-4944-b7f7-e95ec66dd406', 'name': 'ctest-mgmt_vn-19851485', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-mgmt_vn-19851485'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:20,409 - DEBUG - Response for create_subnet : {'subnet': {'id': '8bb97601-5cf1-4060-98cc-32bd7c06d714', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '8c0cbf04-87d3-4944-b7f7-e95ec66dd406', 'ip_version': 4, 'cidr': '184.68.27.0/26', 'allocation_pools': [{'start': '184.68.27.2', 'end': '184.68.27.62'}], 'gateway_ip': '184.68.27.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '184.68.27.2', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:20,435 - INFO - Created VN ctest-mgmt_vn-19851485 2025-07-24 04:13:20,451 - DEBUG - VN ctest-mgmt_vn-19851485 UUID is 8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:20,547 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:20,556 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:20,570 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:20,684 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:20,707 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:20,724 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/476733d8-18eb-4562-9032-c807a04b96fa 2025-07-24 04:13:20,737 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/476733d8-18eb-4562-9032-c807a04b96fa 2025-07-24 04:13:20,749 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a7bd0711-3f0f-4792-8c49-049ab29faa80 2025-07-24 04:13:20,760 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:20,760 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:20,774 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/476733d8-18eb-4562-9032-c807a04b96fa 2025-07-24 04:13:20,805 - INFO - Verified VN network id 11 for VN 8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:20,805 - INFO - Verifications in API Server for VN ctest-mgmt_vn-19851485 passed 2025-07-24 04:13:20,805 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:20,821 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/476733d8-18eb-4562-9032-c807a04b96fa 2025-07-24 04:13:20,834 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/476733d8-18eb-4562-9032-c807a04b96fa 2025-07-24 04:13:20,848 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a7bd0711-3f0f-4792-8c49-049ab29faa80 2025-07-24 04:13:20,862 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10091650891209984324', 'uuid-lslong': '13256320621453628422'}, 'enable': 'true', 'created': '2025-07-24T04:13:20', 'last-modified': '2025-07-24T04:13:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.512632'} 2025-07-24 04:13:20,870 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:20,876 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10091650891209984324', 'uuid-lslong': '13256320621453628422'}, 'enable': 'true', 'created': '2025-07-24T04:13:20', 'last-modified': '2025-07-24T04:13:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532550'} 2025-07-24 04:13:20,885 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:20,895 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10091650891209984324', 'uuid-lslong': '13256320621453628422'}, 'enable': 'true', 'created': '2025-07-24T04:13:20', 'last-modified': '2025-07-24T04:13:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.551122'} 2025-07-24 04:13:20,903 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:20,903 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-19851485 passed 2025-07-24 04:13:20,903 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-19851485 in API_Server ====== 2025-07-24 04:13:20,904 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:20,910 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:20,924 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:21,024 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8c0cbf04-87d3-4944-b7f7-e95ec66dd406 2025-07-24 04:13:21,042 - DEBUG - =>VN ctest-mgmt_vn-19851485 has no policy to be verified 2025-07-24 04:13:21,042 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:21,042 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:21,042 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:21,058 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485?flat'} 2025-07-24 04:13:21,058 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:21,058 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:21,130 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485?flat'} 2025-07-24 04:13:21,130 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:21,130 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:21,200 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485?flat'} 2025-07-24 04:13:21,200 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-mgmt_vn-19851485 is found in opserver 2025-07-24 04:13:21,230 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:21,243 - DEBUG - VRF ids for VN ctest-mgmt_vn-19851485: {} 2025-07-24 04:13:21,554 - DEBUG - Response for create_network : {'network': {'id': '097307c1-141b-4c17-af66-65e8ea900ef8', 'name': 'ctest-left_vn-65763677', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-left_vn-65763677'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:21,821 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab9d9e30-abf6-4a0c-a39a-72253f5aca37', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '097307c1-141b-4c17-af66-65e8ea900ef8', 'ip_version': 4, 'cidr': '95.148.248.128/26', 'allocation_pools': [{'start': '95.148.248.130', 'end': '95.148.248.190'}], 'gateway_ip': '95.148.248.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.148.248.130', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:21,846 - INFO - Created VN ctest-left_vn-65763677 2025-07-24 04:13:21,869 - DEBUG - VN ctest-left_vn-65763677 UUID is 097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:21,953 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:21,961 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:21,976 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:22,081 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:22,101 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:22,118 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1cf79d0e-6844-43c6-9fd5-2da532867180 2025-07-24 04:13:22,128 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1cf79d0e-6844-43c6-9fd5-2da532867180 2025-07-24 04:13:22,140 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/2e6bbdc3-9c32-43da-b4b0-8346b65a7662 2025-07-24 04:13:22,151 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:22,151 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:22,169 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1cf79d0e-6844-43c6-9fd5-2da532867180 2025-07-24 04:13:22,191 - INFO - Verified VN network id 12 for VN 097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:22,191 - INFO - Verifications in API Server for VN ctest-left_vn-65763677 passed 2025-07-24 04:13:22,191 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:22,205 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1cf79d0e-6844-43c6-9fd5-2da532867180 2025-07-24 04:13:22,215 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1cf79d0e-6844-43c6-9fd5-2da532867180 2025-07-24 04:13:22,225 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/2e6bbdc3-9c32-43da-b4b0-8346b65a7662 2025-07-24 04:13:22,249 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '680896494510492695', 'uuid-lslong': '12638901455304003320'}, 'enable': 'true', 'created': '2025-07-24T04:13:21', 'last-modified': '2025-07-24T04:13:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.503484'} 2025-07-24 04:13:22,258 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:22,266 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '680896494510492695', 'uuid-lslong': '12638901455304003320'}, 'enable': 'true', 'created': '2025-07-24T04:13:21', 'last-modified': '2025-07-24T04:13:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.524689'} 2025-07-24 04:13:22,274 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:22,283 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '680896494510492695', 'uuid-lslong': '12638901455304003320'}, 'enable': 'true', 'created': '2025-07-24T04:13:21', 'last-modified': '2025-07-24T04:13:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.536095'} 2025-07-24 04:13:22,292 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:22,292 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-65763677 passed 2025-07-24 04:13:22,292 - DEBUG - ====Verifying policy data for ctest-left_vn-65763677 in API_Server ====== 2025-07-24 04:13:22,292 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:22,302 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:22,317 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:22,425 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/097307c1-141b-4c17-af66-65e8ea900ef8 2025-07-24 04:13:22,440 - DEBUG - =>VN ctest-left_vn-65763677 has no policy to be verified 2025-07-24 04:13:22,440 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:22,440 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:22,440 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:22,467 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677?flat'} 2025-07-24 04:13:22,467 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:22,467 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:22,483 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677?flat'} 2025-07-24 04:13:22,483 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:22,483 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:22,499 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677?flat'} 2025-07-24 04:13:22,499 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-left_vn-65763677 is found in opserver 2025-07-24 04:13:22,532 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:22,548 - DEBUG - VRF ids for VN ctest-left_vn-65763677: {} 2025-07-24 04:13:22,876 - DEBUG - Response for create_network : {'network': {'id': '440084e2-658c-4d72-84a2-e8c6c67539b6', 'name': 'ctest-right_vn-29353419', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-right_vn-29353419'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:23,114 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f2ca67b2-fdfd-4c1e-ba19-b252c3fd382d', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '440084e2-658c-4d72-84a2-e8c6c67539b6', 'ip_version': 4, 'cidr': '223.106.154.128/26', 'allocation_pools': [{'start': '223.106.154.130', 'end': '223.106.154.190'}], 'gateway_ip': '223.106.154.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '223.106.154.130', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:23,140 - INFO - Created VN ctest-right_vn-29353419 2025-07-24 04:13:23,155 - DEBUG - VN ctest-right_vn-29353419 UUID is 440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,253 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:23,262 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:23,284 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:23,423 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,441 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,462 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/38eba274-2c81-41d3-9696-75c9cb63f2a1 2025-07-24 04:13:23,476 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/38eba274-2c81-41d3-9696-75c9cb63f2a1 2025-07-24 04:13:23,489 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a3309454-081b-4073-9be4-69ece69fe86e 2025-07-24 04:13:23,500 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:23,500 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,525 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/38eba274-2c81-41d3-9696-75c9cb63f2a1 2025-07-24 04:13:23,554 - INFO - Verified VN network id 13 for VN 440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,554 - INFO - Verifications in API Server for VN ctest-right_vn-29353419 passed 2025-07-24 04:13:23,554 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,568 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/38eba274-2c81-41d3-9696-75c9cb63f2a1 2025-07-24 04:13:23,579 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/38eba274-2c81-41d3-9696-75c9cb63f2a1 2025-07-24 04:13:23,591 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a3309454-081b-4073-9be4-69ece69fe86e 2025-07-24 04:13:23,612 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4900062502480268658', 'uuid-lslong': '9557457299664353718'}, 'enable': 'true', 'created': '2025-07-24T04:13:22', 'last-modified': '2025-07-24T04:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.560134'} 2025-07-24 04:13:23,621 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:23,630 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4900062502480268658', 'uuid-lslong': '9557457299664353718'}, 'enable': 'true', 'created': '2025-07-24T04:13:22', 'last-modified': '2025-07-24T04:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.584528'} 2025-07-24 04:13:23,639 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:23,647 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4900062502480268658', 'uuid-lslong': '9557457299664353718'}, 'enable': 'true', 'created': '2025-07-24T04:13:22', 'last-modified': '2025-07-24T04:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.593021'} 2025-07-24 04:13:23,656 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:23,656 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-29353419 passed 2025-07-24 04:13:23,656 - DEBUG - ====Verifying policy data for ctest-right_vn-29353419 in API_Server ====== 2025-07-24 04:13:23,656 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:23,664 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:23,683 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:23,885 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/440084e2-658c-4d72-84a2-e8c6c67539b6 2025-07-24 04:13:23,898 - DEBUG - =>VN ctest-right_vn-29353419 has no policy to be verified 2025-07-24 04:13:23,898 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:23,898 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:23,898 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:23,913 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419?flat'} 2025-07-24 04:13:23,914 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:23,914 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:23,929 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419?flat'} 2025-07-24 04:13:23,929 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:23,929 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:23,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419?flat'} 2025-07-24 04:13:23,947 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-right_vn-29353419 is found in opserver 2025-07-24 04:13:23,979 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:23,994 - DEBUG - VRF ids for VN ctest-right_vn-29353419: {} 2025-07-24 04:13:24,294 - DEBUG - Response for create_network : {'network': {'id': '2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6', 'name': 'ctest-trans_left_vn-90047964', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-trans_left_vn-90047964'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:24,595 - DEBUG - Response for create_subnet : {'subnet': {'id': 'eae0a826-e565-4639-acb8-c3e895b61a53', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': '2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6', 'ip_version': 4, 'cidr': '113.246.10.128/26', 'allocation_pools': [{'start': '113.246.10.130', 'end': '113.246.10.190'}], 'gateway_ip': '113.246.10.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '113.246.10.130', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:24,626 - INFO - Created VN ctest-trans_left_vn-90047964 2025-07-24 04:13:24,646 - DEBUG - VN ctest-trans_left_vn-90047964 UUID is 2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:24,739 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:24,747 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:24,765 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:24,870 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:24,891 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:24,903 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ed596c15-946c-4cba-8206-f6b9cc309aec 2025-07-24 04:13:24,914 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ed596c15-946c-4cba-8206-f6b9cc309aec 2025-07-24 04:13:24,925 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/f1bdc811-3271-46cd-8eb0-f948cefece2a 2025-07-24 04:13:24,934 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:24,934 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:24,949 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ed596c15-946c-4cba-8206-f6b9cc309aec 2025-07-24 04:13:24,969 - INFO - Verified VN network id 14 for VN 2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:24,969 - INFO - Verifications in API Server for VN ctest-trans_left_vn-90047964 passed 2025-07-24 04:13:24,969 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:24,984 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ed596c15-946c-4cba-8206-f6b9cc309aec 2025-07-24 04:13:24,993 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ed596c15-946c-4cba-8206-f6b9cc309aec 2025-07-24 04:13:25,002 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/f1bdc811-3271-46cd-8eb0-f948cefece2a 2025-07-24 04:13:25,022 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3148783248248359923', 'uuid-lslong': '12704134216038730678'}, 'enable': 'true', 'created': '2025-07-24T04:13:24', 'last-modified': '2025-07-24T04:13:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499588'} 2025-07-24 04:13:25,030 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:25,037 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3148783248248359923', 'uuid-lslong': '12704134216038730678'}, 'enable': 'true', 'created': '2025-07-24T04:13:24', 'last-modified': '2025-07-24T04:13:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.517856'} 2025-07-24 04:13:25,046 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:25,054 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3148783248248359923', 'uuid-lslong': '12704134216038730678'}, 'enable': 'true', 'created': '2025-07-24T04:13:24', 'last-modified': '2025-07-24T04:13:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.543705'} 2025-07-24 04:13:25,064 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:13:25,064 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-90047964 passed 2025-07-24 04:13:25,064 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-90047964 in API_Server ====== 2025-07-24 04:13:25,064 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:25,074 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:25,089 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:25,199 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/2bb2b9ae-6a8b-4bf3-b04e-26c295dfcbb6 2025-07-24 04:13:25,218 - DEBUG - =>VN ctest-trans_left_vn-90047964 has no policy to be verified 2025-07-24 04:13:25,218 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:25,218 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:25,218 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:25,234 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964?flat'} 2025-07-24 04:13:25,235 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:25,235 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:25,251 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964?flat'} 2025-07-24 04:13:25,251 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:25,251 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:25,266 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964?flat'} 2025-07-24 04:13:25,266 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-trans_left_vn-90047964 is found in opserver 2025-07-24 04:13:25,297 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:25,312 - DEBUG - VRF ids for VN ctest-trans_left_vn-90047964: {} 2025-07-24 04:13:25,623 - DEBUG - Response for create_network : {'network': {'id': 'ad6d78ba-ab9f-4e26-83df-20255554bec3', 'name': 'ctest-trans_right_vn-79234932', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-04549529', 'ctest-trans_right_vn-79234932'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:25,867 - DEBUG - Response for create_subnet : {'subnet': {'id': '7916fd42-20dd-44c9-b037-2946524a6c7c', 'name': '', 'tenant_id': '8ad03799a6834d32ab4a3591f1a1a12b', 'network_id': 'ad6d78ba-ab9f-4e26-83df-20255554bec3', 'ip_version': 4, 'cidr': '135.80.126.0/26', 'allocation_pools': [{'start': '135.80.126.2', 'end': '135.80.126.62'}], 'gateway_ip': '135.80.126.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '135.80.126.2', 'tags': [], 'project_id': '8ad03799a6834d32ab4a3591f1a1a12b'}} 2025-07-24 04:13:25,900 - INFO - Created VN ctest-trans_right_vn-79234932 2025-07-24 04:13:25,918 - DEBUG - VN ctest-trans_right_vn-79234932 UUID is ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,012 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:26,019 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:26,034 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:26,138 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,153 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,166 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7fd7ff6b-ecd9-444c-8b48-3605165afeac 2025-07-24 04:13:26,177 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7fd7ff6b-ecd9-444c-8b48-3605165afeac 2025-07-24 04:13:26,188 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/379dea19-857b-4cf2-8d2c-2826bfacc8e2 2025-07-24 04:13:26,209 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:13:26,209 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,223 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7fd7ff6b-ecd9-444c-8b48-3605165afeac 2025-07-24 04:13:26,247 - INFO - Verified VN network id 15 for VN ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,247 - INFO - Verifications in API Server for VN ctest-trans_right_vn-79234932 passed 2025-07-24 04:13:26,247 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,259 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7fd7ff6b-ecd9-444c-8b48-3605165afeac 2025-07-24 04:13:26,269 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7fd7ff6b-ecd9-444c-8b48-3605165afeac 2025-07-24 04:13:26,280 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/379dea19-857b-4cf2-8d2c-2826bfacc8e2 2025-07-24 04:13:26,296 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12496777284161588774', 'uuid-lslong': '9502349083492531907'}, 'enable': 'true', 'created': '2025-07-24T04:13:25', 'last-modified': '2025-07-24T04:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491681'} 2025-07-24 04:13:26,305 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:13:26,313 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12496777284161588774', 'uuid-lslong': '9502349083492531907'}, 'enable': 'true', 'created': '2025-07-24T04:13:25', 'last-modified': '2025-07-24T04:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.513760'} 2025-07-24 04:13:26,321 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:13:26,328 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-04549529', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12496777284161588774', 'uuid-lslong': '9502349083492531907'}, 'enable': 'true', 'created': '2025-07-24T04:13:25', 'last-modified': '2025-07-24T04:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.531729'} 2025-07-24 04:13:26,335 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:13:26,336 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-79234932 passed 2025-07-24 04:13:26,336 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-79234932 in API_Server ====== 2025-07-24 04:13:26,336 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:26,344 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:26,360 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:26,463 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/ad6d78ba-ab9f-4e26-83df-20255554bec3 2025-07-24 04:13:26,476 - DEBUG - =>VN ctest-trans_right_vn-79234932 has no policy to be verified 2025-07-24 04:13:26,476 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:26,477 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:26,477 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:26,492 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932?flat'} 2025-07-24 04:13:26,492 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:26,492 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:26,510 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932?flat'} 2025-07-24 04:13:26,510 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:26,510 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:26,528 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932?flat'} 2025-07-24 04:13:26,528 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-04549529:ctest-trans_right_vn-79234932 is found in opserver 2025-07-24 04:13:26,556 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:26,572 - DEBUG - VRF ids for VN ctest-trans_right_vn-79234932: {} 2025-07-24 04:13:27,845 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1) 2025-07-24 04:13:29,334 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-2) 2025-07-24 04:13:29,335 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-09835944'] 2025-07-24 04:13:29,662 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09835944'] created succesfully 2025-07-24 04:13:30,277 - DEBUG - Image by name tiny_trans_fw not found 2025-07-24 04:13:30,277 - DEBUG - Installing image tiny_trans_fw 2025-07-24 04:13:30,277 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-07-24 04:13:30,277 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-07-24 04:13:30,278 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-07-24 04:13:30,299 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-07-24 04:13:30,338 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-07-24 04:13:30,338 - DEBUG - Unzip image 2025-07-24 04:13:30,338 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-07-24 04:13:30,379 - DEBUG - Try to create image in user context 2025-07-24 04:13:30,487 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-09835944'] 2025-07-24 04:13:30,592 - INFO - Service template: ['default-domain', 'ctest-service_template_1-09835944'] deleted successfully. 2025-07-24 04:13:30,592 - INFO - Skip interface_detach for VM ctest-right_vm-95584993 in state BUILD 2025-07-24 04:13:30,592 - INFO - Deleting VM ctest-right_vm-95584993 2025-07-24 04:13:30,592 - ERROR - VM ctest-right_vm-95584993 has failed to come up 2025-07-24 04:13:30,592 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:30,592 - ERROR - VM ctest-right_vm-95584993 has failed to come up 2025-07-24 04:13:30,592 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:30,694 - INFO - Skip interface_detach for VM ctest-left_vm-24422972 in state BUILD 2025-07-24 04:13:30,695 - INFO - Deleting VM ctest-left_vm-24422972 2025-07-24 04:13:30,695 - ERROR - VM ctest-left_vm-24422972 has failed to come up 2025-07-24 04:13:30,695 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:30,695 - ERROR - VM ctest-left_vm-24422972 has failed to come up 2025-07-24 04:13:30,695 - ERROR - Nova failed to get host of the VM 2025-07-24 04:13:30,769 - INFO - Deleting VN ctest-trans_right_vn-79234932 2025-07-24 04:13:30,987 - DEBUG - Response for deleting network () 2025-07-24 04:13:30,987 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7fd7ff6b-ecd9-444c-8b48-3605165afeac 2025-07-24 04:13:31,000 - DEBUG - Response Code: 404 2025-07-24 04:13:31,000 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:31,010 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:31,030 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:31,144 - INFO - Validated that VN ctest-trans_right_vn-79234932 is not found in API Server 2025-07-24 04:13:31,159 - DEBUG - VN ctest-trans_right_vn-79234932 is not present in Agent 10.0.0.57 2025-07-24 04:13:31,175 - DEBUG - VN ctest-trans_right_vn-79234932 is not present in Agent 10.0.0.23 2025-07-24 04:13:31,175 - INFO - Validated that VN ctest-trans_right_vn-79234932 is not in any agent 2025-07-24 04:13:31,227 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-79234932 info 2025-07-24 04:13:31,227 - INFO - Deleting VN ctest-trans_left_vn-90047964 2025-07-24 04:13:31,413 - DEBUG - Response for deleting network () 2025-07-24 04:13:31,413 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/ed596c15-946c-4cba-8206-f6b9cc309aec 2025-07-24 04:13:31,432 - DEBUG - Response Code: 404 2025-07-24 04:13:31,432 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:31,443 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:31,469 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:31,607 - INFO - Validated that VN ctest-trans_left_vn-90047964 is not found in API Server 2025-07-24 04:13:31,625 - DEBUG - VN ctest-trans_left_vn-90047964 is not present in Agent 10.0.0.57 2025-07-24 04:13:31,647 - DEBUG - VN ctest-trans_left_vn-90047964 is not present in Agent 10.0.0.23 2025-07-24 04:13:31,647 - INFO - Validated that VN ctest-trans_left_vn-90047964 is not in any agent 2025-07-24 04:13:31,716 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-90047964 info 2025-07-24 04:13:31,716 - INFO - Deleting VN ctest-right_vn-29353419 2025-07-24 04:13:31,777 - DEBUG - VN 440084e2-658c-4d72-84a2-e8c6c67539b6 still in use: Unable to complete operation on network 440084e2-658c-4d72-84a2-e8c6c67539b6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c2957306-71a3-482b-a516-0dece80b666c'] 2025-07-24 04:13:31,777 - WARNING - Deleting VN ctest-right_vn-29353419 failed..Will retry 2025-07-24 04:13:33,962 - DEBUG - Response for deleting network () 2025-07-24 04:13:33,962 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/38eba274-2c81-41d3-9696-75c9cb63f2a1 2025-07-24 04:13:33,971 - DEBUG - Response Code: 404 2025-07-24 04:13:33,971 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:34,002 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:34,021 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:34,129 - INFO - Validated that VN ctest-right_vn-29353419 is not found in API Server 2025-07-24 04:13:34,143 - DEBUG - VN ctest-right_vn-29353419 is not present in Agent 10.0.0.57 2025-07-24 04:13:34,157 - DEBUG - VN ctest-right_vn-29353419 is not present in Agent 10.0.0.23 2025-07-24 04:13:34,157 - INFO - Validated that VN ctest-right_vn-29353419 is not in any agent 2025-07-24 04:13:34,199 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-29353419 info 2025-07-24 04:13:34,199 - INFO - Deleting VN ctest-left_vn-65763677 2025-07-24 04:13:34,395 - DEBUG - Response for deleting network () 2025-07-24 04:13:34,396 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1cf79d0e-6844-43c6-9fd5-2da532867180 2025-07-24 04:13:34,402 - DEBUG - Response Code: 404 2025-07-24 04:13:34,403 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:34,410 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:34,442 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:34,572 - INFO - Validated that VN ctest-left_vn-65763677 is not found in API Server 2025-07-24 04:13:34,586 - DEBUG - VN ctest-left_vn-65763677 is not present in Agent 10.0.0.57 2025-07-24 04:13:34,602 - DEBUG - VN ctest-left_vn-65763677 is not present in Agent 10.0.0.23 2025-07-24 04:13:34,602 - INFO - Validated that VN ctest-left_vn-65763677 is not in any agent 2025-07-24 04:13:34,648 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-65763677 info 2025-07-24 04:13:34,648 - INFO - Deleting VN ctest-mgmt_vn-19851485 2025-07-24 04:13:34,908 - DEBUG - Response for deleting network () 2025-07-24 04:13:34,908 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/476733d8-18eb-4562-9032-c807a04b96fa 2025-07-24 04:13:34,917 - DEBUG - Response Code: 404 2025-07-24 04:13:34,917 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:34,936 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:34,959 - DEBUG - Requesting: http://10.0.0.19:8082/project/8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:35,068 - INFO - Validated that VN ctest-mgmt_vn-19851485 is not found in API Server 2025-07-24 04:13:35,086 - DEBUG - VN ctest-mgmt_vn-19851485 is not present in Agent 10.0.0.57 2025-07-24 04:13:35,100 - DEBUG - VN ctest-mgmt_vn-19851485 is not present in Agent 10.0.0.23 2025-07-24 04:13:35,100 - INFO - Validated that VN ctest-mgmt_vn-19851485 is not in any agent 2025-07-24 04:13:35,144 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-19851485 info 2025-07-24 04:13:36,436 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/tcutils/util.py", line 1041, in wrapper
    return f(self, *func_args, **func_kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 34, in test_svc_v2_transparent_datapath
    create_svms=True)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-net-transparent-fw.qcow2'
2025-07-24 04:13:36,453 - DEBUG - No XMPP flaps were noticed during the test 2025-07-24 04:13:36,453 - INFO - 2025-07-24 04:13:36,453 - INFO - END TEST : test_svc_v2_transparent_datapath : FAILED[0:00:18] 2025-07-24 04:13:36,453 - INFO - -------------------------------------------------------------------------------- 2025-07-24 04:13:37,249 - INFO - Deleted project: ctest-TestSvcRegr-04549529, ID : 8ad03799-a683-4d32-ab4a-3591f1a1a12b 2025-07-24 04:13:37,434 - INFO - Domain Default found not creating 2025-07-24 04:13:37,608 - INFO - Project ctest-TestSvcRegr-49603530 not found, creating it 2025-07-24 04:13:38,177 - INFO - Created Project:ctest-TestSvcRegr-49603530, ID : 04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:39,857 - INFO - ================================================================================ 2025-07-24 04:13:39,857 - INFO - STARTING TEST : test_svc_CEM_22032 2025-07-24 04:13:41,165 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-07-24 04:13:41,165 - INFO - Initial checks done. Running the testcase now 2025-07-24 04:13:41,165 - INFO - 2025-07-24 04:13:41,942 - DEBUG - Response for create_network : {'network': {'id': '96baf905-ccce-4b9f-9f85-525d757e18f5', 'name': 'ctest-mgmt_vn-00301743', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'project_id': '04764df25f7944a7b67258987c38ca86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49603530', 'ctest-mgmt_vn-00301743'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:42,246 - DEBUG - Response for create_subnet : {'subnet': {'id': '439e2ed0-9965-427c-b383-a61c3d3dfe0a', 'name': '', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'network_id': '96baf905-ccce-4b9f-9f85-525d757e18f5', 'ip_version': 4, 'cidr': '151.145.205.64/26', 'allocation_pools': [{'start': '151.145.205.66', 'end': '151.145.205.126'}], 'gateway_ip': '151.145.205.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '151.145.205.66', 'tags': [], 'project_id': '04764df25f7944a7b67258987c38ca86'}} 2025-07-24 04:13:42,276 - INFO - Created VN ctest-mgmt_vn-00301743 2025-07-24 04:13:42,291 - DEBUG - VN ctest-mgmt_vn-00301743 UUID is 96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:42,381 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:42,708 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:42,771 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:42,792 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:42,943 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:42,974 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:42,992 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6b436544-67b1-4e8f-8a86-d3901a7598dc 2025-07-24 04:13:43,004 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6b436544-67b1-4e8f-8a86-d3901a7598dc 2025-07-24 04:13:43,013 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/6e6cc8ce-9425-4c5a-ae97-78900885550b 2025-07-24 04:13:43,025 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:43,025 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:43,036 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6b436544-67b1-4e8f-8a86-d3901a7598dc 2025-07-24 04:13:43,094 - INFO - Verified VN network id 11 for VN 96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:43,094 - INFO - Verifications in API Server for VN ctest-mgmt_vn-00301743 passed 2025-07-24 04:13:43,094 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:43,107 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6b436544-67b1-4e8f-8a86-d3901a7598dc 2025-07-24 04:13:43,131 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6b436544-67b1-4e8f-8a86-d3901a7598dc 2025-07-24 04:13:43,156 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/6e6cc8ce-9425-4c5a-ae97-78900885550b 2025-07-24 04:13:43,189 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10861267254663596959', 'uuid-lslong': '11494684185289693429'}, 'enable': 'true', 'created': '2025-07-24T04:13:41', 'last-modified': '2025-07-24T04:13:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.002321'} 2025-07-24 04:13:43,222 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:43,239 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10861267254663596959', 'uuid-lslong': '11494684185289693429'}, 'enable': 'true', 'created': '2025-07-24T04:13:41', 'last-modified': '2025-07-24T04:13:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.056401'} 2025-07-24 04:13:43,255 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:43,272 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10861267254663596959', 'uuid-lslong': '11494684185289693429'}, 'enable': 'true', 'created': '2025-07-24T04:13:41', 'last-modified': '2025-07-24T04:13:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.083533'} 2025-07-24 04:13:43,283 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:13:43,283 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-00301743 passed 2025-07-24 04:13:43,283 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-00301743 in API_Server ====== 2025-07-24 04:13:43,283 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:43,300 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:43,320 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:43,448 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/96baf905-ccce-4b9f-9f85-525d757e18f5 2025-07-24 04:13:43,465 - DEBUG - =>VN ctest-mgmt_vn-00301743 has no policy to be verified 2025-07-24 04:13:43,465 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:43,465 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:43,466 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:43,958 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:44,030 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743?flat'} 2025-07-24 04:13:44,030 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:44,030 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:44,345 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:44,410 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743?flat'} 2025-07-24 04:13:44,410 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:44,410 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:44,728 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:44,795 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743?flat'} 2025-07-24 04:13:44,795 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-00301743 is found in opserver 2025-07-24 04:13:44,824 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:44,840 - DEBUG - VRF ids for VN ctest-mgmt_vn-00301743: {} 2025-07-24 04:13:45,160 - DEBUG - Response for create_network : {'network': {'id': '7e5c2de2-7088-4657-9864-ed2f3d6de820', 'name': 'service-left-vn-67176234', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'project_id': '04764df25f7944a7b67258987c38ca86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49603530', 'service-left-vn-67176234'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:45,462 - DEBUG - Response for create_subnet : {'subnet': {'id': '614ddeed-f80e-4d2a-839e-792f600a741a', 'name': '', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'network_id': '7e5c2de2-7088-4657-9864-ed2f3d6de820', 'ip_version': 4, 'cidr': '91.138.139.0/26', 'allocation_pools': [{'start': '91.138.139.2', 'end': '91.138.139.62'}], 'gateway_ip': '91.138.139.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '91.138.139.2', 'tags': [], 'project_id': '04764df25f7944a7b67258987c38ca86'}} 2025-07-24 04:13:45,488 - INFO - Created VN service-left-vn-67176234 2025-07-24 04:13:45,505 - DEBUG - VN service-left-vn-67176234 UUID is 7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:45,608 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:45,621 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:45,648 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:45,773 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:45,795 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:45,817 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f84c38c1-e1e7-4085-9286-e45763ff6147 2025-07-24 04:13:45,837 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f84c38c1-e1e7-4085-9286-e45763ff6147 2025-07-24 04:13:45,847 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b02e78d4-27dc-43d5-b3d8-ec35136a2b59 2025-07-24 04:13:45,860 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:45,860 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:45,873 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f84c38c1-e1e7-4085-9286-e45763ff6147 2025-07-24 04:13:45,893 - INFO - Verified VN network id 12 for VN 7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:45,893 - INFO - Verifications in API Server for VN service-left-vn-67176234 passed 2025-07-24 04:13:45,893 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:45,909 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f84c38c1-e1e7-4085-9286-e45763ff6147 2025-07-24 04:13:45,925 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f84c38c1-e1e7-4085-9286-e45763ff6147 2025-07-24 04:13:45,937 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b02e78d4-27dc-43d5-b3d8-ec35136a2b59 2025-07-24 04:13:45,956 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9105202997210138199', 'uuid-lslong': '10981162578585970720'}, 'enable': 'true', 'created': '2025-07-24T04:13:45', 'last-modified': '2025-07-24T04:13:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.569275'} 2025-07-24 04:13:45,965 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:45,973 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9105202997210138199', 'uuid-lslong': '10981162578585970720'}, 'enable': 'true', 'created': '2025-07-24T04:13:45', 'last-modified': '2025-07-24T04:13:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.588489'} 2025-07-24 04:13:45,982 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:45,990 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9105202997210138199', 'uuid-lslong': '10981162578585970720'}, 'enable': 'true', 'created': '2025-07-24T04:13:45', 'last-modified': '2025-07-24T04:13:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.612946'} 2025-07-24 04:13:45,998 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:13:45,998 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-67176234 passed 2025-07-24 04:13:45,999 - DEBUG - ====Verifying policy data for service-left-vn-67176234 in API_Server ====== 2025-07-24 04:13:45,999 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:46,009 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:46,028 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:46,152 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/7e5c2de2-7088-4657-9864-ed2f3d6de820 2025-07-24 04:13:46,165 - DEBUG - =>VN service-left-vn-67176234 has no policy to be verified 2025-07-24 04:13:46,165 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:46,166 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:46,166 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:46,251 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234?flat'} 2025-07-24 04:13:46,251 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:46,251 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:46,322 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234?flat'} 2025-07-24 04:13:46,322 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:46,322 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:46,389 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234?flat'} 2025-07-24 04:13:46,389 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49603530:service-left-vn-67176234 is found in opserver 2025-07-24 04:13:46,425 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:46,439 - DEBUG - VRF ids for VN service-left-vn-67176234: {} 2025-07-24 04:13:46,750 - DEBUG - Response for create_network : {'network': {'id': 'fe9bbfc5-49e5-4913-87c7-26f1b27ef41e', 'name': 'service-right-vn-61597784', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'project_id': '04764df25f7944a7b67258987c38ca86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49603530', 'service-right-vn-61597784'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:13:47,014 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c3c435c9-7c1c-4294-8e32-03e8a0b740f2', 'name': '', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'network_id': 'fe9bbfc5-49e5-4913-87c7-26f1b27ef41e', 'ip_version': 4, 'cidr': '74.161.99.64/26', 'allocation_pools': [{'start': '74.161.99.66', 'end': '74.161.99.126'}], 'gateway_ip': '74.161.99.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '74.161.99.66', 'tags': [], 'project_id': '04764df25f7944a7b67258987c38ca86'}} 2025-07-24 04:13:47,041 - INFO - Created VN service-right-vn-61597784 2025-07-24 04:13:47,064 - DEBUG - VN service-right-vn-61597784 UUID is fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,155 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:47,169 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:47,187 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:47,290 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,304 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,316 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/14033bd2-c1fc-45a4-87eb-038805ec6892 2025-07-24 04:13:47,326 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/14033bd2-c1fc-45a4-87eb-038805ec6892 2025-07-24 04:13:47,336 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/14559532-eb9a-4217-bde0-53231f5b03fc 2025-07-24 04:13:47,347 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:47,347 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,361 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/14033bd2-c1fc-45a4-87eb-038805ec6892 2025-07-24 04:13:47,384 - INFO - Verified VN network id 13 for VN fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,385 - INFO - Verifications in API Server for VN service-right-vn-61597784 passed 2025-07-24 04:13:47,385 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,400 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/14033bd2-c1fc-45a4-87eb-038805ec6892 2025-07-24 04:13:47,410 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/14033bd2-c1fc-45a4-87eb-038805ec6892 2025-07-24 04:13:47,418 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/14559532-eb9a-4217-bde0-53231f5b03fc 2025-07-24 04:13:47,439 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18346468361093073171', 'uuid-lslong': '9783831535009330206'}, 'enable': 'true', 'created': '2025-07-24T04:13:46', 'last-modified': '2025-07-24T04:13:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516693'} 2025-07-24 04:13:47,449 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:47,456 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18346468361093073171', 'uuid-lslong': '9783831535009330206'}, 'enable': 'true', 'created': '2025-07-24T04:13:46', 'last-modified': '2025-07-24T04:13:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.533963'} 2025-07-24 04:13:47,464 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:47,474 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18346468361093073171', 'uuid-lslong': '9783831535009330206'}, 'enable': 'true', 'created': '2025-07-24T04:13:46', 'last-modified': '2025-07-24T04:13:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.556697'} 2025-07-24 04:13:47,484 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:13:47,484 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-61597784 passed 2025-07-24 04:13:47,484 - DEBUG - ====Verifying policy data for service-right-vn-61597784 in API_Server ====== 2025-07-24 04:13:47,484 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:13:47,513 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:13:47,532 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:13:47,635 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fe9bbfc5-49e5-4913-87c7-26f1b27ef41e 2025-07-24 04:13:47,651 - DEBUG - =>VN service-right-vn-61597784 has no policy to be verified 2025-07-24 04:13:47,651 - DEBUG - Verifying the vn in opserver 2025-07-24 04:13:47,651 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784 virtual network link through opserver 10.0.0.19 2025-07-24 04:13:47,651 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:13:47,726 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784?flat'} 2025-07-24 04:13:47,726 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784 virtual network link through opserver 10.0.0.38 2025-07-24 04:13:47,726 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:13:47,793 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784?flat'} 2025-07-24 04:13:47,793 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784 virtual network link through opserver 10.0.0.41 2025-07-24 04:13:47,793 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:13:47,857 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784?flat'} 2025-07-24 04:13:47,858 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49603530:service-right-vn-61597784 is found in opserver 2025-07-24 04:13:47,886 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:13:47,902 - DEBUG - VRF ids for VN service-right-vn-61597784: {} 2025-07-24 04:13:47,975 - DEBUG - Services list from nova: [, , , ] 2025-07-24 04:13:49,174 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1) 2025-07-24 04:13:50,634 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-2) 2025-07-24 04:13:50,634 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-10368682'] 2025-07-24 04:13:50,959 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-10368682'] created succesfully 2025-07-24 04:15:31,757 - DEBUG - Installing image tiny_nat_fw 2025-07-24 04:15:31,757 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-24 04:15:31,758 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:15:31,758 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:15:31,758 - DEBUG - Unzip image 2025-07-24 04:15:31,758 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:15:31,779 - DEBUG - Try to create image in user context 2025-07-24 04:15:31,869 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-10368682'] 2025-07-24 04:15:31,967 - INFO - Service template: ['default-domain', 'ctest-service_template_1-10368682'] deleted successfully. 2025-07-24 04:15:31,968 - INFO - Skip interface_detach for VM ctest-right_vm-77627947 in state BUILD 2025-07-24 04:15:31,968 - INFO - Deleting VM ctest-right_vm-77627947 2025-07-24 04:15:32,013 - ERROR - VM ctest-right_vm-77627947 has failed to come up 2025-07-24 04:15:32,013 - ERROR - Nova failed to get host of the VM 2025-07-24 04:15:32,013 - ERROR - VM ctest-right_vm-77627947 has failed to come up 2025-07-24 04:15:32,014 - ERROR - Nova failed to get host of the VM 2025-07-24 04:15:32,101 - INFO - Skip interface_detach for VM ctest-left_vm-71289407 in state BUILD 2025-07-24 04:15:32,101 - INFO - Deleting VM ctest-left_vm-71289407 2025-07-24 04:15:32,101 - ERROR - VM ctest-left_vm-71289407 has failed to come up 2025-07-24 04:15:32,101 - ERROR - Nova failed to get host of the VM 2025-07-24 04:15:32,101 - ERROR - VM ctest-left_vm-71289407 has failed to come up 2025-07-24 04:15:32,101 - ERROR - Nova failed to get host of the VM 2025-07-24 04:15:32,167 - INFO - Deleting VN service-right-vn-61597784 2025-07-24 04:15:32,214 - DEBUG - VN fe9bbfc5-49e5-4913-87c7-26f1b27ef41e still in use: Unable to complete operation on network fe9bbfc5-49e5-4913-87c7-26f1b27ef41e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-26390bd4-ff7f-421f-95b9-89ce9a220fe3'] 2025-07-24 04:15:32,214 - WARNING - Deleting VN service-right-vn-61597784 failed..Will retry 2025-07-24 04:15:34,421 - DEBUG - Response for deleting network () 2025-07-24 04:15:34,421 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/14033bd2-c1fc-45a4-87eb-038805ec6892 2025-07-24 04:15:34,428 - DEBUG - Response Code: 404 2025-07-24 04:15:34,429 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:34,444 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:34,466 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:34,571 - INFO - Validated that VN service-right-vn-61597784 is not found in API Server 2025-07-24 04:15:34,588 - DEBUG - VN service-right-vn-61597784 is not present in Agent 10.0.0.57 2025-07-24 04:15:34,600 - DEBUG - VN service-right-vn-61597784 is not present in Agent 10.0.0.23 2025-07-24 04:15:34,600 - INFO - Validated that VN service-right-vn-61597784 is not in any agent 2025-07-24 04:15:34,639 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-61597784 info 2025-07-24 04:15:34,639 - INFO - Deleting VN service-left-vn-67176234 2025-07-24 04:15:34,815 - DEBUG - Response for deleting network () 2025-07-24 04:15:34,815 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f84c38c1-e1e7-4085-9286-e45763ff6147 2025-07-24 04:15:34,827 - DEBUG - Response Code: 404 2025-07-24 04:15:34,827 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:34,849 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:34,874 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:34,966 - INFO - Validated that VN service-left-vn-67176234 is not found in API Server 2025-07-24 04:15:34,984 - DEBUG - VN service-left-vn-67176234 is not present in Agent 10.0.0.57 2025-07-24 04:15:35,000 - DEBUG - VN service-left-vn-67176234 is not present in Agent 10.0.0.23 2025-07-24 04:15:35,000 - INFO - Validated that VN service-left-vn-67176234 is not in any agent 2025-07-24 04:15:35,046 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-67176234 info 2025-07-24 04:15:35,046 - INFO - Deleting VN ctest-mgmt_vn-00301743 2025-07-24 04:15:35,225 - DEBUG - Response for deleting network () 2025-07-24 04:15:35,226 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6b436544-67b1-4e8f-8a86-d3901a7598dc 2025-07-24 04:15:35,233 - DEBUG - Response Code: 404 2025-07-24 04:15:35,233 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:35,240 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:35,303 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:35,408 - INFO - Validated that VN ctest-mgmt_vn-00301743 is not found in API Server 2025-07-24 04:15:35,424 - DEBUG - VN ctest-mgmt_vn-00301743 is not present in Agent 10.0.0.57 2025-07-24 04:15:35,438 - DEBUG - VN ctest-mgmt_vn-00301743 is not present in Agent 10.0.0.23 2025-07-24 04:15:35,438 - INFO - Validated that VN ctest-mgmt_vn-00301743 is not in any agent 2025-07-24 04:15:35,478 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-00301743 info 2025-07-24 04:15:36,767 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 35, in test_svc_CEM_22032
    right_vn_name=get_random_name('service-right-vn', ''))
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
2025-07-24 04:15:36,784 - DEBUG - No XMPP flaps were noticed during the test 2025-07-24 04:15:36,784 - INFO - 2025-07-24 04:15:36,784 - INFO - END TEST : test_svc_CEM_22032 : FAILED[0:01:57] 2025-07-24 04:15:36,784 - INFO - -------------------------------------------------------------------------------- 2025-07-24 04:15:36,789 - INFO - ================================================================================ 2025-07-24 04:15:36,789 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-07-24 04:15:38,104 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-07-24 04:15:38,104 - INFO - Initial checks done. Running the testcase now 2025-07-24 04:15:38,104 - INFO - 2025-07-24 04:15:38,413 - DEBUG - Response for create_network : {'network': {'id': 'dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5', 'name': 'ctest-mgmt_vn-95439299', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'project_id': '04764df25f7944a7b67258987c38ca86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49603530', 'ctest-mgmt_vn-95439299'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:15:38,647 - DEBUG - Response for create_subnet : {'subnet': {'id': 'eb940444-0b8b-4d5e-96ee-8ca6b5689470', 'name': '', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'network_id': 'dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5', 'ip_version': 4, 'cidr': '95.68.21.0/26', 'allocation_pools': [{'start': '95.68.21.2', 'end': '95.68.21.62'}], 'gateway_ip': '95.68.21.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.68.21.2', 'tags': [], 'project_id': '04764df25f7944a7b67258987c38ca86'}} 2025-07-24 04:15:38,672 - INFO - Created VN ctest-mgmt_vn-95439299 2025-07-24 04:15:38,692 - DEBUG - VN ctest-mgmt_vn-95439299 UUID is dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:38,781 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:38,790 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:38,804 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:38,906 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:38,923 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:38,936 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/60f7894e-6739-4dda-b588-806afafb515d 2025-07-24 04:15:38,946 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/60f7894e-6739-4dda-b588-806afafb515d 2025-07-24 04:15:38,955 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/e7cfc530-3d7e-4e09-84e9-9d5460e20915 2025-07-24 04:15:38,964 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:15:38,964 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:38,979 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/60f7894e-6739-4dda-b588-806afafb515d 2025-07-24 04:15:39,005 - INFO - Verified VN network id 11 for VN dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:39,005 - INFO - Verifications in API Server for VN ctest-mgmt_vn-95439299 passed 2025-07-24 04:15:39,005 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:39,020 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/60f7894e-6739-4dda-b588-806afafb515d 2025-07-24 04:15:39,030 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/60f7894e-6739-4dda-b588-806afafb515d 2025-07-24 04:15:39,040 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/e7cfc530-3d7e-4e09-84e9-9d5460e20915 2025-07-24 04:15:39,055 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15851112354424702348', 'uuid-lslong': '13030925510146476741'}, 'enable': 'true', 'created': '2025-07-24T04:15:38', 'last-modified': '2025-07-24T04:15:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.468043'} 2025-07-24 04:15:39,063 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:15:39,071 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15851112354424702348', 'uuid-lslong': '13030925510146476741'}, 'enable': 'true', 'created': '2025-07-24T04:15:38', 'last-modified': '2025-07-24T04:15:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.489198'} 2025-07-24 04:15:39,078 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:15:39,086 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15851112354424702348', 'uuid-lslong': '13030925510146476741'}, 'enable': 'true', 'created': '2025-07-24T04:15:38', 'last-modified': '2025-07-24T04:15:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.505136'} 2025-07-24 04:15:39,096 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:15:39,096 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-95439299 passed 2025-07-24 04:15:39,096 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-95439299 in API_Server ====== 2025-07-24 04:15:39,096 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:39,103 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:39,118 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:39,220 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbfa76b4-1c4a-458c-b4d7-25b5eedb4ac5 2025-07-24 04:15:39,235 - DEBUG - =>VN ctest-mgmt_vn-95439299 has no policy to be verified 2025-07-24 04:15:39,235 - DEBUG - Verifying the vn in opserver 2025-07-24 04:15:39,235 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299 virtual network link through opserver 10.0.0.19 2025-07-24 04:15:39,235 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:15:39,250 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299?flat'} 2025-07-24 04:15:39,250 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299 virtual network link through opserver 10.0.0.38 2025-07-24 04:15:39,250 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:15:39,266 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299?flat'} 2025-07-24 04:15:39,266 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299 virtual network link through opserver 10.0.0.41 2025-07-24 04:15:39,266 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:15:39,283 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299?flat'} 2025-07-24 04:15:39,283 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49603530:ctest-mgmt_vn-95439299 is found in opserver 2025-07-24 04:15:39,312 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:15:39,328 - DEBUG - VRF ids for VN ctest-mgmt_vn-95439299: {} 2025-07-24 04:15:39,676 - DEBUG - Response for create_network : {'network': {'id': 'c368f7f6-5a38-461d-8883-8989a12e5bc0', 'name': 'ctest-left_vn-48556319', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'project_id': '04764df25f7944a7b67258987c38ca86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49603530', 'ctest-left_vn-48556319'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:15:39,910 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c344ca24-98fc-4019-9a85-f9d99aac6dea', 'name': '', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'network_id': 'c368f7f6-5a38-461d-8883-8989a12e5bc0', 'ip_version': 4, 'cidr': '125.157.196.128/26', 'allocation_pools': [{'start': '125.157.196.130', 'end': '125.157.196.190'}], 'gateway_ip': '125.157.196.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '125.157.196.130', 'tags': [], 'project_id': '04764df25f7944a7b67258987c38ca86'}} 2025-07-24 04:15:39,936 - INFO - Created VN ctest-left_vn-48556319 2025-07-24 04:15:39,951 - DEBUG - VN ctest-left_vn-48556319 UUID is c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,041 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:40,053 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:40,071 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:40,176 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,190 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,202 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ffd7916-e7b4-4dbd-a0ab-52c082f8b883 2025-07-24 04:15:40,213 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ffd7916-e7b4-4dbd-a0ab-52c082f8b883 2025-07-24 04:15:40,225 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/40bdebb5-f346-4b34-b2aa-ac0aa6f7181f 2025-07-24 04:15:40,235 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:15:40,235 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,247 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ffd7916-e7b4-4dbd-a0ab-52c082f8b883 2025-07-24 04:15:40,269 - INFO - Verified VN network id 12 for VN c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,269 - INFO - Verifications in API Server for VN ctest-left_vn-48556319 passed 2025-07-24 04:15:40,269 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,281 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ffd7916-e7b4-4dbd-a0ab-52c082f8b883 2025-07-24 04:15:40,290 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ffd7916-e7b4-4dbd-a0ab-52c082f8b883 2025-07-24 04:15:40,300 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/40bdebb5-f346-4b34-b2aa-ac0aa6f7181f 2025-07-24 04:15:40,317 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14080776872421508637', 'uuid-lslong': '9836857235314990016'}, 'enable': 'true', 'created': '2025-07-24T04:15:39', 'last-modified': '2025-07-24T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.454870'} 2025-07-24 04:15:40,324 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:15:40,332 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14080776872421508637', 'uuid-lslong': '9836857235314990016'}, 'enable': 'true', 'created': '2025-07-24T04:15:39', 'last-modified': '2025-07-24T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.470592'} 2025-07-24 04:15:40,339 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:15:40,347 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14080776872421508637', 'uuid-lslong': '9836857235314990016'}, 'enable': 'true', 'created': '2025-07-24T04:15:39', 'last-modified': '2025-07-24T04:15:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.489098'} 2025-07-24 04:15:40,356 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:15:40,356 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-48556319 passed 2025-07-24 04:15:40,356 - DEBUG - ====Verifying policy data for ctest-left_vn-48556319 in API_Server ====== 2025-07-24 04:15:40,357 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:40,365 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:40,381 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:40,485 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c368f7f6-5a38-461d-8883-8989a12e5bc0 2025-07-24 04:15:40,502 - DEBUG - =>VN ctest-left_vn-48556319 has no policy to be verified 2025-07-24 04:15:40,502 - DEBUG - Verifying the vn in opserver 2025-07-24 04:15:40,502 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319 virtual network link through opserver 10.0.0.19 2025-07-24 04:15:40,502 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:15:40,518 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319?flat'} 2025-07-24 04:15:40,518 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319 virtual network link through opserver 10.0.0.38 2025-07-24 04:15:40,518 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:15:40,533 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319?flat'} 2025-07-24 04:15:40,533 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319 virtual network link through opserver 10.0.0.41 2025-07-24 04:15:40,533 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:15:40,552 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319?flat'} 2025-07-24 04:15:40,552 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49603530:ctest-left_vn-48556319 is found in opserver 2025-07-24 04:15:40,583 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:15:40,597 - DEBUG - VRF ids for VN ctest-left_vn-48556319: {} 2025-07-24 04:15:40,936 - DEBUG - Response for create_network : {'network': {'id': '5e4cf881-8802-4fb6-bf57-dcf2c11b5cea', 'name': 'ctest-right_vn-54968680', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'project_id': '04764df25f7944a7b67258987c38ca86', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-49603530', 'ctest-right_vn-54968680'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:15:41,249 - DEBUG - Response for create_subnet : {'subnet': {'id': '2a7d381c-2e37-492d-bc04-5c9e123bea48', 'name': '', 'tenant_id': '04764df25f7944a7b67258987c38ca86', 'network_id': '5e4cf881-8802-4fb6-bf57-dcf2c11b5cea', 'ip_version': 4, 'cidr': '32.133.156.64/26', 'allocation_pools': [{'start': '32.133.156.66', 'end': '32.133.156.126'}], 'gateway_ip': '32.133.156.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '32.133.156.66', 'tags': [], 'project_id': '04764df25f7944a7b67258987c38ca86'}} 2025-07-24 04:15:41,276 - INFO - Created VN ctest-right_vn-54968680 2025-07-24 04:15:41,293 - DEBUG - VN ctest-right_vn-54968680 UUID is 5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,382 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:41,391 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:41,406 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:41,506 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,520 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,533 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/422015d2-7ca3-4632-8b97-62b0406284cb 2025-07-24 04:15:41,543 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/422015d2-7ca3-4632-8b97-62b0406284cb 2025-07-24 04:15:41,553 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/74098dad-7662-4965-94fe-31ed7c9f025e 2025-07-24 04:15:41,562 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:15:41,562 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,575 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/422015d2-7ca3-4632-8b97-62b0406284cb 2025-07-24 04:15:41,596 - INFO - Verified VN network id 13 for VN 5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,596 - INFO - Verifications in API Server for VN ctest-right_vn-54968680 passed 2025-07-24 04:15:41,596 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,609 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/422015d2-7ca3-4632-8b97-62b0406284cb 2025-07-24 04:15:41,619 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/422015d2-7ca3-4632-8b97-62b0406284cb 2025-07-24 04:15:41,628 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/74098dad-7662-4965-94fe-31ed7c9f025e 2025-07-24 04:15:41,647 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6795079173011558326', 'uuid-lslong': '13787731719398055146'}, 'enable': 'true', 'created': '2025-07-24T04:15:40', 'last-modified': '2025-07-24T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496512'} 2025-07-24 04:15:41,657 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:15:41,664 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6795079173011558326', 'uuid-lslong': '13787731719398055146'}, 'enable': 'true', 'created': '2025-07-24T04:15:40', 'last-modified': '2025-07-24T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.514488'} 2025-07-24 04:15:41,673 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:15:41,680 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-49603530', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6795079173011558326', 'uuid-lslong': '13787731719398055146'}, 'enable': 'true', 'created': '2025-07-24T04:15:40', 'last-modified': '2025-07-24T04:15:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527028'} 2025-07-24 04:15:41,689 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:15:41,689 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-54968680 passed 2025-07-24 04:15:41,689 - DEBUG - ====Verifying policy data for ctest-right_vn-54968680 in API_Server ====== 2025-07-24 04:15:41,689 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:15:41,698 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:15:41,715 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:15:41,814 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/5e4cf881-8802-4fb6-bf57-dcf2c11b5cea 2025-07-24 04:15:41,832 - DEBUG - =>VN ctest-right_vn-54968680 has no policy to be verified 2025-07-24 04:15:41,832 - DEBUG - Verifying the vn in opserver 2025-07-24 04:15:41,832 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680 virtual network link through opserver 10.0.0.19 2025-07-24 04:15:41,832 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:15:41,851 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680?flat'} 2025-07-24 04:15:41,851 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680 virtual network link through opserver 10.0.0.38 2025-07-24 04:15:41,852 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:15:41,869 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680?flat'} 2025-07-24 04:15:41,869 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680 virtual network link through opserver 10.0.0.41 2025-07-24 04:15:41,869 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:15:41,888 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680?flat'} 2025-07-24 04:15:41,888 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-49603530:ctest-right_vn-54968680 is found in opserver 2025-07-24 04:15:41,924 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:15:41,939 - DEBUG - VRF ids for VN ctest-right_vn-54968680: {} 2025-07-24 04:15:43,198 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-2) 2025-07-24 04:15:44,671 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1) 2025-07-24 04:15:44,672 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-33918007'] 2025-07-24 04:15:45,005 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-33918007'] created succesfully 2025-07-24 04:17:25,759 - DEBUG - Installing image tiny_nat_fw 2025-07-24 04:17:25,759 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmtx', 'vcname': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat.vmdk', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-24 04:17:25,760 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:17:25,760 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:17:25,760 - DEBUG - Unzip image 2025-07-24 04:17:25,760 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-24 04:17:25,789 - DEBUG - Try to create image in user context 2025-07-24 04:17:25,869 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-33918007'] 2025-07-24 04:17:25,980 - INFO - Service template: ['default-domain', 'ctest-service_template_1-33918007'] deleted successfully. 2025-07-24 04:17:25,980 - INFO - Skip interface_detach for VM ctest-right_vm-82210190 in state BUILD 2025-07-24 04:17:25,980 - INFO - Deleting VM ctest-right_vm-82210190 2025-07-24 04:17:25,980 - ERROR - VM ctest-right_vm-82210190 has failed to come up 2025-07-24 04:17:25,981 - ERROR - Nova failed to get host of the VM 2025-07-24 04:17:25,981 - ERROR - VM ctest-right_vm-82210190 has failed to come up 2025-07-24 04:17:25,981 - ERROR - Nova failed to get host of the VM 2025-07-24 04:17:26,088 - INFO - Skip interface_detach for VM ctest-left_vm-40171461 in state BUILD 2025-07-24 04:17:26,088 - INFO - Deleting VM ctest-left_vm-40171461 2025-07-24 04:17:26,088 - ERROR - VM ctest-left_vm-40171461 has failed to come up 2025-07-24 04:17:26,089 - ERROR - Nova failed to get host of the VM 2025-07-24 04:17:26,089 - ERROR - VM ctest-left_vm-40171461 has failed to come up 2025-07-24 04:17:26,089 - ERROR - Nova failed to get host of the VM 2025-07-24 04:17:26,205 - INFO - Deleting VN ctest-right_vn-54968680 2025-07-24 04:17:26,264 - DEBUG - VN 5e4cf881-8802-4fb6-bf57-dcf2c11b5cea still in use: Unable to complete operation on network 5e4cf881-8802-4fb6-bf57-dcf2c11b5cea. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-066e4cb8-dc27-4d57-8e6c-b0d5a1568d6a'] 2025-07-24 04:17:26,264 - WARNING - Deleting VN ctest-right_vn-54968680 failed..Will retry 2025-07-24 04:17:28,469 - DEBUG - Response for deleting network () 2025-07-24 04:17:28,469 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/422015d2-7ca3-4632-8b97-62b0406284cb 2025-07-24 04:17:28,487 - DEBUG - Response Code: 404 2025-07-24 04:17:28,487 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:17:28,499 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:17:28,519 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:17:28,615 - INFO - Validated that VN ctest-right_vn-54968680 is not found in API Server 2025-07-24 04:17:28,629 - DEBUG - VN ctest-right_vn-54968680 is not present in Agent 10.0.0.57 2025-07-24 04:17:28,643 - DEBUG - VN ctest-right_vn-54968680 is not present in Agent 10.0.0.23 2025-07-24 04:17:28,643 - INFO - Validated that VN ctest-right_vn-54968680 is not in any agent 2025-07-24 04:17:28,683 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-54968680 info 2025-07-24 04:17:28,684 - INFO - Deleting VN ctest-left_vn-48556319 2025-07-24 04:17:28,886 - DEBUG - Response for deleting network () 2025-07-24 04:17:28,886 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/7ffd7916-e7b4-4dbd-a0ab-52c082f8b883 2025-07-24 04:17:28,896 - DEBUG - Response Code: 404 2025-07-24 04:17:28,896 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:17:28,904 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:17:28,920 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:17:29,024 - INFO - Validated that VN ctest-left_vn-48556319 is not found in API Server 2025-07-24 04:17:29,037 - DEBUG - VN ctest-left_vn-48556319 is not present in Agent 10.0.0.57 2025-07-24 04:17:29,051 - DEBUG - VN ctest-left_vn-48556319 is not present in Agent 10.0.0.23 2025-07-24 04:17:29,051 - INFO - Validated that VN ctest-left_vn-48556319 is not in any agent 2025-07-24 04:17:29,099 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-48556319 info 2025-07-24 04:17:29,100 - INFO - Deleting VN ctest-mgmt_vn-95439299 2025-07-24 04:17:29,264 - DEBUG - Response for deleting network () 2025-07-24 04:17:29,264 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/60f7894e-6739-4dda-b588-806afafb515d 2025-07-24 04:17:29,272 - DEBUG - Response Code: 404 2025-07-24 04:17:29,273 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:17:29,280 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:17:29,297 - DEBUG - Requesting: http://10.0.0.19:8082/project/04764df2-5f79-44a7-b672-58987c38ca86 2025-07-24 04:17:29,403 - INFO - Validated that VN ctest-mgmt_vn-95439299 is not found in API Server 2025-07-24 04:17:29,420 - DEBUG - VN ctest-mgmt_vn-95439299 is not present in Agent 10.0.0.57 2025-07-24 04:17:29,438 - DEBUG - VN ctest-mgmt_vn-95439299 is not present in Agent 10.0.0.23 2025-07-24 04:17:29,438 - INFO - Validated that VN ctest-mgmt_vn-95439299 is not in any agent 2025-07-24 04:17:29,488 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-95439299 info 2025-07-24 04:17:30,774 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 26, in test_svc_in_network_datapath
    create_svms=True)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
2025-07-24 04:17:30,792 - DEBUG - No XMPP flaps were noticed during the test 2025-07-24 04:17:30,792 - INFO - 2025-07-24 04:17:30,792 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:01:54] 2025-07-24 04:17:30,792 - INFO - -------------------------------------------------------------------------------- 2025-07-24 04:17:31,657 - INFO - Deleted project: ctest-TestSvcRegr-49603530, ID : 04764df2-5f79-44a7-b672-58987c38ca86