]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1)
2025-07-22 16:40:53,521 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-39560695']
2025-07-22 16:40:53,845 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-39560695'] created succesfully
2025-07-22 16:40:54,300 - DEBUG - Image by name tiny_trans_fw not found
2025-07-22 16:40:54,300 - DEBUG - Installing image tiny_trans_fw
2025-07-22 16:40:54,300 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-07-22 16:40:54,301 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-07-22 16:40:54,301 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz
2025-07-22 16:40:54,340 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-22 16:40:54,389 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-22 16:40:54,389 - DEBUG - Unzip image
2025-07-22 16:40:54,389 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz
2025-07-22 16:40:54,412 - DEBUG - Try to create image in user context
2025-07-22 16:40:54,486 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-39560695']
2025-07-22 16:40:54,592 - INFO - Service template: ['default-domain', 'ctest-service_template_1-39560695'] deleted successfully.
2025-07-22 16:40:54,592 - INFO - Skip interface_detach for VM ctest-right_vm-30396999 in state BUILD
2025-07-22 16:40:54,592 - INFO - Deleting VM ctest-right_vm-30396999
2025-07-22 16:40:54,592 - ERROR - VM ctest-right_vm-30396999 has failed to come up
2025-07-22 16:40:54,592 - ERROR - Nova failed to get host of the VM
2025-07-22 16:40:54,592 - ERROR - VM ctest-right_vm-30396999 has failed to come up
2025-07-22 16:40:54,593 - ERROR - Nova failed to get host of the VM
2025-07-22 16:40:54,658 - INFO - Skip interface_detach for VM ctest-left_vm-12991888 in state BUILD
2025-07-22 16:40:54,658 - INFO - Deleting VM ctest-left_vm-12991888
2025-07-22 16:40:54,658 - ERROR - VM ctest-left_vm-12991888 has failed to come up
2025-07-22 16:40:54,658 - ERROR - Nova failed to get host of the VM
2025-07-22 16:40:54,658 - ERROR - VM ctest-left_vm-12991888 has failed to come up
2025-07-22 16:40:54,658 - ERROR - Nova failed to get host of the VM
2025-07-22 16:40:54,741 - INFO - Deleting VN ctest-trans_right_vn-25625418
2025-07-22 16:40:54,933 - DEBUG - Response for deleting network ()
2025-07-22 16:40:54,933 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/ff1a5ade-bb67-44f2-9927-1b770ef4f733
2025-07-22 16:40:54,941 - DEBUG - Response Code: 404
2025-07-22 16:40:54,941 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:40:54,956 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:40:54,987 - DEBUG - Requesting: http://10.0.0.254:8082/project/d2d40f24-0e03-43b6-8e46-fa26b303ffe4
2025-07-22 16:40:55,097 - INFO - Validated that VN ctest-trans_right_vn-25625418 is not found in API Server
2025-07-22 16:40:55,112 - DEBUG - VN ctest-trans_right_vn-25625418 is not present in Agent 10.0.0.19
2025-07-22 16:40:55,125 - DEBUG - VN ctest-trans_right_vn-25625418 is not present in Agent 10.0.0.27
2025-07-22 16:40:55,125 - INFO - Validated that VN ctest-trans_right_vn-25625418 is not in any agent
2025-07-22 16:40:55,172 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-25625418 info
2025-07-22 16:40:55,173 - INFO - Deleting VN ctest-trans_left_vn-26165820
2025-07-22 16:40:55,363 - DEBUG - Response for deleting network ()
2025-07-22 16:40:55,363 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/123f8d73-8ca7-4ab4-b2e8-69689d698f17
2025-07-22 16:40:55,370 - DEBUG - Response Code: 404
2025-07-22 16:40:55,370 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:40:55,386 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:40:55,400 - DEBUG - Requesting: http://10.0.0.254:8082/project/d2d40f24-0e03-43b6-8e46-fa26b303ffe4
2025-07-22 16:40:55,520 - INFO - Validated that VN ctest-trans_left_vn-26165820 is not found in API Server
2025-07-22 16:40:55,551 - DEBUG - VN ctest-trans_left_vn-26165820 is not present in Agent 10.0.0.19
2025-07-22 16:40:55,579 - DEBUG - VN ctest-trans_left_vn-26165820 is not present in Agent 10.0.0.27
2025-07-22 16:40:55,579 - INFO - Validated that VN ctest-trans_left_vn-26165820 is not in any agent
2025-07-22 16:40:55,643 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-26165820 info
2025-07-22 16:40:55,643 - INFO - Deleting VN ctest-right_vn-50816996
2025-07-22 16:40:55,692 - DEBUG - VN 6427c1ab-8a3c-4580-953d-60384a9339f7 still in use: Unable to complete operation on network 6427c1ab-8a3c-4580-953d-60384a9339f7. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-204f1fa4-83b8-43b3-bd4e-a3e0ded9be7a']
2025-07-22 16:40:55,692 - WARNING - Deleting VN ctest-right_vn-50816996 failed..Will retry
2025-07-22 16:40:57,898 - DEBUG - Response for deleting network ()
2025-07-22 16:40:57,898 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/bc4ec96c-8ce6-4928-8112-2d9566281d0b
2025-07-22 16:40:57,906 - DEBUG - Response Code: 404
2025-07-22 16:40:57,906 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:40:57,918 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:40:57,933 - DEBUG - Requesting: http://10.0.0.254:8082/project/d2d40f24-0e03-43b6-8e46-fa26b303ffe4
2025-07-22 16:40:58,024 - INFO - Validated that VN ctest-right_vn-50816996 is not found in API Server
2025-07-22 16:40:58,036 - DEBUG - VN ctest-right_vn-50816996 is not present in Agent 10.0.0.19
2025-07-22 16:40:58,049 - DEBUG - VN ctest-right_vn-50816996 is not present in Agent 10.0.0.27
2025-07-22 16:40:58,049 - INFO - Validated that VN ctest-right_vn-50816996 is not in any agent
2025-07-22 16:40:58,088 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-50816996 info
2025-07-22 16:40:58,088 - INFO - Deleting VN ctest-left_vn-76049448
2025-07-22 16:40:58,247 - DEBUG - Response for deleting network ()
2025-07-22 16:40:58,247 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/e18f7969-51ae-4de3-ba39-8204ced698af
2025-07-22 16:40:58,259 - DEBUG - Response Code: 404
2025-07-22 16:40:58,259 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:40:58,266 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:40:58,297 - DEBUG - Requesting: http://10.0.0.254:8082/project/d2d40f24-0e03-43b6-8e46-fa26b303ffe4
2025-07-22 16:40:58,389 - INFO - Validated that VN ctest-left_vn-76049448 is not found in API Server
2025-07-22 16:40:58,403 - DEBUG - VN ctest-left_vn-76049448 is not present in Agent 10.0.0.19
2025-07-22 16:40:58,416 - DEBUG - VN ctest-left_vn-76049448 is not present in Agent 10.0.0.27
2025-07-22 16:40:58,416 - INFO - Validated that VN ctest-left_vn-76049448 is not in any agent
2025-07-22 16:40:58,455 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-76049448 info
2025-07-22 16:40:58,455 - INFO - Deleting VN ctest-mgmt_vn-40654701
2025-07-22 16:40:58,611 - DEBUG - Response for deleting network ()
2025-07-22 16:40:58,611 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/2782e58e-644a-45ce-9935-34b17928a7c4
2025-07-22 16:40:58,618 - DEBUG - Response Code: 404
2025-07-22 16:40:58,618 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:40:58,624 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:40:58,646 - DEBUG - Requesting: http://10.0.0.254:8082/project/d2d40f24-0e03-43b6-8e46-fa26b303ffe4
2025-07-22 16:40:58,733 - INFO - Validated that VN ctest-mgmt_vn-40654701 is not found in API Server
2025-07-22 16:40:58,759 - DEBUG - VN ctest-mgmt_vn-40654701 is not present in Agent 10.0.0.19
2025-07-22 16:40:58,773 - DEBUG - VN ctest-mgmt_vn-40654701 is not present in Agent 10.0.0.27
2025-07-22 16:40:58,773 - INFO - Validated that VN ctest-mgmt_vn-40654701 is not in any agent
2025-07-22 16:40:58,809 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-40654701 info
2025-07-22 16:41:00,085 - ERROR - Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/tcutils/util.py", line 1041, in wrapper
return f(self, *func_args, **func_kwargs)
File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 34, in test_svc_v2_transparent_datapath
create_svms=True)
File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
max_inst=max_inst)
File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
zone=random.choice(valid_zones))
File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
flavor=flavor, zone=zone, node_name=node_name,**kwargs)
File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
reraise(*exc_info)
File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
raise exc_obj.with_traceback(exc_tb)
File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
fixture.setUp()
File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
self.create()
File "/contrail-test/fixtures/vm_test.py", line 240, in create
fixed_ips=self.fixed_ips)
File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
image = self.get_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
self._install_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
return self.copy_and_glance(build_path, image_name, params)
File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
self.upload_image(obj['id'], filename)
File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-net-transparent-fw.qcow2'
2025-07-22 16:41:00,101 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 16:41:00,101 - INFO -
2025-07-22 16:41:00,101 - INFO - END TEST : test_svc_v2_transparent_datapath : FAILED[0:00:17]
2025-07-22 16:41:00,101 - INFO - --------------------------------------------------------------------------------
2025-07-22 16:41:00,859 - INFO - Deleted project: ctest-TestSvcRegr-69027530, ID : d2d40f24-0e03-43b6-8e46-fa26b303ffe4
2025-07-22 16:41:01,024 - INFO - Domain Default found not creating
2025-07-22 16:41:01,176 - INFO - Project ctest-TestSvcRegr-87886805 not found, creating it
2025-07-22 16:41:01,762 - INFO - Created Project:ctest-TestSvcRegr-87886805, ID : f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:03,176 - INFO - ================================================================================
2025-07-22 16:41:03,176 - INFO - STARTING TEST : test_svc_CEM_22032
2025-07-22 16:41:04,441 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 16:41:04,441 - INFO - Initial checks done. Running the testcase now
2025-07-22 16:41:04,441 - INFO -
2025-07-22 16:41:05,198 - DEBUG - Response for create_network : {'network': {'id': '53371432-ed8c-4aeb-953c-1c151bf3fc69', 'name': 'ctest-mgmt_vn-86713168', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'project_id': 'f5967de3b07346b1849d9beee24ed4a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87886805', 'ctest-mgmt_vn-86713168'], 'port_security_enabled': True, 'description': ''}}
2025-07-22 16:41:05,486 - DEBUG - Response for create_subnet : {'subnet': {'id': '1038bd55-3fc7-4b6a-a943-45c5f7b4fb0c', 'name': '', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'network_id': '53371432-ed8c-4aeb-953c-1c151bf3fc69', 'ip_version': 4, 'cidr': '189.163.123.192/26', 'allocation_pools': [{'start': '189.163.123.194', 'end': '189.163.123.254'}], 'gateway_ip': '189.163.123.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '189.163.123.194', 'tags': [], 'project_id': 'f5967de3b07346b1849d9beee24ed4a8'}}
2025-07-22 16:41:05,509 - INFO - Created VN ctest-mgmt_vn-86713168
2025-07-22 16:41:05,523 - DEBUG - VN ctest-mgmt_vn-86713168 UUID is 53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:05,600 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:05,889 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:05,924 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:41:05,941 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:06,048 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:06,062 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:06,074 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0b5b114c-86a1-4ecd-b8bd-3061900c9b36
2025-07-22 16:41:06,086 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0b5b114c-86a1-4ecd-b8bd-3061900c9b36
2025-07-22 16:41:06,096 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/32b616ad-86c3-4973-aa0a-a45cb376723e
2025-07-22 16:41:06,106 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:41:06,106 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:06,117 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0b5b114c-86a1-4ecd-b8bd-3061900c9b36
2025-07-22 16:41:06,136 - INFO - Verified VN network id 12 for VN 53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:06,136 - INFO - Verifications in API Server for VN ctest-mgmt_vn-86713168 passed
2025-07-22 16:41:06,136 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:06,147 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0b5b114c-86a1-4ecd-b8bd-3061900c9b36
2025-07-22 16:41:06,155 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0b5b114c-86a1-4ecd-b8bd-3061900c9b36
2025-07-22 16:41:06,167 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/32b616ad-86c3-4973-aa0a-a45cb376723e
2025-07-22 16:41:06,182 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5996283637833419499', 'uuid-lslong': '10753500887242767465'}, 'enable': 'true', 'created': '2025-07-22T16:41:05', 'last-modified': '2025-07-22T16:41:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.761100'}
2025-07-22 16:41:06,189 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:41:06,195 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5996283637833419499', 'uuid-lslong': '10753500887242767465'}, 'enable': 'true', 'created': '2025-07-22T16:41:05', 'last-modified': '2025-07-22T16:41:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.779380'}
2025-07-22 16:41:06,202 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:41:06,208 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5996283637833419499', 'uuid-lslong': '10753500887242767465'}, 'enable': 'true', 'created': '2025-07-22T16:41:05', 'last-modified': '2025-07-22T16:41:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.791787'}
2025-07-22 16:41:06,215 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:41:06,215 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-86713168 passed
2025-07-22 16:41:06,215 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-86713168 in API_Server ======
2025-07-22 16:41:06,215 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:06,221 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:41:06,236 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:06,337 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/53371432-ed8c-4aeb-953c-1c151bf3fc69
2025-07-22 16:41:06,350 - DEBUG - =>VN ctest-mgmt_vn-86713168 has no policy to be verified
2025-07-22 16:41:06,350 - DEBUG - Verifying the vn in opserver
2025-07-22 16:41:06,350 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168 virtual network link through opserver 10.0.0.254
2025-07-22 16:41:06,350 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:41:06,643 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:41:06,701 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168?flat'}
2025-07-22 16:41:06,701 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168 virtual network link through opserver 10.0.0.50
2025-07-22 16:41:06,701 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:41:07,009 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:41:07,089 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168?flat'}
2025-07-22 16:41:07,089 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168 virtual network link through opserver 10.0.0.23
2025-07-22 16:41:07,090 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:41:07,388 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:41:07,479 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168?flat'}
2025-07-22 16:41:07,479 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-86713168 is found in opserver
2025-07-22 16:41:07,505 - DEBUG - Do not have enough data to verify VN in agent
2025-07-22 16:41:07,519 - DEBUG - VRF ids for VN ctest-mgmt_vn-86713168: {}
2025-07-22 16:41:07,815 - DEBUG - Response for create_network : {'network': {'id': '413b0a44-48d3-47cf-b3c0-8e0e943cc34c', 'name': 'service-left-vn-50919944', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'project_id': 'f5967de3b07346b1849d9beee24ed4a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87886805', 'service-left-vn-50919944'], 'port_security_enabled': True, 'description': ''}}
2025-07-22 16:41:08,023 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ccf2a583-fce1-4db3-8678-6e30e6535385', 'name': '', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'network_id': '413b0a44-48d3-47cf-b3c0-8e0e943cc34c', 'ip_version': 4, 'cidr': '169.183.111.192/26', 'allocation_pools': [{'start': '169.183.111.194', 'end': '169.183.111.254'}], 'gateway_ip': '169.183.111.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '169.183.111.194', 'tags': [], 'project_id': 'f5967de3b07346b1849d9beee24ed4a8'}}
2025-07-22 16:41:08,048 - INFO - Created VN service-left-vn-50919944
2025-07-22 16:41:08,062 - DEBUG - VN service-left-vn-50919944 UUID is 413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,148 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:08,155 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:41:08,167 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:08,257 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,271 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,282 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/39e58e79-f7bf-40ef-b256-f539514a5293
2025-07-22 16:41:08,297 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/39e58e79-f7bf-40ef-b256-f539514a5293
2025-07-22 16:41:08,306 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/12ea4a4f-ab30-4c5f-9738-7650b2f9507b
2025-07-22 16:41:08,315 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:41:08,315 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,327 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/39e58e79-f7bf-40ef-b256-f539514a5293
2025-07-22 16:41:08,346 - INFO - Verified VN network id 13 for VN 413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,347 - INFO - Verifications in API Server for VN service-left-vn-50919944 passed
2025-07-22 16:41:08,347 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,357 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/39e58e79-f7bf-40ef-b256-f539514a5293
2025-07-22 16:41:08,366 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/39e58e79-f7bf-40ef-b256-f539514a5293
2025-07-22 16:41:08,375 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/12ea4a4f-ab30-4c5f-9738-7650b2f9507b
2025-07-22 16:41:08,389 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4700361924487104463', 'uuid-lslong': '12952508721585242956'}, 'enable': 'true', 'created': '2025-07-22T16:41:07', 'last-modified': '2025-07-22T16:41:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428169'}
2025-07-22 16:41:08,396 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:41:08,402 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4700361924487104463', 'uuid-lslong': '12952508721585242956'}, 'enable': 'true', 'created': '2025-07-22T16:41:07', 'last-modified': '2025-07-22T16:41:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435250'}
2025-07-22 16:41:08,409 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:41:08,417 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4700361924487104463', 'uuid-lslong': '12952508721585242956'}, 'enable': 'true', 'created': '2025-07-22T16:41:07', 'last-modified': '2025-07-22T16:41:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447843'}
2025-07-22 16:41:08,425 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:41:08,425 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-50919944 passed
2025-07-22 16:41:08,425 - DEBUG - ====Verifying policy data for service-left-vn-50919944 in API_Server ======
2025-07-22 16:41:08,425 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:08,432 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:41:08,447 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:08,550 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/413b0a44-48d3-47cf-b3c0-8e0e943cc34c
2025-07-22 16:41:08,561 - DEBUG - =>VN service-left-vn-50919944 has no policy to be verified
2025-07-22 16:41:08,561 - DEBUG - Verifying the vn in opserver
2025-07-22 16:41:08,561 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944 virtual network link through opserver 10.0.0.254
2025-07-22 16:41:08,561 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:41:08,623 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944?flat'}
2025-07-22 16:41:08,623 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944 virtual network link through opserver 10.0.0.50
2025-07-22 16:41:08,624 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:41:08,682 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944?flat'}
2025-07-22 16:41:08,682 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944 virtual network link through opserver 10.0.0.23
2025-07-22 16:41:08,682 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:41:08,739 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944?flat'}
2025-07-22 16:41:08,739 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87886805:service-left-vn-50919944 is found in opserver
2025-07-22 16:41:08,763 - DEBUG - Do not have enough data to verify VN in agent
2025-07-22 16:41:08,775 - DEBUG - VRF ids for VN service-left-vn-50919944: {}
2025-07-22 16:41:09,107 - DEBUG - Response for create_network : {'network': {'id': 'af364c89-9416-45d2-9b11-3bb0c08681aa', 'name': 'service-right-vn-26090002', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'project_id': 'f5967de3b07346b1849d9beee24ed4a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87886805', 'service-right-vn-26090002'], 'port_security_enabled': True, 'description': ''}}
2025-07-22 16:41:09,344 - DEBUG - Response for create_subnet : {'subnet': {'id': '4670c5dc-0ec5-437e-8a0f-10f35afb944f', 'name': '', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'network_id': 'af364c89-9416-45d2-9b11-3bb0c08681aa', 'ip_version': 4, 'cidr': '217.99.55.0/26', 'allocation_pools': [{'start': '217.99.55.2', 'end': '217.99.55.62'}], 'gateway_ip': '217.99.55.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '217.99.55.2', 'tags': [], 'project_id': 'f5967de3b07346b1849d9beee24ed4a8'}}
2025-07-22 16:41:09,368 - INFO - Created VN service-right-vn-26090002
2025-07-22 16:41:09,385 - DEBUG - VN service-right-vn-26090002 UUID is af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,476 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:09,485 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:41:09,501 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:09,610 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,626 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,639 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6f14b77-cfd1-44b7-9b27-3a9d6ee79baa
2025-07-22 16:41:09,650 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6f14b77-cfd1-44b7-9b27-3a9d6ee79baa
2025-07-22 16:41:09,660 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8371f2ce-8048-4f97-b9b8-af57c7403f22
2025-07-22 16:41:09,668 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:41:09,668 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,680 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6f14b77-cfd1-44b7-9b27-3a9d6ee79baa
2025-07-22 16:41:09,701 - INFO - Verified VN network id 14 for VN af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,701 - INFO - Verifications in API Server for VN service-right-vn-26090002 passed
2025-07-22 16:41:09,701 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,713 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6f14b77-cfd1-44b7-9b27-3a9d6ee79baa
2025-07-22 16:41:09,722 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6f14b77-cfd1-44b7-9b27-3a9d6ee79baa
2025-07-22 16:41:09,731 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8371f2ce-8048-4f97-b9b8-af57c7403f22
2025-07-22 16:41:09,747 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12625362759158482386', 'uuid-lslong': '11173777780813234602'}, 'enable': 'true', 'created': '2025-07-22T16:41:09', 'last-modified': '2025-07-22T16:41:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.470704'}
2025-07-22 16:41:09,753 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:41:09,760 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12625362759158482386', 'uuid-lslong': '11173777780813234602'}, 'enable': 'true', 'created': '2025-07-22T16:41:09', 'last-modified': '2025-07-22T16:41:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.480144'}
2025-07-22 16:41:09,768 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:41:09,775 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12625362759158482386', 'uuid-lslong': '11173777780813234602'}, 'enable': 'true', 'created': '2025-07-22T16:41:09', 'last-modified': '2025-07-22T16:41:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493135'}
2025-07-22 16:41:09,784 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:41:09,784 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-26090002 passed
2025-07-22 16:41:09,784 - DEBUG - ====Verifying policy data for service-right-vn-26090002 in API_Server ======
2025-07-22 16:41:09,784 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:41:09,794 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:41:09,814 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:41:09,916 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/af364c89-9416-45d2-9b11-3bb0c08681aa
2025-07-22 16:41:09,929 - DEBUG - =>VN service-right-vn-26090002 has no policy to be verified
2025-07-22 16:41:09,929 - DEBUG - Verifying the vn in opserver
2025-07-22 16:41:09,929 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002 virtual network link through opserver 10.0.0.254
2025-07-22 16:41:09,929 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:41:09,992 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002?flat'}
2025-07-22 16:41:09,992 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002 virtual network link through opserver 10.0.0.50
2025-07-22 16:41:09,992 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:41:10,073 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002?flat'}
2025-07-22 16:41:10,074 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002 virtual network link through opserver 10.0.0.23
2025-07-22 16:41:10,074 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:41:10,144 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002?flat'}
2025-07-22 16:41:10,144 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87886805:service-right-vn-26090002 is found in opserver
2025-07-22 16:41:10,173 - DEBUG - Do not have enough data to verify VN in agent
2025-07-22 16:41:10,186 - DEBUG - VRF ids for VN service-right-vn-26090002: {}
2025-07-22 16:41:10,243 - DEBUG - Services list from nova: [, , , ]
2025-07-22 16:41:11,385 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2)
2025-07-22 16:41:12,915 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1)
2025-07-22 16:41:12,915 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-89848094']
2025-07-22 16:41:13,258 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-89848094'] created succesfully
2025-07-22 16:42:54,048 - DEBUG - Installing image tiny_nat_fw
2025-07-22 16:42:54,049 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-07-22 16:42:54,049 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-22 16:42:54,049 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-22 16:42:54,049 - DEBUG - Unzip image
2025-07-22 16:42:54,049 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-22 16:42:54,066 - DEBUG - Try to create image in user context
2025-07-22 16:42:54,131 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-89848094']
2025-07-22 16:42:54,240 - INFO - Service template: ['default-domain', 'ctest-service_template_1-89848094'] deleted successfully.
2025-07-22 16:42:54,240 - INFO - Skip interface_detach for VM ctest-right_vm-55696083 in state BUILD
2025-07-22 16:42:54,241 - INFO - Deleting VM ctest-right_vm-55696083
2025-07-22 16:42:54,272 - ERROR - VM ctest-right_vm-55696083 has failed to come up
2025-07-22 16:42:54,272 - ERROR - Nova failed to get host of the VM
2025-07-22 16:42:54,272 - ERROR - VM ctest-right_vm-55696083 has failed to come up
2025-07-22 16:42:54,273 - ERROR - Nova failed to get host of the VM
2025-07-22 16:42:54,339 - INFO - Skip interface_detach for VM ctest-left_vm-72337974 in state BUILD
2025-07-22 16:42:54,339 - INFO - Deleting VM ctest-left_vm-72337974
2025-07-22 16:42:54,339 - ERROR - VM ctest-left_vm-72337974 has failed to come up
2025-07-22 16:42:54,339 - ERROR - Nova failed to get host of the VM
2025-07-22 16:42:54,339 - ERROR - VM ctest-left_vm-72337974 has failed to come up
2025-07-22 16:42:54,339 - ERROR - Nova failed to get host of the VM
2025-07-22 16:42:54,414 - INFO - Deleting VN service-right-vn-26090002
2025-07-22 16:42:54,461 - DEBUG - VN af364c89-9416-45d2-9b11-3bb0c08681aa still in use: Unable to complete operation on network af364c89-9416-45d2-9b11-3bb0c08681aa. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-31de8fc8-c796-4141-8553-f75ffbe36ccf']
2025-07-22 16:42:54,461 - WARNING - Deleting VN service-right-vn-26090002 failed..Will retry
2025-07-22 16:42:56,764 - DEBUG - Response for deleting network ()
2025-07-22 16:42:56,764 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/a6f14b77-cfd1-44b7-9b27-3a9d6ee79baa
2025-07-22 16:42:56,770 - DEBUG - Response Code: 404
2025-07-22 16:42:56,770 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:42:56,786 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:42:56,871 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:42:56,982 - INFO - Validated that VN service-right-vn-26090002 is not found in API Server
2025-07-22 16:42:56,997 - DEBUG - VN service-right-vn-26090002 is not present in Agent 10.0.0.19
2025-07-22 16:42:57,011 - DEBUG - VN service-right-vn-26090002 is not present in Agent 10.0.0.27
2025-07-22 16:42:57,011 - INFO - Validated that VN service-right-vn-26090002 is not in any agent
2025-07-22 16:42:57,062 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-26090002 info
2025-07-22 16:42:57,062 - INFO - Deleting VN service-left-vn-50919944
2025-07-22 16:42:57,248 - DEBUG - Response for deleting network ()
2025-07-22 16:42:57,248 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/39e58e79-f7bf-40ef-b256-f539514a5293
2025-07-22 16:42:57,255 - DEBUG - Response Code: 404
2025-07-22 16:42:57,255 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:42:57,263 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:42:57,276 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:42:57,377 - INFO - Validated that VN service-left-vn-50919944 is not found in API Server
2025-07-22 16:42:57,393 - DEBUG - VN service-left-vn-50919944 is not present in Agent 10.0.0.19
2025-07-22 16:42:57,414 - DEBUG - VN service-left-vn-50919944 is not present in Agent 10.0.0.27
2025-07-22 16:42:57,414 - INFO - Validated that VN service-left-vn-50919944 is not in any agent
2025-07-22 16:42:57,469 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-50919944 info
2025-07-22 16:42:57,469 - INFO - Deleting VN ctest-mgmt_vn-86713168
2025-07-22 16:42:57,748 - DEBUG - Response for deleting network ()
2025-07-22 16:42:57,748 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/0b5b114c-86a1-4ecd-b8bd-3061900c9b36
2025-07-22 16:42:57,757 - DEBUG - Response Code: 404
2025-07-22 16:42:57,757 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:42:57,765 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:42:57,822 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:42:57,929 - INFO - Validated that VN ctest-mgmt_vn-86713168 is not found in API Server
2025-07-22 16:42:57,944 - DEBUG - VN ctest-mgmt_vn-86713168 is not present in Agent 10.0.0.19
2025-07-22 16:42:57,958 - DEBUG - VN ctest-mgmt_vn-86713168 is not present in Agent 10.0.0.27
2025-07-22 16:42:57,958 - INFO - Validated that VN ctest-mgmt_vn-86713168 is not in any agent
2025-07-22 16:42:58,008 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-86713168 info
2025-07-22 16:42:59,277 - ERROR - Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 35, in test_svc_CEM_22032
right_vn_name=get_random_name('service-right-vn', ''))
File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
max_inst=max_inst)
File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
zone=random.choice(valid_zones))
File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
flavor=flavor, zone=zone, node_name=node_name,**kwargs)
File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
reraise(*exc_info)
File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
raise exc_obj.with_traceback(exc_tb)
File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
fixture.setUp()
File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
self.create()
File "/contrail-test/fixtures/vm_test.py", line 240, in create
fixed_ips=self.fixed_ips)
File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
image = self.get_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
self._install_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
return self.copy_and_glance(build_path, image_name, params)
File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
self.upload_image(obj['id'], filename)
File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
2025-07-22 16:42:59,291 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 16:42:59,292 - INFO -
2025-07-22 16:42:59,292 - INFO - END TEST : test_svc_CEM_22032 : FAILED[0:01:56]
2025-07-22 16:42:59,292 - INFO - --------------------------------------------------------------------------------
2025-07-22 16:42:59,295 - INFO - ================================================================================
2025-07-22 16:42:59,295 - INFO - STARTING TEST : test_svc_in_network_datapath
2025-07-22 16:43:00,573 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with
2025-07-22 16:43:00,577 - INFO - Initial checks done. Running the testcase now
2025-07-22 16:43:00,577 - INFO -
2025-07-22 16:43:00,862 - DEBUG - Response for create_network : {'network': {'id': '90d6708e-6b4d-4f7c-85ef-dcdfda0a603b', 'name': 'ctest-mgmt_vn-82674006', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'project_id': 'f5967de3b07346b1849d9beee24ed4a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87886805', 'ctest-mgmt_vn-82674006'], 'port_security_enabled': True, 'description': ''}}
2025-07-22 16:43:01,161 - DEBUG - Response for create_subnet : {'subnet': {'id': '731f1e52-1c39-47e8-a202-d7f4ee332170', 'name': '', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'network_id': '90d6708e-6b4d-4f7c-85ef-dcdfda0a603b', 'ip_version': 4, 'cidr': '104.99.173.64/26', 'allocation_pools': [{'start': '104.99.173.66', 'end': '104.99.173.126'}], 'gateway_ip': '104.99.173.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '104.99.173.66', 'tags': [], 'project_id': 'f5967de3b07346b1849d9beee24ed4a8'}}
2025-07-22 16:43:01,186 - INFO - Created VN ctest-mgmt_vn-82674006
2025-07-22 16:43:01,203 - DEBUG - VN ctest-mgmt_vn-82674006 UUID is 90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,286 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:43:01,293 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:43:01,309 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:43:01,426 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,449 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,464 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3a3262a9-edf2-4252-b912-6b4d148a7898
2025-07-22 16:43:01,477 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3a3262a9-edf2-4252-b912-6b4d148a7898
2025-07-22 16:43:01,488 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e67ea489-1cdc-4bde-9e03-0a08ce63d523
2025-07-22 16:43:01,497 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:43:01,497 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,509 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3a3262a9-edf2-4252-b912-6b4d148a7898
2025-07-22 16:43:01,530 - INFO - Verified VN network id 12 for VN 90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,530 - INFO - Verifications in API Server for VN ctest-mgmt_vn-82674006 passed
2025-07-22 16:43:01,530 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,544 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3a3262a9-edf2-4252-b912-6b4d148a7898
2025-07-22 16:43:01,555 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3a3262a9-edf2-4252-b912-6b4d148a7898
2025-07-22 16:43:01,565 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/e67ea489-1cdc-4bde-9e03-0a08ce63d523
2025-07-22 16:43:01,583 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10436652943465598844', 'uuid-lslong': '9651175380472193083'}, 'enable': 'true', 'created': '2025-07-22T16:43:00', 'last-modified': '2025-07-22T16:43:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.509597'}
2025-07-22 16:43:01,598 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:43:01,605 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10436652943465598844', 'uuid-lslong': '9651175380472193083'}, 'enable': 'true', 'created': '2025-07-22T16:43:00', 'last-modified': '2025-07-22T16:43:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532042'}
2025-07-22 16:43:01,614 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:43:01,625 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10436652943465598844', 'uuid-lslong': '9651175380472193083'}, 'enable': 'true', 'created': '2025-07-22T16:43:00', 'last-modified': '2025-07-22T16:43:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.550200'}
2025-07-22 16:43:01,635 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-22 16:43:01,635 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-82674006 passed
2025-07-22 16:43:01,636 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-82674006 in API_Server ======
2025-07-22 16:43:01,636 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:43:01,646 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:43:01,663 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:43:01,773 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/90d6708e-6b4d-4f7c-85ef-dcdfda0a603b
2025-07-22 16:43:01,791 - DEBUG - =>VN ctest-mgmt_vn-82674006 has no policy to be verified
2025-07-22 16:43:01,791 - DEBUG - Verifying the vn in opserver
2025-07-22 16:43:01,791 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006 virtual network link through opserver 10.0.0.254
2025-07-22 16:43:01,791 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:43:01,813 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006?flat'}
2025-07-22 16:43:01,813 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006 virtual network link through opserver 10.0.0.50
2025-07-22 16:43:01,813 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:43:01,830 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006?flat'}
2025-07-22 16:43:01,831 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006 virtual network link through opserver 10.0.0.23
2025-07-22 16:43:01,831 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:43:01,846 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006?flat'}
2025-07-22 16:43:01,846 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87886805:ctest-mgmt_vn-82674006 is found in opserver
2025-07-22 16:43:01,872 - DEBUG - Do not have enough data to verify VN in agent
2025-07-22 16:43:01,891 - DEBUG - VRF ids for VN ctest-mgmt_vn-82674006: {}
2025-07-22 16:43:02,223 - DEBUG - Response for create_network : {'network': {'id': '7eac5e65-84f0-48a0-9c7c-04b900276fbc', 'name': 'ctest-left_vn-95693298', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'project_id': 'f5967de3b07346b1849d9beee24ed4a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87886805', 'ctest-left_vn-95693298'], 'port_security_enabled': True, 'description': ''}}
2025-07-22 16:43:02,483 - DEBUG - Response for create_subnet : {'subnet': {'id': '63e2abb1-37e7-4926-9096-a99908a47b61', 'name': '', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'network_id': '7eac5e65-84f0-48a0-9c7c-04b900276fbc', 'ip_version': 4, 'cidr': '118.166.182.0/26', 'allocation_pools': [{'start': '118.166.182.2', 'end': '118.166.182.62'}], 'gateway_ip': '118.166.182.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '118.166.182.2', 'tags': [], 'project_id': 'f5967de3b07346b1849d9beee24ed4a8'}}
2025-07-22 16:43:02,512 - INFO - Created VN ctest-left_vn-95693298
2025-07-22 16:43:02,525 - DEBUG - VN ctest-left_vn-95693298 UUID is 7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:02,609 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:43:02,616 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:43:02,630 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:43:02,730 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:02,747 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:02,761 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/04055383-1223-4b09-ae1d-48b52c064f0e
2025-07-22 16:43:02,771 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/04055383-1223-4b09-ae1d-48b52c064f0e
2025-07-22 16:43:02,781 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8427b927-8096-4892-af2b-2e072f019788
2025-07-22 16:43:02,793 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:43:02,793 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:02,806 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/04055383-1223-4b09-ae1d-48b52c064f0e
2025-07-22 16:43:02,828 - INFO - Verified VN network id 13 for VN 7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:02,828 - INFO - Verifications in API Server for VN ctest-left_vn-95693298 passed
2025-07-22 16:43:02,828 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:02,841 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/04055383-1223-4b09-ae1d-48b52c064f0e
2025-07-22 16:43:02,852 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/04055383-1223-4b09-ae1d-48b52c064f0e
2025-07-22 16:43:02,866 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/8427b927-8096-4892-af2b-2e072f019788
2025-07-22 16:43:02,882 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9127774334888200352', 'uuid-lslong': '11275892759646924732'}, 'enable': 'true', 'created': '2025-07-22T16:43:02', 'last-modified': '2025-07-22T16:43:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459996'}
2025-07-22 16:43:02,889 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:43:02,896 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9127774334888200352', 'uuid-lslong': '11275892759646924732'}, 'enable': 'true', 'created': '2025-07-22T16:43:02', 'last-modified': '2025-07-22T16:43:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478221'}
2025-07-22 16:43:02,905 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:43:02,912 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9127774334888200352', 'uuid-lslong': '11275892759646924732'}, 'enable': 'true', 'created': '2025-07-22T16:43:02', 'last-modified': '2025-07-22T16:43:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490016'}
2025-07-22 16:43:02,920 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-22 16:43:02,920 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-95693298 passed
2025-07-22 16:43:02,921 - DEBUG - ====Verifying policy data for ctest-left_vn-95693298 in API_Server ======
2025-07-22 16:43:02,921 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:43:02,929 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:43:02,945 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:43:03,053 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7eac5e65-84f0-48a0-9c7c-04b900276fbc
2025-07-22 16:43:03,067 - DEBUG - =>VN ctest-left_vn-95693298 has no policy to be verified
2025-07-22 16:43:03,067 - DEBUG - Verifying the vn in opserver
2025-07-22 16:43:03,067 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298 virtual network link through opserver 10.0.0.254
2025-07-22 16:43:03,067 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:43:03,091 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298?flat'}
2025-07-22 16:43:03,091 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298 virtual network link through opserver 10.0.0.50
2025-07-22 16:43:03,091 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:43:03,106 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298?flat'}
2025-07-22 16:43:03,106 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298 virtual network link through opserver 10.0.0.23
2025-07-22 16:43:03,106 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:43:03,122 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298?flat'}
2025-07-22 16:43:03,122 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87886805:ctest-left_vn-95693298 is found in opserver
2025-07-22 16:43:03,160 - DEBUG - Do not have enough data to verify VN in agent
2025-07-22 16:43:03,174 - DEBUG - VRF ids for VN ctest-left_vn-95693298: {}
2025-07-22 16:43:03,443 - DEBUG - Response for create_network : {'network': {'id': 'db170408-fcfb-4b9d-b475-f1996840bc94', 'name': 'ctest-right_vn-23905280', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'project_id': 'f5967de3b07346b1849d9beee24ed4a8', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-87886805', 'ctest-right_vn-23905280'], 'port_security_enabled': True, 'description': ''}}
2025-07-22 16:43:03,708 - DEBUG - Response for create_subnet : {'subnet': {'id': '225e67e8-1c3d-4282-badb-6c98897d35f7', 'name': '', 'tenant_id': 'f5967de3b07346b1849d9beee24ed4a8', 'network_id': 'db170408-fcfb-4b9d-b475-f1996840bc94', 'ip_version': 4, 'cidr': '185.105.192.64/26', 'allocation_pools': [{'start': '185.105.192.66', 'end': '185.105.192.126'}], 'gateway_ip': '185.105.192.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '185.105.192.66', 'tags': [], 'project_id': 'f5967de3b07346b1849d9beee24ed4a8'}}
2025-07-22 16:43:03,734 - INFO - Created VN ctest-right_vn-23905280
2025-07-22 16:43:03,749 - DEBUG - VN ctest-right_vn-23905280 UUID is db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:03,831 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:43:03,839 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:43:03,857 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:43:03,960 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:03,978 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:03,990 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/877ef9a5-436c-4775-aab8-ac3e7f4e513c
2025-07-22 16:43:04,004 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/877ef9a5-436c-4775-aab8-ac3e7f4e513c
2025-07-22 16:43:04,014 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0889c09b-28a8-4073-b6f9-ab7867d230b6
2025-07-22 16:43:04,022 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:43:04,022 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:04,033 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/877ef9a5-436c-4775-aab8-ac3e7f4e513c
2025-07-22 16:43:04,053 - INFO - Verified VN network id 14 for VN db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:04,053 - INFO - Verifications in API Server for VN ctest-right_vn-23905280 passed
2025-07-22 16:43:04,053 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:04,064 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/877ef9a5-436c-4775-aab8-ac3e7f4e513c
2025-07-22 16:43:04,073 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/877ef9a5-436c-4775-aab8-ac3e7f4e513c
2025-07-22 16:43:04,082 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/0889c09b-28a8-4073-b6f9-ab7867d230b6
2025-07-22 16:43:04,096 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15787091455421139869', 'uuid-lslong': '13003565140283538580'}, 'enable': 'true', 'created': '2025-07-22T16:43:03', 'last-modified': '2025-07-22T16:43:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452266'}
2025-07-22 16:43:04,103 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:43:04,110 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15787091455421139869', 'uuid-lslong': '13003565140283538580'}, 'enable': 'true', 'created': '2025-07-22T16:43:03', 'last-modified': '2025-07-22T16:43:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.461372'}
2025-07-22 16:43:04,117 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:43:04,124 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-87886805', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15787091455421139869', 'uuid-lslong': '13003565140283538580'}, 'enable': 'true', 'created': '2025-07-22T16:43:03', 'last-modified': '2025-07-22T16:43:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476909'}
2025-07-22 16:43:04,132 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-22 16:43:04,132 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-23905280 passed
2025-07-22 16:43:04,132 - DEBUG - ====Verifying policy data for ctest-right_vn-23905280 in API_Server ======
2025-07-22 16:43:04,132 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:43:04,139 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:43:04,153 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:43:04,261 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/db170408-fcfb-4b9d-b475-f1996840bc94
2025-07-22 16:43:04,278 - DEBUG - =>VN ctest-right_vn-23905280 has no policy to be verified
2025-07-22 16:43:04,278 - DEBUG - Verifying the vn in opserver
2025-07-22 16:43:04,278 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280 virtual network link through opserver 10.0.0.254
2025-07-22 16:43:04,278 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-07-22 16:43:04,294 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280?flat'}
2025-07-22 16:43:04,294 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280 virtual network link through opserver 10.0.0.50
2025-07-22 16:43:04,294 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-07-22 16:43:04,311 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280?flat'}
2025-07-22 16:43:04,311 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280 virtual network link through opserver 10.0.0.23
2025-07-22 16:43:04,311 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-22 16:43:04,328 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280?flat'}
2025-07-22 16:43:04,328 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-87886805:ctest-right_vn-23905280 is found in opserver
2025-07-22 16:43:04,359 - DEBUG - Do not have enough data to verify VN in agent
2025-07-22 16:43:04,373 - DEBUG - VRF ids for VN ctest-right_vn-23905280: {}
2025-07-22 16:43:05,629 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1)
2025-07-22 16:43:06,972 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2)
2025-07-22 16:43:06,972 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-28738885']
2025-07-22 16:43:07,282 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-28738885'] created succesfully
2025-07-22 16:44:47,960 - DEBUG - Installing image tiny_nat_fw
2025-07-22 16:44:47,961 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"}
2025-07-22 16:44:47,961 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-22 16:44:47,961 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-22 16:44:47,961 - DEBUG - Unzip image
2025-07-22 16:44:47,961 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz
2025-07-22 16:44:47,996 - DEBUG - Try to create image in user context
2025-07-22 16:44:48,052 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-28738885']
2025-07-22 16:44:48,148 - INFO - Service template: ['default-domain', 'ctest-service_template_1-28738885'] deleted successfully.
2025-07-22 16:44:48,148 - INFO - Skip interface_detach for VM ctest-right_vm-35692469 in state BUILD
2025-07-22 16:44:48,148 - INFO - Deleting VM ctest-right_vm-35692469
2025-07-22 16:44:48,148 - ERROR - VM ctest-right_vm-35692469 has failed to come up
2025-07-22 16:44:48,148 - ERROR - Nova failed to get host of the VM
2025-07-22 16:44:48,148 - ERROR - VM ctest-right_vm-35692469 has failed to come up
2025-07-22 16:44:48,148 - ERROR - Nova failed to get host of the VM
2025-07-22 16:44:48,213 - INFO - Skip interface_detach for VM ctest-left_vm-77457779 in state BUILD
2025-07-22 16:44:48,213 - INFO - Deleting VM ctest-left_vm-77457779
2025-07-22 16:44:48,213 - ERROR - VM ctest-left_vm-77457779 has failed to come up
2025-07-22 16:44:48,213 - ERROR - Nova failed to get host of the VM
2025-07-22 16:44:48,214 - ERROR - VM ctest-left_vm-77457779 has failed to come up
2025-07-22 16:44:48,214 - ERROR - Nova failed to get host of the VM
2025-07-22 16:44:48,278 - INFO - Deleting VN ctest-right_vn-23905280
2025-07-22 16:44:48,323 - DEBUG - VN db170408-fcfb-4b9d-b475-f1996840bc94 still in use: Unable to complete operation on network db170408-fcfb-4b9d-b475-f1996840bc94. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-1c690d5b-cd6e-449f-9c22-984506f61308']
2025-07-22 16:44:48,323 - WARNING - Deleting VN ctest-right_vn-23905280 failed..Will retry
2025-07-22 16:44:50,508 - DEBUG - Response for deleting network ()
2025-07-22 16:44:50,508 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/877ef9a5-436c-4775-aab8-ac3e7f4e513c
2025-07-22 16:44:50,515 - DEBUG - Response Code: 404
2025-07-22 16:44:50,519 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:44:50,532 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:44:50,551 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:44:50,653 - INFO - Validated that VN ctest-right_vn-23905280 is not found in API Server
2025-07-22 16:44:50,665 - DEBUG - VN ctest-right_vn-23905280 is not present in Agent 10.0.0.19
2025-07-22 16:44:50,678 - DEBUG - VN ctest-right_vn-23905280 is not present in Agent 10.0.0.27
2025-07-22 16:44:50,678 - INFO - Validated that VN ctest-right_vn-23905280 is not in any agent
2025-07-22 16:44:50,715 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-23905280 info
2025-07-22 16:44:50,715 - INFO - Deleting VN ctest-left_vn-95693298
2025-07-22 16:44:50,883 - DEBUG - Response for deleting network ()
2025-07-22 16:44:50,883 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/04055383-1223-4b09-ae1d-48b52c064f0e
2025-07-22 16:44:50,889 - DEBUG - Response Code: 404
2025-07-22 16:44:50,889 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:44:50,896 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:44:50,921 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:44:51,027 - INFO - Validated that VN ctest-left_vn-95693298 is not found in API Server
2025-07-22 16:44:51,044 - DEBUG - VN ctest-left_vn-95693298 is not present in Agent 10.0.0.19
2025-07-22 16:44:51,062 - DEBUG - VN ctest-left_vn-95693298 is not present in Agent 10.0.0.27
2025-07-22 16:44:51,062 - INFO - Validated that VN ctest-left_vn-95693298 is not in any agent
2025-07-22 16:44:51,112 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-95693298 info
2025-07-22 16:44:51,113 - INFO - Deleting VN ctest-mgmt_vn-82674006
2025-07-22 16:44:51,289 - DEBUG - Response for deleting network ()
2025-07-22 16:44:51,289 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/3a3262a9-edf2-4252-b912-6b4d148a7898
2025-07-22 16:44:51,297 - DEBUG - Response Code: 404
2025-07-22 16:44:51,297 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-07-22 16:44:51,312 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910
2025-07-22 16:44:51,332 - DEBUG - Requesting: http://10.0.0.254:8082/project/f5967de3-b073-46b1-849d-9beee24ed4a8
2025-07-22 16:44:51,438 - INFO - Validated that VN ctest-mgmt_vn-82674006 is not found in API Server
2025-07-22 16:44:51,456 - DEBUG - VN ctest-mgmt_vn-82674006 is not present in Agent 10.0.0.19
2025-07-22 16:44:51,470 - DEBUG - VN ctest-mgmt_vn-82674006 is not present in Agent 10.0.0.27
2025-07-22 16:44:51,470 - INFO - Validated that VN ctest-mgmt_vn-82674006 is not in any agent
2025-07-22 16:44:51,508 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-82674006 info
2025-07-22 16:44:52,769 - ERROR - Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 26, in test_svc_in_network_datapath
create_svms=True)
File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
max_inst=max_inst)
File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
zone=random.choice(valid_zones))
File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
flavor=flavor, zone=zone, node_name=node_name,**kwargs)
File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
reraise(*exc_info)
File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
raise exc_obj.with_traceback(exc_tb)
File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
fixture.setUp()
File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
self.create()
File "/contrail-test/fixtures/vm_test.py", line 240, in create
fixed_ips=self.fixed_ips)
File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
image = self.get_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
self._install_image(image_name=image_name)
File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
return self.copy_and_glance(build_path, image_name, params)
File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
self.upload_image(obj['id'], filename)
File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'
2025-07-22 16:44:52,783 - DEBUG - No XMPP flaps were noticed during the test
2025-07-22 16:44:52,783 - INFO -
2025-07-22 16:44:52,783 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:01:53]
2025-07-22 16:44:52,784 - INFO - --------------------------------------------------------------------------------
2025-07-22 16:44:53,510 - INFO - Deleted project: ctest-TestSvcRegr-87886805, ID : f5967de3-b073-46b1-849d-9beee24ed4a8