2025-07-22 15:20:39,028 - INFO - Domain Default found not creating 2025-07-22 15:20:39,231 - INFO - Project ctest-TestECMPSanity-78753854 not found, creating it 2025-07-22 15:20:39,857 - INFO - Created Project:ctest-TestECMPSanity-78753854, ID : 40004efd-8243-4947-a65e-dabfa288dbd4 2025-07-22 15:20:42,144 - DEBUG - Response for create_network : {'network': {'id': '5fd86c4d-2683-4291-9840-b02588be02a0', 'name': 'ctest-mgmt_ctest-TestECMPSanity-78753854-43284576', 'tenant_id': '40004efd82434947a65edabfa288dbd4', 'project_id': '40004efd82434947a65edabfa288dbd4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-78753854', 'ctest-mgmt_ctest-TestECMPSanity-78753854-43284576'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 15:20:42,483 - DEBUG - Response for create_subnet : {'subnet': {'id': '974ff518-fa6a-4f98-9b7d-00b681c006c6', 'name': '', 'tenant_id': '40004efd82434947a65edabfa288dbd4', 'network_id': '5fd86c4d-2683-4291-9840-b02588be02a0', 'ip_version': 4, 'cidr': '149.158.34.0/26', 'allocation_pools': [{'start': '149.158.34.2', 'end': '149.158.34.62'}], 'gateway_ip': '149.158.34.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.158.34.2', 'tags': [], 'project_id': '40004efd82434947a65edabfa288dbd4'}} 2025-07-22 15:20:42,506 - INFO - Created VN ctest-mgmt_ctest-TestECMPSanity-78753854-43284576 2025-07-22 15:20:42,520 - DEBUG - VN ctest-mgmt_ctest-TestECMPSanity-78753854-43284576 UUID is 5fd86c4d-2683-4291-9840-b02588be02a0 2025-07-22 15:20:42,948 - DEBUG - Response for create_network : {'network': {'id': 'df80e554-c7cf-4320-af10-d9815f8b8f53', 'name': 'ctest-left_ctest-TestECMPSanity-78753854-53697096', 'tenant_id': '40004efd82434947a65edabfa288dbd4', 'project_id': '40004efd82434947a65edabfa288dbd4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-78753854', 'ctest-left_ctest-TestECMPSanity-78753854-53697096'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 15:20:43,197 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a74ae756-1309-4574-8912-4efa6f82510d', 'name': '', 'tenant_id': '40004efd82434947a65edabfa288dbd4', 'network_id': 'df80e554-c7cf-4320-af10-d9815f8b8f53', 'ip_version': 4, 'cidr': '157.118.204.0/26', 'allocation_pools': [{'start': '157.118.204.2', 'end': '157.118.204.62'}], 'gateway_ip': '157.118.204.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '157.118.204.2', 'tags': [], 'project_id': '40004efd82434947a65edabfa288dbd4'}} 2025-07-22 15:20:43,223 - INFO - Created VN ctest-left_ctest-TestECMPSanity-78753854-53697096 2025-07-22 15:20:43,239 - DEBUG - VN ctest-left_ctest-TestECMPSanity-78753854-53697096 UUID is df80e554-c7cf-4320-af10-d9815f8b8f53 2025-07-22 15:20:43,647 - DEBUG - Response for create_network : {'network': {'id': 'b5449ff9-5d2b-49cb-8f79-cca52b785bdf', 'name': 'ctest-right_ctest-TestECMPSanity-78753854-68996721', 'tenant_id': '40004efd82434947a65edabfa288dbd4', 'project_id': '40004efd82434947a65edabfa288dbd4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPSanity-78753854', 'ctest-right_ctest-TestECMPSanity-78753854-68996721'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 15:20:43,934 - DEBUG - Response for create_subnet : {'subnet': {'id': '24a6a38b-8b31-47f2-959c-8f41ac0848fb', 'name': '', 'tenant_id': '40004efd82434947a65edabfa288dbd4', 'network_id': 'b5449ff9-5d2b-49cb-8f79-cca52b785bdf', 'ip_version': 4, 'cidr': '34.96.248.64/26', 'allocation_pools': [{'start': '34.96.248.66', 'end': '34.96.248.126'}], 'gateway_ip': '34.96.248.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '34.96.248.66', 'tags': [], 'project_id': '40004efd82434947a65edabfa288dbd4'}} 2025-07-22 15:20:43,961 - INFO - Created VN ctest-right_ctest-TestECMPSanity-78753854-68996721 2025-07-22 15:20:43,977 - DEBUG - VN ctest-right_ctest-TestECMPSanity-78753854-68996721 UUID is b5449ff9-5d2b-49cb-8f79-cca52b785bdf 2025-07-22 15:20:44,122 - DEBUG - Services list from nova: [, , , ] 2025-07-22 15:20:45,179 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2) 2025-07-22 15:20:46,604 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1) 2025-07-22 15:20:46,607 - INFO - ================================================================================ 2025-07-22 15:20:46,607 - INFO - STARTING TEST : test_ecmp_svc_in_network_with_static_route_no_policy 2025-07-22 15:20:46,607 - INFO - TEST DESCRIPTION : Description: Validate service chaining in-network mode datapath having a static route entries of the either virtual networks pointing to the corresponding interfaces of the service instance. We will not configure any policy. Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network mode with 1 instance and left-interface of the service instance sharing the IP and both the left and the right interfaces enabled for static route. 3. Delete the policy. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2025-07-22 15:20:48,040 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-07-22 15:20:48,040 - INFO - Initial checks done. Running the testcase now 2025-07-22 15:20:48,040 - INFO - 2025-07-22 15:20:48,040 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-25830000'] 2025-07-22 15:20:48,354 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-25830000'] created succesfully 2025-07-22 15:22:28,958 - DEBUG - Installing image tiny_in_net 2025-07-22 15:22:28,959 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-22 15:22:28,959 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network.qcow2.gz 2025-07-22 15:22:28,959 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network.qcow2.gz 2025-07-22 15:22:28,959 - DEBUG - Unzip image 2025-07-22 15:22:28,959 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2025-07-22 15:22:28,973 - DEBUG - Try to create image in user context 2025-07-22 15:22:29,041 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-25830000'] 2025-07-22 15:22:29,148 - INFO - Service template: ['default-domain', 'ctest-service_template_1-25830000'] deleted successfully. 2025-07-22 15:22:30,412 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/ecmp/test_ecmp.py", line 95, in test_ecmp_svc_in_network_with_static_route_no_policy
    **self.common_args)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network.qcow2'
2025-07-22 15:22:30,432 - DEBUG - No XMPP flaps were noticed during the test 2025-07-22 15:22:30,432 - INFO - 2025-07-22 15:22:30,432 - INFO - END TEST : test_ecmp_svc_in_network_with_static_route_no_policy : FAILED[0:01:44] 2025-07-22 15:22:30,432 - INFO - -------------------------------------------------------------------------------- 2025-07-22 15:22:30,435 - INFO - ================================================================================ 2025-07-22 15:22:30,435 - INFO - STARTING TEST : test_ecmp_svc_v2_transparent_with_3_instance 2025-07-22 15:22:30,435 - INFO - TEST DESCRIPTION : Description: Validate ECMP with version 2 service chaining transparent mode datapath having service instance Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating a service instance in transparent mode with 3 instances. 3.Creating a service chain by applying the service instance as a service in a policy between the VNs. 4.Checking for ping and bidirectional tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1 and vice-versa. Maintainer : ganeshahv@juniper.net 2025-07-22 15:22:31,704 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-07-22 15:22:31,705 - INFO - Initial checks done. Running the testcase now 2025-07-22 15:22:31,705 - INFO - 2025-07-22 15:22:31,705 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3693-2', 'an-jenkins-deploy-platform-ansible-os-3693-1']} 2025-07-22 15:22:31,705 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2025-07-22 15:22:32,988 - DEBUG - No XMPP flaps were noticed during the test 2025-07-22 15:22:32,988 - INFO - 2025-07-22 15:22:32,988 - INFO - END TEST : test_ecmp_svc_v2_transparent_with_3_instance : SKIPPED[0:00:02] 2025-07-22 15:22:32,988 - INFO - -------------------------------------------------------------------------------- 2025-07-22 15:22:32,990 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPSanity-78753854-56925347 in state BUILD 2025-07-22 15:22:32,990 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPSanity-78753854-56925347 2025-07-22 15:22:33,022 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-78753854-56925347 has failed to come up 2025-07-22 15:22:33,022 - ERROR - Nova failed to get host of the VM 2025-07-22 15:22:33,022 - ERROR - VM ctest-right_vm_ctest-TestECMPSanity-78753854-56925347 has failed to come up 2025-07-22 15:22:33,022 - ERROR - Nova failed to get host of the VM 2025-07-22 15:22:33,101 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPSanity-78753854-71896610 in state BUILD 2025-07-22 15:22:33,101 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPSanity-78753854-71896610 2025-07-22 15:22:33,101 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-78753854-71896610 has failed to come up 2025-07-22 15:22:33,101 - ERROR - Nova failed to get host of the VM 2025-07-22 15:22:33,101 - ERROR - VM ctest-left_vm_ctest-TestECMPSanity-78753854-71896610 has failed to come up 2025-07-22 15:22:33,101 - ERROR - Nova failed to get host of the VM 2025-07-22 15:22:33,176 - INFO - Deleting VN ctest-left_ctest-TestECMPSanity-78753854-53697096 2025-07-22 15:22:33,221 - DEBUG - VN df80e554-c7cf-4320-af10-d9815f8b8f53 still in use: Unable to complete operation on network df80e554-c7cf-4320-af10-d9815f8b8f53. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d76da6be-89d0-4415-8dd7-507b1c670cbd'] 2025-07-22 15:22:33,221 - WARNING - Deleting VN ctest-left_ctest-TestECMPSanity-78753854-53697096 failed..Will retry 2025-07-22 15:22:35,418 - DEBUG - Response for deleting network () 2025-07-22 15:22:35,418 - INFO - Deleting VN ctest-right_ctest-TestECMPSanity-78753854-68996721 2025-07-22 15:22:35,626 - DEBUG - Response for deleting network () 2025-07-22 15:22:35,626 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPSanity-78753854-43284576 2025-07-22 15:22:35,893 - DEBUG - Response for deleting network () 2025-07-22 15:22:36,755 - INFO - Deleted project: ctest-TestECMPSanity-78753854, ID : 40004efd-8243-4947-a65e-dabfa288dbd4