2025-07-22 15:20:20,754 - INFO - Domain Default found not creating 2025-07-22 15:20:20,903 - INFO - Project ctest-TestECMPIPv6Fragments-74400240 not found, creating it 2025-07-22 15:20:21,491 - INFO - Created Project:ctest-TestECMPIPv6Fragments-74400240, ID : 3ec9d525-ef11-4a9d-803b-d5faa18e945d 2025-07-22 15:20:23,821 - DEBUG - Response for create_network : {'network': {'id': 'af7623e4-7a0b-4366-ae28-3f804c5a4b61', 'name': 'ctest-mgmt_ctest-TestECMPIPv6Fragments-74400240-57693303', 'tenant_id': '3ec9d525ef114a9d803bd5faa18e945d', 'project_id': '3ec9d525ef114a9d803bd5faa18e945d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPIPv6Fragments-74400240', 'ctest-mgmt_ctest-TestECMPIPv6Fragments-74400240-57693303'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 15:20:24,076 - DEBUG - Response for create_subnet : {'subnet': {'id': '18120751-0d82-468d-a852-14ca55ee3f89', 'name': '', 'tenant_id': '3ec9d525ef114a9d803bd5faa18e945d', 'network_id': 'af7623e4-7a0b-4366-ae28-3f804c5a4b61', 'ip_version': 4, 'cidr': '148.236.179.192/26', 'allocation_pools': [{'start': '148.236.179.194', 'end': '148.236.179.254'}], 'gateway_ip': '148.236.179.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '148.236.179.194', 'tags': [], 'project_id': '3ec9d525ef114a9d803bd5faa18e945d'}} 2025-07-22 15:20:24,107 - INFO - Created VN ctest-mgmt_ctest-TestECMPIPv6Fragments-74400240-57693303 2025-07-22 15:20:24,127 - DEBUG - VN ctest-mgmt_ctest-TestECMPIPv6Fragments-74400240-57693303 UUID is af7623e4-7a0b-4366-ae28-3f804c5a4b61 2025-07-22 15:20:24,564 - DEBUG - Response for create_network : {'network': {'id': 'e621650e-cc23-4747-8101-547b9c5a2dea', 'name': 'ctest-left_ctest-TestECMPIPv6Fragments-74400240-42953435', 'tenant_id': '3ec9d525ef114a9d803bd5faa18e945d', 'project_id': '3ec9d525ef114a9d803bd5faa18e945d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPIPv6Fragments-74400240', 'ctest-left_ctest-TestECMPIPv6Fragments-74400240-42953435'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 15:20:24,857 - DEBUG - Response for create_subnet : {'subnet': {'id': '65ec0440-27f5-4b56-a7ac-59cafb31f5cb', 'name': '', 'tenant_id': '3ec9d525ef114a9d803bd5faa18e945d', 'network_id': 'e621650e-cc23-4747-8101-547b9c5a2dea', 'ip_version': 4, 'cidr': '219.89.74.0/26', 'allocation_pools': [{'start': '219.89.74.2', 'end': '219.89.74.62'}], 'gateway_ip': '219.89.74.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.89.74.2', 'tags': [], 'project_id': '3ec9d525ef114a9d803bd5faa18e945d'}} 2025-07-22 15:20:24,882 - INFO - Created VN ctest-left_ctest-TestECMPIPv6Fragments-74400240-42953435 2025-07-22 15:20:24,897 - DEBUG - VN ctest-left_ctest-TestECMPIPv6Fragments-74400240-42953435 UUID is e621650e-cc23-4747-8101-547b9c5a2dea 2025-07-22 15:20:25,430 - DEBUG - Response for create_network : {'network': {'id': '9589c3d6-babd-4fdc-8040-6e6f9540a3ad', 'name': 'ctest-right_ctest-TestECMPIPv6Fragments-74400240-17725115', 'tenant_id': '3ec9d525ef114a9d803bd5faa18e945d', 'project_id': '3ec9d525ef114a9d803bd5faa18e945d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPIPv6Fragments-74400240', 'ctest-right_ctest-TestECMPIPv6Fragments-74400240-17725115'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 15:20:25,795 - DEBUG - Response for create_subnet : {'subnet': {'id': '2af29522-98d3-4049-b52d-d1c6c23c648b', 'name': '', 'tenant_id': '3ec9d525ef114a9d803bd5faa18e945d', 'network_id': '9589c3d6-babd-4fdc-8040-6e6f9540a3ad', 'ip_version': 4, 'cidr': '130.237.190.0/26', 'allocation_pools': [{'start': '130.237.190.2', 'end': '130.237.190.62'}], 'gateway_ip': '130.237.190.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '130.237.190.2', 'tags': [], 'project_id': '3ec9d525ef114a9d803bd5faa18e945d'}} 2025-07-22 15:20:25,823 - INFO - Created VN ctest-right_ctest-TestECMPIPv6Fragments-74400240-17725115 2025-07-22 15:20:25,844 - DEBUG - VN ctest-right_ctest-TestECMPIPv6Fragments-74400240-17725115 UUID is 9589c3d6-babd-4fdc-8040-6e6f9540a3ad 2025-07-22 15:20:26,028 - DEBUG - Services list from nova: [, , , ] 2025-07-22 15:20:27,287 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2) 2025-07-22 15:20:28,882 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1) 2025-07-22 15:20:28,884 - INFO - ================================================================================ 2025-07-22 15:20:28,885 - INFO - STARTING TEST : test_ecmp_svc_in_network_with_static_route_no_policy 2025-07-22 15:20:28,885 - INFO - TEST DESCRIPTION : Description: Validate service chaining in-network mode datapath having a static route entries of the either virtual networks pointing to the corresponding interfaces of the service instance. We will not configure any policy. Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network mode with 1 instance and left-interface of the service instance sharing the IP and both the left and the right interfaces enabled for static route. 3. Delete the policy. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2025-07-22 15:20:30,279 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-07-22 15:20:30,279 - INFO - Initial checks done. Running the testcase now 2025-07-22 15:20:30,279 - INFO - 2025-07-22 15:20:30,279 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-71307984'] 2025-07-22 15:20:30,609 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-71307984'] created succesfully 2025-07-22 15:20:30,907 - DEBUG - Image by name tiny_in_net not found 2025-07-22 15:20:30,908 - DEBUG - Installing image tiny_in_net 2025-07-22 15:20:30,908 - DEBUG - Image info {'name': 'tinycore-in-network.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_in_net/tinycore-in-network-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-22 15:20:30,908 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network.qcow2.gz 2025-07-22 15:20:30,908 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network.qcow2.gz 2025-07-22 15:20:30,919 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network.qcow2.gz -O /contrail-test/images/tinycore-in-network.qcow2.gz 2025-07-22 15:20:30,943 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network.qcow2.gz 2025-07-22 15:20:30,943 - DEBUG - Unzip image 2025-07-22 15:20:30,943 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network.qcow2.gz 2025-07-22 15:20:30,960 - DEBUG - Try to create image in user context 2025-07-22 15:20:31,031 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-71307984'] 2025-07-22 15:20:31,144 - INFO - Service template: ['default-domain', 'ctest-service_template_1-71307984'] deleted successfully. 2025-07-22 15:20:32,413 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/ecmp/test_ecmp.py", line 95, in test_ecmp_svc_in_network_with_static_route_no_policy
    **self.common_args)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network.qcow2'
2025-07-22 15:20:32,429 - DEBUG - No XMPP flaps were noticed during the test 2025-07-22 15:20:32,429 - INFO - 2025-07-22 15:20:32,429 - INFO - END TEST : test_ecmp_svc_in_network_with_static_route_no_policy : FAILED[0:00:04] 2025-07-22 15:20:32,429 - INFO - -------------------------------------------------------------------------------- 2025-07-22 15:20:32,433 - INFO - ================================================================================ 2025-07-22 15:20:32,433 - INFO - STARTING TEST : test_ecmp_svc_v2_transparent_with_3_instance 2025-07-22 15:20:32,433 - INFO - TEST DESCRIPTION : Description: Validate ECMP with version 2 service chaining transparent mode datapath having service instance Test steps: 1.Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2.Creating a service instance in transparent mode with 3 instances. 3.Creating a service chain by applying the service instance as a service in a policy between the VNs. 4.Checking for ping and bidirectional tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1 and vice-versa. Maintainer : ganeshahv@juniper.net 2025-07-22 15:20:33,726 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-07-22 15:20:33,726 - INFO - Initial checks done. Running the testcase now 2025-07-22 15:20:33,726 - INFO - 2025-07-22 15:20:33,726 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3693-2', 'an-jenkins-deploy-platform-ansible-os-3693-1']} 2025-07-22 15:20:33,726 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2025-07-22 15:20:35,038 - DEBUG - No XMPP flaps were noticed during the test 2025-07-22 15:20:35,038 - INFO - 2025-07-22 15:20:35,038 - INFO - END TEST : test_ecmp_svc_v2_transparent_with_3_instance : SKIPPED[0:00:03] 2025-07-22 15:20:35,038 - INFO - -------------------------------------------------------------------------------- 2025-07-22 15:20:35,040 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPIPv6Fragments-74400240-91378368 in state BUILD 2025-07-22 15:20:35,040 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPIPv6Fragments-74400240-91378368 2025-07-22 15:20:35,076 - ERROR - VM ctest-right_vm_ctest-TestECMPIPv6Fragments-74400240-91378368 has failed to come up 2025-07-22 15:20:35,076 - ERROR - Nova failed to get host of the VM 2025-07-22 15:20:35,076 - ERROR - VM ctest-right_vm_ctest-TestECMPIPv6Fragments-74400240-91378368 has failed to come up 2025-07-22 15:20:35,077 - ERROR - Nova failed to get host of the VM 2025-07-22 15:20:35,189 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPIPv6Fragments-74400240-61567386 in state BUILD 2025-07-22 15:20:35,189 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPIPv6Fragments-74400240-61567386 2025-07-22 15:20:35,189 - ERROR - VM ctest-left_vm_ctest-TestECMPIPv6Fragments-74400240-61567386 has failed to come up 2025-07-22 15:20:35,189 - ERROR - Nova failed to get host of the VM 2025-07-22 15:20:35,189 - ERROR - VM ctest-left_vm_ctest-TestECMPIPv6Fragments-74400240-61567386 has failed to come up 2025-07-22 15:20:35,189 - ERROR - Nova failed to get host of the VM 2025-07-22 15:20:35,309 - INFO - Deleting VN ctest-left_ctest-TestECMPIPv6Fragments-74400240-42953435 2025-07-22 15:20:35,362 - DEBUG - VN e621650e-cc23-4747-8101-547b9c5a2dea still in use: Unable to complete operation on network e621650e-cc23-4747-8101-547b9c5a2dea. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a4abe2b8-b328-4bd2-9fa4-b66fce225607'] 2025-07-22 15:20:35,363 - WARNING - Deleting VN ctest-left_ctest-TestECMPIPv6Fragments-74400240-42953435 failed..Will retry 2025-07-22 15:20:37,551 - DEBUG - Response for deleting network () 2025-07-22 15:20:37,551 - INFO - Deleting VN ctest-right_ctest-TestECMPIPv6Fragments-74400240-17725115 2025-07-22 15:20:37,761 - DEBUG - Response for deleting network () 2025-07-22 15:20:37,762 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPIPv6Fragments-74400240-57693303 2025-07-22 15:20:37,976 - DEBUG - Response for deleting network () 2025-07-22 15:20:38,846 - INFO - Deleted project: ctest-TestECMPIPv6Fragments-74400240, ID : 3ec9d525-ef11-4a9d-803b-d5faa18e945d