2025-11-03 02:07:31,783 - INFO - Domain Default found not creating 2025-11-03 02:07:31,938 - INFO - Project ctest-TestECMPFeature-18342541 not found, creating it 2025-11-03 02:07:32,573 - INFO - Created Project:ctest-TestECMPFeature-18342541, ID : d076c518-81dc-4964-a492-fd1b869fdab1 2025-11-03 02:07:34,754 - DEBUG - Response for create_network : {'network': {'id': 'c9d4eae9-1098-465e-ae5b-2e1bd50ffc6d', 'name': 'ctest-mgmt_ctest-TestECMPFeature-18342541-12981320', 'tenant_id': 'd076c51881dc4964a492fd1b869fdab1', 'project_id': 'd076c51881dc4964a492fd1b869fdab1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPFeature-18342541', 'ctest-mgmt_ctest-TestECMPFeature-18342541-12981320'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:07:35,103 - DEBUG - Response for create_subnet : {'subnet': {'id': '223487c7-5b84-4bea-ae24-0f6314d105a6', 'name': '', 'tenant_id': 'd076c51881dc4964a492fd1b869fdab1', 'network_id': 'c9d4eae9-1098-465e-ae5b-2e1bd50ffc6d', 'ip_version': 4, 'cidr': '203.111.126.128/26', 'allocation_pools': [{'start': '203.111.126.130', 'end': '203.111.126.190'}], 'gateway_ip': '203.111.126.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '203.111.126.130', 'tags': [], 'project_id': 'd076c51881dc4964a492fd1b869fdab1'}} 2025-11-03 02:07:35,135 - INFO - Created VN ctest-mgmt_ctest-TestECMPFeature-18342541-12981320 2025-11-03 02:07:35,150 - DEBUG - VN ctest-mgmt_ctest-TestECMPFeature-18342541-12981320 UUID is c9d4eae9-1098-465e-ae5b-2e1bd50ffc6d 2025-11-03 02:07:35,616 - DEBUG - Response for create_network : {'network': {'id': 'acac60dc-2449-4f7a-b13a-ed280b50ab7c', 'name': 'ctest-left_ctest-TestECMPFeature-18342541-72162907', 'tenant_id': 'd076c51881dc4964a492fd1b869fdab1', 'project_id': 'd076c51881dc4964a492fd1b869fdab1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPFeature-18342541', 'ctest-left_ctest-TestECMPFeature-18342541-72162907'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:07:35,881 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd110cc03-e15d-4247-b924-1e36ded10a7e', 'name': '', 'tenant_id': 'd076c51881dc4964a492fd1b869fdab1', 'network_id': 'acac60dc-2449-4f7a-b13a-ed280b50ab7c', 'ip_version': 4, 'cidr': '165.1.123.128/26', 'allocation_pools': [{'start': '165.1.123.130', 'end': '165.1.123.190'}], 'gateway_ip': '165.1.123.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '165.1.123.130', 'tags': [], 'project_id': 'd076c51881dc4964a492fd1b869fdab1'}} 2025-11-03 02:07:35,910 - INFO - Created VN ctest-left_ctest-TestECMPFeature-18342541-72162907 2025-11-03 02:07:35,921 - DEBUG - VN ctest-left_ctest-TestECMPFeature-18342541-72162907 UUID is acac60dc-2449-4f7a-b13a-ed280b50ab7c 2025-11-03 02:07:36,344 - DEBUG - Response for create_network : {'network': {'id': 'ffb5e181-ca25-4d0a-af28-ef8f43c4f73e', 'name': 'ctest-right_ctest-TestECMPFeature-18342541-33623253', 'tenant_id': 'd076c51881dc4964a492fd1b869fdab1', 'project_id': 'd076c51881dc4964a492fd1b869fdab1', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestECMPFeature-18342541', 'ctest-right_ctest-TestECMPFeature-18342541-33623253'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 02:07:36,671 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd6865e34-1ea6-4728-a1ab-bd9f6aded781', 'name': '', 'tenant_id': 'd076c51881dc4964a492fd1b869fdab1', 'network_id': 'ffb5e181-ca25-4d0a-af28-ef8f43c4f73e', 'ip_version': 4, 'cidr': '53.103.135.0/26', 'allocation_pools': [{'start': '53.103.135.2', 'end': '53.103.135.62'}], 'gateway_ip': '53.103.135.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.103.135.2', 'tags': [], 'project_id': 'd076c51881dc4964a492fd1b869fdab1'}} 2025-11-03 02:07:36,695 - INFO - Created VN ctest-right_ctest-TestECMPFeature-18342541-33623253 2025-11-03 02:07:36,707 - DEBUG - VN ctest-right_ctest-TestECMPFeature-18342541-33623253 UUID is ffb5e181-ca25-4d0a-af28-ef8f43c4f73e 2025-11-03 02:07:36,855 - DEBUG - Services list from nova: [, , , ] 2025-11-03 02:07:38,067 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 02:07:39,509 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 02:07:39,511 - INFO - ================================================================================ 2025-11-03 02:07:39,511 - INFO - STARTING TEST : test_ecmp_svc_v2_in_network_nat_with_3_instance 2025-11-03 02:07:39,511 - INFO - TEST DESCRIPTION : Description: Validate ECMP with v2 service chaining in-network-nat mode datapath having service instance Test steps: 1. Creating vm's - vm1 and vm2 in networks vn1 and vn2. 2. Creating a service instance in in-network-nat mode with 3 instances and left-interface of the service instances sharing the IP and enabled for static route. 3. Creating a service chain by applying the service instance as a service in a policy between the VNs. 4. Checking for ping and tcp traffic between vm1 and vm2. Pass criteria: Ping between the VMs should be successful and TCP traffic should reach vm2 from vm1. Maintainer : ganeshahv@juniper.net 2025-11-03 02:07:40,183 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with 2025-11-03 02:07:40,183 - INFO - Initial checks done. Running the testcase now 2025-11-03 02:07:40,184 - INFO - 2025-11-03 02:07:40,184 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-4597-1', 'an-jenkins-deploy-platform-ansible-os-4597-2']} 2025-11-03 02:07:40,184 - INFO - Skipped as test requires at least 3 nodes, but only 2 found 2025-11-03 02:07:40,847 - DEBUG - No XMPP flaps were noticed during the test 2025-11-03 02:07:40,847 - INFO - 2025-11-03 02:07:40,847 - INFO - END TEST : test_ecmp_svc_v2_in_network_nat_with_3_instance : SKIPPED[0:00:01] 2025-11-03 02:07:40,848 - INFO - -------------------------------------------------------------------------------- 2025-11-03 02:07:40,851 - INFO - Skip interface_detach for VM ctest-right_vm_ctest-TestECMPFeature-18342541-46020698 in state BUILD 2025-11-03 02:07:40,851 - INFO - Deleting VM ctest-right_vm_ctest-TestECMPFeature-18342541-46020698 2025-11-03 02:07:40,880 - ERROR - VM ctest-right_vm_ctest-TestECMPFeature-18342541-46020698 has failed to come up 2025-11-03 02:07:40,880 - ERROR - Nova failed to get host of the VM 2025-11-03 02:07:40,880 - ERROR - VM ctest-right_vm_ctest-TestECMPFeature-18342541-46020698 has failed to come up 2025-11-03 02:07:40,880 - ERROR - Nova failed to get host of the VM 2025-11-03 02:07:40,944 - INFO - Skip interface_detach for VM ctest-left_vm_ctest-TestECMPFeature-18342541-23148895 in state BUILD 2025-11-03 02:07:40,944 - INFO - Deleting VM ctest-left_vm_ctest-TestECMPFeature-18342541-23148895 2025-11-03 02:07:40,944 - ERROR - VM ctest-left_vm_ctest-TestECMPFeature-18342541-23148895 has failed to come up 2025-11-03 02:07:40,944 - ERROR - Nova failed to get host of the VM 2025-11-03 02:07:40,944 - ERROR - VM ctest-left_vm_ctest-TestECMPFeature-18342541-23148895 has failed to come up 2025-11-03 02:07:40,944 - ERROR - Nova failed to get host of the VM 2025-11-03 02:07:41,015 - INFO - Deleting VN ctest-left_ctest-TestECMPFeature-18342541-72162907 2025-11-03 02:07:41,061 - DEBUG - VN acac60dc-2449-4f7a-b13a-ed280b50ab7c still in use: Unable to complete operation on network acac60dc-2449-4f7a-b13a-ed280b50ab7c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4b38c7b9-bd25-4773-8800-ebd1604dd2ba'] 2025-11-03 02:07:41,062 - WARNING - Deleting VN ctest-left_ctest-TestECMPFeature-18342541-72162907 failed..Will retry 2025-11-03 02:07:43,247 - DEBUG - Response for deleting network () 2025-11-03 02:07:43,247 - INFO - Deleting VN ctest-right_ctest-TestECMPFeature-18342541-33623253 2025-11-03 02:07:43,294 - DEBUG - VN ffb5e181-ca25-4d0a-af28-ef8f43c4f73e still in use: Unable to complete operation on network ffb5e181-ca25-4d0a-af28-ef8f43c4f73e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-dc74fea0-2afb-4642-9ca8-f3abb25947b5'] 2025-11-03 02:07:43,294 - WARNING - Deleting VN ctest-right_ctest-TestECMPFeature-18342541-33623253 failed..Will retry 2025-11-03 02:07:45,341 - DEBUG - VN ffb5e181-ca25-4d0a-af28-ef8f43c4f73e still in use: Unable to complete operation on network ffb5e181-ca25-4d0a-af28-ef8f43c4f73e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6a13fe8d-b34e-4c83-acd1-3fa5b0a57466'] 2025-11-03 02:07:45,341 - WARNING - Deleting VN ctest-right_ctest-TestECMPFeature-18342541-33623253 failed..Will retry 2025-11-03 02:07:47,386 - DEBUG - VN ffb5e181-ca25-4d0a-af28-ef8f43c4f73e still in use: Unable to complete operation on network ffb5e181-ca25-4d0a-af28-ef8f43c4f73e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6fd23b4f-142b-43c9-a5d5-e358909333c9'] 2025-11-03 02:07:47,386 - WARNING - Deleting VN ctest-right_ctest-TestECMPFeature-18342541-33623253 failed..Will retry 2025-11-03 02:07:49,435 - DEBUG - VN ffb5e181-ca25-4d0a-af28-ef8f43c4f73e still in use: Unable to complete operation on network ffb5e181-ca25-4d0a-af28-ef8f43c4f73e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5d54bd87-d25d-4bf8-9a9f-5fcd2821d941'] 2025-11-03 02:07:49,435 - WARNING - Deleting VN ctest-right_ctest-TestECMPFeature-18342541-33623253 failed..Will retry 2025-11-03 02:07:51,621 - DEBUG - Response for deleting network () 2025-11-03 02:07:51,621 - INFO - Deleting VN ctest-mgmt_ctest-TestECMPFeature-18342541-12981320 2025-11-03 02:07:51,791 - DEBUG - Response for deleting network () 2025-11-03 02:07:52,618 - INFO - Deleted project: ctest-TestECMPFeature-18342541, ID : d076c518-81dc-4964-a492-fd1b869fdab1