2025-08-04 04:25:45,842 - INFO - Domain Default found not creating 2025-08-04 04:25:46,012 - INFO - Project ctest-TestIpVlanLearning-82239651 not found, creating it 2025-08-04 04:25:46,507 - INFO - Created Project:ctest-TestIpVlanLearning-82239651, ID : cad2146b-2778-4a3b-84f9-a0e7171b95b3 2025-08-04 04:25:48,180 - DEBUG - Services list from nova: [, , , ] 2025-08-04 04:25:48,181 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']} 2025-08-04 04:25:48,182 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']} 2025-08-04 04:25:48,901 - DEBUG - Response for create_network : {'network': {'id': 'd6dc2a9e-d4a5-4849-8ef8-cc4013702433', 'name': 'ctest-vn1-81141967', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-82239651', 'ctest-vn1-81141967'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 04:25:49,184 - DEBUG - Response for create_subnet : {'subnet': {'id': '1e6ae58e-23f3-4133-86cf-6e173fcac6b7', 'name': '', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'network_id': 'd6dc2a9e-d4a5-4849-8ef8-cc4013702433', 'ip_version': 4, 'cidr': '6.105.105.0/24', 'allocation_pools': [{'start': '6.105.105.2', 'end': '6.105.105.254'}], 'gateway_ip': '6.105.105.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '6.105.105.2', 'tags': [], 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3'}} 2025-08-04 04:25:49,212 - INFO - Created VN ctest-vn1-81141967 2025-08-04 04:25:49,227 - DEBUG - VN ctest-vn1-81141967 UUID is d6dc2a9e-d4a5-4849-8ef8-cc4013702433 2025-08-04 04:25:49,619 - DEBUG - Response for create_network : {'network': {'id': '30f4fbd6-b378-4214-893d-a15c2f149e9a', 'name': 'ctest-vn2-50025642', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-82239651', 'ctest-vn2-50025642'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 04:25:49,895 - DEBUG - Response for create_subnet : {'subnet': {'id': '4ea44431-a286-4647-b2c3-9060f6a72339', 'name': '', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'network_id': '30f4fbd6-b378-4214-893d-a15c2f149e9a', 'ip_version': 4, 'cidr': '143.133.1.0/24', 'allocation_pools': [{'start': '143.133.1.2', 'end': '143.133.1.254'}], 'gateway_ip': '143.133.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.133.1.2', 'tags': [], 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3'}} 2025-08-04 04:25:49,926 - INFO - Created VN ctest-vn2-50025642 2025-08-04 04:25:49,944 - DEBUG - VN ctest-vn2-50025642 UUID is 30f4fbd6-b378-4214-893d-a15c2f149e9a 2025-08-04 04:25:50,026 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-82239651:ctest-vn1-81141967 to True 2025-08-04 04:25:50,140 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/d6dc2a9e-d4a5-4849-8ef8-cc4013702433 2025-08-04 04:25:50,449 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/d6dc2a9e-d4a5-4849-8ef8-cc4013702433 2025-08-04 04:25:50,487 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-82239651:ctest-vn2-50025642 to True 2025-08-04 04:25:50,604 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/30f4fbd6-b378-4214-893d-a15c2f149e9a 2025-08-04 04:25:50,736 - DEBUG - Image by name crpd-ipvlan not found 2025-08-04 04:25:50,736 - DEBUG - Installing image crpd-ipvlan 2025-08-04 04:25:50,736 - DEBUG - Image info {'name': 'docker-crpd-ipvlan2.qcow2', 'webserver': '', 'location': '/images/crpd/', 'username': 'centos', 'password': 'centos', 'type': 'os', 'flavor': 'contrail_crpd', 'params': '--container-format bare --disk-format qcow2 --property vmware_disktype="sparse" --property vmware_adaptertype="ide"', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-04 04:25:50,736 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/crpd//docker-crpd-ipvlan2.qcow2 2025-08-04 04:25:50,736 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/crpd//docker-crpd-ipvlan2.qcow2 2025-08-04 04:25:50,751 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/crpd//docker-crpd-ipvlan2.qcow2 -O /contrail-test/images/docker-crpd-ipvlan2.qcow2 2025-08-04 04:25:50,800 - DEBUG - Image has been downloaded to /contrail-test/images/docker-crpd-ipvlan2.qcow2 2025-08-04 04:25:50,801 - DEBUG - Try to create image in user context 2025-08-04 04:25:50,999 - DEBUG - Image has been created in user context 2025-08-04 04:25:50,999 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/docker-crpd-ipvlan2.qcow2 2025-08-04 04:25:51,015 - DEBUG - Downloaded image has been removed 2025-08-04 04:25:51,028 - DEBUG - Uploaded image status = active 2025-08-04 04:25:52,270 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1) 2025-08-04 04:25:53,473 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1) 2025-08-04 04:25:54,712 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2) 2025-08-04 04:25:55,904 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2) 2025-08-04 04:25:55,904 - INFO - Waiting for VM ctest-crpd-vm1-36666902 to be up.. 2025-08-04 04:25:55,972 - DEBUG - VM is in ERROR state now 2025-08-04 04:25:55,972 - ERROR - VM in error state. 2025-08-04 04:25:55,972 - ERROR - VM is not in ACTIVE state 2025-08-04 04:25:56,070 - ERROR - Fatal Nova Exception while getting VM detail 2025-08-04 04:25:56,071 - DEBUG - None 2025-08-04 04:25:56,072 - INFO - Skip interface_detach for VM ctest-crpd-vm4-57147481 in state BUILD 2025-08-04 04:25:56,072 - INFO - Deleting VM ctest-crpd-vm4-57147481 2025-08-04 04:25:56,101 - ERROR - VM ctest-crpd-vm4-57147481 has failed to come up 2025-08-04 04:25:56,101 - ERROR - Nova failed to get host of the VM 2025-08-04 04:25:56,101 - ERROR - VM ctest-crpd-vm4-57147481 has failed to come up 2025-08-04 04:25:56,101 - ERROR - Nova failed to get host of the VM 2025-08-04 04:25:56,329 - INFO - Skip interface_detach for VM ctest-crpd-vm3-75916927 in state BUILD 2025-08-04 04:25:56,329 - INFO - Deleting VM ctest-crpd-vm3-75916927 2025-08-04 04:25:56,329 - ERROR - VM ctest-crpd-vm3-75916927 has failed to come up 2025-08-04 04:25:56,330 - ERROR - Nova failed to get host of the VM 2025-08-04 04:25:56,330 - ERROR - VM ctest-crpd-vm3-75916927 has failed to come up 2025-08-04 04:25:56,330 - ERROR - Nova failed to get host of the VM 2025-08-04 04:25:56,493 - INFO - Skip interface_detach for VM ctest-crpd-vm2-81926673 in state BUILD 2025-08-04 04:25:56,493 - INFO - Deleting VM ctest-crpd-vm2-81926673 2025-08-04 04:25:56,493 - ERROR - VM ctest-crpd-vm2-81926673 has failed to come up 2025-08-04 04:25:56,493 - ERROR - Nova failed to get host of the VM 2025-08-04 04:25:56,493 - ERROR - VM ctest-crpd-vm2-81926673 has failed to come up 2025-08-04 04:25:56,493 - ERROR - Nova failed to get host of the VM 2025-08-04 04:25:56,654 - INFO - Skip interface_detach for VM ctest-crpd-vm1-36666902 in state ERROR 2025-08-04 04:25:56,654 - INFO - Deleting VM ctest-crpd-vm1-36666902 2025-08-04 04:25:56,654 - ERROR - VM ctest-crpd-vm1-36666902 has failed to come up 2025-08-04 04:25:56,655 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-08-04T04:25:52Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-08-04 04:25:56,661 - INFO - Deleting VN ctest-vn2-50025642 2025-08-04 04:25:56,858 - DEBUG - Response for deleting network () 2025-08-04 04:25:56,858 - INFO - Deleting VN ctest-vn1-81141967 2025-08-04 04:25:57,042 - DEBUG - Response for deleting network () 2025-08-04 04:25:57,043 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']} 2025-08-04 04:25:57,338 - DEBUG - Response for create_network : {'network': {'id': '17a78806-e20d-4fa5-83b2-e0ec1d314008', 'name': 'ctest-vn1-43016615', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-82239651', 'ctest-vn1-43016615'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 04:25:57,622 - DEBUG - Response for create_subnet : {'subnet': {'id': 'da00f890-9d8f-45c9-a8a3-b94a3c6d71e1', 'name': '', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'network_id': '17a78806-e20d-4fa5-83b2-e0ec1d314008', 'ip_version': 4, 'cidr': '139.247.141.0/24', 'allocation_pools': [{'start': '139.247.141.2', 'end': '139.247.141.254'}], 'gateway_ip': '139.247.141.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '139.247.141.2', 'tags': [], 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3'}} 2025-08-04 04:25:57,645 - INFO - Created VN ctest-vn1-43016615 2025-08-04 04:25:57,660 - DEBUG - VN ctest-vn1-43016615 UUID is 17a78806-e20d-4fa5-83b2-e0ec1d314008 2025-08-04 04:25:58,062 - DEBUG - Response for create_network : {'network': {'id': 'b2136f96-fd6f-4251-8238-c1a64dd1aafa', 'name': 'ctest-vn2-80932144', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-82239651', 'ctest-vn2-80932144'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 04:25:58,330 - DEBUG - Response for create_subnet : {'subnet': {'id': '62e40fa2-8b88-4074-a9a3-016ca4784ad5', 'name': '', 'tenant_id': 'cad2146b27784a3b84f9a0e7171b95b3', 'network_id': 'b2136f96-fd6f-4251-8238-c1a64dd1aafa', 'ip_version': 4, 'cidr': '157.219.56.0/24', 'allocation_pools': [{'start': '157.219.56.2', 'end': '157.219.56.254'}], 'gateway_ip': '157.219.56.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '157.219.56.2', 'tags': [], 'project_id': 'cad2146b27784a3b84f9a0e7171b95b3'}} 2025-08-04 04:25:58,359 - INFO - Created VN ctest-vn2-80932144 2025-08-04 04:25:58,378 - DEBUG - VN ctest-vn2-80932144 UUID is b2136f96-fd6f-4251-8238-c1a64dd1aafa 2025-08-04 04:25:58,475 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-82239651:ctest-vn1-43016615 to True 2025-08-04 04:25:58,604 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/17a78806-e20d-4fa5-83b2-e0ec1d314008 2025-08-04 04:25:58,620 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-82239651:ctest-vn2-80932144 to True 2025-08-04 04:25:58,732 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b2136f96-fd6f-4251-8238-c1a64dd1aafa 2025-08-04 04:25:59,992 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1) 2025-08-04 04:26:01,193 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-1) 2025-08-04 04:26:02,432 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2) 2025-08-04 04:26:03,690 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3750-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3750-2) 2025-08-04 04:26:03,691 - INFO - Waiting for VM ctest-crpd-vm1-71644106 to be up.. 2025-08-04 04:26:03,754 - DEBUG - VM is in ERROR state now 2025-08-04 04:26:03,754 - ERROR - VM in error state. 2025-08-04 04:26:03,754 - ERROR - VM is not in ACTIVE state 2025-08-04 04:26:03,847 - ERROR - Fatal Nova Exception while getting VM detail 2025-08-04 04:26:03,847 - DEBUG - None 2025-08-04 04:26:03,847 - INFO - Skip interface_detach for VM ctest-crpd-vm4-53608635 in state BUILD 2025-08-04 04:26:03,847 - INFO - Deleting VM ctest-crpd-vm4-53608635 2025-08-04 04:26:03,847 - ERROR - VM ctest-crpd-vm4-53608635 has failed to come up 2025-08-04 04:26:03,847 - ERROR - Nova failed to get host of the VM 2025-08-04 04:26:03,847 - ERROR - VM ctest-crpd-vm4-53608635 has failed to come up 2025-08-04 04:26:03,847 - ERROR - Nova failed to get host of the VM 2025-08-04 04:26:04,018 - INFO - Skip interface_detach for VM ctest-crpd-vm3-07810704 in state BUILD 2025-08-04 04:26:04,018 - INFO - Deleting VM ctest-crpd-vm3-07810704 2025-08-04 04:26:04,018 - ERROR - VM ctest-crpd-vm3-07810704 has failed to come up 2025-08-04 04:26:04,018 - ERROR - Nova failed to get host of the VM 2025-08-04 04:26:04,018 - ERROR - VM ctest-crpd-vm3-07810704 has failed to come up 2025-08-04 04:26:04,018 - ERROR - Nova failed to get host of the VM 2025-08-04 04:26:04,206 - INFO - Skip interface_detach for VM ctest-crpd-vm2-63414102 in state BUILD 2025-08-04 04:26:04,207 - INFO - Deleting VM ctest-crpd-vm2-63414102 2025-08-04 04:26:04,208 - ERROR - VM ctest-crpd-vm2-63414102 has failed to come up 2025-08-04 04:26:04,208 - ERROR - Nova failed to get host of the VM 2025-08-04 04:26:04,208 - ERROR - VM ctest-crpd-vm2-63414102 has failed to come up 2025-08-04 04:26:04,208 - ERROR - Nova failed to get host of the VM 2025-08-04 04:26:04,388 - INFO - Skip interface_detach for VM ctest-crpd-vm1-71644106 in state ERROR 2025-08-04 04:26:04,389 - INFO - Deleting VM ctest-crpd-vm1-71644106 2025-08-04 04:26:04,389 - ERROR - VM ctest-crpd-vm1-71644106 has failed to come up 2025-08-04 04:26:04,389 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2025-08-04T04:25:59Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2025-08-04 04:26:04,389 - INFO - Deleting VN ctest-vn2-80932144 2025-08-04 04:26:04,533 - DEBUG - Response for deleting network () 2025-08-04 04:26:04,533 - INFO - Deleting VN ctest-vn1-43016615 2025-08-04 04:26:04,709 - DEBUG - Response for deleting network () 2025-08-04 04:26:05,500 - INFO - Deleted project: ctest-TestIpVlanLearning-82239651, ID : cad2146b-2778-4a3b-84f9-a0e7171b95b3