2025-08-11 04:01:59,532 - INFO - Domain Default found not creating
2025-08-11 04:01:59,680 - INFO - Project ctest-TestIpVlanLearning-32118572 not found, creating it
2025-08-11 04:02:00,254 - INFO - Created Project:ctest-TestIpVlanLearning-32118572, ID : 8bf614cc-99ec-4b3a-865f-4dc69bca26be 
2025-08-11 04:02:01,814 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>, <Service: 3>]
2025-08-11 04:02:01,814 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3794-2', 'an-jenkins-deploy-platform-ansible-os-3794-1']}
2025-08-11 04:02:01,817 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3794-2', 'an-jenkins-deploy-platform-ansible-os-3794-1']}
2025-08-11 04:02:02,645 - DEBUG - Response for create_network : {'network': {'id': 'df68a04e-c987-430c-90cb-873de278ab2b', 'name': 'ctest-vn1-51272219', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-32118572', 'ctest-vn1-51272219'], 'port_security_enabled': True, 'description': ''}}
2025-08-11 04:02:02,959 - DEBUG - Response for create_subnet : {'subnet': {'id': '861c0696-cd2e-4b6f-ae49-2b12ab39af0c', 'name': '', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'network_id': 'df68a04e-c987-430c-90cb-873de278ab2b', 'ip_version': 4, 'cidr': '32.136.217.0/24', 'allocation_pools': [{'start': '32.136.217.2', 'end': '32.136.217.254'}], 'gateway_ip': '32.136.217.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '32.136.217.2', 'tags': [], 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be'}}
2025-08-11 04:02:02,984 - INFO - Created VN ctest-vn1-51272219
2025-08-11 04:02:02,996 - DEBUG - VN ctest-vn1-51272219 UUID is df68a04e-c987-430c-90cb-873de278ab2b
2025-08-11 04:02:03,359 - DEBUG - Response for create_network : {'network': {'id': '6d68d86e-4ce7-4988-bde5-f0b3d3105591', 'name': 'ctest-vn2-93347223', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-32118572', 'ctest-vn2-93347223'], 'port_security_enabled': True, 'description': ''}}
2025-08-11 04:02:03,597 - DEBUG - Response for create_subnet : {'subnet': {'id': '6ce6a448-a7d3-4000-98a0-d064a3663d60', 'name': '', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'network_id': '6d68d86e-4ce7-4988-bde5-f0b3d3105591', 'ip_version': 4, 'cidr': '28.14.178.0/24', 'allocation_pools': [{'start': '28.14.178.2', 'end': '28.14.178.254'}], 'gateway_ip': '28.14.178.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '28.14.178.2', 'tags': [], 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be'}}
2025-08-11 04:02:03,625 - INFO - Created VN ctest-vn2-93347223
2025-08-11 04:02:03,639 - DEBUG - VN ctest-vn2-93347223 UUID is 6d68d86e-4ce7-4988-bde5-f0b3d3105591
2025-08-11 04:02:03,743 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-32118572:ctest-vn1-51272219 to True
2025-08-11 04:02:03,937 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/df68a04e-c987-430c-90cb-873de278ab2b
2025-08-11 04:02:04,259 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/df68a04e-c987-430c-90cb-873de278ab2b
2025-08-11 04:02:04,306 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-32118572:ctest-vn2-93347223 to True
2025-08-11 04:02:04,423 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/6d68d86e-4ce7-4988-bde5-f0b3d3105591
2025-08-11 04:02:04,563 - DEBUG - Image by name crpd-ipvlan not found
2025-08-11 04:02:04,563 - DEBUG - Installing image crpd-ipvlan
2025-08-11 04:02:04,563 - DEBUG - Image info {'name': 'docker-crpd-ipvlan2.qcow2', 'webserver': '', 'location': '/images/crpd/', 'username': 'centos', 'password': 'centos', 'type': 'os', 'flavor': 'contrail_crpd', 'params': '--container-format bare --disk-format qcow2 --property vmware_disktype="sparse" --property vmware_adaptertype="ide"', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-11 04:02:04,564 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/crpd//docker-crpd-ipvlan2.qcow2
2025-08-11 04:02:04,564 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/crpd//docker-crpd-ipvlan2.qcow2
2025-08-11 04:02:04,583 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/crpd//docker-crpd-ipvlan2.qcow2 -O /contrail-test/images/docker-crpd-ipvlan2.qcow2
2025-08-11 04:02:04,671 - DEBUG - Image has been downloaded to /contrail-test/images/docker-crpd-ipvlan2.qcow2
2025-08-11 04:02:04,671 - DEBUG - Try to create image in user context
2025-08-11 04:02:04,796 - DEBUG - Image has been created in user context
2025-08-11 04:02:04,796 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/docker-crpd-ipvlan2.qcow2
2025-08-11 04:02:04,811 - DEBUG - Downloaded image has been removed
2025-08-11 04:02:04,830 - DEBUG - Uploaded image status = active
2025-08-11 04:02:06,223 - INFO - VM ([<Server: ctest-crpd-vm1-14152360>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-1)
2025-08-11 04:02:07,412 - INFO - VM ([<Server: ctest-crpd-vm2-87602494>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-1)
2025-08-11 04:02:08,712 - INFO - VM ([<Server: ctest-crpd-vm3-31866731>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-2)
2025-08-11 04:02:09,848 - INFO - VM ([<Server: ctest-crpd-vm4-81277507>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-2)
2025-08-11 04:02:09,848 - INFO - Waiting for VM ctest-crpd-vm1-14152360 to be up..
2025-08-11 04:02:09,907 - DEBUG - VM <Server: ctest-crpd-vm1-14152360> is in ERROR state now
2025-08-11 04:02:09,907 - ERROR - VM in error state.
2025-08-11 04:02:09,908 - ERROR - VM is not in ACTIVE state
2025-08-11 04:02:09,992 - ERROR - Fatal Nova Exception while getting VM detail
2025-08-11 04:02:09,992 - DEBUG - None
2025-08-11 04:02:09,994 - INFO - Skip interface_detach for VM ctest-crpd-vm4-81277507 in state BUILD
2025-08-11 04:02:09,994 - INFO - Deleting VM ctest-crpd-vm4-81277507
2025-08-11 04:02:10,016 - ERROR - VM ctest-crpd-vm4-81277507 has failed to come up
2025-08-11 04:02:10,016 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:10,016 - ERROR - VM ctest-crpd-vm4-81277507 has failed to come up
2025-08-11 04:02:10,016 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:10,191 - INFO - Skip interface_detach for VM ctest-crpd-vm3-31866731 in state BUILD
2025-08-11 04:02:10,191 - INFO - Deleting VM ctest-crpd-vm3-31866731
2025-08-11 04:02:10,191 - ERROR - VM ctest-crpd-vm3-31866731 has failed to come up
2025-08-11 04:02:10,191 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:10,191 - ERROR - VM ctest-crpd-vm3-31866731 has failed to come up
2025-08-11 04:02:10,191 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:10,338 - INFO - Skip interface_detach for VM ctest-crpd-vm2-87602494 in state BUILD
2025-08-11 04:02:10,338 - INFO - Deleting VM ctest-crpd-vm2-87602494
2025-08-11 04:02:10,338 - ERROR - VM ctest-crpd-vm2-87602494 has failed to come up
2025-08-11 04:02:10,338 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:10,338 - ERROR - VM ctest-crpd-vm2-87602494 has failed to come up
2025-08-11 04:02:10,338 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:10,490 - INFO - Skip interface_detach for VM ctest-crpd-vm1-14152360 in state ERROR
2025-08-11 04:02:10,490 - INFO - Deleting VM ctest-crpd-vm1-14152360
2025-08-11 04:02:10,490 - ERROR - VM ctest-crpd-vm1-14152360 has failed to come up
2025-08-11 04:02:10,490 - ERROR - Fault seen in nova show <vm-uuid> is:  {'code': 500, 'created': '2025-08-11T04:02:06Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n    instance_uuids, return_alternates=True)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n    return_alternates=return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n    instance_uuids, return_objects, return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n    return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n    retry=self.retry, transport_options=self.transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n    raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n    return func(*args, **kwargs)\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n    raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2025-08-11 04:02:10,495 - INFO - Deleting VN ctest-vn2-93347223 
2025-08-11 04:02:10,625 - DEBUG - Response for deleting network ()
2025-08-11 04:02:10,626 - INFO - Deleting VN ctest-vn1-51272219 
2025-08-11 04:02:10,804 - DEBUG - Response for deleting network ()
2025-08-11 04:02:10,806 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3794-2', 'an-jenkins-deploy-platform-ansible-os-3794-1']}
2025-08-11 04:02:11,334 - DEBUG - Response for create_network : {'network': {'id': '62e84958-72f6-4929-8608-1cbd66d17645', 'name': 'ctest-vn1-80366945', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-32118572', 'ctest-vn1-80366945'], 'port_security_enabled': True, 'description': ''}}
2025-08-11 04:02:11,649 - DEBUG - Response for create_subnet : {'subnet': {'id': '881276a1-3373-446b-b0b0-c865384c7d95', 'name': '', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'network_id': '62e84958-72f6-4929-8608-1cbd66d17645', 'ip_version': 4, 'cidr': '37.125.35.0/24', 'allocation_pools': [{'start': '37.125.35.2', 'end': '37.125.35.254'}], 'gateway_ip': '37.125.35.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '37.125.35.2', 'tags': [], 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be'}}
2025-08-11 04:02:11,681 - INFO - Created VN ctest-vn1-80366945
2025-08-11 04:02:11,703 - DEBUG - VN ctest-vn1-80366945 UUID is 62e84958-72f6-4929-8608-1cbd66d17645
2025-08-11 04:02:12,124 - DEBUG - Response for create_network : {'network': {'id': 'a76384e3-da9a-44d4-889e-379e30d6f36c', 'name': 'ctest-vn2-85422936', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIpVlanLearning-32118572', 'ctest-vn2-85422936'], 'port_security_enabled': True, 'description': ''}}
2025-08-11 04:02:12,337 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f1282b49-ddc4-46db-b94e-2039bd6459d1', 'name': '', 'tenant_id': '8bf614cc99ec4b3a865f4dc69bca26be', 'network_id': 'a76384e3-da9a-44d4-889e-379e30d6f36c', 'ip_version': 4, 'cidr': '185.239.106.0/24', 'allocation_pools': [{'start': '185.239.106.2', 'end': '185.239.106.254'}], 'gateway_ip': '185.239.106.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '185.239.106.2', 'tags': [], 'project_id': '8bf614cc99ec4b3a865f4dc69bca26be'}}
2025-08-11 04:02:12,362 - INFO - Created VN ctest-vn2-85422936
2025-08-11 04:02:12,376 - DEBUG - VN ctest-vn2-85422936 UUID is a76384e3-da9a-44d4-889e-379e30d6f36c
2025-08-11 04:02:12,448 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-32118572:ctest-vn1-80366945 to True
2025-08-11 04:02:12,539 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/62e84958-72f6-4929-8608-1cbd66d17645
2025-08-11 04:02:12,550 - DEBUG - Updating mac_ip_learning flag on VN default-domain:ctest-TestIpVlanLearning-32118572:ctest-vn2-85422936 to True
2025-08-11 04:02:12,659 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/a76384e3-da9a-44d4-889e-379e30d6f36c
2025-08-11 04:02:13,750 - INFO - VM ([<Server: ctest-crpd-vm1-98196039>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-1)
2025-08-11 04:02:14,818 - INFO - VM ([<Server: ctest-crpd-vm2-07538184>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-1)
2025-08-11 04:02:15,901 - INFO - VM ([<Server: ctest-crpd-vm3-51036419>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-2)
2025-08-11 04:02:16,962 - INFO - VM ([<Server: ctest-crpd-vm4-47020187>]) created on node: (an-jenkins-deploy-platform-ansible-os-3794-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3794-2)
2025-08-11 04:02:16,962 - INFO - Waiting for VM ctest-crpd-vm1-98196039 to be up..
2025-08-11 04:02:17,011 - DEBUG - VM <Server: ctest-crpd-vm1-98196039> is in ERROR state now
2025-08-11 04:02:17,011 - ERROR - VM in error state.
2025-08-11 04:02:17,011 - ERROR - VM is not in ACTIVE state
2025-08-11 04:02:17,102 - ERROR - Fatal Nova Exception while getting VM detail
2025-08-11 04:02:17,102 - DEBUG - None
2025-08-11 04:02:17,102 - INFO - Skip interface_detach for VM ctest-crpd-vm4-47020187 in state BUILD
2025-08-11 04:02:17,102 - INFO - Deleting VM ctest-crpd-vm4-47020187
2025-08-11 04:02:17,103 - ERROR - VM ctest-crpd-vm4-47020187 has failed to come up
2025-08-11 04:02:17,103 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:17,103 - ERROR - VM ctest-crpd-vm4-47020187 has failed to come up
2025-08-11 04:02:17,103 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:17,242 - INFO - Skip interface_detach for VM ctest-crpd-vm3-51036419 in state BUILD
2025-08-11 04:02:17,242 - INFO - Deleting VM ctest-crpd-vm3-51036419
2025-08-11 04:02:17,242 - ERROR - VM ctest-crpd-vm3-51036419 has failed to come up
2025-08-11 04:02:17,242 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:17,243 - ERROR - VM ctest-crpd-vm3-51036419 has failed to come up
2025-08-11 04:02:17,243 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:17,379 - INFO - Skip interface_detach for VM ctest-crpd-vm2-07538184 in state BUILD
2025-08-11 04:02:17,379 - INFO - Deleting VM ctest-crpd-vm2-07538184
2025-08-11 04:02:17,379 - ERROR - VM ctest-crpd-vm2-07538184 has failed to come up
2025-08-11 04:02:17,379 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:17,379 - ERROR - VM ctest-crpd-vm2-07538184 has failed to come up
2025-08-11 04:02:17,380 - ERROR - Nova failed to get host of the VM
2025-08-11 04:02:17,516 - INFO - Skip interface_detach for VM ctest-crpd-vm1-98196039 in state ERROR
2025-08-11 04:02:17,516 - INFO - Deleting VM ctest-crpd-vm1-98196039
2025-08-11 04:02:17,517 - ERROR - VM ctest-crpd-vm1-98196039 has failed to come up
2025-08-11 04:02:17,517 - ERROR - Fault seen in nova show <vm-uuid> is:  {'code': 500, 'created': '2025-08-11T04:02:13Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n    instance_uuids, return_alternates=True)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n    return_alternates=return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n    instance_uuids, return_objects, return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n    return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n    retry=self.retry, transport_options=self.transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n    raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n    return func(*args, **kwargs)\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n    raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2025-08-11 04:02:17,517 - INFO - Deleting VN ctest-vn2-85422936 
2025-08-11 04:02:17,669 - DEBUG - Response for deleting network ()
2025-08-11 04:02:17,670 - INFO - Deleting VN ctest-vn1-80366945 
2025-08-11 04:02:17,798 - DEBUG - Response for deleting network ()
2025-08-11 04:02:18,556 - INFO - Deleted project: ctest-TestIpVlanLearning-32118572, ID : 8bf614cc-99ec-4b3a-865f-4dc69bca26be