2026-02-10 18:21:02,293 - INFO - Domain Default found not creating
2026-02-10 18:21:02,485 - INFO - Project ctest-TestBasicVMVN-05309123 not found, creating it
2026-02-10 18:21:02,954 - INFO - Created Project:ctest-TestBasicVMVN-05309123, ID : dc16ad31-6fb9-4f0a-ac91-39f1310bb2af 
2026-02-10 18:21:04,460 - INFO - ================================================================================
2026-02-10 18:21:04,460 - INFO - STARTING TEST    : test_generic_link_local_service
2026-02-10 18:21:04,461 - INFO - TEST DESCRIPTION : 
        Description: Test to validate generic linklocal service - running nova list from vm.
            1.Create generic link local service to be able to wget to jenkins
            2.Create a vm
            3.Try wget to jenkins - passes if successful else fails

        Maintainer: sandipd@juniper.net
        
2026-02-10 18:21:04,721 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.129': '0'}} with
2026-02-10 18:21:04,721 - INFO - Initial checks done. Running the testcase now
2026-02-10 18:21:04,721 - INFO - 
2026-02-10 18:21:05,275 - DEBUG - Response for create_network : {'network': {'id': 'c45ef899-437f-416c-8421-fb9334b00abe', 'name': 'ctest-vn2_metadata-67968258', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-05309123', 'ctest-vn2_metadata-67968258'], 'port_security_enabled': True, 'description': ''}}
2026-02-10 18:21:05,457 - DEBUG - Response for create_subnet : {'subnet': {'id': '2c481826-c67f-40cf-aab4-16416dd51bed', 'name': '', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'network_id': 'c45ef899-437f-416c-8421-fb9334b00abe', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af'}}
2026-02-10 18:21:05,474 - INFO - Created VN ctest-vn2_metadata-67968258
2026-02-10 18:21:05,527 - DEBUG - VN ctest-vn2_metadata-67968258 UUID is c45ef899-437f-416c-8421-fb9334b00abe
2026-02-10 18:21:05,798 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>]
2026-02-10 18:21:06,948 - INFO - VM ([<Server: ctest-TestBasicVMVN-05309123-79188181>]) created on node: (cn-jenkins-deploy-platform-ansible-os-5285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5285-1)
2026-02-10 18:21:07,055 - DEBUG - Link local service introspect added
2026-02-10 18:21:07,108 - DEBUG - VM <Server: ctest-TestBasicVMVN-05309123-79188181> is in ERROR state now
2026-02-10 18:21:07,108 - ERROR - VM in error state.
2026-02-10 18:21:07,167 - DEBUG - VM <Server: ctest-TestBasicVMVN-05309123-79188181> is in ERROR state now
2026-02-10 18:21:07,167 - ERROR - VM in error state.
2026-02-10 18:21:07,275 - DEBUG - Link local service introspect removed
2026-02-10 18:21:07,275 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-05309123-79188181 in state ERROR
2026-02-10 18:21:07,275 - INFO - Deleting VM ctest-TestBasicVMVN-05309123-79188181
2026-02-10 18:21:07,294 - ERROR - VM ctest-TestBasicVMVN-05309123-79188181 has failed to come up
2026-02-10 18:21:07,294 - ERROR - Fault seen in nova show <vm-uuid> is:  {'code': 500, 'created': '2026-02-10T18:21:06Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n    instance_uuids, return_alternates=True)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n    return_alternates=return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n    instance_uuids, return_objects, return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n    return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n    retry=self.retry, transport_options=self.transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n    raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n    return func(*args, **kwargs)\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n    raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-02-10 18:21:07,295 - INFO - Deleting VN ctest-vn2_metadata-67968258 
2026-02-10 18:21:07,406 - DEBUG - Response for deleting network ()
2026-02-10 18:21:07,659 - ERROR - <pre>Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 290, in test_generic_link_local_service
    compute_user = self.inputs.host_data[vm1_fixture.vm_node_ip]['username']
  File "/contrail-test/fixtures/vm_test.py", line 386, in vm_node_ip
    self.get_host_of_vm(refresh=True))
  File "/contrail-test/fixtures/vm_test.py", line 400, in get_host_of_vm
    assert self.wait_till_vm_is_active()
AssertionError
</pre>

2026-02-10 18:21:07,665 - DEBUG - No XMPP flaps were noticed during the test
2026-02-10 18:21:07,665 - INFO - 
2026-02-10 18:21:07,666 - INFO - END TEST : test_generic_link_local_service : FAILED[0:00:03]
2026-02-10 18:21:07,666 - INFO - --------------------------------------------------------------------------------
2026-02-10 18:21:07,669 - INFO - ================================================================================
2026-02-10 18:21:07,669 - INFO - STARTING TEST    : test_metadata_service
2026-02-10 18:21:07,669 - INFO - TEST DESCRIPTION : 
        Description: Test to validate metadata service on VM creation.

               1.Verify from global-vrouter-config if metadata configures or not - fails otherwise
               2.Create a shell script which writes  'hello world ' in a file in /tmp and save the script on the nova api node
               3.Create a vm with userdata pointing to that script - script should get executed during vm boot up
               4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise
            Maintainer: sandipd@juniper.net
        
2026-02-10 18:21:07,959 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.129': '0'}} with
2026-02-10 18:21:07,959 - INFO - Initial checks done. Running the testcase now
2026-02-10 18:21:07,959 - INFO - 
2026-02-10 18:21:07,959 - DEBUG - Requesting: http://10.0.0.129:8082/global-vrouter-configs
2026-02-10 18:21:08,258 - DEBUG - Requesting: http://10.0.0.129:8082/global-vrouter-configs
2026-02-10 18:21:08,291 - DEBUG - Requesting: http://10.0.0.129:8082/global-vrouter-config/dbb12ab5-6d81-4ba4-baa3-576b59789dc9
2026-02-10 18:21:08,484 - DEBUG - Response for create_network : {'network': {'id': 'b61774ff-afdb-45b2-9d3a-33d97ced88ba', 'name': 'ctest-vn-77237395', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-05309123', 'ctest-vn-77237395'], 'port_security_enabled': True, 'description': ''}}
2026-02-10 18:21:08,662 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c03398d5-65b0-4129-bb2b-4e030d8bf85a', 'name': '', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'network_id': 'b61774ff-afdb-45b2-9d3a-33d97ced88ba', 'ip_version': 4, 'cidr': '11.50.85.128/26', 'allocation_pools': [{'start': '11.50.85.130', 'end': '11.50.85.190'}], 'gateway_ip': '11.50.85.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.50.85.130', 'tags': [], 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af'}}
2026-02-10 18:21:08,681 - INFO - Created VN ctest-vn-77237395
2026-02-10 18:21:08,735 - DEBUG - VN ctest-vn-77237395 UUID is b61774ff-afdb-45b2-9d3a-33d97ced88ba
2026-02-10 18:21:10,017 - INFO - VM ([<Server: ctest-TestBasicVMVN-05309123-08672255>]) created on node: (cn-jenkins-deploy-platform-ansible-os-5285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5285-1)
2026-02-10 18:21:10,017 - INFO - Waiting for VM ctest-TestBasicVMVN-05309123-08672255 to be up..
2026-02-10 18:21:10,068 - DEBUG - VM <Server: ctest-TestBasicVMVN-05309123-08672255> is still in BUILD state, Expected: ACTIVE
2026-02-10 18:21:15,133 - DEBUG - VM <Server: ctest-TestBasicVMVN-05309123-08672255> is in ERROR state now
2026-02-10 18:21:15,133 - ERROR - VM in error state.
2026-02-10 18:21:15,133 - ERROR - VM is not in ACTIVE state
2026-02-10 18:21:15,219 - ERROR - Fatal Nova Exception while getting VM detail
2026-02-10 18:21:15,219 - DEBUG - None
2026-02-10 18:21:15,220 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-05309123-08672255 in state ERROR
2026-02-10 18:21:15,220 - INFO - Deleting VM ctest-TestBasicVMVN-05309123-08672255
2026-02-10 18:21:15,220 - ERROR - VM ctest-TestBasicVMVN-05309123-08672255 has failed to come up
2026-02-10 18:21:15,220 - ERROR - Fault seen in nova show <vm-uuid> is:  {'code': 500, 'created': '2026-02-10T18:21:10Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n    instance_uuids, return_alternates=True)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n    return_alternates=return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n    instance_uuids, return_objects, return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n    return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n    retry=self.retry, transport_options=self.transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n    raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n    return func(*args, **kwargs)\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n    raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-02-10 18:21:15,220 - INFO - Deleting VN ctest-vn-77237395 
2026-02-10 18:21:15,333 - DEBUG - Response for deleting network ()
2026-02-10 18:21:15,593 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Tue Feb 10 18:21:15 2026

A problem occurred in a Python script.  Here is the sequence of
function calls leading up to the error, in the order they occurred.

 /contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7fc41c49fd30>, *args=(), **kwargs={})
   78             log.info('Initial checks done. Running the testcase now')
   79             log.info('')
   80             result = function(self, *args, **kwargs)
   81             if self.inputs.upgrade:
   82                 pid = os.getpid()
result = None
function = <function TestBasicVMVN.test_metadata_service>
self = <scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7fc41c49fd30>
args = ()
kwargs = {}

 /contrail-test/scripts/vm_regression/test_vm_basic.py in test_metadata_service(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7fc41c49fd30>)
   55                                      image_name='cirros',
   56                                      userdata='/tmp/metadata_script.txt')
   57         assert vm1_fixture.wait_till_vm_is_up()
   58 
   59         cmd = 'cat /tmp/output.txt'
vm1_fixture = <VMFixture: ctest-TestBasicVMVN-05309123-08672255>
vm1_fixture.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVN-05309123-08672255>>
AssertionError: 
    __cause__ = None
    __class__ = <class 'AssertionError'>
    __context__ = None
    __delattr__ = <method-wrapper '__delattr__' of AssertionError object>
    __dict__ = {}
    __dir__ = <built-in method __dir__ of AssertionError object>
    __doc__ = 'Assertion failed.'
    __eq__ = <method-wrapper '__eq__' of AssertionError object>
    __format__ = <built-in method __format__ of AssertionError object>
    __ge__ = <method-wrapper '__ge__' of AssertionError object>
    __getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
    __gt__ = <method-wrapper '__gt__' of AssertionError object>
    __hash__ = <method-wrapper '__hash__' of AssertionError object>
    __init__ = <method-wrapper '__init__' of AssertionError object>
    __init_subclass__ = <built-in method __init_subclass__ of type object>
    __le__ = <method-wrapper '__le__' of AssertionError object>
    __lt__ = <method-wrapper '__lt__' of AssertionError object>
    __ne__ = <method-wrapper '__ne__' of AssertionError object>
    __new__ = <built-in method __new__ of type object>
    __reduce__ = <built-in method __reduce__ of AssertionError object>
    __reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
    __repr__ = <method-wrapper '__repr__' of AssertionError object>
    __setattr__ = <method-wrapper '__setattr__' of AssertionError object>
    __setstate__ = <built-in method __setstate__ of AssertionError object>
    __sizeof__ = <built-in method __sizeof__ of AssertionError object>
    __str__ = <method-wrapper '__str__' of AssertionError object>
    __subclasshook__ = <built-in method __subclasshook__ of type object>
    __suppress_context__ = False
    __traceback__ = <traceback object>
    args = ()
    with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program.  Here is
the original traceback:

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 57, in test_metadata_service
    assert vm1_fixture.wait_till_vm_is_up()
AssertionError



2026-02-10 18:21:15,600 - DEBUG - No XMPP flaps were noticed during the test
2026-02-10 18:21:15,600 - INFO - 
2026-02-10 18:21:15,600 - INFO - END TEST : test_metadata_service : FAILED[0:00:08]
2026-02-10 18:21:15,600 - INFO - --------------------------------------------------------------------------------
2026-02-10 18:21:15,603 - INFO - ================================================================================
2026-02-10 18:21:15,603 - INFO - STARTING TEST    : test_ping_within_vn_two_vms_two_different_subnets
2026-02-10 18:21:15,603 - INFO - TEST DESCRIPTION : 
        Description:  Validate Ping between 2 VMs in the same VN, 2 VMs in different VN
        subnets.
        Test steps:
                1. Create 1 IPAM's.
                2. Create 1 VN with 2 subnets and launch 2 VMs in them.
                3. Ping between the VMs in the same VN should go thru fine.
                4. Ping to the subnet broadcast and all-broadcast address.
        Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the
                        all-broadcast address.
        Maintainer : ganeshahv@juniper.net
        
2026-02-10 18:21:15,884 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.129': '0'}} with
2026-02-10 18:21:15,884 - INFO - Initial checks done. Running the testcase now
2026-02-10 18:21:15,884 - INFO - 
2026-02-10 18:21:16,380 - DEBUG - Response for create_network : {'network': {'id': 'f55d6960-2f52-41a4-8c41-bdf60028b914', 'name': 'ctest-vn-51922517', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-05309123', 'ctest-vn-51922517'], 'port_security_enabled': True, 'description': ''}}
2026-02-10 18:21:16,612 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a157bb45-d381-4dd4-8e2c-5724d0e91fcb', 'name': '', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'network_id': 'f55d6960-2f52-41a4-8c41-bdf60028b914', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af'}}
2026-02-10 18:21:16,812 - DEBUG - Response for create_subnet : {'subnet': {'id': '17f4eb97-6054-40b3-a566-5b22b4ab2fed', 'name': '', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'network_id': 'f55d6960-2f52-41a4-8c41-bdf60028b914', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af'}}
2026-02-10 18:21:16,833 - INFO - Created VN ctest-vn-51922517
2026-02-10 18:21:16,887 - DEBUG - VN ctest-vn-51922517 UUID is f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:17,277 - DEBUG - Response for create_port : {'port': {'name': 'efc6b88e-432f-4bc6-85be-46c876fb2732', 'id': 'efc6b88e-432f-4bc6-85be-46c876fb2732', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'network_id': 'f55d6960-2f52-41a4-8c41-bdf60028b914', 'mac_address': '02:ef:c6:b8:8e:43', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'a157bb45-d381-4dd4-8e2c-5724d0e91fcb'}], 'security_groups': ['6b151cbd-318c-45ad-9605-5f1d50349aa1'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af'}}
2026-02-10 18:21:17,473 - DEBUG - Response for create_port : {'port': {'name': 'dffd0881-645d-49d7-b291-6024c41e3220', 'id': 'dffd0881-645d-49d7-b291-6024c41e3220', 'tenant_id': 'dc16ad316fb94f0aac9139f1310bb2af', 'network_id': 'f55d6960-2f52-41a4-8c41-bdf60028b914', 'mac_address': '02:df:fd:08:81:64', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '17f4eb97-6054-40b3-a566-5b22b4ab2fed'}], 'security_groups': ['6b151cbd-318c-45ad-9605-5f1d50349aa1'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'dc16ad316fb94f0aac9139f1310bb2af'}}
2026-02-10 18:21:18,016 - INFO - VM ([<Server: ctest-TestBasicVMVN-05309123-00368857>]) created on node: (cn-jenkins-deploy-platform-ansible-os-5285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5285-1)
2026-02-10 18:21:18,581 - INFO - VM ([<Server: ctest-TestBasicVMVN-05309123-33871599>]) created on node: (cn-jenkins-deploy-platform-ansible-os-5285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5285-1)
2026-02-10 18:21:19,849 - INFO - VM ([<Server: ctest-TestBasicVMVN-05309123-08492038>]) created on node: (cn-jenkins-deploy-platform-ansible-os-5285-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-5285-1)
2026-02-10 18:21:19,850 - DEBUG - Requesting: http://10.0.0.129:8082/domains
2026-02-10 18:21:19,856 - DEBUG - Requesting: http://10.0.0.129:8082/domain/e57ea2d5-65ff-4fe2-a66b-03789a16f1b1
2026-02-10 18:21:19,870 - DEBUG - Requesting: http://10.0.0.129:8082/project/dc16ad31-6fb9-4f0a-ac91-39f1310bb2af
2026-02-10 18:21:19,948 - DEBUG - Requesting: http://10.0.0.129:8082/network-ipam/a006b026-69e3-4018-afce-2172db7fd202
2026-02-10 18:21:19,959 - INFO - Verifications in API Server for IPAM: ctest-ipam-52876204 passed
2026-02-10 18:21:19,965 - DEBUG - Control-node 10.0.0.129 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-05309123:ctest-ipam-52876204', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-05309123', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11531097574960480280', 'uuid-lslong': '12668099579032359426'}, 'enable': 'true', 'created': '2026-02-10T18:21:15', 'last-modified': '2026-02-10T18:21:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.851382'}
2026-02-10 18:21:19,965 - INFO - Verifications in Control node for IPAM: ctest-ipam-52876204 passed
2026-02-10 18:21:19,965 - DEBUG - Requesting: http://10.0.0.129:8082/domains
2026-02-10 18:21:19,972 - DEBUG - Requesting: http://10.0.0.129:8082/domain/e57ea2d5-65ff-4fe2-a66b-03789a16f1b1
2026-02-10 18:21:19,984 - DEBUG - Requesting: http://10.0.0.129:8082/project/dc16ad31-6fb9-4f0a-ac91-39f1310bb2af
2026-02-10 18:21:20,056 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-network/f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:20,069 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-network/f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:20,082 - DEBUG - Requesting: http://10.0.0.129:8082/routing-instance/b1b5e172-a959-4d85-98ad-2439054ea15f
2026-02-10 18:21:20,092 - DEBUG - Requesting: http://10.0.0.129:8082/routing-instance/b1b5e172-a959-4d85-98ad-2439054ea15f
2026-02-10 18:21:20,101 - DEBUG - Requesting: http://10.0.0.129:8082/route-target/45b6653b-c355-4679-b386-9539841f1131
2026-02-10 18:21:20,109 - DEBUG - Route Targets: ['target:64512:8000004']
2026-02-10 18:21:20,109 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-network/f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:20,121 - DEBUG - Requesting: http://10.0.0.129:8082/routing-instance/b1b5e172-a959-4d85-98ad-2439054ea15f
2026-02-10 18:21:20,140 - INFO - Verified VN network id 10 for VN f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:20,140 - INFO - Verifications in API Server for VN ctest-vn-51922517 passed
2026-02-10 18:21:20,140 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-network/f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:20,152 - DEBUG - Requesting: http://10.0.0.129:8082/routing-instance/b1b5e172-a959-4d85-98ad-2439054ea15f
2026-02-10 18:21:20,163 - DEBUG - Requesting: http://10.0.0.129:8082/routing-instance/b1b5e172-a959-4d85-98ad-2439054ea15f
2026-02-10 18:21:20,173 - DEBUG - Requesting: http://10.0.0.129:8082/route-target/45b6653b-c355-4679-b386-9539841f1131
2026-02-10 18:21:20,189 - DEBUG - Control-node 10.0.0.129 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-05309123:ctest-vn-51922517', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-05309123', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17680403573958132132', 'uuid-lslong': '10106567903058376980'}, 'enable': 'true', 'created': '2026-02-10T18:21:16', 'last-modified': '2026-02-10T18:21:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.405911'}
2026-02-10 18:21:20,197 - DEBUG - Route Targets: ['target:64512:8000004']
2026-02-10 18:21:20,198 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-51922517 passed
2026-02-10 18:21:20,198 - DEBUG - ====Verifying policy data for ctest-vn-51922517 in API_Server ======
2026-02-10 18:21:20,198 - DEBUG - Requesting: http://10.0.0.129:8082/domains
2026-02-10 18:21:20,205 - DEBUG - Requesting: http://10.0.0.129:8082/domain/e57ea2d5-65ff-4fe2-a66b-03789a16f1b1
2026-02-10 18:21:20,221 - DEBUG - Requesting: http://10.0.0.129:8082/project/dc16ad31-6fb9-4f0a-ac91-39f1310bb2af
2026-02-10 18:21:20,298 - DEBUG - Requesting: http://10.0.0.129:8082/virtual-network/f55d6960-2f52-41a4-8c41-bdf60028b914
2026-02-10 18:21:20,310 - DEBUG - =>VN ctest-vn-51922517 has no policy to be verified
2026-02-10 18:21:20,310 - DEBUG - Verifying the vn in opserver
2026-02-10 18:21:20,310 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-05309123:ctest-vn-51922517 virtual network link  through opserver 10.0.0.129
2026-02-10 18:21:20,310 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-02-10 18:21:20,606 - DEBUG - Requesting: http://10.0.0.129:8081/analytics/uves/virtual-networks
2026-02-10 18:21:20,670 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-05309123:ctest-vn-51922517', 'href': 'http://10.0.0.129:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-05309123:ctest-vn-51922517?flat'}
2026-02-10 18:21:20,670 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-05309123:ctest-vn-51922517 is found in opserver
2026-02-10 18:21:20,683 - DEBUG - Do not have enough data to verify VN in agent
2026-02-10 18:21:20,690 - DEBUG - VRF ids for VN ctest-vn-51922517: {}
2026-02-10 18:21:20,690 - INFO - Waiting for VM ctest-TestBasicVMVN-05309123-00368857 to be up..
2026-02-10 18:21:20,767 - DEBUG - VM <Server: ctest-TestBasicVMVN-05309123-00368857> is in ERROR state now
2026-02-10 18:21:20,768 - ERROR - VM in error state.
2026-02-10 18:21:20,768 - ERROR - VM is not in ACTIVE state
2026-02-10 18:21:20,854 - ERROR - Fatal Nova Exception while getting VM detail
2026-02-10 18:21:20,854 - DEBUG - None
2026-02-10 18:21:20,855 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-05309123-08492038 in state ERROR
2026-02-10 18:21:20,855 - INFO - Deleting VM ctest-TestBasicVMVN-05309123-08492038
2026-02-10 18:21:20,855 - ERROR - VM ctest-TestBasicVMVN-05309123-08492038 has failed to come up
2026-02-10 18:21:20,856 - ERROR - Fault seen in nova show <vm-uuid> is:  {'code': 500, 'created': '2026-02-10T18:21:19Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n    instance_uuids, return_alternates=True)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n    return_alternates=return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n    instance_uuids, return_objects, return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n    return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n    retry=self.retry, transport_options=self.transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n    raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n    return func(*args, **kwargs)\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n    raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-02-10 18:21:20,856 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-05309123-33871599 in state BUILD
2026-02-10 18:21:20,856 - INFO - Deleting VM ctest-TestBasicVMVN-05309123-33871599
2026-02-10 18:21:20,856 - ERROR - VM ctest-TestBasicVMVN-05309123-33871599 has failed to come up
2026-02-10 18:21:20,856 - ERROR - Nova failed to get host of the VM
2026-02-10 18:21:21,027 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-05309123-00368857 in state ERROR
2026-02-10 18:21:21,027 - INFO - Deleting VM ctest-TestBasicVMVN-05309123-00368857
2026-02-10 18:21:21,027 - ERROR - VM ctest-TestBasicVMVN-05309123-00368857 has failed to come up
2026-02-10 18:21:21,027 - ERROR - Fault seen in nova show <vm-uuid> is:  {'code': 500, 'created': '2026-02-10T18:21:18Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n    instance_uuids, return_alternates=True)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n    return_alternates=return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n    instance_uuids, return_objects, return_alternates)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n    return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n    retry=self.retry, transport_options=self.transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n    transport_options=transport_options)\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n    raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n    return func(*args, **kwargs)\n\n  File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n    raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-02-10 18:21:21,028 - INFO - Deleting VN ctest-vn-51922517 
2026-02-10 18:21:21,141 - DEBUG - Response for delete_port : ()
2026-02-10 18:21:21,251 - DEBUG - Response for delete_port : ()
2026-02-10 18:21:21,360 - DEBUG - Response for deleting network ()
2026-02-10 18:21:21,361 - DEBUG - Requesting: http://10.0.0.129:8082/routing-instance/b1b5e172-a959-4d85-98ad-2439054ea15f
2026-02-10 18:21:21,367 - DEBUG - Response Code: 404
2026-02-10 18:21:21,367 - DEBUG - Requesting: http://10.0.0.129:8082/domains
2026-02-10 18:21:21,372 - DEBUG - Requesting: http://10.0.0.129:8082/domain/e57ea2d5-65ff-4fe2-a66b-03789a16f1b1
2026-02-10 18:21:21,425 - DEBUG - Requesting: http://10.0.0.129:8082/project/dc16ad31-6fb9-4f0a-ac91-39f1310bb2af
2026-02-10 18:21:21,503 - INFO - Validated that VN ctest-vn-51922517 is not found in API Server
2026-02-10 18:21:21,515 - DEBUG - VN ctest-vn-51922517 is not present in Agent 10.0.0.129 
2026-02-10 18:21:21,515 - INFO - Validated that VN ctest-vn-51922517 is not in any agent
2026-02-10 18:21:21,529 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-51922517 info
2026-02-10 18:21:21,607 - INFO - IPAM: ctest-ipam-52876204 is not found in API Server
2026-02-10 18:21:21,619 - INFO - IPAM:ctest-ipam-52876204 is not found in control node
2026-02-10 18:21:21,890 - ERROR - AssertionError
Python 3.9.25: /usr/bin/python3
Tue Feb 10 18:21:20 2026

A problem occurred in a Python script.  Here is the sequence of
function calls leading up to the error, in the order they occurred.

 /contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7fc41c4a6190>, *args=(), **kwargs={})
   78             log.info('Initial checks done. Running the testcase now')
   79             log.info('')
   80             result = function(self, *args, **kwargs)
   81             if self.inputs.upgrade:
   82                 pid = os.getpid()
result = None
function = <function TestBasicVMVN.test_ping_within_vn_two_vms_two_different_subnets>
self = <scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7fc41c4a6190>
args = ()
kwargs = {}

 /contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7fc41c4a6190>)
  145         assert ipam_obj.verify_on_setup()
  146         assert vn1_fixture.verify_on_setup()
  147         assert vm1.wait_till_vm_is_up()
  148         assert vm2.wait_till_vm_is_up()
  149         assert vm3.wait_till_vm_is_up()
vm1 = <VMFixture: ctest-TestBasicVMVN-05309123-00368857>
vm1.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVN-05309123-00368857>>
AssertionError: 
    __cause__ = None
    __class__ = <class 'AssertionError'>
    __context__ = None
    __delattr__ = <method-wrapper '__delattr__' of AssertionError object>
    __dict__ = {}
    __dir__ = <built-in method __dir__ of AssertionError object>
    __doc__ = 'Assertion failed.'
    __eq__ = <method-wrapper '__eq__' of AssertionError object>
    __format__ = <built-in method __format__ of AssertionError object>
    __ge__ = <method-wrapper '__ge__' of AssertionError object>
    __getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
    __gt__ = <method-wrapper '__gt__' of AssertionError object>
    __hash__ = <method-wrapper '__hash__' of AssertionError object>
    __init__ = <method-wrapper '__init__' of AssertionError object>
    __init_subclass__ = <built-in method __init_subclass__ of type object>
    __le__ = <method-wrapper '__le__' of AssertionError object>
    __lt__ = <method-wrapper '__lt__' of AssertionError object>
    __ne__ = <method-wrapper '__ne__' of AssertionError object>
    __new__ = <built-in method __new__ of type object>
    __reduce__ = <built-in method __reduce__ of AssertionError object>
    __reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
    __repr__ = <method-wrapper '__repr__' of AssertionError object>
    __setattr__ = <method-wrapper '__setattr__' of AssertionError object>
    __setstate__ = <built-in method __setstate__ of AssertionError object>
    __sizeof__ = <built-in method __sizeof__ of AssertionError object>
    __str__ = <method-wrapper '__str__' of AssertionError object>
    __subclasshook__ = <built-in method __subclasshook__ of type object>
    __suppress_context__ = False
    __traceback__ = <traceback object>
    args = ()
    with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program.  Here is
the original traceback:

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 147, in test_ping_within_vn_two_vms_two_different_subnets
    assert vm1.wait_till_vm_is_up()
AssertionError



2026-02-10 18:21:21,897 - DEBUG - No XMPP flaps were noticed during the test
2026-02-10 18:21:21,897 - INFO - 
2026-02-10 18:21:21,897 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:06]
2026-02-10 18:21:21,897 - INFO - --------------------------------------------------------------------------------
2026-02-10 18:21:22,639 - INFO - Deleted project: ctest-TestBasicVMVN-05309123, ID : dc16ad31-6fb9-4f0a-ac91-39f1310bb2af