is: {'code': 500, 'created': '2026-01-22T03:16:21Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-01-22 03:16:27,131 - INFO - Deleting VN ctest-vn2_metadata-90307362
2026-01-22 03:16:27,273 - DEBUG - Response for deleting network ()
2026-01-22 03:16:28,529 - ERROR - Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 290, in test_generic_link_local_service
compute_user = self.inputs.host_data[vm1_fixture.vm_node_ip]['username']
File "/contrail-test/fixtures/vm_test.py", line 386, in vm_node_ip
self.get_host_of_vm(refresh=True))
File "/contrail-test/fixtures/vm_test.py", line 400, in get_host_of_vm
assert self.wait_till_vm_is_active()
AssertionError
2026-01-22 03:16:28,541 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 03:16:28,542 - INFO -
2026-01-22 03:16:28,542 - INFO - END TEST : test_generic_link_local_service : FAILED[0:00:10]
2026-01-22 03:16:28,542 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:16:28,549 - INFO - ================================================================================
2026-01-22 03:16:28,549 - INFO - STARTING TEST : test_metadata_service
2026-01-22 03:16:28,549 - INFO - TEST DESCRIPTION :
Description: Test to validate metadata service on VM creation.
1.Verify from global-vrouter-config if metadata configures or not - fails otherwise
2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node
3.Create a vm with userdata pointing to that script - script should get executed during vm boot up
4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise
Maintainer: sandipd@juniper.net
2026-01-22 03:16:29,854 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}} with
2026-01-22 03:16:29,855 - INFO - Initial checks done. Running the testcase now
2026-01-22 03:16:29,855 - INFO -
2026-01-22 03:16:29,855 - DEBUG - Requesting: http://10.0.0.38:8082/global-vrouter-configs
2026-01-22 03:16:30,170 - DEBUG - Requesting: http://10.0.0.38:8082/global-vrouter-configs
2026-01-22 03:16:30,209 - DEBUG - Requesting: http://10.0.0.38:8082/global-vrouter-config/134763ab-e522-46eb-b687-07919a9eeb32
2026-01-22 03:16:30,515 - DEBUG - Response for create_network : {'network': {'id': '26688e7d-d09a-4735-94ba-1a6302551043', 'name': 'ctest-vn-75547315', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-87054456', 'ctest-vn-75547315'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:16:30,716 - DEBUG - Response for create_subnet : {'subnet': {'id': '5f9671e4-9b2b-4019-8741-28ad31d4c345', 'name': '', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'network_id': '26688e7d-d09a-4735-94ba-1a6302551043', 'ip_version': 4, 'cidr': '24.74.177.192/26', 'allocation_pools': [{'start': '24.74.177.194', 'end': '24.74.177.254'}], 'gateway_ip': '24.74.177.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '24.74.177.194', 'tags': [], 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e'}}
2026-01-22 03:16:30,740 - INFO - Created VN ctest-vn-75547315
2026-01-22 03:16:30,751 - DEBUG - VN ctest-vn-75547315 UUID is 26688e7d-d09a-4735-94ba-1a6302551043
2026-01-22 03:16:32,156 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-2)
2026-01-22 03:16:32,157 - INFO - Waiting for VM ctest-TestBasicVMVN-87054456-96381269 to be up..
2026-01-22 03:16:32,206 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-01-22 03:16:37,301 - DEBUG - VM is in ACTIVE state now
2026-01-22 03:16:37,301 - INFO - VM name : ctest-TestBasicVMVN-87054456-96381269
2026-01-22 03:16:37,393 - DEBUG - VM ctest-TestBasicVMVN-87054456-96381269 ID is 5bcc86e7-177a-488c-a4af-2fd8ca72be54
2026-01-22 03:16:37,393 - DEBUG - VM ctest-TestBasicVMVN-87054456-96381269 launched on Node an-jenkins-deploy-platform-ansible-os-5055-2
2026-01-22 03:16:37,477 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/5bcc86e7-177a-488c-a4af-2fd8ca72be54
2026-01-22 03:16:37,793 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/5bcc86e7-177a-488c-a4af-2fd8ca72be54
2026-01-22 03:16:37,829 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/bb4ebc7e-d2c7-4dc9-9955-42bfaa6a43fd
2026-01-22 03:16:40,995 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms')
2026-01-22 03:16:40,995 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87054456-96381269 failed!
2026-01-22 03:16:41,010 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-75547315 is 24.74.177.193 and allocation pool is NOT set
2026-01-22 03:16:45,096 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=8.49 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1019ms\r\nrtt min/avg/max/mdev = 8.493/8.493/8.493/0.000 ms')
2026-01-22 03:16:45,097 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-87054456-96381269 passed
2026-01-22 03:16:45,162 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-22 03:16:45,162 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-87054456-96381269, IP 24.74.177.195, Port 22
2026-01-22 03:16:45,320 - DEBUG - VM ctest-TestBasicVMVN-87054456-96381269 is ready for SSH connections
2026-01-22 03:16:45,320 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.141, gateway password: c0ntrail123
2026-01-22 03:16:45,320 - DEBUG - cat /tmp/output.txt
2026-01-22 03:16:47,307 - DEBUG - Hello World. The time is now Wed, 21 Jan 2026 20:16:43 -0700!
2026-01-22 03:16:47,307 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Wed, 21 Jan 2026 20:16:43 -0700!'}
2026-01-22 03:16:47,308 - INFO - metadata_script.txt got executed in the vm
2026-01-22 03:16:47,308 - INFO - Deleting VM ctest-TestBasicVMVN-87054456-96381269
2026-01-22 03:16:47,420 - INFO - Deleting VN ctest-vn-75547315
2026-01-22 03:16:47,464 - DEBUG - VN 26688e7d-d09a-4735-94ba-1a6302551043 still in use: Unable to complete operation on network 26688e7d-d09a-4735-94ba-1a6302551043. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-01fe830d-4817-48a9-80be-064d66c2a3b0']
2026-01-22 03:16:47,464 - WARNING - Deleting VN ctest-vn-75547315 failed..Will retry
2026-01-22 03:16:49,669 - DEBUG - Response for deleting network ()
2026-01-22 03:16:50,953 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 03:16:50,953 - INFO - END TEST : test_metadata_service : PASSED[0:00:22]
2026-01-22 03:16:50,953 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:16:50,958 - INFO - ================================================================================
2026-01-22 03:16:50,958 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets
2026-01-22 03:16:50,959 - INFO - TEST DESCRIPTION :
Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN
subnets.
Test steps:
1. Create 1 IPAM's.
2. Create 1 VN with 2 subnets and launch 2 VMs in them.
3. Ping between the VMs in the same VN should go thru fine.
4. Ping to the subnet broadcast and all-broadcast address.
Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the
all-broadcast address.
Maintainer : ganeshahv@juniper.net
2026-01-22 03:16:52,233 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.19': '0', '10.20.0.5': '0'}, '10.0.0.141': {'10.20.0.19': '0', '10.20.0.5': '1'}} with
2026-01-22 03:16:52,233 - INFO - Initial checks done. Running the testcase now
2026-01-22 03:16:52,233 - INFO -
2026-01-22 03:16:52,833 - DEBUG - Response for create_network : {'network': {'id': '456ef8df-f923-465d-9412-68ede5dbebd4', 'name': 'ctest-vn-87912533', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-87054456', 'ctest-vn-87912533'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:16:53,083 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e315e24c-b001-4793-b9a3-5fdeec5fc72e', 'name': '', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'network_id': '456ef8df-f923-465d-9412-68ede5dbebd4', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e'}}
2026-01-22 03:16:53,290 - DEBUG - Response for create_subnet : {'subnet': {'id': '7c64f264-e894-4935-a4dc-facb74645a84', 'name': '', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'network_id': '456ef8df-f923-465d-9412-68ede5dbebd4', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e'}}
2026-01-22 03:16:53,315 - INFO - Created VN ctest-vn-87912533
2026-01-22 03:16:53,327 - DEBUG - VN ctest-vn-87912533 UUID is 456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:53,773 - DEBUG - Response for create_port : {'port': {'name': '2155a5dc-31d4-484b-bcae-7f419b4e89e3', 'id': '2155a5dc-31d4-484b-bcae-7f419b4e89e3', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'network_id': '456ef8df-f923-465d-9412-68ede5dbebd4', 'mac_address': '02:21:55:a5:dc:31', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'e315e24c-b001-4793-b9a3-5fdeec5fc72e'}], 'security_groups': ['67938dcb-db40-4591-9619-f2b5cc41c133'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e'}}
2026-01-22 03:16:54,005 - DEBUG - Response for create_port : {'port': {'name': 'd1f3bc31-2f63-4d7c-928c-1a0818d29d4b', 'id': 'd1f3bc31-2f63-4d7c-928c-1a0818d29d4b', 'tenant_id': 'c2dd73ca8e2841f78f6b95b2e018432e', 'network_id': '456ef8df-f923-465d-9412-68ede5dbebd4', 'mac_address': '02:d1:f3:bc:31:2f', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '7c64f264-e894-4935-a4dc-facb74645a84'}], 'security_groups': ['67938dcb-db40-4591-9619-f2b5cc41c133'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'c2dd73ca8e2841f78f6b95b2e018432e'}}
2026-01-22 03:16:54,669 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 03:16:55,302 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-2)
2026-01-22 03:16:56,709 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5055-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5055-1)
2026-01-22 03:16:56,710 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:16:56,717 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:16:56,745 - DEBUG - Requesting: http://10.0.0.38:8082/project/c2dd73ca-8e28-41f7-8f6b-95b2e018432e
2026-01-22 03:16:56,862 - DEBUG - Requesting: http://10.0.0.38:8082/network-ipam/ef20ae28-8a4a-4766-9106-28f4283e16ed
2026-01-22 03:16:56,874 - INFO - Verifications in API Server for IPAM: ctest-ipam-22597519 passed
2026-01-22 03:16:56,881 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-87054456:ctest-ipam-22597519', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87054456', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17230963663461566310', 'uuid-lslong': '10450085014472103661'}, 'enable': 'true', 'created': '2026-01-22T03:16:52', 'last-modified': '2026-01-22T03:16:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.381638'}
2026-01-22 03:16:56,886 - DEBUG - Control-node 10.0.0.50 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-87054456:ctest-ipam-22597519', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87054456', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17230963663461566310', 'uuid-lslong': '10450085014472103661'}, 'enable': 'true', 'created': '2026-01-22T03:16:52', 'last-modified': '2026-01-22T03:16:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.388738'}
2026-01-22 03:16:56,891 - DEBUG - Control-node 10.0.0.131 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-87054456:ctest-ipam-22597519', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87054456', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17230963663461566310', 'uuid-lslong': '10450085014472103661'}, 'enable': 'true', 'created': '2026-01-22T03:16:52', 'last-modified': '2026-01-22T03:16:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.393890'}
2026-01-22 03:16:56,891 - INFO - Verifications in Control node for IPAM: ctest-ipam-22597519 passed
2026-01-22 03:16:56,891 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:16:56,898 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:16:56,908 - DEBUG - Requesting: http://10.0.0.38:8082/project/c2dd73ca-8e28-41f7-8f6b-95b2e018432e
2026-01-22 03:16:56,999 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:57,016 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:57,027 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/8c0bc1b6-f1d8-441e-baf8-fdac36335f6c
2026-01-22 03:16:57,039 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/8c0bc1b6-f1d8-441e-baf8-fdac36335f6c
2026-01-22 03:16:57,047 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/321e1475-56d4-4251-b238-df9e55ec36cd
2026-01-22 03:16:57,056 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:16:57,056 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:57,069 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/8c0bc1b6-f1d8-441e-baf8-fdac36335f6c
2026-01-22 03:16:57,086 - INFO - Verified VN network id 12 for VN 456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:57,086 - INFO - Verifications in API Server for VN ctest-vn-87912533 passed
2026-01-22 03:16:57,086 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:57,096 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/8c0bc1b6-f1d8-441e-baf8-fdac36335f6c
2026-01-22 03:16:57,104 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/8c0bc1b6-f1d8-441e-baf8-fdac36335f6c
2026-01-22 03:16:57,112 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/321e1475-56d4-4251-b238-df9e55ec36cd
2026-01-22 03:16:57,124 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533', 'interests': '1', 'advertised': '1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87054456', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5003209876896433757', 'uuid-lslong': '10669705838167059412'}, 'enable': 'true', 'created': '2026-01-22T03:16:52', 'last-modified': '2026-01-22T03:16:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.885713'}
2026-01-22 03:16:57,131 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:16:57,137 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87054456', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5003209876896433757', 'uuid-lslong': '10669705838167059412'}, 'enable': 'true', 'created': '2026-01-22T03:16:52', 'last-modified': '2026-01-22T03:16:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.897669'}
2026-01-22 03:16:57,144 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:16:57,149 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-87054456', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5003209876896433757', 'uuid-lslong': '10669705838167059412'}, 'enable': 'true', 'created': '2026-01-22T03:16:52', 'last-modified': '2026-01-22T03:16:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.917665'}
2026-01-22 03:16:57,154 - DEBUG - Route Targets: ['target:64512:8000004']
2026-01-22 03:16:57,154 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-87912533 passed
2026-01-22 03:16:57,155 - DEBUG - ====Verifying policy data for ctest-vn-87912533 in API_Server ======
2026-01-22 03:16:57,155 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:16:57,161 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:16:57,172 - DEBUG - Requesting: http://10.0.0.38:8082/project/c2dd73ca-8e28-41f7-8f6b-95b2e018432e
2026-01-22 03:16:57,268 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/456ef8df-f923-465d-9412-68ede5dbebd4
2026-01-22 03:16:57,280 - DEBUG - =>VN ctest-vn-87912533 has no policy to be verified
2026-01-22 03:16:57,280 - DEBUG - Verifying the vn in opserver
2026-01-22 03:16:57,280 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533 virtual network link through opserver 10.0.0.38
2026-01-22 03:16:57,280 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:16:57,584 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:16:57,650 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533?flat'}
2026-01-22 03:16:57,650 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533 virtual network link through opserver 10.0.0.50
2026-01-22 03:16:57,650 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:16:57,960 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:16:58,025 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533?flat'}
2026-01-22 03:16:58,025 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533 virtual network link through opserver 10.0.0.131
2026-01-22 03:16:58,025 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:16:58,342 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:16:58,409 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533?flat'}
2026-01-22 03:16:58,409 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533 is found in opserver
2026-01-22 03:16:58,419 - DEBUG - VRF ids for VN ctest-vn-87912533: {'10.0.0.141': '2'}
2026-01-22 03:16:58,419 - INFO - Waiting for VM ctest-TestBasicVMVN-87054456-99392058 to be up..
2026-01-22 03:16:58,476 - DEBUG - VM is in ERROR state now
2026-01-22 03:16:58,476 - ERROR - VM in error state.
2026-01-22 03:16:58,476 - ERROR - VM is not in ACTIVE state
2026-01-22 03:16:58,551 - ERROR - Fatal Nova Exception while getting VM detail
2026-01-22 03:16:58,551 - DEBUG - None
2026-01-22 03:16:58,552 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-87054456-58702976 in state ERROR
2026-01-22 03:16:58,552 - INFO - Deleting VM ctest-TestBasicVMVN-87054456-58702976
2026-01-22 03:16:58,552 - ERROR - VM ctest-TestBasicVMVN-87054456-58702976 has failed to come up
2026-01-22 03:16:58,552 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-01-22T03:16:56Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-01-22 03:16:58,552 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-87054456-95551683 in state BUILD
2026-01-22 03:16:58,552 - INFO - Deleting VM ctest-TestBasicVMVN-87054456-95551683
2026-01-22 03:16:58,552 - ERROR - VM ctest-TestBasicVMVN-87054456-95551683 has failed to come up
2026-01-22 03:16:58,552 - ERROR - Nova failed to get host of the VM
2026-01-22 03:16:58,552 - ERROR - VM ctest-TestBasicVMVN-87054456-95551683 has failed to come up
2026-01-22 03:16:58,552 - ERROR - Nova failed to get host of the VM
2026-01-22 03:16:58,619 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-87054456-99392058 in state ERROR
2026-01-22 03:16:58,619 - INFO - Deleting VM ctest-TestBasicVMVN-87054456-99392058
2026-01-22 03:16:58,619 - ERROR - VM ctest-TestBasicVMVN-87054456-99392058 has failed to come up
2026-01-22 03:16:58,619 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-01-22T03:16:54Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 1581, in schedule_and_build_instances\n instance_uuids, return_alternates=True)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n return_alternates=return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/client/query.py", line 42, in select_destinations\n instance_uuids, return_objects, return_alternates)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/client.py", line 192, in call\n retry=self.retry, transport_options=self.transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/transport.py", line 128, in _send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 691, in send\n transport_options=transport_options)\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 241, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib/python3.6/site-packages/nova/scheduler/manager.py", line 209, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'}
2026-01-22 03:16:58,619 - INFO - Deleting VN ctest-vn-87912533
2026-01-22 03:16:58,787 - DEBUG - Response for delete_port : ()
2026-01-22 03:16:59,045 - DEBUG - Response for delete_port : ()
2026-01-22 03:16:59,258 - DEBUG - Response for deleting network ()
2026-01-22 03:16:59,258 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/8c0bc1b6-f1d8-441e-baf8-fdac36335f6c
2026-01-22 03:16:59,265 - DEBUG - Response Code: 404
2026-01-22 03:16:59,265 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:16:59,271 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:16:59,285 - DEBUG - Requesting: http://10.0.0.38:8082/project/c2dd73ca-8e28-41f7-8f6b-95b2e018432e
2026-01-22 03:16:59,387 - INFO - Validated that VN ctest-vn-87912533 is not found in API Server
2026-01-22 03:16:59,404 - DEBUG - VN ctest-vn-87912533 is not present in Agent 10.0.0.23
2026-01-22 03:16:59,418 - DEBUG - VN ctest-vn-87912533 is not present in Agent 10.0.0.141
2026-01-22 03:16:59,418 - INFO - Validated that VN ctest-vn-87912533 is not in any agent
2026-01-22 03:16:59,427 - DEBUG - VRF 2 is not seen in agent 10.0.0.141
2026-01-22 03:16:59,434 - DEBUG - Vrouter 10.0.0.141 does not have vrf 2 for VN ctest-vn-87912533
2026-01-22 03:16:59,434 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-87054456:ctest-vn-87912533
2026-01-22 03:16:59,454 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-87912533 info
2026-01-22 03:16:59,543 - INFO - IPAM: ctest-ipam-22597519 is not found in API Server
2026-01-22 03:16:59,562 - INFO - IPAM:ctest-ipam-22597519 is not found in control node
2026-01-22 03:17:00,817 - ERROR - AssertionError
Python 3.9.21: /usr/bin/python3
Thu Jan 22 03:16:58 2026
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=)
145 assert ipam_obj.verify_on_setup()
146 assert vn1_fixture.verify_on_setup()
147 assert vm1.wait_till_vm_is_up()
148 assert vm2.wait_till_vm_is_up()
149 assert vm3.wait_till_vm_is_up()
vm1 =
vm1.wait_till_vm_is_up = >
AssertionError:
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ()
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 147, in test_ping_within_vn_two_vms_two_different_subnets
assert vm1.wait_till_vm_is_up()
AssertionError
2026-01-22 03:17:00,833 - DEBUG - No XMPP flaps were noticed during the test
2026-01-22 03:17:00,833 - INFO -
2026-01-22 03:17:00,834 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:10]
2026-01-22 03:17:00,834 - INFO - --------------------------------------------------------------------------------
2026-01-22 03:17:01,599 - INFO - Deleted project: ctest-TestBasicVMVN-87054456, ID : c2dd73ca-8e28-41f7-8f6b-95b2e018432e