2025-07-01 14:57:38,061 - INFO - Domain Default found not creating 2025-07-01 14:57:38,201 - INFO - Project ctest-TestBasicVMVN-46574737 not found, creating it 2025-07-01 14:57:38,631 - INFO - Created Project:ctest-TestBasicVMVN-46574737, ID : eb61194b-5239-460a-ad33-c2096f7f484f 2025-07-01 14:57:40,051 - INFO - ================================================================================ 2025-07-01 14:57:40,051 - INFO - STARTING TEST : test_generic_link_local_service 2025-07-01 14:57:40,051 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-07-01 14:57:40,308 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.49': '0'}} with 2025-07-01 14:57:40,308 - INFO - Initial checks done. Running the testcase now 2025-07-01 14:57:40,308 - INFO - 2025-07-01 14:57:40,844 - DEBUG - Response for create_network : {'network': {'id': '9bd900c5-0815-4582-bb2a-1da6ec2bd110', 'name': 'ctest-vn2_metadata-73298355', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'project_id': 'eb61194b5239460aad33c2096f7f484f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-46574737', 'ctest-vn2_metadata-73298355'], 'port_security_enabled': True, 'description': ''}} 2025-07-01 14:57:41,028 - DEBUG - Response for create_subnet : {'subnet': {'id': '24eccea4-4198-4230-824c-2eec3bb1eb7e', 'name': '', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'network_id': '9bd900c5-0815-4582-bb2a-1da6ec2bd110', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'eb61194b5239460aad33c2096f7f484f'}} 2025-07-01 14:57:41,044 - INFO - Created VN ctest-vn2_metadata-73298355 2025-07-01 14:57:41,093 - DEBUG - VN ctest-vn2_metadata-73298355 UUID is 9bd900c5-0815-4582-bb2a-1da6ec2bd110 2025-07-01 14:57:41,271 - DEBUG - Services list from nova: [, , ] 2025-07-01 14:57:42,304 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3587-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3587-1) 2025-07-01 14:57:42,409 - DEBUG - Link local service introspect added 2025-07-01 14:57:42,450 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-01 14:57:47,531 - DEBUG - VM is in ACTIVE state now 2025-07-01 14:57:47,666 - INFO - Waiting for VM ctest-TestBasicVMVN-46574737-23673255 to be up.. 2025-07-01 14:57:47,666 - INFO - VM name : ctest-TestBasicVMVN-46574737-23673255 2025-07-01 14:57:47,744 - DEBUG - VM ctest-TestBasicVMVN-46574737-23673255 ID is 650b8c18-e4ff-43e7-8210-2c1910e8cf14 2025-07-01 14:57:47,744 - DEBUG - VM ctest-TestBasicVMVN-46574737-23673255 launched on Node cn-jenkins-deploy-platform-ansible-os-3587-1. 2025-07-01 14:57:47,833 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/650b8c18-e4ff-43e7-8210-2c1910e8cf14 2025-07-01 14:57:48,134 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/650b8c18-e4ff-43e7-8210-2c1910e8cf14 2025-07-01 14:57:48,165 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/ec613aa5-3777-47b6-a412-26d47f4c6357 2025-07-01 14:57:51,417 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-07-01 14:57:51,417 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-46574737-23673255 failed! 2025-07-01 14:57:51,473 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-46574737:ctest-vn2_metadata-73298355 is 11.1.1.1 and allocation pool is NOT set 2025-07-01 14:57:53,542 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.26 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.596 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.596/4.925/9.255/4.329 ms') 2025-07-01 14:57:53,542 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-46574737-23673255 passed 2025-07-01 14:57:53,693 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-01 14:57:53,693 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-46574737-23673255, IP 11.1.1.3, Port 22 2025-07-01 14:57:53,848 - DEBUG - VM ctest-TestBasicVMVN-46574737-23673255 is ready for SSH connections 2025-07-01 14:57:53,848 - INFO - Retry 0 2025-07-01 14:57:53,849 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-07-01 14:57:53,849 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-07-01 14:57:55,839 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-07-01 14:57:55,839 - INFO - Generic metadata worked 2025-07-01 14:57:56,081 - DEBUG - Link local service introspect removed 2025-07-01 14:57:56,081 - INFO - Deleting VM ctest-TestBasicVMVN-46574737-23673255 2025-07-01 14:57:56,146 - INFO - Deleting VN ctest-vn2_metadata-73298355 2025-07-01 14:57:56,185 - DEBUG - VN 9bd900c5-0815-4582-bb2a-1da6ec2bd110 still in use: Unable to complete operation on network 9bd900c5-0815-4582-bb2a-1da6ec2bd110. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8470b408-0f6e-4a1d-a627-1f760654772a'] 2025-07-01 14:57:56,185 - WARNING - Deleting VN ctest-vn2_metadata-73298355 failed..Will retry 2025-07-01 14:57:58,287 - DEBUG - Response for deleting network () 2025-07-01 14:57:58,541 - DEBUG - No XMPP flaps were noticed during the test 2025-07-01 14:57:58,541 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:18] 2025-07-01 14:57:58,541 - INFO - -------------------------------------------------------------------------------- 2025-07-01 14:57:58,544 - INFO - ================================================================================ 2025-07-01 14:57:58,544 - INFO - STARTING TEST : test_metadata_service 2025-07-01 14:57:58,544 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-07-01 14:57:58,830 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.49': '0'}} with 2025-07-01 14:57:58,830 - INFO - Initial checks done. Running the testcase now 2025-07-01 14:57:58,830 - INFO - 2025-07-01 14:57:58,830 - DEBUG - Requesting: http://10.0.0.49:8082/global-vrouter-configs 2025-07-01 14:57:58,836 - DEBUG - Requesting: http://10.0.0.49:8082/global-vrouter-config/a1bbe786-d127-4186-8bba-6462bc1f8e7a 2025-07-01 14:57:59,033 - DEBUG - Response for create_network : {'network': {'id': '6337e7cc-b7a0-4544-8d0f-0e21c706d1b0', 'name': 'ctest-vn-85029270', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'project_id': 'eb61194b5239460aad33c2096f7f484f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-46574737', 'ctest-vn-85029270'], 'port_security_enabled': True, 'description': ''}} 2025-07-01 14:57:59,207 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd96fb201-e868-45b8-808f-bac2bb38eb6f', 'name': '', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'network_id': '6337e7cc-b7a0-4544-8d0f-0e21c706d1b0', 'ip_version': 4, 'cidr': '178.222.6.0/26', 'allocation_pools': [{'start': '178.222.6.2', 'end': '178.222.6.62'}], 'gateway_ip': '178.222.6.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '178.222.6.2', 'tags': [], 'project_id': 'eb61194b5239460aad33c2096f7f484f'}} 2025-07-01 14:57:59,223 - INFO - Created VN ctest-vn-85029270 2025-07-01 14:57:59,273 - DEBUG - VN ctest-vn-85029270 UUID is 6337e7cc-b7a0-4544-8d0f-0e21c706d1b0 2025-07-01 14:58:00,448 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3587-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3587-1) 2025-07-01 14:58:00,448 - INFO - Waiting for VM ctest-TestBasicVMVN-46574737-36624517 to be up.. 2025-07-01 14:58:00,490 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-01 14:58:05,573 - DEBUG - VM is in ACTIVE state now 2025-07-01 14:58:05,573 - INFO - VM name : ctest-TestBasicVMVN-46574737-36624517 2025-07-01 14:58:05,654 - DEBUG - VM ctest-TestBasicVMVN-46574737-36624517 ID is 2ab3015d-14ac-447e-8809-d4cf1bf5e760 2025-07-01 14:58:05,654 - DEBUG - VM ctest-TestBasicVMVN-46574737-36624517 launched on Node cn-jenkins-deploy-platform-ansible-os-3587-1. 2025-07-01 14:58:05,730 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/2ab3015d-14ac-447e-8809-d4cf1bf5e760 2025-07-01 14:58:05,741 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/92483a23-2439-41fb-8d2b-de98e71226be 2025-07-01 14:58:08,976 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-07-01 14:58:08,976 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-46574737-36624517 failed! 2025-07-01 14:58:09,029 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-85029270 is 178.222.6.1 and allocation pool is NOT set 2025-07-01 14:58:11,089 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.61 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.613/3.132/4.652/1.519 ms') 2025-07-01 14:58:11,089 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-46574737-36624517 passed 2025-07-01 14:58:11,237 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-01 14:58:11,237 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-46574737-36624517, IP 178.222.6.3, Port 22 2025-07-01 14:58:11,292 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-07-01 14:58:11,372 - DEBUG - VM ctest-TestBasicVMVN-46574737-36624517 is NOT ready for SSH connections, VM status: ACTIVE 2025-07-01 14:58:16,372 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-01 14:58:16,372 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-46574737-36624517, IP 178.222.6.3, Port 22 2025-07-01 14:58:16,525 - DEBUG - VM ctest-TestBasicVMVN-46574737-36624517 is ready for SSH connections 2025-07-01 14:58:16,525 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-07-01 14:58:16,525 - DEBUG - cat /tmp/output.txt 2025-07-01 14:58:18,139 - DEBUG - Hello World. The time is now Tue, 01 Jul 2025 08:58:12 -0600! 2025-07-01 14:58:18,139 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Tue, 01 Jul 2025 08:58:12 -0600!'} 2025-07-01 14:58:18,139 - INFO - metadata_script.txt got executed in the vm 2025-07-01 14:58:18,139 - INFO - Deleting VM ctest-TestBasicVMVN-46574737-36624517 2025-07-01 14:58:18,204 - INFO - Deleting VN ctest-vn-85029270 2025-07-01 14:58:18,243 - DEBUG - VN 6337e7cc-b7a0-4544-8d0f-0e21c706d1b0 still in use: Unable to complete operation on network 6337e7cc-b7a0-4544-8d0f-0e21c706d1b0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-3e1b3b2b-3d44-4bb0-969e-d7d6bf762c7f'] 2025-07-01 14:58:18,244 - WARNING - Deleting VN ctest-vn-85029270 failed..Will retry 2025-07-01 14:58:20,353 - DEBUG - Response for deleting network () 2025-07-01 14:58:20,610 - DEBUG - No XMPP flaps were noticed during the test 2025-07-01 14:58:20,610 - INFO - END TEST : test_metadata_service : PASSED[0:00:22] 2025-07-01 14:58:20,610 - INFO - -------------------------------------------------------------------------------- 2025-07-01 14:58:20,612 - INFO - ================================================================================ 2025-07-01 14:58:20,612 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-07-01 14:58:20,613 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-07-01 14:58:20,902 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.49': '0'}} with 2025-07-01 14:58:20,902 - INFO - Initial checks done. Running the testcase now 2025-07-01 14:58:20,902 - INFO - 2025-07-01 14:58:21,374 - DEBUG - Response for create_network : {'network': {'id': '79dbdcb0-7146-492a-a578-94e4d1d159bc', 'name': 'ctest-vn-80575181', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'project_id': 'eb61194b5239460aad33c2096f7f484f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-46574737', 'ctest-vn-80575181'], 'port_security_enabled': True, 'description': ''}} 2025-07-01 14:58:21,567 - DEBUG - Response for create_subnet : {'subnet': {'id': '9b845957-8812-4a8b-9cc5-f16b330dfd62', 'name': '', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'network_id': '79dbdcb0-7146-492a-a578-94e4d1d159bc', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'eb61194b5239460aad33c2096f7f484f'}} 2025-07-01 14:58:21,744 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f38d80e2-8318-4245-9ba1-2399ac609347', 'name': '', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'network_id': '79dbdcb0-7146-492a-a578-94e4d1d159bc', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'eb61194b5239460aad33c2096f7f484f'}} 2025-07-01 14:58:21,765 - INFO - Created VN ctest-vn-80575181 2025-07-01 14:58:21,817 - DEBUG - VN ctest-vn-80575181 UUID is 79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:22,159 - DEBUG - Response for create_port : {'port': {'name': '6c35f2b5-de93-4e71-a847-00b6dca6875f', 'id': '6c35f2b5-de93-4e71-a847-00b6dca6875f', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'network_id': '79dbdcb0-7146-492a-a578-94e4d1d159bc', 'mac_address': '02:6c:35:f2:b5:de', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '9b845957-8812-4a8b-9cc5-f16b330dfd62'}], 'security_groups': ['bf30bb39-0fa8-4b34-806d-b129fa1e3348'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'eb61194b5239460aad33c2096f7f484f'}} 2025-07-01 14:58:22,334 - DEBUG - Response for create_port : {'port': {'name': '8436ad4c-922f-409c-9075-186fef98c49e', 'id': '8436ad4c-922f-409c-9075-186fef98c49e', 'tenant_id': 'eb61194b5239460aad33c2096f7f484f', 'network_id': '79dbdcb0-7146-492a-a578-94e4d1d159bc', 'mac_address': '02:84:36:ad:4c:92', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'f38d80e2-8318-4245-9ba1-2399ac609347'}], 'security_groups': ['bf30bb39-0fa8-4b34-806d-b129fa1e3348'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'eb61194b5239460aad33c2096f7f484f'}} 2025-07-01 14:58:22,754 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3587-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3587-1) 2025-07-01 14:58:23,139 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3587-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3587-1) 2025-07-01 14:58:24,312 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3587-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3587-1) 2025-07-01 14:58:24,312 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-07-01 14:58:24,318 - DEBUG - Requesting: http://10.0.0.49:8082/domain/8b0116a9-d93e-48c2-9709-939b3ba99be6 2025-07-01 14:58:24,331 - DEBUG - Requesting: http://10.0.0.49:8082/project/eb61194b-5239-460a-ad33-c2096f7f484f 2025-07-01 14:58:24,407 - DEBUG - Requesting: http://10.0.0.49:8082/network-ipam/7b70987b-0920-4c1c-9e9a-ee2fd2ed5caa 2025-07-01 14:58:24,419 - INFO - Verifications in API Server for IPAM: ctest-ipam-10435446 passed 2025-07-01 14:58:24,424 - DEBUG - Control-node 10.0.0.49 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-46574737:ctest-ipam-10435446', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-46574737', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8894776918258240540', 'uuid-lslong': '11428708893575699626'}, 'enable': 'true', 'created': '2025-07-01T14:58:20', 'last-modified': '2025-07-01T14:58:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.298399'} 2025-07-01 14:58:24,424 - INFO - Verifications in Control node for IPAM: ctest-ipam-10435446 passed 2025-07-01 14:58:24,424 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-07-01 14:58:24,430 - DEBUG - Requesting: http://10.0.0.49:8082/domain/8b0116a9-d93e-48c2-9709-939b3ba99be6 2025-07-01 14:58:24,446 - DEBUG - Requesting: http://10.0.0.49:8082/project/eb61194b-5239-460a-ad33-c2096f7f484f 2025-07-01 14:58:24,552 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:24,565 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:24,583 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8fec68dd-2b2b-4af2-bcbf-0c0d73f76eb8 2025-07-01 14:58:24,590 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8fec68dd-2b2b-4af2-bcbf-0c0d73f76eb8 2025-07-01 14:58:24,597 - DEBUG - Requesting: http://10.0.0.49:8082/route-target/a85898d1-b3fd-4574-9dde-8cbd6e267f1b 2025-07-01 14:58:24,606 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-01 14:58:24,606 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:24,619 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8fec68dd-2b2b-4af2-bcbf-0c0d73f76eb8 2025-07-01 14:58:24,637 - INFO - Verified VN network id 8 for VN 79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:24,637 - INFO - Verifications in API Server for VN ctest-vn-80575181 passed 2025-07-01 14:58:24,637 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:24,652 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8fec68dd-2b2b-4af2-bcbf-0c0d73f76eb8 2025-07-01 14:58:24,659 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/8fec68dd-2b2b-4af2-bcbf-0c0d73f76eb8 2025-07-01 14:58:24,666 - DEBUG - Requesting: http://10.0.0.49:8082/route-target/a85898d1-b3fd-4574-9dde-8cbd6e267f1b 2025-07-01 14:58:24,677 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-46574737', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8780854548861700394', 'uuid-lslong': '11923443723957000636'}, 'enable': 'true', 'created': '2025-07-01T14:58:21', 'last-modified': '2025-07-01T14:58:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.956706'} 2025-07-01 14:58:24,683 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-01 14:58:24,683 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-80575181 passed 2025-07-01 14:58:24,683 - DEBUG - ====Verifying policy data for ctest-vn-80575181 in API_Server ====== 2025-07-01 14:58:24,683 - DEBUG - Requesting: http://10.0.0.49:8082/domains 2025-07-01 14:58:24,688 - DEBUG - Requesting: http://10.0.0.49:8082/domain/8b0116a9-d93e-48c2-9709-939b3ba99be6 2025-07-01 14:58:24,745 - DEBUG - Requesting: http://10.0.0.49:8082/project/eb61194b-5239-460a-ad33-c2096f7f484f 2025-07-01 14:58:24,842 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-network/79dbdcb0-7146-492a-a578-94e4d1d159bc 2025-07-01 14:58:24,865 - DEBUG - =>VN ctest-vn-80575181 has no policy to be verified 2025-07-01 14:58:24,865 - DEBUG - Verifying the vn in opserver 2025-07-01 14:58:24,865 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:24,865 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:25,242 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:28,318 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:28,319 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:31,330 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:31,331 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:34,349 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:34,349 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:37,359 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:37,360 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:40,371 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:40,371 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:43,385 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:43,385 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:46,396 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:46,396 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:49,406 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:49,407 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:52,417 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:52,417 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:55,428 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:55,428 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:58:58,439 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:58:58,439 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:59:01,451 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:59:01,451 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:59:04,463 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:59:04,463 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:59:07,475 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:59:07,475 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:59:10,486 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-46574737:ctest-vn-80575181 virtual network link through opserver 10.0.0.49 2025-07-01 14:59:10,486 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-07-01 14:59:10,499 - ERROR - One or more verifications in OpServer for VN ctest-vn-80575181 failed 2025-07-01 14:59:10,500 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-46574737-18691495 in state BUILD 2025-07-01 14:59:10,501 - INFO - Deleting VM ctest-TestBasicVMVN-46574737-18691495 2025-07-01 14:59:10,501 - ERROR - VM ctest-TestBasicVMVN-46574737-18691495 has failed to come up 2025-07-01 14:59:10,501 - ERROR - Nova failed to get host of the VM 2025-07-01 14:59:10,581 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-46574737-90957574 in state BUILD 2025-07-01 14:59:10,581 - INFO - Deleting VM ctest-TestBasicVMVN-46574737-90957574 2025-07-01 14:59:10,581 - ERROR - VM ctest-TestBasicVMVN-46574737-90957574 has failed to come up 2025-07-01 14:59:10,581 - ERROR - Nova failed to get host of the VM 2025-07-01 14:59:10,763 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-46574737-52965498 in state BUILD 2025-07-01 14:59:10,763 - INFO - Deleting VM ctest-TestBasicVMVN-46574737-52965498 2025-07-01 14:59:10,763 - ERROR - VM ctest-TestBasicVMVN-46574737-52965498 has failed to come up 2025-07-01 14:59:10,764 - ERROR - Nova failed to get host of the VM 2025-07-01 14:59:10,838 - INFO - Deleting VN ctest-vn-80575181 2025-07-01 14:59:10,989 - DEBUG - Response for delete_port : () 2025-07-01 14:59:11,188 - DEBUG - Response for delete_port : () 2025-07-01 14:59:11,236 - DEBUG - VN 79dbdcb0-7146-492a-a578-94e4d1d159bc still in use: Unable to complete operation on network 79dbdcb0-7146-492a-a578-94e4d1d159bc. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1971599c-31cb-4768-9700-4ba1291b082c'] 2025-07-01 14:59:11,236 - WARNING - Deleting VN ctest-vn-80575181 failed..Will retry 2025-07-01 14:59:13,373 - DEBUG - Response for deleting network () 2025-07-01 14:59:13,453 - INFO - IPAM: ctest-ipam-10435446 is not found in API Server 2025-07-01 14:59:13,463 - INFO - IPAM:ctest-ipam-10435446 is not found in control node 2025-07-01 14:59:13,713 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Tue Jul 1 14:59:10 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=) 144 vm3 = self.create_vm(image_name='cirros', vn_fixture=vn1_fixture) 145 assert ipam_obj.verify_on_setup() 146 assert vn1_fixture.verify_on_setup() 147 assert vm1.wait_till_vm_is_up() 148 assert vm2.wait_till_vm_is_up() vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 146, in test_ping_within_vn_two_vms_two_different_subnets assert vn1_fixture.verify_on_setup() AssertionError 2025-07-01 14:59:13,718 - DEBUG - No XMPP flaps were noticed during the test 2025-07-01 14:59:13,719 - INFO - 2025-07-01 14:59:13,719 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:53] 2025-07-01 14:59:13,719 - INFO - -------------------------------------------------------------------------------- 2025-07-01 14:59:14,370 - INFO - Deleted project: ctest-TestBasicVMVN-46574737, ID : eb61194b-5239-460a-ad33-c2096f7f484f