2025-06-30 16:38:55,293 - INFO - Domain Default found not creating 2025-06-30 16:38:55,453 - INFO - Project ctest-TestBasicVMVN-72609679 not found, creating it 2025-06-30 16:38:55,958 - INFO - Created Project:ctest-TestBasicVMVN-72609679, ID : d075459d-75bf-4334-a5f7-0a36701df99e 2025-06-30 16:38:57,570 - INFO - ================================================================================ 2025-06-30 16:38:57,570 - INFO - STARTING TEST : test_generic_link_local_service 2025-06-30 16:38:57,570 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-06-30 16:38:57,831 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.38': '0'}} with 2025-06-30 16:38:57,831 - INFO - Initial checks done. Running the testcase now 2025-06-30 16:38:57,831 - INFO - 2025-06-30 16:38:58,446 - DEBUG - Response for create_network : {'network': {'id': 'a143a0af-673e-4182-8622-038022fe18fa', 'name': 'ctest-vn2_metadata-84983890', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'project_id': 'd075459d75bf4334a5f70a36701df99e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-72609679', 'ctest-vn2_metadata-84983890'], 'port_security_enabled': True, 'description': ''}} 2025-06-30 16:38:58,695 - DEBUG - Response for create_subnet : {'subnet': {'id': '565f7d50-973f-4bc6-8512-eb4d41b9b829', 'name': '', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'network_id': 'a143a0af-673e-4182-8622-038022fe18fa', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'd075459d75bf4334a5f70a36701df99e'}} 2025-06-30 16:38:58,717 - INFO - Created VN ctest-vn2_metadata-84983890 2025-06-30 16:38:58,770 - DEBUG - VN ctest-vn2_metadata-84983890 UUID is a143a0af-673e-4182-8622-038022fe18fa 2025-06-30 16:38:58,998 - DEBUG - Services list from nova: [, , ] 2025-06-30 16:39:00,234 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:39:00,341 - DEBUG - Link local service introspect added 2025-06-30 16:39:00,385 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-06-30 16:39:05,481 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:39:05,627 - INFO - Waiting for VM ctest-TestBasicVMVN-72609679-94797234 to be up.. 2025-06-30 16:39:05,627 - INFO - VM name : ctest-TestBasicVMVN-72609679-94797234 2025-06-30 16:39:05,738 - DEBUG - VM ctest-TestBasicVMVN-72609679-94797234 ID is 2de0c113-9424-4be3-b4fd-83a5da0f621e 2025-06-30 16:39:05,738 - DEBUG - VM ctest-TestBasicVMVN-72609679-94797234 launched on Node cn-jenkins-deploy-platform-ansible-os-3582-1. 2025-06-30 16:39:05,833 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/2de0c113-9424-4be3-b4fd-83a5da0f621e 2025-06-30 16:39:06,169 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/2de0c113-9424-4be3-b4fd-83a5da0f621e 2025-06-30 16:39:06,204 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/2e934af4-7d76-4aec-ae4f-edd5b9ef1c99 2025-06-30 16:39:09,482 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-06-30 16:39:09,482 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72609679-94797234 failed! 2025-06-30 16:39:09,550 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-72609679:ctest-vn2_metadata-84983890 is 11.1.1.1 and allocation pool is NOT set 2025-06-30 16:39:11,615 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=10.4 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.902 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.902/5.664/10.427/4.762 ms') 2025-06-30 16:39:11,616 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72609679-94797234 passed 2025-06-30 16:39:11,774 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:39:11,774 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-72609679-94797234, IP 11.1.1.3, Port 22 2025-06-30 16:39:11,854 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:39:11,964 - DEBUG - VM ctest-TestBasicVMVN-72609679-94797234 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:39:16,966 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:39:16,966 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-72609679-94797234, IP 11.1.1.3, Port 22 2025-06-30 16:39:17,121 - DEBUG - VM ctest-TestBasicVMVN-72609679-94797234 is ready for SSH connections 2025-06-30 16:39:17,122 - INFO - Retry 0 2025-06-30 16:39:17,122 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-06-30 16:39:17,122 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-06-30 16:39:19,179 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-06-30 16:39:19,179 - INFO - Generic metadata worked 2025-06-30 16:39:19,453 - DEBUG - Link local service introspect removed 2025-06-30 16:39:19,453 - INFO - Deleting VM ctest-TestBasicVMVN-72609679-94797234 2025-06-30 16:39:19,535 - INFO - Deleting VN ctest-vn2_metadata-84983890 2025-06-30 16:39:19,590 - DEBUG - VN a143a0af-673e-4182-8622-038022fe18fa still in use: Unable to complete operation on network a143a0af-673e-4182-8622-038022fe18fa. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-73b2d39a-6058-482d-b8c8-51a77aaad533'] 2025-06-30 16:39:19,590 - WARNING - Deleting VN ctest-vn2_metadata-84983890 failed..Will retry 2025-06-30 16:39:21,713 - DEBUG - Response for deleting network () 2025-06-30 16:39:21,984 - DEBUG - No XMPP flaps were noticed during the test 2025-06-30 16:39:21,984 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:24] 2025-06-30 16:39:21,984 - INFO - -------------------------------------------------------------------------------- 2025-06-30 16:39:21,988 - INFO - ================================================================================ 2025-06-30 16:39:21,988 - INFO - STARTING TEST : test_metadata_service 2025-06-30 16:39:21,988 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2025-06-30 16:39:22,303 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.38': '0'}} with 2025-06-30 16:39:22,303 - INFO - Initial checks done. Running the testcase now 2025-06-30 16:39:22,304 - INFO - 2025-06-30 16:39:22,304 - DEBUG - Requesting: http://10.0.0.38:8082/global-vrouter-configs 2025-06-30 16:39:22,316 - DEBUG - Requesting: http://10.0.0.38:8082/global-vrouter-config/aebd5cb1-09de-4a0e-b95d-894c0d8b15f3 2025-06-30 16:39:22,562 - DEBUG - Response for create_network : {'network': {'id': '1d87dbca-8795-40a5-b1d1-56e6175a22ad', 'name': 'ctest-vn-86971074', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'project_id': 'd075459d75bf4334a5f70a36701df99e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-72609679', 'ctest-vn-86971074'], 'port_security_enabled': True, 'description': ''}} 2025-06-30 16:39:22,737 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c21313c6-3525-4a10-8d56-bf2936717da5', 'name': '', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'network_id': '1d87dbca-8795-40a5-b1d1-56e6175a22ad', 'ip_version': 4, 'cidr': '93.247.49.0/26', 'allocation_pools': [{'start': '93.247.49.2', 'end': '93.247.49.62'}], 'gateway_ip': '93.247.49.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '93.247.49.2', 'tags': [], 'project_id': 'd075459d75bf4334a5f70a36701df99e'}} 2025-06-30 16:39:22,761 - INFO - Created VN ctest-vn-86971074 2025-06-30 16:39:22,813 - DEBUG - VN ctest-vn-86971074 UUID is 1d87dbca-8795-40a5-b1d1-56e6175a22ad 2025-06-30 16:39:24,108 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:39:24,108 - INFO - Waiting for VM ctest-TestBasicVMVN-72609679-27511549 to be up.. 2025-06-30 16:39:24,153 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-06-30 16:39:29,247 - DEBUG - VM is in ACTIVE state now 2025-06-30 16:39:29,247 - INFO - VM name : ctest-TestBasicVMVN-72609679-27511549 2025-06-30 16:39:29,350 - DEBUG - VM ctest-TestBasicVMVN-72609679-27511549 ID is 7fc5501b-9b07-4f21-9ae3-c1553ab58e53 2025-06-30 16:39:29,350 - DEBUG - VM ctest-TestBasicVMVN-72609679-27511549 launched on Node cn-jenkins-deploy-platform-ansible-os-3582-1. 2025-06-30 16:39:29,456 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/7fc5501b-9b07-4f21-9ae3-c1553ab58e53 2025-06-30 16:39:29,466 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/0e807121-d650-4eca-8bff-37d8c08e3db3 2025-06-30 16:39:32,740 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2025-06-30 16:39:32,740 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72609679-27511549 failed! 2025-06-30 16:39:32,798 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-86971074 is 93.247.49.1 and allocation pool is NOT set 2025-06-30 16:39:34,867 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.05 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.79 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 2.792/5.921/9.050/3.129 ms') 2025-06-30 16:39:34,867 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-72609679-27511549 passed 2025-06-30 16:39:35,021 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:39:35,022 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-72609679-27511549, IP 93.247.49.3, Port 22 2025-06-30 16:39:35,088 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-06-30 16:39:35,190 - DEBUG - VM ctest-TestBasicVMVN-72609679-27511549 is NOT ready for SSH connections, VM status: ACTIVE 2025-06-30 16:39:40,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-06-30 16:39:40,192 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-72609679-27511549, IP 93.247.49.3, Port 22 2025-06-30 16:39:40,364 - DEBUG - VM ctest-TestBasicVMVN-72609679-27511549 is ready for SSH connections 2025-06-30 16:39:40,364 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.38, gateway password: c0ntrail123 2025-06-30 16:39:40,364 - DEBUG - cat /tmp/output.txt 2025-06-30 16:39:42,045 - DEBUG - Hello World. The time is now Mon, 30 Jun 2025 10:39:36 -0600! 2025-06-30 16:39:42,045 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Mon, 30 Jun 2025 10:39:36 -0600!'} 2025-06-30 16:39:42,045 - INFO - metadata_script.txt got executed in the vm 2025-06-30 16:39:42,045 - INFO - Deleting VM ctest-TestBasicVMVN-72609679-27511549 2025-06-30 16:39:42,118 - INFO - Deleting VN ctest-vn-86971074 2025-06-30 16:39:42,176 - DEBUG - VN 1d87dbca-8795-40a5-b1d1-56e6175a22ad still in use: Unable to complete operation on network 1d87dbca-8795-40a5-b1d1-56e6175a22ad. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-99c2bfab-ea68-441a-aa9b-1ac1645601a6'] 2025-06-30 16:39:42,176 - WARNING - Deleting VN ctest-vn-86971074 failed..Will retry 2025-06-30 16:39:44,320 - DEBUG - Response for deleting network () 2025-06-30 16:39:44,589 - DEBUG - No XMPP flaps were noticed during the test 2025-06-30 16:39:44,589 - INFO - END TEST : test_metadata_service : PASSED[0:00:23] 2025-06-30 16:39:44,589 - INFO - -------------------------------------------------------------------------------- 2025-06-30 16:39:44,592 - INFO - ================================================================================ 2025-06-30 16:39:44,592 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-06-30 16:39:44,592 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-06-30 16:39:44,888 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.38': '0'}} with 2025-06-30 16:39:44,889 - INFO - Initial checks done. Running the testcase now 2025-06-30 16:39:44,889 - INFO - 2025-06-30 16:39:45,415 - DEBUG - Response for create_network : {'network': {'id': '23242bb4-0d76-4a94-b8f1-051c7b75929f', 'name': 'ctest-vn-19361696', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'project_id': 'd075459d75bf4334a5f70a36701df99e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-72609679', 'ctest-vn-19361696'], 'port_security_enabled': True, 'description': ''}} 2025-06-30 16:39:45,646 - DEBUG - Response for create_subnet : {'subnet': {'id': '17c905c8-ba8f-41a8-8514-5acbf50f70b8', 'name': '', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'network_id': '23242bb4-0d76-4a94-b8f1-051c7b75929f', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'd075459d75bf4334a5f70a36701df99e'}} 2025-06-30 16:39:45,854 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b3cb2ba7-472c-437f-80f6-e4e758441eac', 'name': '', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'network_id': '23242bb4-0d76-4a94-b8f1-051c7b75929f', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'd075459d75bf4334a5f70a36701df99e'}} 2025-06-30 16:39:45,879 - INFO - Created VN ctest-vn-19361696 2025-06-30 16:39:45,934 - DEBUG - VN ctest-vn-19361696 UUID is 23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:46,330 - DEBUG - Response for create_port : {'port': {'name': '8432e14a-9d0f-485d-802f-9d3b700459b2', 'id': '8432e14a-9d0f-485d-802f-9d3b700459b2', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'network_id': '23242bb4-0d76-4a94-b8f1-051c7b75929f', 'mac_address': '02:84:32:e1:4a:9d', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '17c905c8-ba8f-41a8-8514-5acbf50f70b8'}], 'security_groups': ['372ca40b-0fcc-4223-96fd-831061f7d0af'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'd075459d75bf4334a5f70a36701df99e'}} 2025-06-30 16:39:46,534 - DEBUG - Response for create_port : {'port': {'name': 'a86c97f5-fbd1-4c8d-a29d-d13ee6de3103', 'id': 'a86c97f5-fbd1-4c8d-a29d-d13ee6de3103', 'tenant_id': 'd075459d75bf4334a5f70a36701df99e', 'network_id': '23242bb4-0d76-4a94-b8f1-051c7b75929f', 'mac_address': '02:a8:6c:97:f5:fb', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'b3cb2ba7-472c-437f-80f6-e4e758441eac'}], 'security_groups': ['372ca40b-0fcc-4223-96fd-831061f7d0af'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'd075459d75bf4334a5f70a36701df99e'}} 2025-06-30 16:39:46,959 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:39:47,469 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:39:48,785 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3582-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3582-1) 2025-06-30 16:39:48,785 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:39:48,791 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:39:48,805 - DEBUG - Requesting: http://10.0.0.38:8082/project/d075459d-75bf-4334-a5f7-0a36701df99e 2025-06-30 16:39:48,898 - DEBUG - Requesting: http://10.0.0.38:8082/network-ipam/9e7a1b42-8f0f-4cd6-baf0-0ec393bf9f28 2025-06-30 16:39:48,913 - INFO - Verifications in API Server for IPAM: ctest-ipam-01623348 passed 2025-06-30 16:39:48,919 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-72609679:ctest-ipam-01623348', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-72609679', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11419469777833250006', 'uuid-lslong': '13470282718625373992'}, 'enable': 'true', 'created': '2025-06-30T16:39:44', 'last-modified': '2025-06-30T16:39:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.794079'} 2025-06-30 16:39:48,919 - INFO - Verifications in Control node for IPAM: ctest-ipam-01623348 passed 2025-06-30 16:39:48,920 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:39:48,928 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:39:48,944 - DEBUG - Requesting: http://10.0.0.38:8082/project/d075459d-75bf-4334-a5f7-0a36701df99e 2025-06-30 16:39:49,034 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:49,049 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:49,061 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/16b7dbe7-52f8-4c8e-a887-7690c36a65cc 2025-06-30 16:39:49,071 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/16b7dbe7-52f8-4c8e-a887-7690c36a65cc 2025-06-30 16:39:49,084 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/c858e350-a1d6-4fb0-8510-894ffe271bdc 2025-06-30 16:39:49,107 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-30 16:39:49,107 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:49,118 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/16b7dbe7-52f8-4c8e-a887-7690c36a65cc 2025-06-30 16:39:49,133 - INFO - Verified VN network id 8 for VN 23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:49,133 - INFO - Verifications in API Server for VN ctest-vn-19361696 passed 2025-06-30 16:39:49,133 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:49,144 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/16b7dbe7-52f8-4c8e-a887-7690c36a65cc 2025-06-30 16:39:49,155 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/16b7dbe7-52f8-4c8e-a887-7690c36a65cc 2025-06-30 16:39:49,169 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/c858e350-a1d6-4fb0-8510-894ffe271bdc 2025-06-30 16:39:49,185 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-72609679', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2532196942809025172', 'uuid-lslong': '13326438392254534303'}, 'enable': 'true', 'created': '2025-06-30T16:39:45', 'last-modified': '2025-06-30T16:39:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.364914'} 2025-06-30 16:39:49,195 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-06-30 16:39:49,195 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-19361696 passed 2025-06-30 16:39:49,196 - DEBUG - ====Verifying policy data for ctest-vn-19361696 in API_Server ====== 2025-06-30 16:39:49,196 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-06-30 16:39:49,210 - DEBUG - Requesting: http://10.0.0.38:8082/domain/ad6718b7-0413-433b-bf30-9d76cb024daf 2025-06-30 16:39:49,222 - DEBUG - Requesting: http://10.0.0.38:8082/project/d075459d-75bf-4334-a5f7-0a36701df99e 2025-06-30 16:39:49,321 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/23242bb4-0d76-4a94-b8f1-051c7b75929f 2025-06-30 16:39:49,341 - DEBUG - =>VN ctest-vn-19361696 has no policy to be verified 2025-06-30 16:39:49,341 - DEBUG - Verifying the vn in opserver 2025-06-30 16:39:49,341 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:39:49,341 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:39:49,791 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:39:52,978 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:39:52,978 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:39:55,996 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:39:55,996 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:39:59,009 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:39:59,009 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:02,026 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:02,026 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:05,040 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:05,041 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:08,053 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:08,053 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:11,070 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:11,070 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:14,082 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:14,082 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:17,095 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:17,095 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:20,108 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:20,108 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:23,122 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:23,122 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:26,136 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:26,136 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:29,151 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:29,151 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:32,165 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:32,165 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:35,178 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-72609679:ctest-vn-19361696 virtual network link through opserver 10.0.0.38 2025-06-30 16:40:35,178 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-06-30 16:40:35,190 - ERROR - One or more verifications in OpServer for VN ctest-vn-19361696 failed 2025-06-30 16:40:35,191 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-72609679-14993858 in state BUILD 2025-06-30 16:40:35,191 - INFO - Deleting VM ctest-TestBasicVMVN-72609679-14993858 2025-06-30 16:40:35,191 - ERROR - VM ctest-TestBasicVMVN-72609679-14993858 has failed to come up 2025-06-30 16:40:35,191 - ERROR - Nova failed to get host of the VM 2025-06-30 16:40:35,274 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-72609679-40378202 in state BUILD 2025-06-30 16:40:35,274 - INFO - Deleting VM ctest-TestBasicVMVN-72609679-40378202 2025-06-30 16:40:35,275 - ERROR - VM ctest-TestBasicVMVN-72609679-40378202 has failed to come up 2025-06-30 16:40:35,275 - ERROR - Nova failed to get host of the VM 2025-06-30 16:40:35,358 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-72609679-46233955 in state BUILD 2025-06-30 16:40:35,358 - INFO - Deleting VM ctest-TestBasicVMVN-72609679-46233955 2025-06-30 16:40:35,358 - ERROR - VM ctest-TestBasicVMVN-72609679-46233955 has failed to come up 2025-06-30 16:40:35,359 - ERROR - Nova failed to get host of the VM 2025-06-30 16:40:35,439 - INFO - Deleting VN ctest-vn-19361696 2025-06-30 16:40:35,612 - DEBUG - Response for delete_port : () 2025-06-30 16:40:35,795 - DEBUG - Response for delete_port : () 2025-06-30 16:40:35,839 - DEBUG - VN 23242bb4-0d76-4a94-b8f1-051c7b75929f still in use: Unable to complete operation on network 23242bb4-0d76-4a94-b8f1-051c7b75929f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-89a792fe-eb9d-4dda-b7bc-61a36f523af6'] 2025-06-30 16:40:35,839 - WARNING - Deleting VN ctest-vn-19361696 failed..Will retry 2025-06-30 16:40:37,985 - DEBUG - Response for deleting network () 2025-06-30 16:40:38,078 - INFO - IPAM: ctest-ipam-01623348 is not found in API Server 2025-06-30 16:40:38,093 - INFO - IPAM:ctest-ipam-01623348 is not found in control node 2025-06-30 16:40:38,346 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Jun 30 16:40:35 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=) 144 vm3 = self.create_vm(image_name='cirros', vn_fixture=vn1_fixture) 145 assert ipam_obj.verify_on_setup() 146 assert vn1_fixture.verify_on_setup() 147 assert vm1.wait_till_vm_is_up() 148 assert vm2.wait_till_vm_is_up() vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 146, in test_ping_within_vn_two_vms_two_different_subnets assert vn1_fixture.verify_on_setup() AssertionError 2025-06-30 16:40:38,352 - DEBUG - No XMPP flaps were noticed during the test 2025-06-30 16:40:38,352 - INFO - 2025-06-30 16:40:38,352 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:00:54] 2025-06-30 16:40:38,352 - INFO - -------------------------------------------------------------------------------- 2025-06-30 16:40:39,058 - INFO - Deleted project: ctest-TestBasicVMVN-72609679, ID : d075459d-75bf-4334-a5f7-0a36701df99e