2026-01-26 03:12:15,477 - INFO - Domain Default found not creating 2026-01-26 03:12:15,696 - INFO - Project ctest-TestBasicVMVN-80195183 not found, creating it 2026-01-26 03:12:16,247 - INFO - Created Project:ctest-TestBasicVMVN-80195183, ID : 6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:12:17,722 - INFO - ================================================================================ 2026-01-26 03:12:17,722 - INFO - STARTING TEST : test_generic_link_local_service 2026-01-26 03:12:17,723 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2026-01-26 03:12:19,027 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2026-01-26 03:12:19,027 - INFO - Initial checks done. Running the testcase now 2026-01-26 03:12:19,027 - INFO - 2026-01-26 03:12:19,691 - DEBUG - Response for create_network : {'network': {'id': 'd5c4e969-b205-44d9-916f-15674321dc43', 'name': 'ctest-vn2_metadata-46742717', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-80195183', 'ctest-vn2_metadata-46742717'], 'port_security_enabled': True, 'description': ''}} 2026-01-26 03:12:19,979 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a8efb4d3-b244-4e9a-93b5-6a91306b21ae', 'name': '', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'network_id': 'd5c4e969-b205-44d9-916f-15674321dc43', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff'}} 2026-01-26 03:12:20,003 - INFO - Created VN ctest-vn2_metadata-46742717 2026-01-26 03:12:20,014 - DEBUG - VN ctest-vn2_metadata-46742717 UUID is d5c4e969-b205-44d9-916f-15674321dc43 2026-01-26 03:12:20,169 - DEBUG - Services list from nova: [, , , ] 2026-01-26 03:12:21,247 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5076-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5076-1) 2026-01-26 03:12:21,324 - DEBUG - Link local service introspect added 2026-01-26 03:12:21,368 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-01-26 03:12:26,450 - DEBUG - VM is in ACTIVE state now 2026-01-26 03:12:26,593 - INFO - Waiting for VM ctest-TestBasicVMVN-80195183-38832423 to be up.. 2026-01-26 03:12:26,593 - INFO - VM name : ctest-TestBasicVMVN-80195183-38832423 2026-01-26 03:12:26,673 - DEBUG - VM ctest-TestBasicVMVN-80195183-38832423 ID is 03a4913f-d500-4d01-a5fb-003a8801f1b1 2026-01-26 03:12:26,673 - DEBUG - VM ctest-TestBasicVMVN-80195183-38832423 launched on Node an-jenkins-deploy-platform-ansible-os-5076-1 2026-01-26 03:12:26,752 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/03a4913f-d500-4d01-a5fb-003a8801f1b1 2026-01-26 03:12:27,052 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/03a4913f-d500-4d01-a5fb-003a8801f1b1 2026-01-26 03:12:27,091 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/ba27ccd8-c56a-4509-988e-795ceb0fce5b 2026-01-26 03:12:30,251 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2026-01-26 03:12:30,251 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-80195183-38832423 failed! 2026-01-26 03:12:30,266 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-80195183:ctest-vn2_metadata-46742717 is 11.1.1.1 and allocation pool is NOT set 2026-01-26 03:12:32,331 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.19 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.77 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.765/3.479/4.194/0.714 ms') 2026-01-26 03:12:32,331 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-80195183-38832423 passed 2026-01-26 03:12:32,404 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-26 03:12:32,404 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-80195183-38832423, IP 11.1.1.3, Port 22 2026-01-26 03:12:32,562 - DEBUG - VM ctest-TestBasicVMVN-80195183-38832423 is ready for SSH connections 2026-01-26 03:12:32,562 - INFO - Retry 0 2026-01-26 03:12:32,563 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2026-01-26 03:12:32,563 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2026-01-26 03:12:34,484 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2026-01-26 03:12:34,484 - INFO - Generic metadata worked 2026-01-26 03:12:34,700 - DEBUG - Link local service introspect removed 2026-01-26 03:12:34,700 - INFO - Deleting VM ctest-TestBasicVMVN-80195183-38832423 2026-01-26 03:12:34,771 - INFO - Deleting VN ctest-vn2_metadata-46742717 2026-01-26 03:12:34,811 - DEBUG - VN d5c4e969-b205-44d9-916f-15674321dc43 still in use: Unable to complete operation on network d5c4e969-b205-44d9-916f-15674321dc43. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6bb53f6f-da3b-4fd4-8d61-193526d93b66'] 2026-01-26 03:12:34,811 - WARNING - Deleting VN ctest-vn2_metadata-46742717 failed..Will retry 2026-01-26 03:12:36,965 - DEBUG - Response for deleting network () 2026-01-26 03:12:38,229 - DEBUG - No XMPP flaps were noticed during the test 2026-01-26 03:12:38,229 - INFO - -------------------------------------------------------------------------------- 2026-01-26 03:12:38,231 - INFO - ================================================================================ 2026-01-26 03:12:38,232 - INFO - STARTING TEST : test_metadata_service 2026-01-26 03:12:38,232 - INFO - TEST DESCRIPTION : Description: Test to validate metadata service on VM creation. 1.Verify from global-vrouter-config if metadata configures or not - fails otherwise 2.Create a shell script which writes 'hello world ' in a file in /tmp and save the script on the nova api node 3.Create a vm with userdata pointing to that script - script should get executed during vm boot up 4.Go to the vm and verify if the file with 'hello world ' written saved in /tmp of the vm - fails otherwise Maintainer: sandipd@juniper.net 2026-01-26 03:12:39,513 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2026-01-26 03:12:39,513 - INFO - Initial checks done. Running the testcase now 2026-01-26 03:12:39,513 - INFO - 2026-01-26 03:12:39,513 - DEBUG - Requesting: http://10.0.0.141:8082/global-vrouter-configs 2026-01-26 03:12:39,809 - DEBUG - Requesting: http://10.0.0.141:8082/global-vrouter-configs 2026-01-26 03:12:39,840 - DEBUG - Requesting: http://10.0.0.141:8082/global-vrouter-config/548f92c3-75cb-411e-a748-df91772062a4 2026-01-26 03:12:40,105 - DEBUG - Response for create_network : {'network': {'id': 'e977930e-d843-4793-b22e-e98491c14359', 'name': 'ctest-vn-28366660', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-80195183', 'ctest-vn-28366660'], 'port_security_enabled': True, 'description': ''}} 2026-01-26 03:12:40,360 - DEBUG - Response for create_subnet : {'subnet': {'id': '69ea70c1-c82a-4479-b627-8b7ecd595698', 'name': '', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'network_id': 'e977930e-d843-4793-b22e-e98491c14359', 'ip_version': 4, 'cidr': '203.236.190.128/26', 'allocation_pools': [{'start': '203.236.190.130', 'end': '203.236.190.190'}], 'gateway_ip': '203.236.190.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '203.236.190.130', 'tags': [], 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff'}} 2026-01-26 03:12:40,382 - INFO - Created VN ctest-vn-28366660 2026-01-26 03:12:40,398 - DEBUG - VN ctest-vn-28366660 UUID is e977930e-d843-4793-b22e-e98491c14359 2026-01-26 03:12:41,579 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5076-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5076-2) 2026-01-26 03:12:41,579 - INFO - Waiting for VM ctest-TestBasicVMVN-80195183-94253213 to be up.. 2026-01-26 03:12:41,620 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-01-26 03:12:46,700 - DEBUG - VM is in ACTIVE state now 2026-01-26 03:12:46,700 - INFO - VM name : ctest-TestBasicVMVN-80195183-94253213 2026-01-26 03:12:46,796 - DEBUG - VM ctest-TestBasicVMVN-80195183-94253213 ID is ccd3b64b-5998-4436-add3-f0de65f544f3 2026-01-26 03:12:46,796 - DEBUG - VM ctest-TestBasicVMVN-80195183-94253213 launched on Node an-jenkins-deploy-platform-ansible-os-5076-2 2026-01-26 03:12:46,878 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/ccd3b64b-5998-4436-add3-f0de65f544f3 2026-01-26 03:12:46,888 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/f144daff-e9a6-4eae-80b6-e2234de64b99 2026-01-26 03:12:50,075 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2026-01-26 03:12:50,076 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-80195183-94253213 failed! 2026-01-26 03:12:50,090 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-80195183:ctest-vn-28366660 is 203.236.190.129 and allocation pool is NOT set 2026-01-26 03:12:54,174 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.60 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1015ms\r\nrtt min/avg/max/mdev = 3.596/3.596/3.596/0.000 ms') 2026-01-26 03:12:54,175 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-80195183-94253213 passed 2026-01-26 03:12:54,245 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-01-26 03:12:54,245 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-80195183-94253213, IP 203.236.190.131, Port 22 2026-01-26 03:12:54,416 - DEBUG - VM ctest-TestBasicVMVN-80195183-94253213 is ready for SSH connections 2026-01-26 03:12:54,416 - DEBUG - Running remote_cmd, Cmd : cat /tmp/output.txt, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2026-01-26 03:12:54,416 - DEBUG - cat /tmp/output.txt 2026-01-26 03:12:56,314 - DEBUG - Hello World. The time is now Sun, 25 Jan 2026 20:12:52 -0700! 2026-01-26 03:12:56,315 - DEBUG - ret : {'cat /tmp/output.txt': 'Hello World. The time is now Sun, 25 Jan 2026 20:12:52 -0700!'} 2026-01-26 03:12:56,315 - INFO - metadata_script.txt got executed in the vm 2026-01-26 03:12:56,315 - INFO - Deleting VM ctest-TestBasicVMVN-80195183-94253213 2026-01-26 03:12:56,394 - INFO - Deleting VN ctest-vn-28366660 2026-01-26 03:12:56,553 - DEBUG - VN e977930e-d843-4793-b22e-e98491c14359 still in use: Unable to complete operation on network e977930e-d843-4793-b22e-e98491c14359. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-beaac2c7-3e2e-4f7e-a082-e869652887e5'] 2026-01-26 03:12:56,553 - WARNING - Deleting VN ctest-vn-28366660 failed..Will retry 2026-01-26 03:12:58,700 - DEBUG - Response for deleting network () 2026-01-26 03:12:59,957 - DEBUG - No XMPP flaps were noticed during the test
2026-01-26 03:12:59,957 - INFO - END TEST : test_metadata_service : PASSED[0:00:21]
2026-01-26 03:12:59,957 - INFO - -------------------------------------------------------------------------------- 2026-01-26 03:12:59,960 - INFO - ================================================================================ 2026-01-26 03:12:59,960 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2026-01-26 03:12:59,960 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2026-01-26 03:13:01,247 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2026-01-26 03:13:01,247 - INFO - Initial checks done. Running the testcase now 2026-01-26 03:13:01,247 - INFO - 2026-01-26 03:13:01,909 - DEBUG - Response for create_network : {'network': {'id': '479ac10a-c0d8-4571-962c-113083587821', 'name': 'ctest-vn-27579143', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-80195183', 'ctest-vn-27579143'], 'port_security_enabled': True, 'description': ''}} 2026-01-26 03:13:02,121 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ae6a3a9c-4059-4d7d-95a3-a305ca74ac7c', 'name': '', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'network_id': '479ac10a-c0d8-4571-962c-113083587821', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff'}} 2026-01-26 03:13:02,375 - DEBUG - Response for create_subnet : {'subnet': {'id': '4703dc6e-d235-4d7f-a013-0655956b2cd7', 'name': '', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'network_id': '479ac10a-c0d8-4571-962c-113083587821', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff'}} 2026-01-26 03:13:02,407 - INFO - Created VN ctest-vn-27579143 2026-01-26 03:13:02,421 - DEBUG - VN ctest-vn-27579143 UUID is 479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:02,841 - DEBUG - Response for create_port : {'port': {'name': '6498411e-08de-42ae-b287-183b75bf1c01', 'id': '6498411e-08de-42ae-b287-183b75bf1c01', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'network_id': '479ac10a-c0d8-4571-962c-113083587821', 'mac_address': '02:64:98:41:1e:08', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'ae6a3a9c-4059-4d7d-95a3-a305ca74ac7c'}], 'security_groups': ['800804fe-a30e-43bd-898f-626fa73f1452'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff'}} 2026-01-26 03:13:03,092 - DEBUG - Response for create_port : {'port': {'name': 'fc6212b2-cf59-4e39-9bd3-f1ea62cf8837', 'id': 'fc6212b2-cf59-4e39-9bd3-f1ea62cf8837', 'tenant_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff', 'network_id': '479ac10a-c0d8-4571-962c-113083587821', 'mac_address': '02:fc:62:12:b2:cf', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '4703dc6e-d235-4d7f-a013-0655956b2cd7'}], 'security_groups': ['800804fe-a30e-43bd-898f-626fa73f1452'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6dd30cf95ca44cf0902fe9cfcf6a4dff'}} 2026-01-26 03:13:03,780 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5076-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5076-1) 2026-01-26 03:13:04,442 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5076-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5076-2) 2026-01-26 03:13:05,960 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5076-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5076-1) 2026-01-26 03:13:05,960 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:05,966 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:05,980 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:06,090 - DEBUG - Requesting: http://10.0.0.141:8082/network-ipam/475926e8-0e51-4805-92ef-258f4aaf75b8 2026-01-26 03:13:06,103 - INFO - Verifications in API Server for IPAM: ctest-ipam-37115821 passed 2026-01-26 03:13:06,110 - DEBUG - Control-node 10.0.0.141 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-80195183:ctest-ipam-37115821', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-80195183', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5141183227734607877', 'uuid-lslong': '10587722546334889400'}, 'enable': 'true', 'created': '2026-01-26T03:13:01', 'last-modified': '2026-01-26T03:13:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.587973'} 2026-01-26 03:13:06,115 - DEBUG - Control-node 10.0.0.38 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-80195183:ctest-ipam-37115821', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-80195183', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5141183227734607877', 'uuid-lslong': '10587722546334889400'}, 'enable': 'true', 'created': '2026-01-26T03:13:01', 'last-modified': '2026-01-26T03:13:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.595636'} 2026-01-26 03:13:06,121 - DEBUG - Control-node 10.0.0.240 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-80195183:ctest-ipam-37115821', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-80195183', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5141183227734607877', 'uuid-lslong': '10587722546334889400'}, 'enable': 'true', 'created': '2026-01-26T03:13:01', 'last-modified': '2026-01-26T03:13:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.600016'} 2026-01-26 03:13:06,121 - INFO - Verifications in Control node for IPAM: ctest-ipam-37115821 passed 2026-01-26 03:13:06,121 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:06,129 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:06,144 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:06,253 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:06,268 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:06,285 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:06,295 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:06,306 - DEBUG - Route Targets: [] 2026-01-26 03:13:06,306 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:11,307 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:11,313 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:11,324 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:11,409 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:11,422 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:11,431 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:11,447 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:11,456 - DEBUG - Route Targets: [] 2026-01-26 03:13:11,456 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:16,456 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:16,463 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:16,475 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:16,562 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:16,573 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:16,586 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:16,595 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:16,604 - DEBUG - Route Targets: [] 2026-01-26 03:13:16,604 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:21,605 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:21,615 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:21,652 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:21,755 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:21,768 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:21,778 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:21,787 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:21,794 - DEBUG - Route Targets: [] 2026-01-26 03:13:21,794 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:26,795 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:26,803 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:26,816 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:26,910 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:26,924 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:26,935 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:26,944 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:26,953 - DEBUG - Route Targets: [] 2026-01-26 03:13:26,953 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:31,954 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:31,960 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:31,971 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:32,065 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:32,074 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:32,084 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:32,091 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:32,099 - DEBUG - Route Targets: [] 2026-01-26 03:13:32,099 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:37,100 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:37,107 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:37,118 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:37,212 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:37,230 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:37,240 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:37,249 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:37,257 - DEBUG - Route Targets: [] 2026-01-26 03:13:37,257 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:42,258 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:42,267 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:42,279 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:42,370 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:42,383 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:42,393 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:42,401 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:42,409 - DEBUG - Route Targets: [] 2026-01-26 03:13:42,410 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:47,410 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:47,418 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:47,429 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:47,513 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:47,529 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:47,540 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:47,547 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:47,554 - DEBUG - Route Targets: [] 2026-01-26 03:13:47,554 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:52,555 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:52,563 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:52,573 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:52,664 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:52,675 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:52,686 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:52,696 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:52,705 - DEBUG - Route Targets: [] 2026-01-26 03:13:52,705 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:57,706 - DEBUG - Requesting: http://10.0.0.141:8082/domains 2026-01-26 03:13:57,713 - DEBUG - Requesting: http://10.0.0.141:8082/domain/08a144b7-f725-46be-ae4d-cb483f66bd80 2026-01-26 03:13:57,725 - DEBUG - Requesting: http://10.0.0.141:8082/project/6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff 2026-01-26 03:13:57,832 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:57,850 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-network/479ac10a-c0d8-4571-962c-113083587821 2026-01-26 03:13:57,860 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:57,868 - DEBUG - Requesting: http://10.0.0.141:8082/routing-instance/47ed8208-a1be-49f0-bdcd-46e7a667523d 2026-01-26 03:13:57,875 - DEBUG - Route Targets: [] 2026-01-26 03:13:57,875 - DEBUG - RT names not yet present for VN ctest-vn-27579143 2026-01-26 03:13:57,875 - ERROR - One or more verifications in API Server for VN ctest-vn-27579143 failed 2026-01-26 03:13:57,876 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-80195183-97813430 in state BUILD 2026-01-26 03:13:57,876 - INFO - Deleting VM ctest-TestBasicVMVN-80195183-97813430 2026-01-26 03:13:57,877 - ERROR - VM ctest-TestBasicVMVN-80195183-97813430 has failed to come up 2026-01-26 03:13:57,877 - ERROR - Nova failed to get host of the VM 2026-01-26 03:13:57,877 - ERROR - VM ctest-TestBasicVMVN-80195183-97813430 has failed to come up 2026-01-26 03:13:57,877 - ERROR - Nova failed to get host of the VM 2026-01-26 03:13:57,946 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-80195183-54440615 in state BUILD 2026-01-26 03:13:57,946 - INFO - Deleting VM ctest-TestBasicVMVN-80195183-54440615 2026-01-26 03:13:57,946 - ERROR - VM ctest-TestBasicVMVN-80195183-54440615 has failed to come up 2026-01-26 03:13:57,946 - ERROR - Nova failed to get host of the VM 2026-01-26 03:13:57,946 - ERROR - VM ctest-TestBasicVMVN-80195183-54440615 has failed to come up 2026-01-26 03:13:57,946 - ERROR - Nova failed to get host of the VM 2026-01-26 03:13:58,020 - INFO - Skip interface_detach for VM ctest-TestBasicVMVN-80195183-30805496 in state BUILD 2026-01-26 03:13:58,021 - INFO - Deleting VM ctest-TestBasicVMVN-80195183-30805496 2026-01-26 03:13:58,022 - ERROR - VM ctest-TestBasicVMVN-80195183-30805496 has failed to come up 2026-01-26 03:13:58,022 - ERROR - Nova failed to get host of the VM 2026-01-26 03:13:58,023 - ERROR - VM ctest-TestBasicVMVN-80195183-30805496 has failed to come up 2026-01-26 03:13:58,023 - ERROR - Nova failed to get host of the VM 2026-01-26 03:13:58,092 - INFO - Deleting VN ctest-vn-27579143 2026-01-26 03:13:58,316 - DEBUG - Response for delete_port : () 2026-01-26 03:13:58,600 - DEBUG - Response for delete_port : () 2026-01-26 03:13:58,697 - DEBUG - VN 479ac10a-c0d8-4571-962c-113083587821 still in use: Unable to complete operation on network 479ac10a-c0d8-4571-962c-113083587821. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8dc14298-5de3-4fa5-9b7e-ebe45dab5d9b'] 2026-01-26 03:13:58,697 - WARNING - Deleting VN ctest-vn-27579143 failed..Will retry 2026-01-26 03:14:00,912 - DEBUG - Response for deleting network () 2026-01-26 03:14:01,032 - INFO - IPAM: ctest-ipam-37115821 is not found in API Server 2026-01-26 03:14:01,061 - INFO - IPAM:ctest-ipam-37115821 is not found in control node 2026-01-26 03:14:02,317 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Mon Jan 26 03:13:57 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=) 144 vm3 = self.create_vm(image_name='cirros', vn_fixture=vn1_fixture) 145 assert ipam_obj.verify_on_setup() 146 assert vn1_fixture.verify_on_setup() 147 assert vm1.wait_till_vm_is_up() 148 assert vm2.wait_till_vm_is_up() vn1_fixture = vn1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 146, in test_ping_within_vn_two_vms_two_different_subnets assert vn1_fixture.verify_on_setup() AssertionError 2026-01-26 03:14:02,332 - DEBUG - No XMPP flaps were noticed during the test 2026-01-26 03:14:02,332 - INFO -
2026-01-26 03:14:02,332 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : FAILED[0:01:03]
2026-01-26 03:14:02,333 - INFO - -------------------------------------------------------------------------------- 2026-01-26 03:14:03,149 - INFO - Deleted project: ctest-TestBasicVMVN-80195183, ID : 6dd30cf9-5ca4-4cf0-902f-e9cfcf6a4dff