2024-11-10 00:42:49,129 - INFO - Domain Default found not creating 2024-11-10 00:42:49,294 - INFO - Project ctest-TestBasicVMVN-75342990 not found, creating it 2024-11-10 00:42:50,037 - INFO - Created Project:ctest-TestBasicVMVN-75342990, ID : bee52d5e-676a-4bbe-a113-9a2302a6b248 2024-11-10 00:42:51,619 - INFO - ================================================================================ 2024-11-10 00:42:51,620 - INFO - STARTING TEST : test_generic_link_local_service 2024-11-10 00:42:51,620 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-11-10 00:42:51,877 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.20.0.25': '0'}} with 2024-11-10 00:42:51,877 - INFO - Initial checks done. Running the testcase now 2024-11-10 00:42:51,877 - INFO - 2024-11-10 00:42:52,485 - DEBUG - Response for create_network : {'network': {'id': '9a7f1ab4-68f1-45ec-8d3f-0999e9217a68', 'name': 'ctest-vn2_metadata-10730064', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'project_id': 'bee52d5e676a4bbea1139a2302a6b248', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-75342990', 'ctest-vn2_metadata-10730064'], 'port_security_enabled': True, 'description': ''}} 2024-11-10 00:42:52,667 - DEBUG - Response for create_subnet : {'subnet': {'id': '5280aed8-6170-4031-8e91-dedd1771a008', 'name': '', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'network_id': '9a7f1ab4-68f1-45ec-8d3f-0999e9217a68', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'bee52d5e676a4bbea1139a2302a6b248'}} 2024-11-10 00:42:52,690 - INFO - Created VN ctest-vn2_metadata-10730064 2024-11-10 00:42:52,751 - DEBUG - VN ctest-vn2_metadata-10730064 UUID is 9a7f1ab4-68f1-45ec-8d3f-0999e9217a68 2024-11-10 00:42:52,984 - DEBUG - Services list from nova: [, , ] 2024-11-10 00:42:54,101 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2247-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2247-1) 2024-11-10 00:42:54,223 - DEBUG - Link local service introspect added 2024-11-10 00:42:54,272 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-11-10 00:42:59,366 - DEBUG - VM is in ACTIVE state now 2024-11-10 00:42:59,510 - INFO - Waiting for VM ctest-TestBasicVMVN-75342990-16936841 to be up.. 2024-11-10 00:42:59,511 - INFO - VM name : ctest-TestBasicVMVN-75342990-16936841 2024-11-10 00:42:59,593 - DEBUG - VM ctest-TestBasicVMVN-75342990-16936841 ID is a19c2ea9-1e55-414f-b70a-90ce7f5507de 2024-11-10 00:42:59,593 - DEBUG - VM ctest-TestBasicVMVN-75342990-16936841 launched on Node cn-jenkins-deploy-platform-ansible-os-2247-1 2024-11-10 00:42:59,687 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/a19c2ea9-1e55-414f-b70a-90ce7f5507de 2024-11-10 00:43:00,006 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/a19c2ea9-1e55-414f-b70a-90ce7f5507de 2024-11-10 00:43:00,049 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/a1b4d0d8-3f7b-4a5b-9180-b833f6663c19 2024-11-10 00:43:03,329 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2024-11-10 00:43:03,329 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75342990-16936841 failed! 2024-11-10 00:43:03,391 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75342990:ctest-vn2_metadata-10730064 is 11.1.1.1 and allocation pool is NOT set 2024-11-10 00:43:05,453 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.41 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.927 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.927/1.670/2.414/0.743 ms') 2024-11-10 00:43:05,453 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75342990-16936841 passed 2024-11-10 00:43:05,611 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:05,611 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75342990-16936841, IP 11.1.1.3, Port 22 2024-11-10 00:43:05,767 - DEBUG - VM ctest-TestBasicVMVN-75342990-16936841 is ready for SSH connections 2024-11-10 00:43:05,767 - INFO - Retry 0 2024-11-10 00:43:05,767 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:05,767 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-11-10 00:43:07,363 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-11-10 00:43:07,363 - INFO - Generic metadata worked 2024-11-10 00:43:07,623 - DEBUG - Link local service introspect removed 2024-11-10 00:43:07,623 - INFO - Deleting VM ctest-TestBasicVMVN-75342990-16936841 2024-11-10 00:43:07,691 - INFO - Deleting VN ctest-vn2_metadata-10730064 2024-11-10 00:43:07,744 - DEBUG - VN 9a7f1ab4-68f1-45ec-8d3f-0999e9217a68 still in use: Unable to complete operation on network 9a7f1ab4-68f1-45ec-8d3f-0999e9217a68. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-cd29105e-ccfe-412c-8b68-c911a8c0ca55'] 2024-11-10 00:43:07,744 - WARNING - Deleting VN ctest-vn2_metadata-10730064 failed..Will retry 2024-11-10 00:43:09,881 - DEBUG - Response for deleting network () 2024-11-10 00:43:10,136 - DEBUG - No XMPP flaps were noticed during the test 2024-11-10 00:43:10,137 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:19] 2024-11-10 00:43:10,137 - INFO - -------------------------------------------------------------------------------- 2024-11-10 00:43:10,140 - INFO - ================================================================================ 2024-11-10 00:43:10,140 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-11-10 00:43:10,140 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-11-10 00:43:10,436 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.20.0.25': '0'}} with 2024-11-10 00:43:10,436 - INFO - Initial checks done. Running the testcase now 2024-11-10 00:43:10,436 - INFO - 2024-11-10 00:43:10,931 - DEBUG - Response for create_network : {'network': {'id': '3a88f091-6c82-4d04-b505-20c85bbe837c', 'name': 'ctest-vn-88162712', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'project_id': 'bee52d5e676a4bbea1139a2302a6b248', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-75342990', 'ctest-vn-88162712'], 'port_security_enabled': True, 'description': ''}} 2024-11-10 00:43:11,144 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b3e14d9a-3116-4c83-aa9c-5f0456cabbd3', 'name': '', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'network_id': '3a88f091-6c82-4d04-b505-20c85bbe837c', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'bee52d5e676a4bbea1139a2302a6b248'}} 2024-11-10 00:43:11,283 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e83baf73-df20-42cf-944c-5d58cd3083bd', 'name': '', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'network_id': '3a88f091-6c82-4d04-b505-20c85bbe837c', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'bee52d5e676a4bbea1139a2302a6b248'}} 2024-11-10 00:43:11,304 - INFO - Created VN ctest-vn-88162712 2024-11-10 00:43:11,363 - DEBUG - VN ctest-vn-88162712 UUID is 3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:11,750 - DEBUG - Response for create_port : {'port': {'name': 'c3fb3ffd-3a24-4c29-b15f-c761bdc76d05', 'id': 'c3fb3ffd-3a24-4c29-b15f-c761bdc76d05', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'network_id': '3a88f091-6c82-4d04-b505-20c85bbe837c', 'mac_address': '02:c3:fb:3f:fd:3a', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'b3e14d9a-3116-4c83-aa9c-5f0456cabbd3'}], 'security_groups': ['e5b84bd3-c88a-4d4f-bbe5-d6a64b587722'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'bee52d5e676a4bbea1139a2302a6b248'}} 2024-11-10 00:43:11,934 - DEBUG - Response for create_port : {'port': {'name': '7e7af2f3-eb1d-479c-95e0-6653f82212b6', 'id': '7e7af2f3-eb1d-479c-95e0-6653f82212b6', 'tenant_id': 'bee52d5e676a4bbea1139a2302a6b248', 'network_id': '3a88f091-6c82-4d04-b505-20c85bbe837c', 'mac_address': '02:7e:7a:f2:f3:eb', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'e83baf73-df20-42cf-944c-5d58cd3083bd'}], 'security_groups': ['e5b84bd3-c88a-4d4f-bbe5-d6a64b587722'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'bee52d5e676a4bbea1139a2302a6b248'}} 2024-11-10 00:43:12,331 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2247-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2247-1) 2024-11-10 00:43:12,732 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2247-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2247-1) 2024-11-10 00:43:13,987 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2247-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2247-1) 2024-11-10 00:43:13,988 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-10 00:43:13,994 - DEBUG - Requesting: http://10.0.0.29:8082/domain/e70409f1-e19f-4af2-a675-314a546d1614 2024-11-10 00:43:14,010 - DEBUG - Requesting: http://10.0.0.29:8082/project/bee52d5e-676a-4bbe-a113-9a2302a6b248 2024-11-10 00:43:14,101 - DEBUG - Requesting: http://10.0.0.29:8082/network-ipam/c993a1f7-bdf7-4fe2-87c8-243d0b8ee1d9 2024-11-10 00:43:14,113 - INFO - Verifications in API Server for IPAM: ctest-ipam-35216718 passed 2024-11-10 00:43:14,128 - DEBUG - Control-node 10.0.0.29 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-75342990:ctest-ipam-35216718', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-75342990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14525131308616077282', 'uuid-lslong': '9784110035067920857'}, 'enable': 'true', 'created': '2024-11-10T00:43:10', 'last-modified': '2024-11-10T00:43:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.452999'} 2024-11-10 00:43:14,128 - INFO - Verifications in Control node for IPAM: ctest-ipam-35216718 passed 2024-11-10 00:43:14,129 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-10 00:43:14,143 - DEBUG - Requesting: http://10.0.0.29:8082/domain/e70409f1-e19f-4af2-a675-314a546d1614 2024-11-10 00:43:14,161 - DEBUG - Requesting: http://10.0.0.29:8082/project/bee52d5e-676a-4bbe-a113-9a2302a6b248 2024-11-10 00:43:14,250 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:14,271 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:14,287 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/11a9fc18-dade-472e-a9fe-49efd7859a98 2024-11-10 00:43:14,297 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/11a9fc18-dade-472e-a9fe-49efd7859a98 2024-11-10 00:43:14,315 - DEBUG - Requesting: http://10.0.0.29:8082/route-target/9339bfb3-d559-4243-9e39-677a1cb56feb 2024-11-10 00:43:14,327 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-10 00:43:14,327 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:14,344 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/11a9fc18-dade-472e-a9fe-49efd7859a98 2024-11-10 00:43:14,384 - INFO - Verified VN network id 8 for VN 3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:14,385 - INFO - Verifications in API Server for VN ctest-vn-88162712 passed 2024-11-10 00:43:14,386 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:14,412 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/11a9fc18-dade-472e-a9fe-49efd7859a98 2024-11-10 00:43:14,423 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/11a9fc18-dade-472e-a9fe-49efd7859a98 2024-11-10 00:43:14,447 - DEBUG - Requesting: http://10.0.0.29:8082/route-target/9339bfb3-d559-4243-9e39-677a1cb56feb 2024-11-10 00:43:14,472 - DEBUG - Control-node 10.0.0.29 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-75342990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4217885558413872388', 'uuid-lslong': '13043867940653269884'}, 'enable': 'true', 'created': '2024-11-10T00:43:10', 'last-modified': '2024-11-10T00:43:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.219340'} 2024-11-10 00:43:14,485 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-10 00:43:14,485 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-88162712 passed 2024-11-10 00:43:14,485 - DEBUG - ====Verifying policy data for ctest-vn-88162712 in API_Server ====== 2024-11-10 00:43:14,485 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-10 00:43:14,498 - DEBUG - Requesting: http://10.0.0.29:8082/domain/e70409f1-e19f-4af2-a675-314a546d1614 2024-11-10 00:43:14,573 - DEBUG - Requesting: http://10.0.0.29:8082/project/bee52d5e-676a-4bbe-a113-9a2302a6b248 2024-11-10 00:43:14,753 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/3a88f091-6c82-4d04-b505-20c85bbe837c 2024-11-10 00:43:14,788 - DEBUG - =>VN ctest-vn-88162712 has no policy to be verified 2024-11-10 00:43:14,788 - DEBUG - Verifying the vn in opserver 2024-11-10 00:43:14,788 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 virtual network link through opserver 10.0.0.29 2024-11-10 00:43:14,788 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-11-10 00:43:15,212 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-11-10 00:43:15,300 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712', 'href': 'http://10.0.0.29:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712?flat'} 2024-11-10 00:43:15,300 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 is found in opserver 2024-11-10 00:43:15,307 - DEBUG - VRF ids for VN ctest-vn-88162712: {'10.0.0.29': '2'} 2024-11-10 00:43:15,307 - INFO - Waiting for VM ctest-TestBasicVMVN-75342990-73794332 to be up.. 2024-11-10 00:43:15,407 - DEBUG - VM is in ACTIVE state now 2024-11-10 00:43:15,407 - INFO - VM name : ctest-TestBasicVMVN-75342990-73794332 2024-11-10 00:43:15,503 - DEBUG - VM ctest-TestBasicVMVN-75342990-73794332 ID is 02cb1896-0a63-4853-bac4-e987b77463d3 2024-11-10 00:43:15,503 - DEBUG - VM ctest-TestBasicVMVN-75342990-73794332 launched on Node cn-jenkins-deploy-platform-ansible-os-2247-1 2024-11-10 00:43:15,595 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/02cb1896-0a63-4853-bac4-e987b77463d3 2024-11-10 00:43:15,606 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/c3fb3ffd-3a24-4c29-b15f-c761bdc76d05 2024-11-10 00:43:18,911 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-11-10 00:43:18,911 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-75342990-73794332 failed! 2024-11-10 00:43:18,971 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 is 31.1.1.1 and allocation pool is NOT set 2024-11-10 00:43:18,971 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 is 31.1.2.1 and allocation pool is NOT set 2024-11-10 00:43:23,044 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2024-11-10 00:43:23,044 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-75342990-73794332 failed! 2024-11-10 00:43:23,115 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 is 31.1.1.1 and allocation pool is NOT set 2024-11-10 00:43:23,115 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 is 31.1.2.1 and allocation pool is NOT set 2024-11-10 00:43:25,181 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.07 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.448 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.448/1.758/3.068/1.310 ms') 2024-11-10 00:43:25,181 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-75342990-73794332 passed 2024-11-10 00:43:25,335 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:25,335 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75342990-73794332, IP 31.1.1.4, Port 22 2024-11-10 00:43:25,509 - DEBUG - VM ctest-TestBasicVMVN-75342990-73794332 is ready for SSH connections 2024-11-10 00:43:25,509 - INFO - Waiting for VM ctest-TestBasicVMVN-75342990-37635548 to be up.. 2024-11-10 00:43:25,634 - DEBUG - VM is in ACTIVE state now 2024-11-10 00:43:25,634 - INFO - VM name : ctest-TestBasicVMVN-75342990-37635548 2024-11-10 00:43:25,716 - DEBUG - VM ctest-TestBasicVMVN-75342990-37635548 ID is 2ca53663-f5d9-4078-800a-4beb5d39506c 2024-11-10 00:43:25,716 - DEBUG - VM ctest-TestBasicVMVN-75342990-37635548 launched on Node cn-jenkins-deploy-platform-ansible-os-2247-1 2024-11-10 00:43:25,796 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/2ca53663-f5d9-4078-800a-4beb5d39506c 2024-11-10 00:43:25,806 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/7e7af2f3-eb1d-479c-95e0-6653f82212b6 2024-11-10 00:43:27,054 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.30 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.407 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.407/1.851/3.295/1.444 ms') 2024-11-10 00:43:27,054 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75342990-37635548 passed 2024-11-10 00:43:27,215 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:27,215 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75342990-37635548, IP 31.1.2.4, Port 22 2024-11-10 00:43:27,375 - DEBUG - VM ctest-TestBasicVMVN-75342990-37635548 is ready for SSH connections 2024-11-10 00:43:27,375 - INFO - Waiting for VM ctest-TestBasicVMVN-75342990-75516230 to be up.. 2024-11-10 00:43:27,461 - DEBUG - VM is in ACTIVE state now 2024-11-10 00:43:27,461 - INFO - VM name : ctest-TestBasicVMVN-75342990-75516230 2024-11-10 00:43:27,563 - DEBUG - VM ctest-TestBasicVMVN-75342990-75516230 ID is 5ee4852c-0317-480d-afdf-e1c4d96038f8 2024-11-10 00:43:27,563 - DEBUG - VM ctest-TestBasicVMVN-75342990-75516230 launched on Node cn-jenkins-deploy-platform-ansible-os-2247-1 2024-11-10 00:43:27,654 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/5ee4852c-0317-480d-afdf-e1c4d96038f8 2024-11-10 00:43:27,666 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/f4e01e55-db05-4eef-a70f-d4a8ef927a90 2024-11-10 00:43:28,924 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.02 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.440 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.440/1.727/3.015/1.287 ms') 2024-11-10 00:43:28,925 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-75342990-75516230 passed 2024-11-10 00:43:29,091 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:29,091 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75342990-75516230, IP 31.1.1.3, Port 22 2024-11-10 00:43:29,250 - DEBUG - VM ctest-TestBasicVMVN-75342990-75516230 is ready for SSH connections 2024-11-10 00:43:29,250 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:29,250 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:29,250 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-11-10 00:43:32,902 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.525 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.085 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.062 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.062/1.890/3.525 ms 2024-11-10 00:43:32,903 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-75342990-73794332 passed 2024-11-10 00:43:32,903 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:32,903 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:32,903 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-11-10 00:43:36,539 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.837 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.859 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.191 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.859/1.962/3.837 ms 2024-11-10 00:43:36,540 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-75342990-37635548 passed 2024-11-10 00:43:36,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:36,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:36,540 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-10 00:43:36,540 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:36,540 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-10 00:43:36,714 - DEBUG - None 2024-11-10 00:43:36,714 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:36,714 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-10 00:43:36,893 - DEBUG - None 2024-11-10 00:43:36,893 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:36,893 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-10 00:43:37,498 - DEBUG - None 2024-11-10 00:43:37,498 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:37,498 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-11-10 00:43:39,700 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.671 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.132 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.368 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.057 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.415 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.368/1.728/4.132 ms 2024-11-10 00:43:39,700 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:39,700 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-11-10 00:43:41,942 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.428 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.409 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.421 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.455 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.001 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.179 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.360 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.360/2.464/5.421 ms 2024-11-10 00:43:41,943 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-10 00:43:41,943 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-11-10 00:43:44,176 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.637 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.632 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.416 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.498 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.443 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.124 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.450 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.450/1.885/3.416 ms 2024-11-10 00:43:44,176 - INFO - Deleting VM ctest-TestBasicVMVN-75342990-75516230 2024-11-10 00:43:44,261 - INFO - Detaching port 7e7af2f3-eb1d-479c-95e0-6653f82212b6 from VM ctest-TestBasicVMVN-75342990-37635548 2024-11-10 00:43:44,312 - INFO - Deleting VM ctest-TestBasicVMVN-75342990-37635548 2024-11-10 00:43:44,376 - INFO - Detaching port c3fb3ffd-3a24-4c29-b15f-c761bdc76d05 from VM ctest-TestBasicVMVN-75342990-73794332 2024-11-10 00:43:44,407 - INFO - Deleting VM ctest-TestBasicVMVN-75342990-73794332 2024-11-10 00:43:44,473 - INFO - Deleting VN ctest-vn-88162712 2024-11-10 00:43:44,656 - DEBUG - Response for delete_port : () 2024-11-10 00:43:44,849 - DEBUG - Response for delete_port : () 2024-11-10 00:43:44,903 - DEBUG - VN 3a88f091-6c82-4d04-b505-20c85bbe837c still in use: Unable to complete operation on network 3a88f091-6c82-4d04-b505-20c85bbe837c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b1f26373-c2bd-4d1b-80e4-26bbbbf55560'] 2024-11-10 00:43:44,903 - WARNING - Deleting VN ctest-vn-88162712 failed..Will retry 2024-11-10 00:43:47,057 - DEBUG - Response for deleting network () 2024-11-10 00:43:47,058 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/11a9fc18-dade-472e-a9fe-49efd7859a98 2024-11-10 00:43:47,064 - DEBUG - Response Code: 404 2024-11-10 00:43:47,064 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-10 00:43:47,069 - DEBUG - Requesting: http://10.0.0.29:8082/domain/e70409f1-e19f-4af2-a675-314a546d1614 2024-11-10 00:43:47,124 - DEBUG - Requesting: http://10.0.0.29:8082/project/bee52d5e-676a-4bbe-a113-9a2302a6b248 2024-11-10 00:43:47,204 - INFO - Validated that VN ctest-vn-88162712 is not found in API Server 2024-11-10 00:43:47,214 - DEBUG - VN ctest-vn-88162712 is not present in Agent 10.0.0.29 2024-11-10 00:43:47,214 - INFO - Validated that VN ctest-vn-88162712 is not in any agent 2024-11-10 00:43:47,221 - DEBUG - VRF 2 is not seen in agent 10.0.0.29 2024-11-10 00:43:47,226 - DEBUG - Vrouter 10.0.0.29 does not have vrf 2 for VN ctest-vn-88162712 2024-11-10 00:43:47,226 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-75342990:ctest-vn-88162712 2024-11-10 00:43:47,237 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-88162712 info 2024-11-10 00:43:47,318 - INFO - IPAM: ctest-ipam-35216718 is not found in API Server 2024-11-10 00:43:47,330 - INFO - IPAM:ctest-ipam-35216718 is not found in control node 2024-11-10 00:43:47,584 - DEBUG - No XMPP flaps were noticed during the test 2024-11-10 00:43:47,584 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:37] 2024-11-10 00:43:47,584 - INFO - -------------------------------------------------------------------------------- 2024-11-10 00:43:48,320 - INFO - Deleted project: ctest-TestBasicVMVN-75342990, ID : bee52d5e-676a-4bbe-a113-9a2302a6b248