2025-01-20 02:23:35,125 - INFO - Domain Default found not creating 2025-01-20 02:23:35,282 - INFO - Project ctest-TestBasicVMVN-48182115 not found, creating it 2025-01-20 02:23:35,782 - INFO - Created Project:ctest-TestBasicVMVN-48182115, ID : c953bc2f-efb2-4608-bee3-c1c63e2b0051 2025-01-20 02:23:37,456 - INFO - ================================================================================ 2025-01-20 02:23:37,456 - INFO - STARTING TEST : test_generic_link_local_service 2025-01-20 02:23:37,456 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-01-20 02:23:37,711 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.20.0.5': '0'}} with 2025-01-20 02:23:37,711 - INFO - Initial checks done. Running the testcase now 2025-01-20 02:23:37,711 - INFO - 2025-01-20 02:23:38,305 - DEBUG - Response for create_network : {'network': {'id': 'ebf2b2ea-f869-4f94-b88e-f9fb7ff3fa90', 'name': 'ctest-vn2_metadata-12188799', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-48182115', 'ctest-vn2_metadata-12188799'], 'port_security_enabled': True, 'description': ''}} 2025-01-20 02:23:38,536 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b7a1a611-2771-4f96-90b2-dfeaa1efc5e7', 'name': '', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'network_id': 'ebf2b2ea-f869-4f94-b88e-f9fb7ff3fa90', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051'}} 2025-01-20 02:23:38,554 - INFO - Created VN ctest-vn2_metadata-12188799 2025-01-20 02:23:38,604 - DEBUG - VN ctest-vn2_metadata-12188799 UUID is ebf2b2ea-f869-4f94-b88e-f9fb7ff3fa90 2025-01-20 02:23:38,788 - DEBUG - Services list from nova: [, , ] 2025-01-20 02:23:40,010 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2651-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2651-1) 2025-01-20 02:23:40,124 - DEBUG - Link local service introspect added 2025-01-20 02:23:40,177 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-20 02:23:45,269 - DEBUG - VM is in ACTIVE state now 2025-01-20 02:23:45,396 - INFO - Waiting for VM ctest-TestBasicVMVN-48182115-26890197 to be up.. 2025-01-20 02:23:45,396 - INFO - VM name : ctest-TestBasicVMVN-48182115-26890197 2025-01-20 02:23:45,483 - DEBUG - VM ctest-TestBasicVMVN-48182115-26890197 ID is 9f4701b1-30ca-4f04-8ee4-cf3b0a4ae7dc 2025-01-20 02:23:45,483 - DEBUG - VM ctest-TestBasicVMVN-48182115-26890197 launched on Node cn-jenkins-deploy-platform-ansible-os-2651-1 2025-01-20 02:23:45,564 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/9f4701b1-30ca-4f04-8ee4-cf3b0a4ae7dc 2025-01-20 02:23:45,904 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/9f4701b1-30ca-4f04-8ee4-cf3b0a4ae7dc 2025-01-20 02:23:45,945 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/8276b2c4-8abb-4a13-bec0-ba32ea510679 2025-01-20 02:23:49,196 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-01-20 02:23:49,196 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-48182115-26890197 failed! 2025-01-20 02:23:49,252 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-48182115:ctest-vn2_metadata-12188799 is 11.1.1.1 and allocation pool is NOT set 2025-01-20 02:23:53,329 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.69 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1010ms\r\nrtt min/avg/max/mdev = 3.686/3.686/3.686/0.000 ms') 2025-01-20 02:23:53,329 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-48182115-26890197 passed 2025-01-20 02:23:53,484 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:23:53,484 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-48182115-26890197, IP 11.1.1.3, Port 22 2025-01-20 02:23:53,654 - DEBUG - VM ctest-TestBasicVMVN-48182115-26890197 is ready for SSH connections 2025-01-20 02:23:53,655 - INFO - Retry 0 2025-01-20 02:23:53,655 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:23:53,655 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-01-20 02:23:55,311 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-01-20 02:23:55,311 - INFO - Generic metadata worked 2025-01-20 02:23:55,564 - DEBUG - Link local service introspect removed 2025-01-20 02:23:55,564 - INFO - Deleting VM ctest-TestBasicVMVN-48182115-26890197 2025-01-20 02:23:55,632 - INFO - Deleting VN ctest-vn2_metadata-12188799 2025-01-20 02:23:55,674 - DEBUG - VN ebf2b2ea-f869-4f94-b88e-f9fb7ff3fa90 still in use: Unable to complete operation on network ebf2b2ea-f869-4f94-b88e-f9fb7ff3fa90. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7517d177-dd6b-4041-9703-321fb22e03e3'] 2025-01-20 02:23:55,674 - WARNING - Deleting VN ctest-vn2_metadata-12188799 failed..Will retry 2025-01-20 02:23:57,777 - DEBUG - Response for deleting network () 2025-01-20 02:23:58,034 - DEBUG - No XMPP flaps were noticed during the test 2025-01-20 02:23:58,034 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:21] 2025-01-20 02:23:58,034 - INFO - -------------------------------------------------------------------------------- 2025-01-20 02:23:58,037 - INFO - ================================================================================ 2025-01-20 02:23:58,037 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-01-20 02:23:58,037 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-01-20 02:23:58,322 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.20.0.5': '0'}} with 2025-01-20 02:23:58,322 - INFO - Initial checks done. Running the testcase now 2025-01-20 02:23:58,322 - INFO - 2025-01-20 02:23:58,814 - DEBUG - Response for create_network : {'network': {'id': '77c08094-54fc-4ce8-b71c-b9c040590e09', 'name': 'ctest-vn-83927932', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-48182115', 'ctest-vn-83927932'], 'port_security_enabled': True, 'description': ''}} 2025-01-20 02:23:58,998 - DEBUG - Response for create_subnet : {'subnet': {'id': '8306d0c1-e49d-4db0-a503-1dc30db51cf8', 'name': '', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'network_id': '77c08094-54fc-4ce8-b71c-b9c040590e09', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051'}} 2025-01-20 02:23:59,135 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ca99883c-7488-44b0-a2e7-71b726ad4188', 'name': '', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'network_id': '77c08094-54fc-4ce8-b71c-b9c040590e09', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051'}} 2025-01-20 02:23:59,159 - INFO - Created VN ctest-vn-83927932 2025-01-20 02:23:59,212 - DEBUG - VN ctest-vn-83927932 UUID is 77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:23:59,593 - DEBUG - Response for create_port : {'port': {'name': '609e986d-2d4e-4b5f-9eea-cb5fd7eb1956', 'id': '609e986d-2d4e-4b5f-9eea-cb5fd7eb1956', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'network_id': '77c08094-54fc-4ce8-b71c-b9c040590e09', 'mac_address': '02:60:9e:98:6d:2d', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '8306d0c1-e49d-4db0-a503-1dc30db51cf8'}], 'security_groups': ['ba005439-b51c-4461-81f2-759f217f277a'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051'}} 2025-01-20 02:23:59,801 - DEBUG - Response for create_port : {'port': {'name': 'fef9914c-d2fc-43fb-b088-5adfcfb43a88', 'id': 'fef9914c-d2fc-43fb-b088-5adfcfb43a88', 'tenant_id': 'c953bc2fefb24608bee3c1c63e2b0051', 'network_id': '77c08094-54fc-4ce8-b71c-b9c040590e09', 'mac_address': '02:fe:f9:91:4c:d2', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'ca99883c-7488-44b0-a2e7-71b726ad4188'}], 'security_groups': ['ba005439-b51c-4461-81f2-759f217f277a'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'c953bc2fefb24608bee3c1c63e2b0051'}} 2025-01-20 02:24:00,363 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2651-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2651-1) 2025-01-20 02:24:00,895 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2651-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2651-1) 2025-01-20 02:24:02,419 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2651-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2651-1) 2025-01-20 02:24:02,420 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-01-20 02:24:02,428 - DEBUG - Requesting: http://10.0.0.40:8082/domain/21c3f377-201f-4207-b4ef-b03c1c786541 2025-01-20 02:24:02,451 - DEBUG - Requesting: http://10.0.0.40:8082/project/c953bc2f-efb2-4608-bee3-c1c63e2b0051 2025-01-20 02:24:02,567 - DEBUG - Requesting: http://10.0.0.40:8082/network-ipam/807c39f1-65e7-43b3-9c25-6a8df616fe9a 2025-01-20 02:24:02,583 - INFO - Verifications in API Server for IPAM: ctest-ipam-80649730 passed 2025-01-20 02:24:02,591 - DEBUG - Control-node 10.0.0.40 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-48182115:ctest-ipam-80649730', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-48182115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9258338642926453683', 'uuid-lslong': '11251516402006687386'}, 'enable': 'true', 'created': '2025-01-20T02:23:58', 'last-modified': '2025-01-20T02:23:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.041484'} 2025-01-20 02:24:02,591 - INFO - Verifications in Control node for IPAM: ctest-ipam-80649730 passed 2025-01-20 02:24:02,591 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-01-20 02:24:02,605 - DEBUG - Requesting: http://10.0.0.40:8082/domain/21c3f377-201f-4207-b4ef-b03c1c786541 2025-01-20 02:24:02,619 - DEBUG - Requesting: http://10.0.0.40:8082/project/c953bc2f-efb2-4608-bee3-c1c63e2b0051 2025-01-20 02:24:02,695 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:24:02,707 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:24:02,728 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/d9c628fb-9ba6-44f3-8419-f67cc5c8c28b 2025-01-20 02:24:02,741 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/d9c628fb-9ba6-44f3-8419-f67cc5c8c28b 2025-01-20 02:24:02,755 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/11814525-cd6d-4b9e-93e8-8e25ad72f844 2025-01-20 02:24:02,765 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-01-20 02:24:02,765 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:24:02,775 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/d9c628fb-9ba6-44f3-8419-f67cc5c8c28b 2025-01-20 02:24:02,800 - INFO - Verified VN network id 9 for VN 77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:24:02,800 - INFO - Verifications in API Server for VN ctest-vn-83927932 passed 2025-01-20 02:24:02,800 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:24:02,813 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/d9c628fb-9ba6-44f3-8419-f67cc5c8c28b 2025-01-20 02:24:02,821 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/d9c628fb-9ba6-44f3-8419-f67cc5c8c28b 2025-01-20 02:24:02,831 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/11814525-cd6d-4b9e-93e8-8e25ad72f844 2025-01-20 02:24:02,847 - DEBUG - Control-node 10.0.0.40 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-48182115', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8629038260611206376', 'uuid-lslong': '13194625243653148169'}, 'enable': 'true', 'created': '2025-01-20T02:23:58', 'last-modified': '2025-01-20T02:23:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.740298'} 2025-01-20 02:24:02,857 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-01-20 02:24:02,857 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-83927932 passed 2025-01-20 02:24:02,857 - DEBUG - ====Verifying policy data for ctest-vn-83927932 in API_Server ====== 2025-01-20 02:24:02,857 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-01-20 02:24:02,864 - DEBUG - Requesting: http://10.0.0.40:8082/domain/21c3f377-201f-4207-b4ef-b03c1c786541 2025-01-20 02:24:02,887 - DEBUG - Requesting: http://10.0.0.40:8082/project/c953bc2f-efb2-4608-bee3-c1c63e2b0051 2025-01-20 02:24:03,009 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/77c08094-54fc-4ce8-b71c-b9c040590e09 2025-01-20 02:24:03,038 - DEBUG - =>VN ctest-vn-83927932 has no policy to be verified 2025-01-20 02:24:03,038 - DEBUG - Verifying the vn in opserver 2025-01-20 02:24:03,038 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 virtual network link through opserver 10.0.0.40 2025-01-20 02:24:03,038 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2025-01-20 02:24:03,438 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2025-01-20 02:24:03,551 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932', 'href': 'http://10.0.0.40:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932?flat'} 2025-01-20 02:24:03,551 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 is found in opserver 2025-01-20 02:24:03,558 - DEBUG - VRF ids for VN ctest-vn-83927932: {'10.0.0.40': '2'} 2025-01-20 02:24:03,559 - INFO - Waiting for VM ctest-TestBasicVMVN-48182115-74128716 to be up.. 2025-01-20 02:24:03,659 - DEBUG - VM is in ACTIVE state now 2025-01-20 02:24:03,659 - INFO - VM name : ctest-TestBasicVMVN-48182115-74128716 2025-01-20 02:24:03,843 - DEBUG - VM ctest-TestBasicVMVN-48182115-74128716 ID is bbb7558a-e36b-4663-b2a6-94668f5ca547 2025-01-20 02:24:03,843 - DEBUG - VM ctest-TestBasicVMVN-48182115-74128716 launched on Node cn-jenkins-deploy-platform-ansible-os-2651-1 2025-01-20 02:24:03,938 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/bbb7558a-e36b-4663-b2a6-94668f5ca547 2025-01-20 02:24:03,948 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/609e986d-2d4e-4b5f-9eea-cb5fd7eb1956 2025-01-20 02:24:07,214 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-01-20 02:24:07,215 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-48182115-74128716 failed! 2025-01-20 02:24:07,272 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 is 31.1.1.1 and allocation pool is NOT set 2025-01-20 02:24:07,272 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 is 31.1.2.1 and allocation pool is NOT set 2025-01-20 02:24:11,347 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-01-20 02:24:11,348 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-48182115-74128716 failed! 2025-01-20 02:24:11,404 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 is 31.1.1.1 and allocation pool is NOT set 2025-01-20 02:24:11,404 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 is 31.1.2.1 and allocation pool is NOT set 2025-01-20 02:24:13,466 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.64 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.01 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.008/4.322/7.636/3.314 ms') 2025-01-20 02:24:13,466 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-48182115-74128716 passed 2025-01-20 02:24:13,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:13,621 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-48182115-74128716, IP 31.1.1.4, Port 22 2025-01-20 02:24:13,686 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-01-20 02:24:13,787 - DEBUG - VM ctest-TestBasicVMVN-48182115-74128716 is NOT ready for SSH connections, VM status: ACTIVE 2025-01-20 02:24:18,789 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:18,789 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-48182115-74128716, IP 31.1.1.4, Port 22 2025-01-20 02:24:18,955 - DEBUG - VM ctest-TestBasicVMVN-48182115-74128716 is ready for SSH connections 2025-01-20 02:24:18,955 - INFO - Waiting for VM ctest-TestBasicVMVN-48182115-19142690 to be up.. 2025-01-20 02:24:19,044 - DEBUG - VM is in ACTIVE state now 2025-01-20 02:24:19,044 - INFO - VM name : ctest-TestBasicVMVN-48182115-19142690 2025-01-20 02:24:19,135 - DEBUG - VM ctest-TestBasicVMVN-48182115-19142690 ID is 3895a89a-eb21-40ba-a945-037a5940f5d1 2025-01-20 02:24:19,136 - DEBUG - VM ctest-TestBasicVMVN-48182115-19142690 launched on Node cn-jenkins-deploy-platform-ansible-os-2651-1 2025-01-20 02:24:19,222 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/3895a89a-eb21-40ba-a945-037a5940f5d1 2025-01-20 02:24:19,231 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/fef9914c-d2fc-43fb-b088-5adfcfb43a88 2025-01-20 02:24:20,470 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.14 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.552 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.552/2.344/4.137/1.792 ms') 2025-01-20 02:24:20,470 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-48182115-19142690 passed 2025-01-20 02:24:20,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:20,620 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-48182115-19142690, IP 31.1.2.4, Port 22 2025-01-20 02:24:20,777 - DEBUG - VM ctest-TestBasicVMVN-48182115-19142690 is ready for SSH connections 2025-01-20 02:24:20,777 - INFO - Waiting for VM ctest-TestBasicVMVN-48182115-07549145 to be up.. 2025-01-20 02:24:20,864 - DEBUG - VM is in ACTIVE state now 2025-01-20 02:24:20,864 - INFO - VM name : ctest-TestBasicVMVN-48182115-07549145 2025-01-20 02:24:20,956 - DEBUG - VM ctest-TestBasicVMVN-48182115-07549145 ID is 31e1f039-ad79-4749-9952-e032392be965 2025-01-20 02:24:20,956 - DEBUG - VM ctest-TestBasicVMVN-48182115-07549145 launched on Node cn-jenkins-deploy-platform-ansible-os-2651-1 2025-01-20 02:24:21,045 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/31e1f039-ad79-4749-9952-e032392be965 2025-01-20 02:24:21,057 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/a7cd2fa5-99dd-4d0e-a1cf-8caf2d6afd9d 2025-01-20 02:24:22,306 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.29 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.429 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.429/1.859/3.290/1.430 ms') 2025-01-20 02:24:22,306 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-48182115-07549145 passed 2025-01-20 02:24:22,460 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:22,460 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-48182115-07549145, IP 31.1.1.3, Port 22 2025-01-20 02:24:22,620 - DEBUG - VM ctest-TestBasicVMVN-48182115-07549145 is ready for SSH connections 2025-01-20 02:24:22,620 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:22,620 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:22,620 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-01-20 02:24:26,392 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.254 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.032 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.147 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.032/2.144/4.254 ms 2025-01-20 02:24:26,392 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-48182115-74128716 passed 2025-01-20 02:24:26,392 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:26,392 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:26,393 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-01-20 02:24:30,143 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.206 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.880 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.834 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.834/1.640/3.206 ms 2025-01-20 02:24:30,143 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-48182115-19142690 passed 2025-01-20 02:24:30,143 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:30,143 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:30,143 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-20 02:24:30,144 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:30,144 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-20 02:24:30,375 - DEBUG - None 2025-01-20 02:24:30,375 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:30,375 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-20 02:24:30,584 - DEBUG - None 2025-01-20 02:24:30,584 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:30,584 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-20 02:24:31,740 - DEBUG - None 2025-01-20 02:24:31,740 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:31,740 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-01-20 02:24:33,985 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.166 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.729 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.658 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.301 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.469 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.469/2.264/5.729 ms 2025-01-20 02:24:33,985 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:33,985 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-01-20 02:24:36,249 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.083 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.224 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.544 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.490 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.194 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.194 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.417 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.417/2.163/4.544 ms 2025-01-20 02:24:36,249 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2025-01-20 02:24:36,249 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-01-20 02:24:38,497 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.718 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.007 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.889 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.664 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.691 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=4.279 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.416 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.416/2.523/4.889 ms 2025-01-20 02:24:38,498 - INFO - Deleting VM ctest-TestBasicVMVN-48182115-07549145 2025-01-20 02:24:38,570 - INFO - Detaching port fef9914c-d2fc-43fb-b088-5adfcfb43a88 from VM ctest-TestBasicVMVN-48182115-19142690 2025-01-20 02:24:38,623 - INFO - Deleting VM ctest-TestBasicVMVN-48182115-19142690 2025-01-20 02:24:38,693 - INFO - Detaching port 609e986d-2d4e-4b5f-9eea-cb5fd7eb1956 from VM ctest-TestBasicVMVN-48182115-74128716 2025-01-20 02:24:38,726 - INFO - Deleting VM ctest-TestBasicVMVN-48182115-74128716 2025-01-20 02:24:38,801 - INFO - Deleting VN ctest-vn-83927932 2025-01-20 02:24:38,961 - DEBUG - Response for delete_port : () 2025-01-20 02:24:39,128 - DEBUG - Response for delete_port : () 2025-01-20 02:24:39,169 - DEBUG - VN 77c08094-54fc-4ce8-b71c-b9c040590e09 still in use: Unable to complete operation on network 77c08094-54fc-4ce8-b71c-b9c040590e09. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-2d33d0fe-30fa-4811-962a-9e9cff328e4a'] 2025-01-20 02:24:39,169 - WARNING - Deleting VN ctest-vn-83927932 failed..Will retry 2025-01-20 02:24:41,315 - DEBUG - Response for deleting network () 2025-01-20 02:24:41,315 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/d9c628fb-9ba6-44f3-8419-f67cc5c8c28b 2025-01-20 02:24:41,326 - DEBUG - Response Code: 404 2025-01-20 02:24:41,327 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2025-01-20 02:24:41,334 - DEBUG - Requesting: http://10.0.0.40:8082/domain/21c3f377-201f-4207-b4ef-b03c1c786541 2025-01-20 02:24:41,391 - DEBUG - Requesting: http://10.0.0.40:8082/project/c953bc2f-efb2-4608-bee3-c1c63e2b0051 2025-01-20 02:24:41,469 - INFO - Validated that VN ctest-vn-83927932 is not found in API Server 2025-01-20 02:24:41,484 - DEBUG - VN ctest-vn-83927932 is not present in Agent 10.0.0.40 2025-01-20 02:24:41,484 - INFO - Validated that VN ctest-vn-83927932 is not in any agent 2025-01-20 02:24:41,494 - DEBUG - VRF 2 is not seen in agent 10.0.0.40 2025-01-20 02:24:41,502 - DEBUG - Vrouter 10.0.0.40 does not have vrf 2 for VN ctest-vn-83927932 2025-01-20 02:24:41,502 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-48182115:ctest-vn-83927932 2025-01-20 02:24:41,516 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-83927932 info 2025-01-20 02:24:41,600 - INFO - IPAM: ctest-ipam-80649730 is not found in API Server 2025-01-20 02:24:41,618 - INFO - IPAM:ctest-ipam-80649730 is not found in control node 2025-01-20 02:24:41,893 - DEBUG - No XMPP flaps were noticed during the test 2025-01-20 02:24:41,893 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:43] 2025-01-20 02:24:41,894 - INFO - -------------------------------------------------------------------------------- 2025-01-20 02:24:42,648 - INFO - Deleted project: ctest-TestBasicVMVN-48182115, ID : c953bc2f-efb2-4608-bee3-c1c63e2b0051