2024-10-28 16:27:48,059 - INFO - Domain Default found not creating 2024-10-28 16:27:48,269 - INFO - Project ctest-TestBasicVMVN-49925123 not found, creating it 2024-10-28 16:27:48,826 - INFO - Created Project:ctest-TestBasicVMVN-49925123, ID : f3f22f4c-c163-463f-944b-c5f5a14462e6 2024-10-28 16:27:50,536 - INFO - ================================================================================ 2024-10-28 16:27:50,536 - INFO - STARTING TEST : test_generic_link_local_service 2024-10-28 16:27:50,537 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-10-28 16:27:50,793 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.20.0.22': '0'}} with 2024-10-28 16:27:50,793 - INFO - Initial checks done. Running the testcase now 2024-10-28 16:27:50,793 - INFO - 2024-10-28 16:27:51,443 - DEBUG - Response for create_network : {'network': {'id': '4ac0e798-a04f-4f1b-939a-4b3eab9066ba', 'name': 'ctest-vn2_metadata-73174175', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-49925123', 'ctest-vn2_metadata-73174175'], 'port_security_enabled': True, 'description': ''}} 2024-10-28 16:27:51,629 - DEBUG - Response for create_subnet : {'subnet': {'id': '3f0477eb-a792-4c89-9c1f-02e7306c521d', 'name': '', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'network_id': '4ac0e798-a04f-4f1b-939a-4b3eab9066ba', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6'}} 2024-10-28 16:27:51,650 - INFO - Created VN ctest-vn2_metadata-73174175 2024-10-28 16:27:51,709 - DEBUG - VN ctest-vn2_metadata-73174175 UUID is 4ac0e798-a04f-4f1b-939a-4b3eab9066ba 2024-10-28 16:27:51,915 - DEBUG - Services list from nova: [, , ] 2024-10-28 16:27:53,058 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2167-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2167-1) 2024-10-28 16:27:53,181 - DEBUG - Link local service introspect added 2024-10-28 16:27:53,235 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-28 16:27:58,366 - DEBUG - VM is in ACTIVE state now 2024-10-28 16:27:58,503 - INFO - Waiting for VM ctest-TestBasicVMVN-49925123-03850606 to be up.. 2024-10-28 16:27:58,503 - INFO - VM name : ctest-TestBasicVMVN-49925123-03850606 2024-10-28 16:27:58,590 - DEBUG - VM ctest-TestBasicVMVN-49925123-03850606 ID is 9569953e-5c89-4f08-b858-4aa6b758f678 2024-10-28 16:27:58,590 - DEBUG - VM ctest-TestBasicVMVN-49925123-03850606 launched on Node cn-jenkins-deploy-platform-ansible-os-2167-1 2024-10-28 16:27:58,683 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine/9569953e-5c89-4f08-b858-4aa6b758f678 2024-10-28 16:27:59,282 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine/9569953e-5c89-4f08-b858-4aa6b758f678 2024-10-28 16:27:59,344 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine-interface/579ebfba-a409-4d07-b3b4-a815741eda66 2024-10-28 16:28:02,641 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2024-10-28 16:28:02,642 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-49925123-03850606 failed! 2024-10-28 16:28:02,701 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-49925123:ctest-vn2_metadata-73174175 is 11.1.1.1 and allocation pool is NOT set 2024-10-28 16:28:04,763 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.51 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.621 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.621/2.067/3.514/1.446 ms') 2024-10-28 16:28:04,763 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-49925123-03850606 passed 2024-10-28 16:28:04,925 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:04,925 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-49925123-03850606, IP 11.1.1.3, Port 22 2024-10-28 16:28:05,095 - DEBUG - VM ctest-TestBasicVMVN-49925123-03850606 is ready for SSH connections 2024-10-28 16:28:05,096 - INFO - Retry 0 2024-10-28 16:28:05,096 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:05,096 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-10-28 16:28:06,717 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-10-28 16:28:06,717 - INFO - Generic metadata worked 2024-10-28 16:28:06,989 - DEBUG - Link local service introspect removed 2024-10-28 16:28:06,989 - INFO - Deleting VM ctest-TestBasicVMVN-49925123-03850606 2024-10-28 16:28:07,078 - INFO - Deleting VN ctest-vn2_metadata-73174175 2024-10-28 16:28:07,128 - DEBUG - VN 4ac0e798-a04f-4f1b-939a-4b3eab9066ba still in use: Unable to complete operation on network 4ac0e798-a04f-4f1b-939a-4b3eab9066ba. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6e8d6442-58c8-48ec-80c6-266588bf824b'] 2024-10-28 16:28:07,128 - WARNING - Deleting VN ctest-vn2_metadata-73174175 failed..Will retry 2024-10-28 16:28:09,248 - DEBUG - Response for deleting network () 2024-10-28 16:28:09,511 - DEBUG - No XMPP flaps were noticed during the test 2024-10-28 16:28:09,511 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:19] 2024-10-28 16:28:09,511 - INFO - -------------------------------------------------------------------------------- 2024-10-28 16:28:09,514 - INFO - ================================================================================ 2024-10-28 16:28:09,514 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-10-28 16:28:09,514 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-10-28 16:28:09,799 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.20.0.22': '0'}} with 2024-10-28 16:28:09,799 - INFO - Initial checks done. Running the testcase now 2024-10-28 16:28:09,799 - INFO - 2024-10-28 16:28:10,356 - DEBUG - Response for create_network : {'network': {'id': '47d99b74-8473-49e3-9350-9529c5d68488', 'name': 'ctest-vn-25476619', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-49925123', 'ctest-vn-25476619'], 'port_security_enabled': True, 'description': ''}} 2024-10-28 16:28:10,607 - DEBUG - Response for create_subnet : {'subnet': {'id': '8216666a-784d-45db-a6df-56cd96d3fe0d', 'name': '', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'network_id': '47d99b74-8473-49e3-9350-9529c5d68488', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6'}} 2024-10-28 16:28:10,819 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b2339250-0278-4ea2-b9c1-5cce2e0a2697', 'name': '', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'network_id': '47d99b74-8473-49e3-9350-9529c5d68488', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6'}} 2024-10-28 16:28:10,843 - INFO - Created VN ctest-vn-25476619 2024-10-28 16:28:10,905 - DEBUG - VN ctest-vn-25476619 UUID is 47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:11,342 - DEBUG - Response for create_port : {'port': {'name': 'ac6ab2c6-1ef1-44d6-8701-c6eca54ed3fa', 'id': 'ac6ab2c6-1ef1-44d6-8701-c6eca54ed3fa', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'network_id': '47d99b74-8473-49e3-9350-9529c5d68488', 'mac_address': '02:ac:6a:b2:c6:1e', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '8216666a-784d-45db-a6df-56cd96d3fe0d'}], 'security_groups': ['7d1275e5-8857-4554-9d17-f0b159a520bc'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6'}} 2024-10-28 16:28:11,560 - DEBUG - Response for create_port : {'port': {'name': '033bd67d-b7fc-40f3-846a-01ddcf30e8b2', 'id': '033bd67d-b7fc-40f3-846a-01ddcf30e8b2', 'tenant_id': 'f3f22f4cc163463f944bc5f5a14462e6', 'network_id': '47d99b74-8473-49e3-9350-9529c5d68488', 'mac_address': '02:03:3b:d6:7d:b7', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'b2339250-0278-4ea2-b9c1-5cce2e0a2697'}], 'security_groups': ['7d1275e5-8857-4554-9d17-f0b159a520bc'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'f3f22f4cc163463f944bc5f5a14462e6'}} 2024-10-28 16:28:12,252 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2167-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2167-1) 2024-10-28 16:28:12,738 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2167-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2167-1) 2024-10-28 16:28:14,175 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2167-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2167-1) 2024-10-28 16:28:14,176 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2024-10-28 16:28:14,186 - DEBUG - Requesting: http://10.0.0.42:8082/domain/0eadca13-f91b-4073-b75d-e931ef45dff3 2024-10-28 16:28:14,206 - DEBUG - Requesting: http://10.0.0.42:8082/project/f3f22f4c-c163-463f-944b-c5f5a14462e6 2024-10-28 16:28:14,291 - DEBUG - Requesting: http://10.0.0.42:8082/network-ipam/fdb6c852-e785-4f9b-8b60-5095353d62db 2024-10-28 16:28:14,303 - INFO - Verifications in API Server for IPAM: ctest-ipam-80319520 passed 2024-10-28 16:28:14,312 - DEBUG - Control-node 10.0.0.42 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-49925123:ctest-ipam-80319520', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-49925123', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18282019995754254235', 'uuid-lslong': '10043115770809770715'}, 'enable': 'true', 'created': '2024-10-28T16:28:09', 'last-modified': '2024-10-28T16:28:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.271762'} 2024-10-28 16:28:14,313 - INFO - Verifications in Control node for IPAM: ctest-ipam-80319520 passed 2024-10-28 16:28:14,313 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2024-10-28 16:28:14,322 - DEBUG - Requesting: http://10.0.0.42:8082/domain/0eadca13-f91b-4073-b75d-e931ef45dff3 2024-10-28 16:28:14,347 - DEBUG - Requesting: http://10.0.0.42:8082/project/f3f22f4c-c163-463f-944b-c5f5a14462e6 2024-10-28 16:28:14,446 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:14,472 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:14,498 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/954227f6-0c01-4917-8e56-b547c7cb3f64 2024-10-28 16:28:14,515 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/954227f6-0c01-4917-8e56-b547c7cb3f64 2024-10-28 16:28:14,533 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/96727e0f-5b26-48c1-b086-f2f08d2c5a66 2024-10-28 16:28:14,549 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-28 16:28:14,549 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:14,571 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/954227f6-0c01-4917-8e56-b547c7cb3f64 2024-10-28 16:28:14,606 - INFO - Verified VN network id 8 for VN 47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:14,606 - INFO - Verifications in API Server for VN ctest-vn-25476619 passed 2024-10-28 16:28:14,606 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:14,630 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/954227f6-0c01-4917-8e56-b547c7cb3f64 2024-10-28 16:28:14,648 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/954227f6-0c01-4917-8e56-b547c7cb3f64 2024-10-28 16:28:14,681 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/96727e0f-5b26-48c1-b086-f2f08d2c5a66 2024-10-28 16:28:14,702 - DEBUG - Control-node 10.0.0.42 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-49925123', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5177340171379755491', 'uuid-lslong': '10615148328357627016'}, 'enable': 'true', 'created': '2024-10-28T16:28:10', 'last-modified': '2024-10-28T16:28:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.911348'} 2024-10-28 16:28:14,718 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-28 16:28:14,718 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-25476619 passed 2024-10-28 16:28:14,718 - DEBUG - ====Verifying policy data for ctest-vn-25476619 in API_Server ====== 2024-10-28 16:28:14,718 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2024-10-28 16:28:14,734 - DEBUG - Requesting: http://10.0.0.42:8082/domain/0eadca13-f91b-4073-b75d-e931ef45dff3 2024-10-28 16:28:14,805 - DEBUG - Requesting: http://10.0.0.42:8082/project/f3f22f4c-c163-463f-944b-c5f5a14462e6 2024-10-28 16:28:14,998 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/47d99b74-8473-49e3-9350-9529c5d68488 2024-10-28 16:28:15,029 - DEBUG - =>VN ctest-vn-25476619 has no policy to be verified 2024-10-28 16:28:15,029 - DEBUG - Verifying the vn in opserver 2024-10-28 16:28:15,029 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 virtual network link through opserver 10.0.0.42 2024-10-28 16:28:15,029 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks 2024-10-28 16:28:15,432 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks 2024-10-28 16:28:15,529 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619', 'href': 'http://10.0.0.42:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619?flat'} 2024-10-28 16:28:15,529 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 is found in opserver 2024-10-28 16:28:15,537 - DEBUG - VRF ids for VN ctest-vn-25476619: {'10.0.0.42': '2'} 2024-10-28 16:28:15,537 - INFO - Waiting for VM ctest-TestBasicVMVN-49925123-17251397 to be up.. 2024-10-28 16:28:15,663 - DEBUG - VM is in ACTIVE state now 2024-10-28 16:28:15,663 - INFO - VM name : ctest-TestBasicVMVN-49925123-17251397 2024-10-28 16:28:15,784 - DEBUG - VM ctest-TestBasicVMVN-49925123-17251397 ID is b7e8b5f2-f9fc-426a-ba9b-801095a28215 2024-10-28 16:28:15,784 - DEBUG - VM ctest-TestBasicVMVN-49925123-17251397 launched on Node cn-jenkins-deploy-platform-ansible-os-2167-1 2024-10-28 16:28:15,913 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine/b7e8b5f2-f9fc-426a-ba9b-801095a28215 2024-10-28 16:28:15,930 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine-interface/ac6ab2c6-1ef1-44d6-8701-c6eca54ed3fa 2024-10-28 16:28:19,222 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2024-10-28 16:28:19,222 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-49925123-17251397 failed! 2024-10-28 16:28:19,289 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 is 31.1.1.1 and allocation pool is NOT set 2024-10-28 16:28:19,290 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 is 31.1.2.1 and allocation pool is NOT set 2024-10-28 16:28:23,384 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2024-10-28 16:28:23,384 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-49925123-17251397 failed! 2024-10-28 16:28:23,453 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 is 31.1.1.1 and allocation pool is NOT set 2024-10-28 16:28:23,453 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 is 31.1.2.1 and allocation pool is NOT set 2024-10-28 16:28:25,522 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.00 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.999/3.988/4.978/0.989 ms') 2024-10-28 16:28:25,522 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-49925123-17251397 passed 2024-10-28 16:28:25,693 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:25,693 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-49925123-17251397, IP 31.1.1.4, Port 22 2024-10-28 16:28:25,852 - DEBUG - VM ctest-TestBasicVMVN-49925123-17251397 is ready for SSH connections 2024-10-28 16:28:25,853 - INFO - Waiting for VM ctest-TestBasicVMVN-49925123-97296108 to be up.. 2024-10-28 16:28:25,953 - DEBUG - VM is in ACTIVE state now 2024-10-28 16:28:25,953 - INFO - VM name : ctest-TestBasicVMVN-49925123-97296108 2024-10-28 16:28:26,046 - DEBUG - VM ctest-TestBasicVMVN-49925123-97296108 ID is aa8bda08-04c0-42fb-80fd-c3a568697c5b 2024-10-28 16:28:26,046 - DEBUG - VM ctest-TestBasicVMVN-49925123-97296108 launched on Node cn-jenkins-deploy-platform-ansible-os-2167-1 2024-10-28 16:28:26,151 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine/aa8bda08-04c0-42fb-80fd-c3a568697c5b 2024-10-28 16:28:26,164 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine-interface/033bd67d-b7fc-40f3-846a-01ddcf30e8b2 2024-10-28 16:28:27,468 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.18 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.575 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.575/1.879/3.183/1.304 ms') 2024-10-28 16:28:27,468 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-49925123-97296108 passed 2024-10-28 16:28:27,633 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:27,633 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-49925123-97296108, IP 31.1.2.4, Port 22 2024-10-28 16:28:27,803 - DEBUG - VM ctest-TestBasicVMVN-49925123-97296108 is ready for SSH connections 2024-10-28 16:28:27,803 - INFO - Waiting for VM ctest-TestBasicVMVN-49925123-59626387 to be up.. 2024-10-28 16:28:27,899 - DEBUG - VM is in ACTIVE state now 2024-10-28 16:28:27,899 - INFO - VM name : ctest-TestBasicVMVN-49925123-59626387 2024-10-28 16:28:28,007 - DEBUG - VM ctest-TestBasicVMVN-49925123-59626387 ID is b14053e7-bca4-402b-ad90-294ad091010b 2024-10-28 16:28:28,007 - DEBUG - VM ctest-TestBasicVMVN-49925123-59626387 launched on Node cn-jenkins-deploy-platform-ansible-os-2167-1 2024-10-28 16:28:28,118 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine/b14053e7-bca4-402b-ad90-294ad091010b 2024-10-28 16:28:28,129 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-machine-interface/4d93fd3a-0de5-4946-b237-0b4aafc181af 2024-10-28 16:28:29,398 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.00 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.395 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.395/1.697/3.000/1.302 ms') 2024-10-28 16:28:29,398 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-49925123-59626387 passed 2024-10-28 16:28:29,557 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:29,557 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-49925123-59626387, IP 31.1.1.3, Port 22 2024-10-28 16:28:29,724 - DEBUG - VM ctest-TestBasicVMVN-49925123-59626387 is ready for SSH connections 2024-10-28 16:28:29,725 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:29,725 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:29,725 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-10-28 16:28:33,606 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.933 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.937 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.261 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.937/2.043/3.933 ms 2024-10-28 16:28:33,607 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-49925123-17251397 passed 2024-10-28 16:28:33,607 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:33,607 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:33,607 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-10-28 16:28:37,289 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=2.837 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=1.130 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.028 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.028/1.665/2.837 ms 2024-10-28 16:28:37,289 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-49925123-97296108 passed 2024-10-28 16:28:37,289 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:37,289 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:37,289 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-28 16:28:37,289 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:37,289 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-28 16:28:37,485 - DEBUG - None 2024-10-28 16:28:37,486 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:37,486 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-28 16:28:37,673 - DEBUG - None 2024-10-28 16:28:37,674 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:37,674 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-28 16:28:38,308 - DEBUG - None 2024-10-28 16:28:38,308 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:38,308 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-10-28 16:28:40,524 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.978 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.001 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.466 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.452 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.400 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.400/1.859/4.001 ms 2024-10-28 16:28:40,524 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:40,524 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-10-28 16:28:42,787 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.395 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.636 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.911 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.479 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.786 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.735 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.400 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.400/2.620/5.911 ms 2024-10-28 16:28:42,787 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.42, gateway password: c0ntrail123 2024-10-28 16:28:42,788 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-10-28 16:28:45,069 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.805 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.880 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=6.232 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.513 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.336 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.496 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.410 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.410/2.810/6.232 ms 2024-10-28 16:28:45,069 - INFO - Deleting VM ctest-TestBasicVMVN-49925123-59626387 2024-10-28 16:28:45,144 - INFO - Detaching port 033bd67d-b7fc-40f3-846a-01ddcf30e8b2 from VM ctest-TestBasicVMVN-49925123-97296108 2024-10-28 16:28:45,205 - INFO - Deleting VM ctest-TestBasicVMVN-49925123-97296108 2024-10-28 16:28:45,278 - INFO - Detaching port ac6ab2c6-1ef1-44d6-8701-c6eca54ed3fa from VM ctest-TestBasicVMVN-49925123-17251397 2024-10-28 16:28:45,315 - INFO - Deleting VM ctest-TestBasicVMVN-49925123-17251397 2024-10-28 16:28:45,394 - INFO - Deleting VN ctest-vn-25476619 2024-10-28 16:28:45,608 - DEBUG - Response for delete_port : () 2024-10-28 16:28:45,921 - DEBUG - Response for delete_port : () 2024-10-28 16:28:45,991 - DEBUG - VN 47d99b74-8473-49e3-9350-9529c5d68488 still in use: Unable to complete operation on network 47d99b74-8473-49e3-9350-9529c5d68488. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-23d93e55-6cfc-41d2-9664-20742291e8e0'] 2024-10-28 16:28:45,991 - WARNING - Deleting VN ctest-vn-25476619 failed..Will retry 2024-10-28 16:28:48,177 - DEBUG - Response for deleting network () 2024-10-28 16:28:48,177 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/954227f6-0c01-4917-8e56-b547c7cb3f64 2024-10-28 16:28:48,185 - DEBUG - Response Code: 404 2024-10-28 16:28:48,185 - DEBUG - Requesting: http://10.0.0.42:8082/domains 2024-10-28 16:28:48,193 - DEBUG - Requesting: http://10.0.0.42:8082/domain/0eadca13-f91b-4073-b75d-e931ef45dff3 2024-10-28 16:28:48,251 - DEBUG - Requesting: http://10.0.0.42:8082/project/f3f22f4c-c163-463f-944b-c5f5a14462e6 2024-10-28 16:28:48,337 - INFO - Validated that VN ctest-vn-25476619 is not found in API Server 2024-10-28 16:28:48,354 - DEBUG - VN ctest-vn-25476619 is not present in Agent 10.0.0.42 2024-10-28 16:28:48,354 - INFO - Validated that VN ctest-vn-25476619 is not in any agent 2024-10-28 16:28:48,363 - DEBUG - VRF 2 is not seen in agent 10.0.0.42 2024-10-28 16:28:48,371 - DEBUG - Vrouter 10.0.0.42 does not have vrf 2 for VN ctest-vn-25476619 2024-10-28 16:28:48,371 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-49925123:ctest-vn-25476619 2024-10-28 16:28:48,385 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-25476619 info 2024-10-28 16:28:48,465 - INFO - IPAM: ctest-ipam-80319520 is not found in API Server 2024-10-28 16:28:48,480 - INFO - IPAM:ctest-ipam-80319520 is not found in control node 2024-10-28 16:28:48,739 - DEBUG - No XMPP flaps were noticed during the test 2024-10-28 16:28:48,739 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:39] 2024-10-28 16:28:48,740 - INFO - -------------------------------------------------------------------------------- 2024-10-28 16:28:49,477 - INFO - Deleted project: ctest-TestBasicVMVN-49925123, ID : f3f22f4c-c163-463f-944b-c5f5a14462e6