2024-08-21 09:09:31,705 - INFO - Domain Default found not creating 2024-08-21 09:09:31,877 - INFO - Project ctest-TestBasicVMVN-68998769 not found, creating it 2024-08-21 09:09:32,359 - INFO - Created Project:ctest-TestBasicVMVN-68998769, ID : d665e6a6-d141-4f8a-b2a6-93b4450f4af4 2024-08-21 09:09:33,944 - INFO - ================================================================================ 2024-08-21 09:09:33,944 - INFO - STARTING TEST : test_generic_link_local_service 2024-08-21 09:09:33,944 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-08-21 09:09:34,214 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.28': '0'}} with 2024-08-21 09:09:34,214 - INFO - Initial checks done. Running the testcase now 2024-08-21 09:09:34,214 - INFO - 2024-08-21 09:09:34,772 - DEBUG - Response for create_network : {'network': {'id': '5b321958-66e1-4040-907a-a017d69057fb', 'name': 'ctest-vn2_metadata-77896340', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-68998769', 'ctest-vn2_metadata-77896340'], 'port_security_enabled': True, 'description': ''}} 2024-08-21 09:09:34,975 - DEBUG - Response for create_subnet : {'subnet': {'id': '66e9b802-b47b-4614-ba56-3ba23c401739', 'name': '', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'network_id': '5b321958-66e1-4040-907a-a017d69057fb', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4'}} 2024-08-21 09:09:34,996 - INFO - Created VN ctest-vn2_metadata-77896340 2024-08-21 09:09:35,045 - DEBUG - VN ctest-vn2_metadata-77896340 UUID is 5b321958-66e1-4040-907a-a017d69057fb 2024-08-21 09:09:35,242 - DEBUG - Services list from nova: [, , ] 2024-08-21 09:09:36,264 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1680-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1680-1) 2024-08-21 09:09:36,372 - DEBUG - Link local service introspect added 2024-08-21 09:09:36,416 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-08-21 09:09:41,500 - DEBUG - VM is in ACTIVE state now 2024-08-21 09:09:41,639 - INFO - Waiting for VM ctest-TestBasicVMVN-68998769-02386810 to be up.. 2024-08-21 09:09:41,640 - INFO - VM name : ctest-TestBasicVMVN-68998769-02386810 2024-08-21 09:09:41,739 - DEBUG - VM ctest-TestBasicVMVN-68998769-02386810 ID is fb28f9c6-4eef-461d-b448-ea5f86376904 2024-08-21 09:09:41,739 - DEBUG - VM ctest-TestBasicVMVN-68998769-02386810 launched on Node cn-jenkins-deploy-platform-ansible-os-1680-1 2024-08-21 09:09:41,828 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/fb28f9c6-4eef-461d-b448-ea5f86376904 2024-08-21 09:09:42,151 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/fb28f9c6-4eef-461d-b448-ea5f86376904 2024-08-21 09:09:42,189 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/b43bf916-10f9-4350-888c-1522ca0c99fc 2024-08-21 09:09:45,442 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2024-08-21 09:09:45,442 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-68998769-02386810 failed! 2024-08-21 09:09:45,497 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-68998769:ctest-vn2_metadata-77896340 is 11.1.1.1 and allocation pool is NOT set 2024-08-21 09:09:47,560 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.17 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.79 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.786/4.979/7.173/2.193 ms') 2024-08-21 09:09:47,561 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-68998769-02386810 passed 2024-08-21 09:09:47,713 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:09:47,713 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-68998769-02386810, IP 11.1.1.3, Port 22 2024-08-21 09:09:47,868 - DEBUG - VM ctest-TestBasicVMVN-68998769-02386810 is ready for SSH connections 2024-08-21 09:09:47,868 - INFO - Retry 0 2024-08-21 09:09:47,868 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:09:47,868 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-08-21 09:09:49,471 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-08-21 09:09:49,471 - INFO - Generic metadata worked 2024-08-21 09:09:49,737 - DEBUG - Link local service introspect removed 2024-08-21 09:09:49,737 - INFO - Deleting VM ctest-TestBasicVMVN-68998769-02386810 2024-08-21 09:09:49,826 - INFO - Deleting VN ctest-vn2_metadata-77896340 2024-08-21 09:09:49,866 - DEBUG - VN 5b321958-66e1-4040-907a-a017d69057fb still in use: Unable to complete operation on network 5b321958-66e1-4040-907a-a017d69057fb. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-8f7a3376-a4de-446d-9247-c78c6965bdfb'] 2024-08-21 09:09:49,866 - WARNING - Deleting VN ctest-vn2_metadata-77896340 failed..Will retry 2024-08-21 09:09:52,024 - DEBUG - Response for deleting network () 2024-08-21 09:09:52,283 - DEBUG - No XMPP flaps were noticed during the test 2024-08-21 09:09:52,283 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:19] 2024-08-21 09:09:52,283 - INFO - -------------------------------------------------------------------------------- 2024-08-21 09:09:52,286 - INFO - ================================================================================ 2024-08-21 09:09:52,286 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-08-21 09:09:52,286 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-08-21 09:09:52,570 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.20.0.28': '0'}} with 2024-08-21 09:09:52,571 - INFO - Initial checks done. Running the testcase now 2024-08-21 09:09:52,571 - INFO - 2024-08-21 09:09:53,083 - DEBUG - Response for create_network : {'network': {'id': '46bae0e7-ac32-406f-ac99-6c58eb9db437', 'name': 'ctest-vn-62677222', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-68998769', 'ctest-vn-62677222'], 'port_security_enabled': True, 'description': ''}} 2024-08-21 09:09:53,308 - DEBUG - Response for create_subnet : {'subnet': {'id': '07ea3e5c-4eb7-4e6b-b409-cff6dcd8a124', 'name': '', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'network_id': '46bae0e7-ac32-406f-ac99-6c58eb9db437', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4'}} 2024-08-21 09:09:53,450 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a0932f7b-c393-47ad-b3d5-65e509143a69', 'name': '', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'network_id': '46bae0e7-ac32-406f-ac99-6c58eb9db437', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4'}} 2024-08-21 09:09:53,474 - INFO - Created VN ctest-vn-62677222 2024-08-21 09:09:53,525 - DEBUG - VN ctest-vn-62677222 UUID is 46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:53,929 - DEBUG - Response for create_port : {'port': {'name': '570faebc-9dc7-4a9b-98af-9366538f49bd', 'id': '570faebc-9dc7-4a9b-98af-9366538f49bd', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'network_id': '46bae0e7-ac32-406f-ac99-6c58eb9db437', 'mac_address': '02:57:0f:ae:bc:9d', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '07ea3e5c-4eb7-4e6b-b409-cff6dcd8a124'}], 'security_groups': ['64606030-1600-4453-98ab-3262611724de'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4'}} 2024-08-21 09:09:54,112 - DEBUG - Response for create_port : {'port': {'name': '03bca4bd-c1f8-498a-a2cd-28d7334db440', 'id': '03bca4bd-c1f8-498a-a2cd-28d7334db440', 'tenant_id': 'd665e6a6d1414f8ab2a693b4450f4af4', 'network_id': '46bae0e7-ac32-406f-ac99-6c58eb9db437', 'mac_address': '02:03:bc:a4:bd:c1', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'a0932f7b-c393-47ad-b3d5-65e509143a69'}], 'security_groups': ['64606030-1600-4453-98ab-3262611724de'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'd665e6a6d1414f8ab2a693b4450f4af4'}} 2024-08-21 09:09:54,623 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1680-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1680-1) 2024-08-21 09:09:55,087 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1680-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1680-1) 2024-08-21 09:09:56,277 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-1680-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-1680-1) 2024-08-21 09:09:56,277 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2024-08-21 09:09:56,284 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c71d6dcd-4970-4416-ad48-05f2e0e07161 2024-08-21 09:09:56,302 - DEBUG - Requesting: http://10.0.0.23:8082/project/d665e6a6-d141-4f8a-b2a6-93b4450f4af4 2024-08-21 09:09:56,385 - DEBUG - Requesting: http://10.0.0.23:8082/network-ipam/a650fdbc-020b-4ee4-98b3-41871e621cbc 2024-08-21 09:09:56,396 - INFO - Verifications in API Server for IPAM: ctest-ipam-18379960 passed 2024-08-21 09:09:56,407 - DEBUG - Control-node 10.0.0.23 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-68998769:ctest-ipam-18379960', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-68998769', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11984357592362864356', 'uuid-lslong': '11003210363182390460'}, 'enable': 'true', 'created': '2024-08-21T09:09:52', 'last-modified': '2024-08-21T09:09:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.594395'} 2024-08-21 09:09:56,407 - INFO - Verifications in Control node for IPAM: ctest-ipam-18379960 passed 2024-08-21 09:09:56,407 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2024-08-21 09:09:56,419 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c71d6dcd-4970-4416-ad48-05f2e0e07161 2024-08-21 09:09:56,437 - DEBUG - Requesting: http://10.0.0.23:8082/project/d665e6a6-d141-4f8a-b2a6-93b4450f4af4 2024-08-21 09:09:56,529 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:56,544 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:56,567 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/89fa43e7-4d26-4202-ac8b-1cc2ef15ac41 2024-08-21 09:09:56,577 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/89fa43e7-4d26-4202-ac8b-1cc2ef15ac41 2024-08-21 09:09:56,587 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f90cc732-e9ff-4fd5-8304-5914f1d7b56e 2024-08-21 09:09:56,594 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-08-21 09:09:56,594 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:56,605 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/89fa43e7-4d26-4202-ac8b-1cc2ef15ac41 2024-08-21 09:09:56,621 - INFO - Verified VN network id 9 for VN 46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:56,621 - INFO - Verifications in API Server for VN ctest-vn-62677222 passed 2024-08-21 09:09:56,621 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:56,632 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/89fa43e7-4d26-4202-ac8b-1cc2ef15ac41 2024-08-21 09:09:56,642 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/89fa43e7-4d26-4202-ac8b-1cc2ef15ac41 2024-08-21 09:09:56,655 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f90cc732-e9ff-4fd5-8304-5914f1d7b56e 2024-08-21 09:09:56,674 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-68998769', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5096633213954179183', 'uuid-lslong': '12437090975126238263'}, 'enable': 'true', 'created': '2024-08-21T09:09:53', 'last-modified': '2024-08-21T09:09:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.251385'} 2024-08-21 09:09:56,681 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-08-21 09:09:56,682 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-62677222 passed 2024-08-21 09:09:56,682 - DEBUG - ====Verifying policy data for ctest-vn-62677222 in API_Server ====== 2024-08-21 09:09:56,682 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2024-08-21 09:09:56,689 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c71d6dcd-4970-4416-ad48-05f2e0e07161 2024-08-21 09:09:56,704 - DEBUG - Requesting: http://10.0.0.23:8082/project/d665e6a6-d141-4f8a-b2a6-93b4450f4af4 2024-08-21 09:09:56,803 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/46bae0e7-ac32-406f-ac99-6c58eb9db437 2024-08-21 09:09:56,821 - DEBUG - =>VN ctest-vn-62677222 has no policy to be verified 2024-08-21 09:09:56,821 - DEBUG - Verifying the vn in opserver 2024-08-21 09:09:56,821 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 virtual network link through opserver 10.0.0.23 2024-08-21 09:09:56,821 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2024-08-21 09:09:57,211 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2024-08-21 09:09:57,282 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222?flat'} 2024-08-21 09:09:57,282 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 is found in opserver 2024-08-21 09:09:57,289 - DEBUG - VRF ids for VN ctest-vn-62677222: {'10.0.0.23': '2'} 2024-08-21 09:09:57,289 - INFO - Waiting for VM ctest-TestBasicVMVN-68998769-35337196 to be up.. 2024-08-21 09:09:57,397 - DEBUG - VM is in ACTIVE state now 2024-08-21 09:09:57,397 - INFO - VM name : ctest-TestBasicVMVN-68998769-35337196 2024-08-21 09:09:57,512 - DEBUG - VM ctest-TestBasicVMVN-68998769-35337196 ID is 6e30e475-c1c2-42d2-8e51-cf5e73b2fb83 2024-08-21 09:09:57,512 - DEBUG - VM ctest-TestBasicVMVN-68998769-35337196 launched on Node cn-jenkins-deploy-platform-ansible-os-1680-1 2024-08-21 09:09:57,657 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/6e30e475-c1c2-42d2-8e51-cf5e73b2fb83 2024-08-21 09:09:57,673 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/570faebc-9dc7-4a9b-98af-9366538f49bd 2024-08-21 09:10:00,953 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2024-08-21 09:10:00,954 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-68998769-35337196 failed! 2024-08-21 09:10:01,009 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 is 31.1.1.1 and allocation pool is NOT set 2024-08-21 09:10:01,009 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 is 31.1.2.1 and allocation pool is NOT set 2024-08-21 09:10:05,089 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2024-08-21 09:10:05,089 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-68998769-35337196 failed! 2024-08-21 09:10:05,149 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 is 31.1.1.1 and allocation pool is NOT set 2024-08-21 09:10:05,149 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 is 31.1.2.1 and allocation pool is NOT set 2024-08-21 09:10:07,217 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.02 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.024/5.971/9.918/3.947 ms') 2024-08-21 09:10:07,217 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-68998769-35337196 passed 2024-08-21 09:10:07,369 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:07,369 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-68998769-35337196, IP 31.1.1.4, Port 22 2024-08-21 09:10:07,424 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-08-21 09:10:07,505 - DEBUG - VM ctest-TestBasicVMVN-68998769-35337196 is NOT ready for SSH connections, VM status: ACTIVE 2024-08-21 09:10:12,506 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:12,507 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-68998769-35337196, IP 31.1.1.4, Port 22 2024-08-21 09:10:12,665 - DEBUG - VM ctest-TestBasicVMVN-68998769-35337196 is ready for SSH connections 2024-08-21 09:10:12,665 - INFO - Waiting for VM ctest-TestBasicVMVN-68998769-02280607 to be up.. 2024-08-21 09:10:12,755 - DEBUG - VM is in ACTIVE state now 2024-08-21 09:10:12,755 - INFO - VM name : ctest-TestBasicVMVN-68998769-02280607 2024-08-21 09:10:12,836 - DEBUG - VM ctest-TestBasicVMVN-68998769-02280607 ID is 486d87ac-96ff-42b4-8ef5-e015de099e51 2024-08-21 09:10:12,836 - DEBUG - VM ctest-TestBasicVMVN-68998769-02280607 launched on Node cn-jenkins-deploy-platform-ansible-os-1680-1 2024-08-21 09:10:12,936 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/486d87ac-96ff-42b4-8ef5-e015de099e51 2024-08-21 09:10:12,946 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/03bca4bd-c1f8-498a-a2cd-28d7334db440 2024-08-21 09:10:14,185 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.89 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.406 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.406/1.648/2.891/1.242 ms') 2024-08-21 09:10:14,186 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-68998769-02280607 passed 2024-08-21 09:10:14,337 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:14,337 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-68998769-02280607, IP 31.1.2.4, Port 22 2024-08-21 09:10:14,492 - DEBUG - VM ctest-TestBasicVMVN-68998769-02280607 is ready for SSH connections 2024-08-21 09:10:14,493 - INFO - Waiting for VM ctest-TestBasicVMVN-68998769-52245460 to be up.. 2024-08-21 09:10:14,582 - DEBUG - VM is in ACTIVE state now 2024-08-21 09:10:14,582 - INFO - VM name : ctest-TestBasicVMVN-68998769-52245460 2024-08-21 09:10:14,662 - DEBUG - VM ctest-TestBasicVMVN-68998769-52245460 ID is 4689017b-cfab-4894-a91c-35fc0225a131 2024-08-21 09:10:14,662 - DEBUG - VM ctest-TestBasicVMVN-68998769-52245460 launched on Node cn-jenkins-deploy-platform-ansible-os-1680-1 2024-08-21 09:10:14,749 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/4689017b-cfab-4894-a91c-35fc0225a131 2024-08-21 09:10:14,759 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/bc4f5cdd-310a-42bd-a5c0-815c483fc834 2024-08-21 09:10:15,994 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=2.89 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.364 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.364/1.626/2.888/1.262 ms') 2024-08-21 09:10:15,994 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-68998769-52245460 passed 2024-08-21 09:10:16,145 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:16,145 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-68998769-52245460, IP 31.1.1.3, Port 22 2024-08-21 09:10:16,301 - DEBUG - VM ctest-TestBasicVMVN-68998769-52245460 is ready for SSH connections 2024-08-21 09:10:16,301 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:16,301 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:16,301 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-08-21 09:10:20,021 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.867 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.844 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.809 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.809/1.840/3.867 ms 2024-08-21 09:10:20,021 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-68998769-35337196 passed 2024-08-21 09:10:20,021 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:20,021 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:20,022 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-08-21 09:10:23,696 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.266 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.970 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.891 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.891/1.709/3.266 ms 2024-08-21 09:10:23,697 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-68998769-02280607 passed 2024-08-21 09:10:23,697 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:23,697 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:23,697 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-08-21 09:10:23,697 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:23,697 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-08-21 09:10:23,883 - DEBUG - None 2024-08-21 09:10:23,883 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:23,883 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-08-21 09:10:24,060 - DEBUG - None 2024-08-21 09:10:24,061 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:24,061 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-08-21 09:10:24,695 - DEBUG - None 2024-08-21 09:10:24,695 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:24,695 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-08-21 09:10:26,903 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.917 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.191 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.406 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.669 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.355 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.355/1.707/4.191 ms 2024-08-21 09:10:26,903 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:26,903 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-08-21 09:10:29,162 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.974 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.308 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.684 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.480 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.657 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.574 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.365 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.365/2.006/4.684 ms 2024-08-21 09:10:29,163 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.23, gateway password: c0ntrail123 2024-08-21 09:10:29,163 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-08-21 09:10:31,409 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.635 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.759 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.794 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.386 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.632 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.437 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.395 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.386/1.719/3.794 ms 2024-08-21 09:10:31,409 - INFO - Deleting VM ctest-TestBasicVMVN-68998769-52245460 2024-08-21 09:10:31,477 - INFO - Detaching port 03bca4bd-c1f8-498a-a2cd-28d7334db440 from VM ctest-TestBasicVMVN-68998769-02280607 2024-08-21 09:10:31,543 - INFO - Deleting VM ctest-TestBasicVMVN-68998769-02280607 2024-08-21 09:10:31,641 - INFO - Detaching port 570faebc-9dc7-4a9b-98af-9366538f49bd from VM ctest-TestBasicVMVN-68998769-35337196 2024-08-21 09:10:31,687 - INFO - Deleting VM ctest-TestBasicVMVN-68998769-35337196 2024-08-21 09:10:31,780 - INFO - Deleting VN ctest-vn-62677222 2024-08-21 09:10:31,963 - DEBUG - Response for delete_port : () 2024-08-21 09:10:32,589 - DEBUG - Response for delete_port : () 2024-08-21 09:10:32,774 - DEBUG - Response for deleting network () 2024-08-21 09:10:32,774 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/89fa43e7-4d26-4202-ac8b-1cc2ef15ac41 2024-08-21 09:10:32,781 - DEBUG - Response Code: 404 2024-08-21 09:10:32,781 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2024-08-21 09:10:32,787 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c71d6dcd-4970-4416-ad48-05f2e0e07161 2024-08-21 09:10:32,845 - DEBUG - Requesting: http://10.0.0.23:8082/project/d665e6a6-d141-4f8a-b2a6-93b4450f4af4 2024-08-21 09:10:32,926 - INFO - Validated that VN ctest-vn-62677222 is not found in API Server 2024-08-21 09:10:32,937 - DEBUG - VN ctest-vn-62677222 is not present in Agent 10.0.0.23 2024-08-21 09:10:32,937 - INFO - Validated that VN ctest-vn-62677222 is not in any agent 2024-08-21 09:10:32,945 - DEBUG - VRF 2 is not seen in agent 10.0.0.23 2024-08-21 09:10:32,954 - DEBUG - Vrouter 10.0.0.23 does not have vrf 2 for VN ctest-vn-62677222 2024-08-21 09:10:32,954 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-68998769:ctest-vn-62677222 2024-08-21 09:10:32,969 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-62677222 info 2024-08-21 09:10:33,060 - INFO - IPAM: ctest-ipam-18379960 is not found in API Server 2024-08-21 09:10:33,073 - INFO - IPAM:ctest-ipam-18379960 is not found in control node 2024-08-21 09:10:33,331 - DEBUG - No XMPP flaps were noticed during the test 2024-08-21 09:10:33,331 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:41] 2024-08-21 09:10:33,331 - INFO - -------------------------------------------------------------------------------- 2024-08-21 09:10:34,105 - INFO - Deleted project: ctest-TestBasicVMVN-68998769, ID : d665e6a6-d141-4f8a-b2a6-93b4450f4af4