2024-10-21 02:33:09,615 - INFO - Domain Default found not creating 2024-10-21 02:33:09,812 - INFO - Project ctest-TestBasicVMVN-88100480 not found, creating it 2024-10-21 02:33:10,369 - INFO - Created Project:ctest-TestBasicVMVN-88100480, ID : b15913e2-b4f8-4aab-a771-6184e9555475 2024-10-21 02:33:12,229 - INFO - ================================================================================ 2024-10-21 02:33:12,229 - INFO - STARTING TEST : test_generic_link_local_service 2024-10-21 02:33:12,230 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-10-21 02:33:12,491 - DEBUG - Nothing to compare xmpp stats {'10.0.0.32': {'10.20.0.12': '0'}} with 2024-10-21 02:33:12,491 - INFO - Initial checks done. Running the testcase now 2024-10-21 02:33:12,491 - INFO - 2024-10-21 02:33:13,204 - DEBUG - Response for create_network : {'network': {'id': '9f918bdb-2f9e-4ad9-be1e-0ff0e4455ff1', 'name': 'ctest-vn2_metadata-84734408', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'project_id': 'b15913e2b4f84aaba7716184e9555475', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-88100480', 'ctest-vn2_metadata-84734408'], 'port_security_enabled': True, 'description': ''}} 2024-10-21 02:33:13,397 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b5ed7fb7-dea7-4f7b-89be-44aadb9465fd', 'name': '', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'network_id': '9f918bdb-2f9e-4ad9-be1e-0ff0e4455ff1', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'b15913e2b4f84aaba7716184e9555475'}} 2024-10-21 02:33:13,421 - INFO - Created VN ctest-vn2_metadata-84734408 2024-10-21 02:33:13,480 - DEBUG - VN ctest-vn2_metadata-84734408 UUID is 9f918bdb-2f9e-4ad9-be1e-0ff0e4455ff1 2024-10-21 02:33:13,711 - DEBUG - Services list from nova: [, , ] 2024-10-21 02:33:15,627 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2121-1) 2024-10-21 02:33:15,748 - DEBUG - Link local service introspect added 2024-10-21 02:33:15,798 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-10-21 02:33:20,907 - DEBUG - VM is in ACTIVE state now 2024-10-21 02:33:21,076 - INFO - Waiting for VM ctest-TestBasicVMVN-88100480-87809438 to be up.. 2024-10-21 02:33:21,077 - INFO - VM name : ctest-TestBasicVMVN-88100480-87809438 2024-10-21 02:33:21,179 - DEBUG - VM ctest-TestBasicVMVN-88100480-87809438 ID is 859c9174-1b1a-48c8-86fd-fbf3380abf43 2024-10-21 02:33:21,180 - DEBUG - VM ctest-TestBasicVMVN-88100480-87809438 launched on Node cn-jenkins-deploy-platform-ansible-os-2121-1 2024-10-21 02:33:21,285 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine/859c9174-1b1a-48c8-86fd-fbf3380abf43 2024-10-21 02:33:21,644 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine/859c9174-1b1a-48c8-86fd-fbf3380abf43 2024-10-21 02:33:21,694 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine-interface/74798908-846b-431e-b4bf-f20018c2bca7 2024-10-21 02:33:25,015 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1035ms') 2024-10-21 02:33:25,016 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-88100480-87809438 failed! 2024-10-21 02:33:25,080 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-88100480:ctest-vn2_metadata-84734408 is 11.1.1.1 and allocation pool is NOT set 2024-10-21 02:33:29,174 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.89 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1025ms\r\nrtt min/avg/max/mdev = 2.886/2.886/2.886/0.000 ms') 2024-10-21 02:33:29,174 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-88100480-87809438 passed 2024-10-21 02:33:29,340 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:33:29,341 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-88100480-87809438, IP 11.1.1.3, Port 22 2024-10-21 02:33:29,508 - DEBUG - VM ctest-TestBasicVMVN-88100480-87809438 is ready for SSH connections 2024-10-21 02:33:29,508 - INFO - Retry 0 2024-10-21 02:33:29,508 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:33:29,508 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-10-21 02:33:31,188 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-10-21 02:33:31,188 - INFO - Generic metadata worked 2024-10-21 02:33:31,464 - DEBUG - Link local service introspect removed 2024-10-21 02:33:31,464 - INFO - Deleting VM ctest-TestBasicVMVN-88100480-87809438 2024-10-21 02:33:31,552 - INFO - Deleting VN ctest-vn2_metadata-84734408 2024-10-21 02:33:31,605 - DEBUG - VN 9f918bdb-2f9e-4ad9-be1e-0ff0e4455ff1 still in use: Unable to complete operation on network 9f918bdb-2f9e-4ad9-be1e-0ff0e4455ff1. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a2f15721-a85b-48a3-91cd-fcefc50606e1'] 2024-10-21 02:33:31,605 - WARNING - Deleting VN ctest-vn2_metadata-84734408 failed..Will retry 2024-10-21 02:33:33,739 - DEBUG - Response for deleting network () 2024-10-21 02:33:34,010 - DEBUG - No XMPP flaps were noticed during the test 2024-10-21 02:33:34,010 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:22] 2024-10-21 02:33:34,010 - INFO - -------------------------------------------------------------------------------- 2024-10-21 02:33:34,014 - INFO - ================================================================================ 2024-10-21 02:33:34,014 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-10-21 02:33:34,014 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-10-21 02:33:34,300 - DEBUG - Nothing to compare xmpp stats {'10.0.0.32': {'10.20.0.12': '0'}} with 2024-10-21 02:33:34,301 - INFO - Initial checks done. Running the testcase now 2024-10-21 02:33:34,301 - INFO - 2024-10-21 02:33:34,854 - DEBUG - Response for create_network : {'network': {'id': '9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4', 'name': 'ctest-vn-25932267', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'project_id': 'b15913e2b4f84aaba7716184e9555475', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-88100480', 'ctest-vn-25932267'], 'port_security_enabled': True, 'description': ''}} 2024-10-21 02:33:35,061 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b7f2892d-95ac-4ac7-8879-aa90f7b15e57', 'name': '', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'network_id': '9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'b15913e2b4f84aaba7716184e9555475'}} 2024-10-21 02:33:35,252 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd41b062d-a1e5-4cd4-a29e-6d862f24814a', 'name': '', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'network_id': '9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'b15913e2b4f84aaba7716184e9555475'}} 2024-10-21 02:33:35,279 - INFO - Created VN ctest-vn-25932267 2024-10-21 02:33:35,340 - DEBUG - VN ctest-vn-25932267 UUID is 9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:35,836 - DEBUG - Response for create_port : {'port': {'name': 'f9522f95-ed36-41ec-bca0-ea398dd8992f', 'id': 'f9522f95-ed36-41ec-bca0-ea398dd8992f', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'network_id': '9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4', 'mac_address': '02:f9:52:2f:95:ed', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'b7f2892d-95ac-4ac7-8879-aa90f7b15e57'}], 'security_groups': ['59fc0431-11dc-4a1a-8399-64ebfdf48dd4'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'b15913e2b4f84aaba7716184e9555475'}} 2024-10-21 02:33:36,067 - DEBUG - Response for create_port : {'port': {'name': 'f56dc0db-5142-496c-9acf-dfb5fd165615', 'id': 'f56dc0db-5142-496c-9acf-dfb5fd165615', 'tenant_id': 'b15913e2b4f84aaba7716184e9555475', 'network_id': '9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4', 'mac_address': '02:f5:6d:c0:db:51', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'd41b062d-a1e5-4cd4-a29e-6d862f24814a'}], 'security_groups': ['59fc0431-11dc-4a1a-8399-64ebfdf48dd4'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'b15913e2b4f84aaba7716184e9555475'}} 2024-10-21 02:33:36,520 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2121-1) 2024-10-21 02:33:37,033 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2121-1) 2024-10-21 02:33:38,520 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2121-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2121-1) 2024-10-21 02:33:38,520 - DEBUG - Requesting: http://10.0.0.32:8082/domains 2024-10-21 02:33:38,532 - DEBUG - Requesting: http://10.0.0.32:8082/domain/c68dda55-aa39-4297-8407-793b327cbe14 2024-10-21 02:33:38,558 - DEBUG - Requesting: http://10.0.0.32:8082/project/b15913e2-b4f8-4aab-a771-6184e9555475 2024-10-21 02:33:38,677 - DEBUG - Requesting: http://10.0.0.32:8082/network-ipam/b8ae171d-924d-40ce-9cc3-815a40eb68fe 2024-10-21 02:33:38,696 - INFO - Verifications in API Server for IPAM: ctest-ipam-62947175 passed 2024-10-21 02:33:38,706 - DEBUG - Control-node 10.0.0.32 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-88100480:ctest-ipam-62947175', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-88100480', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13307599364702421198', 'uuid-lslong': '11296014515011545342'}, 'enable': 'true', 'created': '2024-10-21T02:33:34', 'last-modified': '2024-10-21T02:33:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.158788'} 2024-10-21 02:33:38,707 - INFO - Verifications in Control node for IPAM: ctest-ipam-62947175 passed 2024-10-21 02:33:38,708 - DEBUG - Requesting: http://10.0.0.32:8082/domains 2024-10-21 02:33:38,718 - DEBUG - Requesting: http://10.0.0.32:8082/domain/c68dda55-aa39-4297-8407-793b327cbe14 2024-10-21 02:33:38,738 - DEBUG - Requesting: http://10.0.0.32:8082/project/b15913e2-b4f8-4aab-a771-6184e9555475 2024-10-21 02:33:38,840 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-network/9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:38,871 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-network/9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:38,899 - DEBUG - Requesting: http://10.0.0.32:8082/routing-instance/e6500745-5a41-4b33-8c72-28f23be3598c 2024-10-21 02:33:38,911 - DEBUG - Requesting: http://10.0.0.32:8082/routing-instance/e6500745-5a41-4b33-8c72-28f23be3598c 2024-10-21 02:33:38,922 - DEBUG - Requesting: http://10.0.0.32:8082/route-target/4550226b-3d4f-4922-aec5-3e3318404a0e 2024-10-21 02:33:38,932 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-21 02:33:38,932 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-network/9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:38,951 - DEBUG - Requesting: http://10.0.0.32:8082/routing-instance/e6500745-5a41-4b33-8c72-28f23be3598c 2024-10-21 02:33:38,981 - INFO - Verified VN network id 8 for VN 9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:38,981 - INFO - Verifications in API Server for VN ctest-vn-25932267 passed 2024-10-21 02:33:38,981 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-network/9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:39,004 - DEBUG - Requesting: http://10.0.0.32:8082/routing-instance/e6500745-5a41-4b33-8c72-28f23be3598c 2024-10-21 02:33:39,018 - DEBUG - Requesting: http://10.0.0.32:8082/routing-instance/e6500745-5a41-4b33-8c72-28f23be3598c 2024-10-21 02:33:39,031 - DEBUG - Requesting: http://10.0.0.32:8082/route-target/4550226b-3d4f-4922-aec5-3e3318404a0e 2024-10-21 02:33:39,052 - DEBUG - Control-node 10.0.0.32 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-88100480', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11163126223188345324', 'uuid-lslong': '11755080295617249780'}, 'enable': 'true', 'created': '2024-10-21T02:33:34', 'last-modified': '2024-10-21T02:33:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.834372'} 2024-10-21 02:33:39,065 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-10-21 02:33:39,066 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-25932267 passed 2024-10-21 02:33:39,066 - DEBUG - ====Verifying policy data for ctest-vn-25932267 in API_Server ====== 2024-10-21 02:33:39,066 - DEBUG - Requesting: http://10.0.0.32:8082/domains 2024-10-21 02:33:39,083 - DEBUG - Requesting: http://10.0.0.32:8082/domain/c68dda55-aa39-4297-8407-793b327cbe14 2024-10-21 02:33:39,157 - DEBUG - Requesting: http://10.0.0.32:8082/project/b15913e2-b4f8-4aab-a771-6184e9555475 2024-10-21 02:33:39,327 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-network/9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 2024-10-21 02:33:39,361 - DEBUG - =>VN ctest-vn-25932267 has no policy to be verified 2024-10-21 02:33:39,361 - DEBUG - Verifying the vn in opserver 2024-10-21 02:33:39,361 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 virtual network link through opserver 10.0.0.32 2024-10-21 02:33:39,362 - DEBUG - Requesting: http://10.0.0.32:8081/analytics/uves/virtual-networks 2024-10-21 02:33:39,774 - DEBUG - Requesting: http://10.0.0.32:8081/analytics/uves/virtual-networks 2024-10-21 02:33:39,886 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267', 'href': 'http://10.0.0.32:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267?flat'} 2024-10-21 02:33:39,886 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 is found in opserver 2024-10-21 02:33:39,895 - DEBUG - VRF ids for VN ctest-vn-25932267: {'10.0.0.32': '2'} 2024-10-21 02:33:39,895 - INFO - Waiting for VM ctest-TestBasicVMVN-88100480-62927046 to be up.. 2024-10-21 02:33:40,011 - DEBUG - VM is in ACTIVE state now 2024-10-21 02:33:40,011 - INFO - VM name : ctest-TestBasicVMVN-88100480-62927046 2024-10-21 02:33:40,135 - DEBUG - VM ctest-TestBasicVMVN-88100480-62927046 ID is 7efb6afb-10c8-41d9-8e3b-dbb68dc9a6e6 2024-10-21 02:33:40,135 - DEBUG - VM ctest-TestBasicVMVN-88100480-62927046 launched on Node cn-jenkins-deploy-platform-ansible-os-2121-1 2024-10-21 02:33:40,266 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine/7efb6afb-10c8-41d9-8e3b-dbb68dc9a6e6 2024-10-21 02:33:40,289 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine-interface/f9522f95-ed36-41ec-bca0-ea398dd8992f 2024-10-21 02:33:43,610 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2024-10-21 02:33:43,611 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-88100480-62927046 failed! 2024-10-21 02:33:43,672 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 is 31.1.1.1 and allocation pool is NOT set 2024-10-21 02:33:43,673 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 is 31.1.2.1 and allocation pool is NOT set 2024-10-21 02:33:47,762 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2024-10-21 02:33:47,763 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-88100480-62927046 failed! 2024-10-21 02:33:47,828 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 is 31.1.1.1 and allocation pool is NOT set 2024-10-21 02:33:47,829 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 is 31.1.2.1 and allocation pool is NOT set 2024-10-21 02:33:49,900 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=16.4 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.87 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.872/9.132/16.392/7.260 ms') 2024-10-21 02:33:49,900 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-88100480-62927046 passed 2024-10-21 02:33:50,064 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:33:50,065 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-88100480-62927046, IP 31.1.1.4, Port 22 2024-10-21 02:33:50,130 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-10-21 02:33:50,231 - DEBUG - VM ctest-TestBasicVMVN-88100480-62927046 is NOT ready for SSH connections, VM status: ACTIVE 2024-10-21 02:33:55,231 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:33:55,231 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-88100480-62927046, IP 31.1.1.4, Port 22 2024-10-21 02:33:55,392 - DEBUG - VM ctest-TestBasicVMVN-88100480-62927046 is ready for SSH connections 2024-10-21 02:33:55,392 - INFO - Waiting for VM ctest-TestBasicVMVN-88100480-48653809 to be up.. 2024-10-21 02:33:55,497 - DEBUG - VM is in ACTIVE state now 2024-10-21 02:33:55,497 - INFO - VM name : ctest-TestBasicVMVN-88100480-48653809 2024-10-21 02:33:55,610 - DEBUG - VM ctest-TestBasicVMVN-88100480-48653809 ID is ce4b350c-aaca-4793-9151-37cbd25d78b3 2024-10-21 02:33:55,610 - DEBUG - VM ctest-TestBasicVMVN-88100480-48653809 launched on Node cn-jenkins-deploy-platform-ansible-os-2121-1 2024-10-21 02:33:55,721 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine/ce4b350c-aaca-4793-9151-37cbd25d78b3 2024-10-21 02:33:55,734 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine-interface/f56dc0db-5142-496c-9acf-dfb5fd165615 2024-10-21 02:33:57,009 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.11 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.468 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.468/2.286/4.105/1.818 ms') 2024-10-21 02:33:57,009 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-88100480-48653809 passed 2024-10-21 02:33:57,177 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:33:57,177 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-88100480-48653809, IP 31.1.2.4, Port 22 2024-10-21 02:33:57,355 - DEBUG - VM ctest-TestBasicVMVN-88100480-48653809 is ready for SSH connections 2024-10-21 02:33:57,355 - INFO - Waiting for VM ctest-TestBasicVMVN-88100480-74157700 to be up.. 2024-10-21 02:33:57,461 - DEBUG - VM is in ACTIVE state now 2024-10-21 02:33:57,461 - INFO - VM name : ctest-TestBasicVMVN-88100480-74157700 2024-10-21 02:33:57,606 - DEBUG - VM ctest-TestBasicVMVN-88100480-74157700 ID is 3aa5b84d-77d2-466a-b87c-b09fc0d457a1 2024-10-21 02:33:57,606 - DEBUG - VM ctest-TestBasicVMVN-88100480-74157700 launched on Node cn-jenkins-deploy-platform-ansible-os-2121-1 2024-10-21 02:33:57,717 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine/3aa5b84d-77d2-466a-b87c-b09fc0d457a1 2024-10-21 02:33:57,730 - DEBUG - Requesting: http://10.0.0.32:8082/virtual-machine-interface/c05745f1-083d-4312-a034-2ad9f0038859 2024-10-21 02:33:59,020 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.37 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.426 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.426/2.399/4.372/1.973 ms') 2024-10-21 02:33:59,020 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-88100480-74157700 passed 2024-10-21 02:33:59,180 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:33:59,181 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-88100480-74157700, IP 31.1.1.3, Port 22 2024-10-21 02:33:59,358 - DEBUG - VM ctest-TestBasicVMVN-88100480-74157700 is ready for SSH connections 2024-10-21 02:33:59,358 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:33:59,358 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:33:59,358 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-10-21 02:34:03,146 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.700 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.060 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=2.029 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.060/2.929/5.700 ms 2024-10-21 02:34:03,146 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-88100480-62927046 passed 2024-10-21 02:34:03,146 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:34:03,146 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:03,146 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-10-21 02:34:07,273 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.661 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=1.082 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.105 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.082/1.949/3.661 ms 2024-10-21 02:34:07,273 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-88100480-48653809 passed 2024-10-21 02:34:07,273 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:34:07,273 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:34:07,273 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-10-21 02:34:07,273 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:07,273 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-21 02:34:07,481 - DEBUG - None 2024-10-21 02:34:07,481 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:07,481 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-21 02:34:07,684 - DEBUG - None 2024-10-21 02:34:07,684 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:07,684 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-10-21 02:34:08,384 - DEBUG - None 2024-10-21 02:34:08,385 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:08,385 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-10-21 02:34:10,643 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.306 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=6.774 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.494 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.896 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.449 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.449/2.383/6.774 ms 2024-10-21 02:34:10,644 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:10,644 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-10-21 02:34:12,912 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.153 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.593 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=5.359 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.549 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.148 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.066 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.591 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.549/2.351/5.359 ms 2024-10-21 02:34:12,912 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.32, gateway password: c0ntrail123 2024-10-21 02:34:12,912 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-10-21 02:34:15,186 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.986 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.430 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.327 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.594 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.895 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.986 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.568 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.568/2.398/4.327 ms 2024-10-21 02:34:15,187 - INFO - Deleting VM ctest-TestBasicVMVN-88100480-74157700 2024-10-21 02:34:15,262 - INFO - Detaching port f56dc0db-5142-496c-9acf-dfb5fd165615 from VM ctest-TestBasicVMVN-88100480-48653809 2024-10-21 02:34:15,322 - INFO - Deleting VM ctest-TestBasicVMVN-88100480-48653809 2024-10-21 02:34:15,402 - INFO - Detaching port f9522f95-ed36-41ec-bca0-ea398dd8992f from VM ctest-TestBasicVMVN-88100480-62927046 2024-10-21 02:34:15,443 - INFO - Deleting VM ctest-TestBasicVMVN-88100480-62927046 2024-10-21 02:34:15,539 - INFO - Deleting VN ctest-vn-25932267 2024-10-21 02:34:15,790 - DEBUG - Response for delete_port : () 2024-10-21 02:34:16,022 - DEBUG - Response for delete_port : () 2024-10-21 02:34:16,095 - DEBUG - VN 9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4 still in use: Unable to complete operation on network 9aeb6427-bbfd-41ec-a322-6f3f6e75c1f4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1215ca17-e441-4030-93cc-3d536b4ad19d'] 2024-10-21 02:34:16,095 - WARNING - Deleting VN ctest-vn-25932267 failed..Will retry 2024-10-21 02:34:18,281 - DEBUG - Response for deleting network () 2024-10-21 02:34:18,281 - DEBUG - Requesting: http://10.0.0.32:8082/routing-instance/e6500745-5a41-4b33-8c72-28f23be3598c 2024-10-21 02:34:18,289 - DEBUG - Response Code: 404 2024-10-21 02:34:18,289 - DEBUG - Requesting: http://10.0.0.32:8082/domains 2024-10-21 02:34:18,297 - DEBUG - Requesting: http://10.0.0.32:8082/domain/c68dda55-aa39-4297-8407-793b327cbe14 2024-10-21 02:34:18,358 - DEBUG - Requesting: http://10.0.0.32:8082/project/b15913e2-b4f8-4aab-a771-6184e9555475 2024-10-21 02:34:18,468 - INFO - Validated that VN ctest-vn-25932267 is not found in API Server 2024-10-21 02:34:18,481 - DEBUG - VN ctest-vn-25932267 is not present in Agent 10.0.0.32 2024-10-21 02:34:18,481 - INFO - Validated that VN ctest-vn-25932267 is not in any agent 2024-10-21 02:34:18,488 - DEBUG - VRF 2 is not seen in agent 10.0.0.32 2024-10-21 02:34:18,495 - DEBUG - Vrouter 10.0.0.32 does not have vrf 2 for VN ctest-vn-25932267 2024-10-21 02:34:18,495 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-88100480:ctest-vn-25932267 2024-10-21 02:34:18,511 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-25932267 info 2024-10-21 02:34:18,616 - INFO - IPAM: ctest-ipam-62947175 is not found in API Server 2024-10-21 02:34:18,632 - INFO - IPAM:ctest-ipam-62947175 is not found in control node 2024-10-21 02:34:18,897 - DEBUG - No XMPP flaps were noticed during the test 2024-10-21 02:34:18,897 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:44] 2024-10-21 02:34:18,897 - INFO - -------------------------------------------------------------------------------- 2024-10-21 02:34:19,733 - INFO - Deleted project: ctest-TestBasicVMVN-88100480, ID : b15913e2-b4f8-4aab-a771-6184e9555475