2025-01-07 18:45:03,372 - INFO - Domain Default found not creating 2025-01-07 18:45:03,506 - INFO - Project ctest-TestBasicVMVN-90295340 not found, creating it 2025-01-07 18:45:03,970 - INFO - Created Project:ctest-TestBasicVMVN-90295340, ID : 1b43e589-c95f-4afe-b429-5188ca443c45 2025-01-07 18:45:05,477 - INFO - ================================================================================ 2025-01-07 18:45:05,477 - INFO - STARTING TEST : test_generic_link_local_service 2025-01-07 18:45:05,478 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-01-07 18:45:05,736 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.20': '0'}} with 2025-01-07 18:45:05,736 - INFO - Initial checks done. Running the testcase now 2025-01-07 18:45:05,736 - INFO - 2025-01-07 18:45:06,271 - DEBUG - Response for create_network : {'network': {'id': '3ee8de99-6032-4c0a-927b-3a22c69cb67b', 'name': 'ctest-vn2_metadata-67697190', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'project_id': '1b43e589c95f4afeb4295188ca443c45', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-90295340', 'ctest-vn2_metadata-67697190'], 'port_security_enabled': True, 'description': ''}} 2025-01-07 18:45:06,439 - DEBUG - Response for create_subnet : {'subnet': {'id': '9804355c-7ee4-4bcb-b3f9-e21015bdb2f3', 'name': '', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'network_id': '3ee8de99-6032-4c0a-927b-3a22c69cb67b', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '1b43e589c95f4afeb4295188ca443c45'}} 2025-01-07 18:45:06,459 - INFO - Created VN ctest-vn2_metadata-67697190 2025-01-07 18:45:06,517 - DEBUG - VN ctest-vn2_metadata-67697190 UUID is 3ee8de99-6032-4c0a-927b-3a22c69cb67b 2025-01-07 18:45:06,690 - DEBUG - Services list from nova: [, , ] 2025-01-07 18:45:07,694 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2553-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2553-1) 2025-01-07 18:45:07,805 - DEBUG - Link local service introspect added 2025-01-07 18:45:07,846 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-07 18:45:12,920 - DEBUG - VM is in ACTIVE state now 2025-01-07 18:45:13,043 - INFO - Waiting for VM ctest-TestBasicVMVN-90295340-39752702 to be up.. 2025-01-07 18:45:13,043 - INFO - VM name : ctest-TestBasicVMVN-90295340-39752702 2025-01-07 18:45:13,117 - DEBUG - VM ctest-TestBasicVMVN-90295340-39752702 ID is f162cd49-18ee-4db5-9fc2-f1d0f11e7371 2025-01-07 18:45:13,117 - DEBUG - VM ctest-TestBasicVMVN-90295340-39752702 launched on Node cn-jenkins-deploy-platform-ansible-os-2553-1 2025-01-07 18:45:13,187 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/f162cd49-18ee-4db5-9fc2-f1d0f11e7371 2025-01-07 18:45:13,481 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/f162cd49-18ee-4db5-9fc2-f1d0f11e7371 2025-01-07 18:45:13,511 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/1fc30c37-ddc8-4e2b-9bf4-bdfbdb945f47 2025-01-07 18:45:16,774 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-01-07 18:45:16,774 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-90295340-39752702 failed! 2025-01-07 18:45:16,829 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-90295340:ctest-vn2_metadata-67697190 is 11.1.1.1 and allocation pool is NOT set 2025-01-07 18:45:18,891 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.06 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.058/2.854/4.651/1.796 ms') 2025-01-07 18:45:18,891 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-90295340-39752702 passed 2025-01-07 18:45:19,045 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:19,045 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-90295340-39752702, IP 11.1.1.3, Port 22 2025-01-07 18:45:19,196 - DEBUG - VM ctest-TestBasicVMVN-90295340-39752702 is ready for SSH connections 2025-01-07 18:45:19,196 - INFO - Retry 0 2025-01-07 18:45:19,196 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:19,196 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-01-07 18:45:20,821 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-01-07 18:45:20,821 - INFO - Generic metadata worked 2025-01-07 18:45:21,076 - DEBUG - Link local service introspect removed 2025-01-07 18:45:21,077 - INFO - Deleting VM ctest-TestBasicVMVN-90295340-39752702 2025-01-07 18:45:21,143 - INFO - Deleting VN ctest-vn2_metadata-67697190 2025-01-07 18:45:21,175 - DEBUG - VN 3ee8de99-6032-4c0a-927b-3a22c69cb67b still in use: Unable to complete operation on network 3ee8de99-6032-4c0a-927b-3a22c69cb67b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-14f2a34f-5c57-4b7d-a6c4-d6b8a7a1a4d3'] 2025-01-07 18:45:21,175 - WARNING - Deleting VN ctest-vn2_metadata-67697190 failed..Will retry 2025-01-07 18:45:23,312 - DEBUG - Response for deleting network () 2025-01-07 18:45:23,565 - DEBUG - No XMPP flaps were noticed during the test 2025-01-07 18:45:23,566 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:18] 2025-01-07 18:45:23,566 - INFO - -------------------------------------------------------------------------------- 2025-01-07 18:45:23,569 - INFO - ================================================================================ 2025-01-07 18:45:23,569 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-01-07 18:45:23,569 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-01-07 18:45:23,854 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.20.0.20': '0'}} with 2025-01-07 18:45:23,854 - INFO - Initial checks done. Running the testcase now 2025-01-07 18:45:23,854 - INFO - 2025-01-07 18:45:24,338 - DEBUG - Response for create_network : {'network': {'id': '3e79a3a2-6fc5-44a9-9af6-40fd8a148db0', 'name': 'ctest-vn-42300133', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'project_id': '1b43e589c95f4afeb4295188ca443c45', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-90295340', 'ctest-vn-42300133'], 'port_security_enabled': True, 'description': ''}} 2025-01-07 18:45:24,535 - DEBUG - Response for create_subnet : {'subnet': {'id': '4d6dfaf0-6d7f-4472-8692-4a5b6debbc5f', 'name': '', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'network_id': '3e79a3a2-6fc5-44a9-9af6-40fd8a148db0', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '1b43e589c95f4afeb4295188ca443c45'}} 2025-01-07 18:45:24,683 - DEBUG - Response for create_subnet : {'subnet': {'id': '229c8dd7-1b40-45f1-80dc-aa01779ceb4e', 'name': '', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'network_id': '3e79a3a2-6fc5-44a9-9af6-40fd8a148db0', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '1b43e589c95f4afeb4295188ca443c45'}} 2025-01-07 18:45:24,703 - INFO - Created VN ctest-vn-42300133 2025-01-07 18:45:24,757 - DEBUG - VN ctest-vn-42300133 UUID is 3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:25,095 - DEBUG - Response for create_port : {'port': {'name': '14c188ee-8004-433d-894d-b8613cd1fa8b', 'id': '14c188ee-8004-433d-894d-b8613cd1fa8b', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'network_id': '3e79a3a2-6fc5-44a9-9af6-40fd8a148db0', 'mac_address': '02:14:c1:88:ee:80', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '4d6dfaf0-6d7f-4472-8692-4a5b6debbc5f'}], 'security_groups': ['9ec44b71-95cc-4ad9-a9a2-92a91aacc5ac'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '1b43e589c95f4afeb4295188ca443c45'}} 2025-01-07 18:45:25,258 - DEBUG - Response for create_port : {'port': {'name': 'aa08976e-a009-4a18-ae00-4f76b9912d05', 'id': 'aa08976e-a009-4a18-ae00-4f76b9912d05', 'tenant_id': '1b43e589c95f4afeb4295188ca443c45', 'network_id': '3e79a3a2-6fc5-44a9-9af6-40fd8a148db0', 'mac_address': '02:aa:08:97:6e:a0', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '229c8dd7-1b40-45f1-80dc-aa01779ceb4e'}], 'security_groups': ['9ec44b71-95cc-4ad9-a9a2-92a91aacc5ac'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '1b43e589c95f4afeb4295188ca443c45'}} 2025-01-07 18:45:25,662 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2553-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2553-1) 2025-01-07 18:45:26,017 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2553-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2553-1) 2025-01-07 18:45:27,187 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2553-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2553-1) 2025-01-07 18:45:27,187 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-01-07 18:45:27,194 - DEBUG - Requesting: http://10.0.0.33:8082/domain/55e8d94e-79ac-41b8-83db-aa344982376d 2025-01-07 18:45:27,209 - DEBUG - Requesting: http://10.0.0.33:8082/project/1b43e589-c95f-4afe-b429-5188ca443c45 2025-01-07 18:45:27,282 - DEBUG - Requesting: http://10.0.0.33:8082/network-ipam/515cbd87-03b9-4f8f-b310-2b32ca1f6fc9 2025-01-07 18:45:27,295 - INFO - Verifications in API Server for IPAM: ctest-ipam-54034998 passed 2025-01-07 18:45:27,305 - DEBUG - Control-node 10.0.0.33 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-90295340:ctest-ipam-54034998', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-90295340', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5862769202510253967', 'uuid-lslong': '12902860429555888073'}, 'enable': 'true', 'created': '2025-01-07T18:45:23', 'last-modified': '2025-01-07T18:45:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.216106'} 2025-01-07 18:45:27,305 - INFO - Verifications in Control node for IPAM: ctest-ipam-54034998 passed 2025-01-07 18:45:27,306 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-01-07 18:45:27,314 - DEBUG - Requesting: http://10.0.0.33:8082/domain/55e8d94e-79ac-41b8-83db-aa344982376d 2025-01-07 18:45:27,328 - DEBUG - Requesting: http://10.0.0.33:8082/project/1b43e589-c95f-4afe-b429-5188ca443c45 2025-01-07 18:45:27,418 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:27,432 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:27,445 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7b859192-2c9e-4a0c-9975-d5b9351f3de6 2025-01-07 18:45:27,454 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7b859192-2c9e-4a0c-9975-d5b9351f3de6 2025-01-07 18:45:27,464 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/616357c2-d861-47fc-ab12-db73975fc605 2025-01-07 18:45:27,472 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-01-07 18:45:27,472 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:27,487 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7b859192-2c9e-4a0c-9975-d5b9351f3de6 2025-01-07 18:45:27,503 - INFO - Verified VN network id 8 for VN 3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:27,503 - INFO - Verifications in API Server for VN ctest-vn-42300133 passed 2025-01-07 18:45:27,503 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:27,516 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7b859192-2c9e-4a0c-9975-d5b9351f3de6 2025-01-07 18:45:27,529 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7b859192-2c9e-4a0c-9975-d5b9351f3de6 2025-01-07 18:45:27,557 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/616357c2-d861-47fc-ab12-db73975fc605 2025-01-07 18:45:27,578 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-90295340', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4501809220588749993', 'uuid-lslong': '11166183783799229872'}, 'enable': 'true', 'created': '2025-01-07T18:45:24', 'last-modified': '2025-01-07T18:45:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.927512'} 2025-01-07 18:45:27,588 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-01-07 18:45:27,589 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-42300133 passed 2025-01-07 18:45:27,589 - DEBUG - ====Verifying policy data for ctest-vn-42300133 in API_Server ====== 2025-01-07 18:45:27,589 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-01-07 18:45:27,608 - DEBUG - Requesting: http://10.0.0.33:8082/domain/55e8d94e-79ac-41b8-83db-aa344982376d 2025-01-07 18:45:27,684 - DEBUG - Requesting: http://10.0.0.33:8082/project/1b43e589-c95f-4afe-b429-5188ca443c45 2025-01-07 18:45:27,774 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 2025-01-07 18:45:27,788 - DEBUG - =>VN ctest-vn-42300133 has no policy to be verified 2025-01-07 18:45:27,788 - DEBUG - Verifying the vn in opserver 2025-01-07 18:45:27,788 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 virtual network link through opserver 10.0.0.33 2025-01-07 18:45:27,788 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-01-07 18:45:28,114 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-01-07 18:45:28,222 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133?flat'} 2025-01-07 18:45:28,223 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 is found in opserver 2025-01-07 18:45:28,229 - DEBUG - VRF ids for VN ctest-vn-42300133: {'10.0.0.33': '2'} 2025-01-07 18:45:28,229 - INFO - Waiting for VM ctest-TestBasicVMVN-90295340-71017131 to be up.. 2025-01-07 18:45:28,386 - DEBUG - VM is in ACTIVE state now 2025-01-07 18:45:28,386 - INFO - VM name : ctest-TestBasicVMVN-90295340-71017131 2025-01-07 18:45:28,455 - DEBUG - VM ctest-TestBasicVMVN-90295340-71017131 ID is 46393f1e-1b35-4589-a3ec-f21f53480117 2025-01-07 18:45:28,455 - DEBUG - VM ctest-TestBasicVMVN-90295340-71017131 launched on Node cn-jenkins-deploy-platform-ansible-os-2553-1 2025-01-07 18:45:28,632 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/46393f1e-1b35-4589-a3ec-f21f53480117 2025-01-07 18:45:28,646 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/14c188ee-8004-433d-894d-b8613cd1fa8b 2025-01-07 18:45:31,906 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-01-07 18:45:31,906 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-90295340-71017131 failed! 2025-01-07 18:45:31,961 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 is 31.1.1.1 and allocation pool is NOT set 2025-01-07 18:45:31,961 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 is 31.1.2.1 and allocation pool is NOT set 2025-01-07 18:45:36,040 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-01-07 18:45:36,041 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-90295340-71017131 failed! 2025-01-07 18:45:36,101 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 is 31.1.1.1 and allocation pool is NOT set 2025-01-07 18:45:36,101 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 is 31.1.2.1 and allocation pool is NOT set 2025-01-07 18:45:38,165 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=7.78 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.59 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.591/4.687/7.784/3.096 ms') 2025-01-07 18:45:38,165 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-90295340-71017131 passed 2025-01-07 18:45:38,317 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:38,317 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-90295340-71017131, IP 31.1.1.4, Port 22 2025-01-07 18:45:38,372 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-01-07 18:45:38,449 - DEBUG - VM ctest-TestBasicVMVN-90295340-71017131 is NOT ready for SSH connections, VM status: ACTIVE 2025-01-07 18:45:43,450 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:43,450 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-90295340-71017131, IP 31.1.1.4, Port 22 2025-01-07 18:45:43,608 - DEBUG - VM ctest-TestBasicVMVN-90295340-71017131 is ready for SSH connections 2025-01-07 18:45:43,609 - INFO - Waiting for VM ctest-TestBasicVMVN-90295340-05844855 to be up.. 2025-01-07 18:45:43,690 - DEBUG - VM is in ACTIVE state now 2025-01-07 18:45:43,690 - INFO - VM name : ctest-TestBasicVMVN-90295340-05844855 2025-01-07 18:45:43,776 - DEBUG - VM ctest-TestBasicVMVN-90295340-05844855 ID is 30f4b432-ba7a-4554-b9c3-0e35bfb5dc7a 2025-01-07 18:45:43,776 - DEBUG - VM ctest-TestBasicVMVN-90295340-05844855 launched on Node cn-jenkins-deploy-platform-ansible-os-2553-1 2025-01-07 18:45:43,859 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/30f4b432-ba7a-4554-b9c3-0e35bfb5dc7a 2025-01-07 18:45:43,869 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/aa08976e-a009-4a18-ae00-4f76b9912d05 2025-01-07 18:45:45,107 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.401 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.401/1.691/2.981/1.290 ms') 2025-01-07 18:45:45,107 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-90295340-05844855 passed 2025-01-07 18:45:45,257 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:45,257 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-90295340-05844855, IP 31.1.2.4, Port 22 2025-01-07 18:45:45,423 - DEBUG - VM ctest-TestBasicVMVN-90295340-05844855 is ready for SSH connections 2025-01-07 18:45:45,423 - INFO - Waiting for VM ctest-TestBasicVMVN-90295340-35525291 to be up.. 2025-01-07 18:45:45,493 - DEBUG - VM is in ACTIVE state now 2025-01-07 18:45:45,493 - INFO - VM name : ctest-TestBasicVMVN-90295340-35525291 2025-01-07 18:45:45,590 - DEBUG - VM ctest-TestBasicVMVN-90295340-35525291 ID is 96ba4e17-1508-48de-90f5-988acd0a6b5c 2025-01-07 18:45:45,590 - DEBUG - VM ctest-TestBasicVMVN-90295340-35525291 launched on Node cn-jenkins-deploy-platform-ansible-os-2553-1 2025-01-07 18:45:45,675 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/96ba4e17-1508-48de-90f5-988acd0a6b5c 2025-01-07 18:45:45,684 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/e0066be1-5660-4f57-8865-956f9965c856 2025-01-07 18:45:46,978 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.43 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.383 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.383/1.905/3.428/1.522 ms') 2025-01-07 18:45:46,978 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-90295340-35525291 passed 2025-01-07 18:45:47,129 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:47,129 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-90295340-35525291, IP 31.1.1.3, Port 22 2025-01-07 18:45:47,285 - DEBUG - VM ctest-TestBasicVMVN-90295340-35525291 is ready for SSH connections 2025-01-07 18:45:47,285 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:47,285 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:47,285 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-01-07 18:45:50,931 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.281 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.791 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.302 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.791/1.791/3.281 ms 2025-01-07 18:45:50,931 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-90295340-71017131 passed 2025-01-07 18:45:50,931 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:50,931 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:50,931 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-01-07 18:45:54,777 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.068 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.856 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.519 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.856/1.814/3.068 ms 2025-01-07 18:45:54,778 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-90295340-05844855 passed 2025-01-07 18:45:54,778 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:54,778 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:54,778 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-07 18:45:54,778 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:54,778 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-07 18:45:54,951 - DEBUG - None 2025-01-07 18:45:54,951 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:54,951 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-07 18:45:55,124 - DEBUG - None 2025-01-07 18:45:55,124 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:55,124 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-07 18:45:55,738 - DEBUG - None 2025-01-07 18:45:55,738 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:55,738 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-01-07 18:45:57,946 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.883 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.662 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.434 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.652 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.382 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.382/2.002/4.662 ms 2025-01-07 18:45:57,946 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:45:57,947 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-01-07 18:46:00,184 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.965 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=2.826 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.816 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=1.209 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.655 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.718 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.373 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.373/2.223/3.816 ms 2025-01-07 18:46:00,184 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.33, gateway password: c0ntrail123 2025-01-07 18:46:00,185 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-01-07 18:46:02,418 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.958 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.780 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.779 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.406 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.230 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.476 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.413 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.406/2.434/4.779 ms 2025-01-07 18:46:02,419 - INFO - Deleting VM ctest-TestBasicVMVN-90295340-35525291 2025-01-07 18:46:02,490 - INFO - Detaching port aa08976e-a009-4a18-ae00-4f76b9912d05 from VM ctest-TestBasicVMVN-90295340-05844855 2025-01-07 18:46:02,538 - INFO - Deleting VM ctest-TestBasicVMVN-90295340-05844855 2025-01-07 18:46:02,594 - INFO - Detaching port 14c188ee-8004-433d-894d-b8613cd1fa8b from VM ctest-TestBasicVMVN-90295340-71017131 2025-01-07 18:46:02,627 - INFO - Deleting VM ctest-TestBasicVMVN-90295340-71017131 2025-01-07 18:46:02,716 - INFO - Deleting VN ctest-vn-42300133 2025-01-07 18:46:02,872 - DEBUG - Response for delete_port : () 2025-01-07 18:46:03,063 - DEBUG - Response for delete_port : () 2025-01-07 18:46:03,102 - DEBUG - VN 3e79a3a2-6fc5-44a9-9af6-40fd8a148db0 still in use: Unable to complete operation on network 3e79a3a2-6fc5-44a9-9af6-40fd8a148db0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-25fac1bb-6a13-46be-99f7-9fb16f677058'] 2025-01-07 18:46:03,102 - WARNING - Deleting VN ctest-vn-42300133 failed..Will retry 2025-01-07 18:46:05,226 - DEBUG - Response for deleting network () 2025-01-07 18:46:05,226 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7b859192-2c9e-4a0c-9975-d5b9351f3de6 2025-01-07 18:46:05,234 - DEBUG - Response Code: 404 2025-01-07 18:46:05,235 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-01-07 18:46:05,241 - DEBUG - Requesting: http://10.0.0.33:8082/domain/55e8d94e-79ac-41b8-83db-aa344982376d 2025-01-07 18:46:05,295 - DEBUG - Requesting: http://10.0.0.33:8082/project/1b43e589-c95f-4afe-b429-5188ca443c45 2025-01-07 18:46:05,366 - INFO - Validated that VN ctest-vn-42300133 is not found in API Server 2025-01-07 18:46:05,377 - DEBUG - VN ctest-vn-42300133 is not present in Agent 10.0.0.33 2025-01-07 18:46:05,377 - INFO - Validated that VN ctest-vn-42300133 is not in any agent 2025-01-07 18:46:05,382 - DEBUG - VRF 2 is not seen in agent 10.0.0.33 2025-01-07 18:46:05,386 - DEBUG - Vrouter 10.0.0.33 does not have vrf 2 for VN ctest-vn-42300133 2025-01-07 18:46:05,386 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-90295340:ctest-vn-42300133 2025-01-07 18:46:05,398 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-42300133 info 2025-01-07 18:46:05,480 - INFO - IPAM: ctest-ipam-54034998 is not found in API Server 2025-01-07 18:46:05,491 - INFO - IPAM:ctest-ipam-54034998 is not found in control node 2025-01-07 18:46:05,750 - DEBUG - No XMPP flaps were noticed during the test 2025-01-07 18:46:05,750 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:42] 2025-01-07 18:46:05,750 - INFO - -------------------------------------------------------------------------------- 2025-01-07 18:46:06,461 - INFO - Deleted project: ctest-TestBasicVMVN-90295340, ID : 1b43e589-c95f-4afe-b429-5188ca443c45