2025-01-02 02:30:14,737 - INFO - Domain Default found not creating 2025-01-02 02:30:14,898 - INFO - Project ctest-TestBasicVMVN-00807865 not found, creating it 2025-01-02 02:30:15,378 - INFO - Created Project:ctest-TestBasicVMVN-00807865, ID : e4066647-21dc-4dc5-aeba-74aad9712f2b 2025-01-02 02:30:17,093 - INFO - ================================================================================ 2025-01-02 02:30:17,093 - INFO - STARTING TEST : test_generic_link_local_service 2025-01-02 02:30:17,094 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2025-01-02 02:30:17,359 - DEBUG - Nothing to compare xmpp stats {'10.0.0.35': {'10.0.0.35': '0'}} with 2025-01-02 02:30:17,359 - INFO - Initial checks done. Running the testcase now 2025-01-02 02:30:17,359 - INFO - 2025-01-02 02:30:17,970 - DEBUG - Response for create_network : {'network': {'id': '5065a35a-1acc-4989-9e91-bf1045be6ffc', 'name': 'ctest-vn2_metadata-92734145', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'project_id': 'e406664721dc4dc5aeba74aad9712f2b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-00807865', 'ctest-vn2_metadata-92734145'], 'port_security_enabled': True, 'description': ''}} 2025-01-02 02:30:18,154 - DEBUG - Response for create_subnet : {'subnet': {'id': '91835c79-5f55-48c2-ab29-b3bfb716213b', 'name': '', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'network_id': '5065a35a-1acc-4989-9e91-bf1045be6ffc', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': 'e406664721dc4dc5aeba74aad9712f2b'}} 2025-01-02 02:30:18,185 - INFO - Created VN ctest-vn2_metadata-92734145 2025-01-02 02:30:18,243 - DEBUG - VN ctest-vn2_metadata-92734145 UUID is 5065a35a-1acc-4989-9e91-bf1045be6ffc 2025-01-02 02:30:18,439 - DEBUG - Services list from nova: [, , ] 2025-01-02 02:30:19,706 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2509-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2509-1) 2025-01-02 02:30:19,815 - DEBUG - Link local service introspect added 2025-01-02 02:30:19,860 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-01-02 02:30:24,943 - DEBUG - VM is in ACTIVE state now 2025-01-02 02:30:25,071 - INFO - Waiting for VM ctest-TestBasicVMVN-00807865-54253631 to be up.. 2025-01-02 02:30:25,071 - INFO - VM name : ctest-TestBasicVMVN-00807865-54253631 2025-01-02 02:30:25,150 - DEBUG - VM ctest-TestBasicVMVN-00807865-54253631 ID is 1f2f7ed7-4cd0-4fbc-9862-4089c7c83534 2025-01-02 02:30:25,150 - DEBUG - VM ctest-TestBasicVMVN-00807865-54253631 launched on Node cn-jenkins-deploy-platform-ansible-os-2509-1. 2025-01-02 02:30:25,229 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/1f2f7ed7-4cd0-4fbc-9862-4089c7c83534 2025-01-02 02:30:25,565 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/1f2f7ed7-4cd0-4fbc-9862-4089c7c83534 2025-01-02 02:30:25,602 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/e40a2f94-495b-4bae-8edc-fd764a89e626 2025-01-02 02:30:28,860 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1002ms') 2025-01-02 02:30:28,860 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-00807865-54253631 failed! 2025-01-02 02:30:28,915 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-00807865:ctest-vn2_metadata-92734145 is 11.1.1.1 and allocation pool is NOT set 2025-01-02 02:30:30,984 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.81 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.48 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.475/2.140/2.806/0.665 ms') 2025-01-02 02:30:30,985 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-00807865-54253631 passed 2025-01-02 02:30:31,139 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:30:31,139 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-00807865-54253631, IP 11.1.1.3, Port 22 2025-01-02 02:30:31,205 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-01-02 02:30:31,292 - DEBUG - VM ctest-TestBasicVMVN-00807865-54253631 is NOT ready for SSH connections, VM status: ACTIVE 2025-01-02 02:30:36,293 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:30:36,293 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-00807865-54253631, IP 11.1.1.3, Port 22 2025-01-02 02:30:36,455 - DEBUG - VM ctest-TestBasicVMVN-00807865-54253631 is ready for SSH connections 2025-01-02 02:30:36,455 - INFO - Retry 0 2025-01-02 02:30:36,455 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:30:36,455 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2025-01-02 02:30:38,101 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2025-01-02 02:30:38,101 - INFO - Generic metadata worked 2025-01-02 02:30:38,367 - DEBUG - Link local service introspect removed 2025-01-02 02:30:38,367 - INFO - Deleting VM ctest-TestBasicVMVN-00807865-54253631 2025-01-02 02:30:38,443 - INFO - Deleting VN ctest-vn2_metadata-92734145 2025-01-02 02:30:38,495 - DEBUG - VN 5065a35a-1acc-4989-9e91-bf1045be6ffc still in use: Unable to complete operation on network 5065a35a-1acc-4989-9e91-bf1045be6ffc. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a36c7ec5-11a4-4351-9308-ce1da3dc81c0'] 2025-01-02 02:30:38,495 - WARNING - Deleting VN ctest-vn2_metadata-92734145 failed..Will retry 2025-01-02 02:30:40,613 - DEBUG - Response for deleting network () 2025-01-02 02:30:40,882 - DEBUG - No XMPP flaps were noticed during the test 2025-01-02 02:30:40,882 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:23] 2025-01-02 02:30:40,882 - INFO - -------------------------------------------------------------------------------- 2025-01-02 02:30:40,885 - INFO - ================================================================================ 2025-01-02 02:30:40,885 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2025-01-02 02:30:40,885 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2025-01-02 02:30:41,182 - DEBUG - Nothing to compare xmpp stats {'10.0.0.35': {'10.0.0.35': '0'}} with 2025-01-02 02:30:41,182 - INFO - Initial checks done. Running the testcase now 2025-01-02 02:30:41,182 - INFO - 2025-01-02 02:30:41,688 - DEBUG - Response for create_network : {'network': {'id': '146a4383-7883-4e75-bf97-a32d0ce2b388', 'name': 'ctest-vn-34569475', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'project_id': 'e406664721dc4dc5aeba74aad9712f2b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-00807865', 'ctest-vn-34569475'], 'port_security_enabled': True, 'description': ''}} 2025-01-02 02:30:41,911 - DEBUG - Response for create_subnet : {'subnet': {'id': '8f8a6ec6-12ea-439a-a35d-cf6d3dd7dd04', 'name': '', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'network_id': '146a4383-7883-4e75-bf97-a32d0ce2b388', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': 'e406664721dc4dc5aeba74aad9712f2b'}} 2025-01-02 02:30:42,107 - DEBUG - Response for create_subnet : {'subnet': {'id': '5a56be02-39a1-4dc9-b540-bda37e12dd0c', 'name': '', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'network_id': '146a4383-7883-4e75-bf97-a32d0ce2b388', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': 'e406664721dc4dc5aeba74aad9712f2b'}} 2025-01-02 02:30:42,132 - INFO - Created VN ctest-vn-34569475 2025-01-02 02:30:42,187 - DEBUG - VN ctest-vn-34569475 UUID is 146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:42,555 - DEBUG - Response for create_port : {'port': {'name': '57f4c085-8b0d-483a-adb3-f093d150c636', 'id': '57f4c085-8b0d-483a-adb3-f093d150c636', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'network_id': '146a4383-7883-4e75-bf97-a32d0ce2b388', 'mac_address': '02:57:f4:c0:85:8b', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '8f8a6ec6-12ea-439a-a35d-cf6d3dd7dd04'}], 'security_groups': ['0950a623-9e76-4f95-9578-a15ad1468d37'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'e406664721dc4dc5aeba74aad9712f2b'}} 2025-01-02 02:30:42,742 - DEBUG - Response for create_port : {'port': {'name': '2a8b6083-b977-4616-9de1-94e1249d9165', 'id': '2a8b6083-b977-4616-9de1-94e1249d9165', 'tenant_id': 'e406664721dc4dc5aeba74aad9712f2b', 'network_id': '146a4383-7883-4e75-bf97-a32d0ce2b388', 'mac_address': '02:2a:8b:60:83:b9', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '5a56be02-39a1-4dc9-b540-bda37e12dd0c'}], 'security_groups': ['0950a623-9e76-4f95-9578-a15ad1468d37'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': 'e406664721dc4dc5aeba74aad9712f2b'}} 2025-01-02 02:30:43,107 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2509-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2509-1) 2025-01-02 02:30:43,504 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2509-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2509-1) 2025-01-02 02:30:44,886 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2509-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2509-1) 2025-01-02 02:30:44,887 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2025-01-02 02:30:44,895 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2afbfd83-1fcc-482a-9608-ad9bb9881c64 2025-01-02 02:30:44,916 - DEBUG - Requesting: http://10.0.0.35:8082/project/e4066647-21dc-4dc5-aeba-74aad9712f2b 2025-01-02 02:30:45,014 - DEBUG - Requesting: http://10.0.0.35:8082/network-ipam/7472dc75-fa83-43ad-b64a-41338ed9918c 2025-01-02 02:30:45,038 - INFO - Verifications in API Server for IPAM: ctest-ipam-81979981 passed 2025-01-02 02:30:45,045 - DEBUG - Control-node 10.0.0.35 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-00807865:ctest-ipam-81979981', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-00807865', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8391011455016846253', 'uuid-lslong': '13135382952875233676'}, 'enable': 'true', 'created': '2025-01-02T02:30:41', 'last-modified': '2025-01-02T02:30:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.625386'} 2025-01-02 02:30:45,046 - INFO - Verifications in Control node for IPAM: ctest-ipam-81979981 passed 2025-01-02 02:30:45,046 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2025-01-02 02:30:45,054 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2afbfd83-1fcc-482a-9608-ad9bb9881c64 2025-01-02 02:30:45,068 - DEBUG - Requesting: http://10.0.0.35:8082/project/e4066647-21dc-4dc5-aeba-74aad9712f2b 2025-01-02 02:30:45,148 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:45,163 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:45,180 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/acedaaf0-1d12-485b-bba2-6103a1d820a3 2025-01-02 02:30:45,191 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/acedaaf0-1d12-485b-bba2-6103a1d820a3 2025-01-02 02:30:45,202 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/a26c8312-0f70-4a39-ab8e-4e69090aedfe 2025-01-02 02:30:45,213 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-01-02 02:30:45,213 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:45,228 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/acedaaf0-1d12-485b-bba2-6103a1d820a3 2025-01-02 02:30:45,253 - INFO - Verified VN network id 9 for VN 146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:45,254 - INFO - Verifications in API Server for VN ctest-vn-34569475 passed 2025-01-02 02:30:45,254 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:45,268 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/acedaaf0-1d12-485b-bba2-6103a1d820a3 2025-01-02 02:30:45,289 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/acedaaf0-1d12-485b-bba2-6103a1d820a3 2025-01-02 02:30:45,300 - DEBUG - Requesting: http://10.0.0.35:8082/route-target/a26c8312-0f70-4a39-ab8e-4e69090aedfe 2025-01-02 02:30:45,327 - DEBUG - Control-node 10.0.0.35 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-00807865', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1471062460231536245', 'uuid-lslong': '13805682596612584328'}, 'enable': 'true', 'created': '2025-01-02T02:30:41', 'last-modified': '2025-01-02T02:30:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.244820'} 2025-01-02 02:30:45,343 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-01-02 02:30:45,343 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-34569475 passed 2025-01-02 02:30:45,344 - DEBUG - ====Verifying policy data for ctest-vn-34569475 in API_Server ====== 2025-01-02 02:30:45,344 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2025-01-02 02:30:45,354 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2afbfd83-1fcc-482a-9608-ad9bb9881c64 2025-01-02 02:30:45,370 - DEBUG - Requesting: http://10.0.0.35:8082/project/e4066647-21dc-4dc5-aeba-74aad9712f2b 2025-01-02 02:30:45,492 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-network/146a4383-7883-4e75-bf97-a32d0ce2b388 2025-01-02 02:30:45,515 - DEBUG - =>VN ctest-vn-34569475 has no policy to be verified 2025-01-02 02:30:45,515 - DEBUG - Verifying the vn in opserver 2025-01-02 02:30:45,515 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 virtual network link through opserver 10.0.0.35 2025-01-02 02:30:45,515 - DEBUG - Requesting: http://10.0.0.35:8081/analytics/uves/virtual-networks 2025-01-02 02:30:45,905 - DEBUG - Requesting: http://10.0.0.35:8081/analytics/uves/virtual-networks 2025-01-02 02:30:45,974 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475', 'href': 'http://10.0.0.35:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475?flat'} 2025-01-02 02:30:45,974 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 is found in opserver 2025-01-02 02:30:45,982 - DEBUG - VRF ids for VN ctest-vn-34569475: {'10.0.0.35': '2'} 2025-01-02 02:30:45,982 - INFO - Waiting for VM ctest-TestBasicVMVN-00807865-55740055 to be up.. 2025-01-02 02:30:46,107 - DEBUG - VM is in ACTIVE state now 2025-01-02 02:30:46,107 - INFO - VM name : ctest-TestBasicVMVN-00807865-55740055 2025-01-02 02:30:46,207 - DEBUG - VM ctest-TestBasicVMVN-00807865-55740055 ID is 839e8b3d-261e-4e25-ae0c-b2af6375230f 2025-01-02 02:30:46,207 - DEBUG - VM ctest-TestBasicVMVN-00807865-55740055 launched on Node cn-jenkins-deploy-platform-ansible-os-2509-1. 2025-01-02 02:30:46,312 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/839e8b3d-261e-4e25-ae0c-b2af6375230f 2025-01-02 02:30:46,324 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/57f4c085-8b0d-483a-adb3-f093d150c636 2025-01-02 02:30:49,627 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-01-02 02:30:49,627 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-00807865-55740055 failed! 2025-01-02 02:30:49,683 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 is 31.1.1.1 and allocation pool is NOT set 2025-01-02 02:30:49,683 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 is 31.1.2.1 and allocation pool is NOT set 2025-01-02 02:30:53,753 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-01-02 02:30:53,753 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-00807865-55740055 failed! 2025-01-02 02:30:53,811 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 is 31.1.1.1 and allocation pool is NOT set 2025-01-02 02:30:53,811 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 is 31.1.2.1 and allocation pool is NOT set 2025-01-02 02:30:55,878 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.79 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.77 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.773/5.782/8.792/3.009 ms') 2025-01-02 02:30:55,879 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-00807865-55740055 passed 2025-01-02 02:30:56,047 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:30:56,047 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-00807865-55740055, IP 31.1.1.4, Port 22 2025-01-02 02:30:56,118 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-01-02 02:30:56,228 - DEBUG - VM ctest-TestBasicVMVN-00807865-55740055 is NOT ready for SSH connections, VM status: ACTIVE 2025-01-02 02:31:01,229 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:01,229 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-00807865-55740055, IP 31.1.1.4, Port 22 2025-01-02 02:31:01,391 - DEBUG - VM ctest-TestBasicVMVN-00807865-55740055 is ready for SSH connections 2025-01-02 02:31:01,391 - INFO - Waiting for VM ctest-TestBasicVMVN-00807865-03371067 to be up.. 2025-01-02 02:31:01,477 - DEBUG - VM is in ACTIVE state now 2025-01-02 02:31:01,477 - INFO - VM name : ctest-TestBasicVMVN-00807865-03371067 2025-01-02 02:31:01,563 - DEBUG - VM ctest-TestBasicVMVN-00807865-03371067 ID is 410a542d-2f45-4d95-828f-e8592dfaa013 2025-01-02 02:31:01,564 - DEBUG - VM ctest-TestBasicVMVN-00807865-03371067 launched on Node cn-jenkins-deploy-platform-ansible-os-2509-1. 2025-01-02 02:31:01,657 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/410a542d-2f45-4d95-828f-e8592dfaa013 2025-01-02 02:31:01,669 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/2a8b6083-b977-4616-9de1-94e1249d9165 2025-01-02 02:31:02,939 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.60 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.376 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.376/1.986/3.596/1.610 ms') 2025-01-02 02:31:02,939 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-00807865-03371067 passed 2025-01-02 02:31:03,095 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:03,095 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-00807865-03371067, IP 31.1.2.4, Port 22 2025-01-02 02:31:03,251 - DEBUG - VM ctest-TestBasicVMVN-00807865-03371067 is ready for SSH connections 2025-01-02 02:31:03,251 - INFO - Waiting for VM ctest-TestBasicVMVN-00807865-26940847 to be up.. 2025-01-02 02:31:03,337 - DEBUG - VM is in ACTIVE state now 2025-01-02 02:31:03,337 - INFO - VM name : ctest-TestBasicVMVN-00807865-26940847 2025-01-02 02:31:03,422 - DEBUG - VM ctest-TestBasicVMVN-00807865-26940847 ID is 9b21a786-fa8a-43e2-bfb9-3f8a1731d99d 2025-01-02 02:31:03,422 - DEBUG - VM ctest-TestBasicVMVN-00807865-26940847 launched on Node cn-jenkins-deploy-platform-ansible-os-2509-1. 2025-01-02 02:31:03,507 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine/9b21a786-fa8a-43e2-bfb9-3f8a1731d99d 2025-01-02 02:31:03,517 - DEBUG - Requesting: http://10.0.0.35:8082/virtual-machine-interface/6895936f-ad6d-47d9-86aa-4cabbd7fbfb8 2025-01-02 02:31:04,764 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.33 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.931 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.931/2.132/3.333/1.201 ms') 2025-01-02 02:31:04,765 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-00807865-26940847 passed 2025-01-02 02:31:04,920 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:04,920 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-00807865-26940847, IP 31.1.1.3, Port 22 2025-01-02 02:31:05,079 - DEBUG - VM ctest-TestBasicVMVN-00807865-26940847 is ready for SSH connections 2025-01-02 02:31:05,079 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:05,079 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:05,079 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2025-01-02 02:31:08,815 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.658 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.925 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.922 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.922/1.835/3.658 ms 2025-01-02 02:31:08,815 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-00807865-55740055 passed 2025-01-02 02:31:08,815 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:08,815 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:08,815 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2025-01-02 02:31:12,875 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.288 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.914 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.040 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.914/1.747/3.288 ms 2025-01-02 02:31:12,875 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-00807865-03371067 passed 2025-01-02 02:31:12,875 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:12,875 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:12,875 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-01-02 02:31:12,875 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:12,875 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-02 02:31:13,077 - DEBUG - None 2025-01-02 02:31:13,077 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:13,077 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-02 02:31:13,298 - DEBUG - None 2025-01-02 02:31:13,299 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:13,299 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2025-01-02 02:31:13,992 - DEBUG - None 2025-01-02 02:31:13,993 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:13,993 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2025-01-02 02:31:16,214 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.059 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=7.034 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.553 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.394 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.555 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.553/2.519/7.034 ms 2025-01-02 02:31:16,214 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:16,215 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2025-01-02 02:31:18,479 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.078 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.039 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.199 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.491 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.224 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=3.541 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.742 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.491/2.473/5.199 ms 2025-01-02 02:31:18,480 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.35, gateway password: c0ntrail123 2025-01-02 02:31:18,480 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2025-01-02 02:31:20,750 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.080 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.110 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.974 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.500 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.924 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.806 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.509 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.500/1.986/3.974 ms 2025-01-02 02:31:20,750 - INFO - Deleting VM ctest-TestBasicVMVN-00807865-26940847 2025-01-02 02:31:20,819 - INFO - Detaching port 2a8b6083-b977-4616-9de1-94e1249d9165 from VM ctest-TestBasicVMVN-00807865-03371067 2025-01-02 02:31:20,869 - INFO - Deleting VM ctest-TestBasicVMVN-00807865-03371067 2025-01-02 02:31:20,938 - INFO - Detaching port 57f4c085-8b0d-483a-adb3-f093d150c636 from VM ctest-TestBasicVMVN-00807865-55740055 2025-01-02 02:31:20,973 - INFO - Deleting VM ctest-TestBasicVMVN-00807865-55740055 2025-01-02 02:31:21,054 - INFO - Deleting VN ctest-vn-34569475 2025-01-02 02:31:21,264 - DEBUG - Response for delete_port : () 2025-01-02 02:31:21,539 - DEBUG - Response for delete_port : () 2025-01-02 02:31:21,595 - DEBUG - VN 146a4383-7883-4e75-bf97-a32d0ce2b388 still in use: Unable to complete operation on network 146a4383-7883-4e75-bf97-a32d0ce2b388. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-4f5f7a9f-e2fe-4f2a-af9b-98f69215558e'] 2025-01-02 02:31:21,595 - WARNING - Deleting VN ctest-vn-34569475 failed..Will retry 2025-01-02 02:31:23,733 - DEBUG - Response for deleting network () 2025-01-02 02:31:23,733 - DEBUG - Requesting: http://10.0.0.35:8082/routing-instance/acedaaf0-1d12-485b-bba2-6103a1d820a3 2025-01-02 02:31:23,740 - DEBUG - Response Code: 404 2025-01-02 02:31:23,740 - DEBUG - Requesting: http://10.0.0.35:8082/domains 2025-01-02 02:31:23,746 - DEBUG - Requesting: http://10.0.0.35:8082/domain/2afbfd83-1fcc-482a-9608-ad9bb9881c64 2025-01-02 02:31:23,802 - DEBUG - Requesting: http://10.0.0.35:8082/project/e4066647-21dc-4dc5-aeba-74aad9712f2b 2025-01-02 02:31:23,882 - INFO - Validated that VN ctest-vn-34569475 is not found in API Server 2025-01-02 02:31:23,894 - DEBUG - VN ctest-vn-34569475 is not present in Agent 10.0.0.35 2025-01-02 02:31:23,894 - INFO - Validated that VN ctest-vn-34569475 is not in any agent 2025-01-02 02:31:23,899 - DEBUG - VRF 2 is not seen in agent 10.0.0.35 2025-01-02 02:31:23,905 - DEBUG - Vrouter 10.0.0.35 does not have vrf 2 for VN ctest-vn-34569475 2025-01-02 02:31:23,905 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-00807865:ctest-vn-34569475 2025-01-02 02:31:23,917 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-34569475 info 2025-01-02 02:31:24,031 - INFO - IPAM: ctest-ipam-81979981 is not found in API Server 2025-01-02 02:31:24,043 - INFO - IPAM:ctest-ipam-81979981 is not found in control node 2025-01-02 02:31:24,301 - DEBUG - No XMPP flaps were noticed during the test 2025-01-02 02:31:24,301 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:44] 2025-01-02 02:31:24,301 - INFO - -------------------------------------------------------------------------------- 2025-01-02 02:31:25,050 - INFO - Deleted project: ctest-TestBasicVMVN-00807865, ID : e4066647-21dc-4dc5-aeba-74aad9712f2b