2024-11-07 07:00:22,591 - INFO - Domain Default found not creating 2024-11-07 07:00:22,757 - INFO - Project ctest-TestBasicVMVN-11633931 not found, creating it 2024-11-07 07:00:23,253 - INFO - Created Project:ctest-TestBasicVMVN-11633931, ID : 9349ac43-8f07-42e5-981a-fc27b2466c61 2024-11-07 07:00:27,136 - INFO - ================================================================================ 2024-11-07 07:00:27,136 - INFO - STARTING TEST : test_generic_link_local_service 2024-11-07 07:00:27,136 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-11-07 07:00:27,390 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.20.0.14': '0'}} with 2024-11-07 07:00:27,390 - INFO - Initial checks done. Running the testcase now 2024-11-07 07:00:27,390 - INFO - 2024-11-07 07:00:29,079 - DEBUG - Response for create_network : {'network': {'id': '78cc941b-f980-4796-aee2-07bbc90dc3d6', 'name': 'ctest-vn2_metadata-15911813', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'project_id': '9349ac438f0742e5981afc27b2466c61', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-11633931', 'ctest-vn2_metadata-15911813'], 'port_security_enabled': True, 'description': ''}} 2024-11-07 07:00:29,298 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f80f726c-96f5-459a-8601-bfe537852f55', 'name': '', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'network_id': '78cc941b-f980-4796-aee2-07bbc90dc3d6', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '9349ac438f0742e5981afc27b2466c61'}} 2024-11-07 07:00:29,316 - INFO - Created VN ctest-vn2_metadata-15911813 2024-11-07 07:00:29,372 - DEBUG - VN ctest-vn2_metadata-15911813 UUID is 78cc941b-f980-4796-aee2-07bbc90dc3d6 2024-11-07 07:00:29,560 - DEBUG - Services list from nova: [, , ] 2024-11-07 07:00:30,719 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2211-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2211-1) 2024-11-07 07:00:30,832 - DEBUG - Link local service introspect added 2024-11-07 07:00:30,886 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-11-07 07:00:35,974 - DEBUG - VM is in ACTIVE state now 2024-11-07 07:00:36,117 - INFO - Waiting for VM ctest-TestBasicVMVN-11633931-87308648 to be up.. 2024-11-07 07:00:36,117 - INFO - VM name : ctest-TestBasicVMVN-11633931-87308648 2024-11-07 07:00:36,210 - DEBUG - VM ctest-TestBasicVMVN-11633931-87308648 ID is add7622a-abe0-4432-a657-38370b80adbc 2024-11-07 07:00:36,210 - DEBUG - VM ctest-TestBasicVMVN-11633931-87308648 launched on Node cn-jenkins-deploy-platform-ansible-os-2211-1 2024-11-07 07:00:36,287 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/add7622a-abe0-4432-a657-38370b80adbc 2024-11-07 07:00:36,586 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/add7622a-abe0-4432-a657-38370b80adbc 2024-11-07 07:00:36,624 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/4afe3319-920a-40a3-9e9b-100fe190aa76 2024-11-07 07:00:39,877 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2024-11-07 07:00:39,877 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-11633931-87308648 failed! 2024-11-07 07:00:39,936 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-11633931:ctest-vn2_metadata-15911813 is 11.1.1.1 and allocation pool is NOT set 2024-11-07 07:00:41,996 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.21 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.74 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.740/4.974/8.209/3.234 ms') 2024-11-07 07:00:41,996 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-11633931-87308648 passed 2024-11-07 07:00:42,148 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:00:42,148 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-11633931-87308648, IP 11.1.1.3, Port 22 2024-11-07 07:00:42,203 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-11-07 07:00:42,284 - DEBUG - VM ctest-TestBasicVMVN-11633931-87308648 is NOT ready for SSH connections, VM status: ACTIVE 2024-11-07 07:00:47,284 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:00:47,285 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-11633931-87308648, IP 11.1.1.3, Port 22 2024-11-07 07:00:47,444 - DEBUG - VM ctest-TestBasicVMVN-11633931-87308648 is ready for SSH connections 2024-11-07 07:00:47,444 - INFO - Retry 0 2024-11-07 07:00:47,444 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:00:47,444 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-11-07 07:00:49,065 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-11-07 07:00:49,065 - INFO - Generic metadata worked 2024-11-07 07:00:49,324 - DEBUG - Link local service introspect removed 2024-11-07 07:00:49,324 - INFO - Deleting VM ctest-TestBasicVMVN-11633931-87308648 2024-11-07 07:00:49,389 - INFO - Deleting VN ctest-vn2_metadata-15911813 2024-11-07 07:00:49,453 - DEBUG - VN 78cc941b-f980-4796-aee2-07bbc90dc3d6 still in use: Unable to complete operation on network 78cc941b-f980-4796-aee2-07bbc90dc3d6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-64896725-7b73-465a-9bdf-9519fc35c97a'] 2024-11-07 07:00:49,453 - WARNING - Deleting VN ctest-vn2_metadata-15911813 failed..Will retry 2024-11-07 07:00:51,560 - DEBUG - Response for deleting network () 2024-11-07 07:00:51,814 - DEBUG - No XMPP flaps were noticed during the test 2024-11-07 07:00:51,814 - INFO - END TEST : test_generic_link_local_service : PASSED[0:00:24] 2024-11-07 07:00:51,814 - INFO - -------------------------------------------------------------------------------- 2024-11-07 07:00:51,817 - INFO - ================================================================================ 2024-11-07 07:00:51,817 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-11-07 07:00:51,817 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-11-07 07:00:52,101 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.20.0.14': '0'}} with 2024-11-07 07:00:52,102 - INFO - Initial checks done. Running the testcase now 2024-11-07 07:00:52,102 - INFO - 2024-11-07 07:00:53,407 - DEBUG - Response for create_network : {'network': {'id': '2411b4aa-0a15-4e56-a826-9a6c7170c539', 'name': 'ctest-vn-10586639', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'project_id': '9349ac438f0742e5981afc27b2466c61', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-11633931', 'ctest-vn-10586639'], 'port_security_enabled': True, 'description': ''}} 2024-11-07 07:00:53,638 - DEBUG - Response for create_subnet : {'subnet': {'id': '56553b5a-fd46-4429-8d31-a32b1e8c9182', 'name': '', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'network_id': '2411b4aa-0a15-4e56-a826-9a6c7170c539', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '9349ac438f0742e5981afc27b2466c61'}} 2024-11-07 07:00:53,868 - DEBUG - Response for create_subnet : {'subnet': {'id': '16567cfb-a5e3-4468-a0be-9ec90e42c87e', 'name': '', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'network_id': '2411b4aa-0a15-4e56-a826-9a6c7170c539', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '9349ac438f0742e5981afc27b2466c61'}} 2024-11-07 07:00:53,892 - INFO - Created VN ctest-vn-10586639 2024-11-07 07:00:53,948 - DEBUG - VN ctest-vn-10586639 UUID is 2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:54,324 - DEBUG - Response for create_port : {'port': {'name': 'a1c876c5-9cda-48ad-8976-02abfebfc240', 'id': 'a1c876c5-9cda-48ad-8976-02abfebfc240', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'network_id': '2411b4aa-0a15-4e56-a826-9a6c7170c539', 'mac_address': '02:a1:c8:76:c5:9c', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '56553b5a-fd46-4429-8d31-a32b1e8c9182'}], 'security_groups': ['e32dd22b-2bb4-4b56-8896-2e531f81a8a6'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '9349ac438f0742e5981afc27b2466c61'}} 2024-11-07 07:00:54,504 - DEBUG - Response for create_port : {'port': {'name': '1dc5a28a-55f1-4ce5-bcfa-c3f82a885eea', 'id': '1dc5a28a-55f1-4ce5-bcfa-c3f82a885eea', 'tenant_id': '9349ac438f0742e5981afc27b2466c61', 'network_id': '2411b4aa-0a15-4e56-a826-9a6c7170c539', 'mac_address': '02:1d:c5:a2:8a:55', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '16567cfb-a5e3-4468-a0be-9ec90e42c87e'}], 'security_groups': ['e32dd22b-2bb4-4b56-8896-2e531f81a8a6'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '9349ac438f0742e5981afc27b2466c61'}} 2024-11-07 07:00:54,867 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2211-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2211-1) 2024-11-07 07:00:55,265 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2211-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2211-1) 2024-11-07 07:00:56,493 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2211-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2211-1) 2024-11-07 07:00:56,493 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-07 07:00:56,503 - DEBUG - Requesting: http://10.0.0.29:8082/domain/4b532f27-e9d0-42ad-8618-92fdbd522c96 2024-11-07 07:00:56,526 - DEBUG - Requesting: http://10.0.0.29:8082/project/9349ac43-8f07-42e5-981a-fc27b2466c61 2024-11-07 07:00:56,614 - DEBUG - Requesting: http://10.0.0.29:8082/network-ipam/8c518dce-8465-47e3-abed-419225fd858e 2024-11-07 07:00:56,628 - INFO - Verifications in API Server for IPAM: ctest-ipam-17301712 passed 2024-11-07 07:00:56,640 - DEBUG - Control-node 10.0.0.29 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-11633931:ctest-ipam-17301712', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-11633931', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10111018556547483619', 'uuid-lslong': '12388630245924504974'}, 'enable': 'true', 'created': '2024-11-07T07:00:52', 'last-modified': '2024-11-07T07:00:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:04.285308'} 2024-11-07 07:00:56,640 - INFO - Verifications in Control node for IPAM: ctest-ipam-17301712 passed 2024-11-07 07:00:56,640 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-07 07:00:56,646 - DEBUG - Requesting: http://10.0.0.29:8082/domain/4b532f27-e9d0-42ad-8618-92fdbd522c96 2024-11-07 07:00:56,658 - DEBUG - Requesting: http://10.0.0.29:8082/project/9349ac43-8f07-42e5-981a-fc27b2466c61 2024-11-07 07:00:56,773 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:56,798 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:56,820 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/1c04043c-90fb-4878-b066-d15ff4dda038 2024-11-07 07:00:56,832 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/1c04043c-90fb-4878-b066-d15ff4dda038 2024-11-07 07:00:56,845 - DEBUG - Requesting: http://10.0.0.29:8082/route-target/f16f0eb0-453b-449c-a57d-473c2f247c11 2024-11-07 07:00:56,859 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-07 07:00:56,859 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:56,894 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/1c04043c-90fb-4878-b066-d15ff4dda038 2024-11-07 07:00:56,934 - INFO - Verified VN network id 9 for VN 2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:56,935 - INFO - Verifications in API Server for VN ctest-vn-10586639 passed 2024-11-07 07:00:56,935 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:56,965 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/1c04043c-90fb-4878-b066-d15ff4dda038 2024-11-07 07:00:56,978 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/1c04043c-90fb-4878-b066-d15ff4dda038 2024-11-07 07:00:56,989 - DEBUG - Requesting: http://10.0.0.29:8082/route-target/f16f0eb0-453b-449c-a57d-473c2f247c11 2024-11-07 07:00:57,011 - DEBUG - Control-node 10.0.0.29 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-11633931', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2599057102376095318', 'uuid-lslong': '12116541638037259577'}, 'enable': 'true', 'created': '2024-11-07T07:00:53', 'last-modified': '2024-11-07T07:00:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.180038'} 2024-11-07 07:00:57,021 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-07 07:00:57,021 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-10586639 passed 2024-11-07 07:00:57,022 - DEBUG - ====Verifying policy data for ctest-vn-10586639 in API_Server ====== 2024-11-07 07:00:57,022 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-07 07:00:57,043 - DEBUG - Requesting: http://10.0.0.29:8082/domain/4b532f27-e9d0-42ad-8618-92fdbd522c96 2024-11-07 07:00:57,064 - DEBUG - Requesting: http://10.0.0.29:8082/project/9349ac43-8f07-42e5-981a-fc27b2466c61 2024-11-07 07:00:57,717 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-network/2411b4aa-0a15-4e56-a826-9a6c7170c539 2024-11-07 07:00:57,745 - DEBUG - =>VN ctest-vn-10586639 has no policy to be verified 2024-11-07 07:00:57,746 - DEBUG - Verifying the vn in opserver 2024-11-07 07:00:57,746 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639 virtual network link through opserver 10.0.0.29 2024-11-07 07:00:57,746 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-11-07 07:00:58,161 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-11-07 07:00:58,256 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639', 'href': 'http://10.0.0.29:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639?flat'} 2024-11-07 07:00:58,256 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639 is found in opserver 2024-11-07 07:00:58,267 - DEBUG - VRF ids for VN ctest-vn-10586639: {'10.0.0.29': '2'} 2024-11-07 07:00:58,267 - INFO - Waiting for VM ctest-TestBasicVMVN-11633931-79170567 to be up.. 2024-11-07 07:00:58,386 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-11-07 07:01:03,478 - DEBUG - VM is in ACTIVE state now 2024-11-07 07:01:03,478 - INFO - VM name : ctest-TestBasicVMVN-11633931-79170567 2024-11-07 07:01:03,588 - DEBUG - VM ctest-TestBasicVMVN-11633931-79170567 ID is 64acca72-f35f-4763-85e7-7e28f5b39529 2024-11-07 07:01:03,588 - DEBUG - VM ctest-TestBasicVMVN-11633931-79170567 launched on Node cn-jenkins-deploy-platform-ansible-os-2211-1 2024-11-07 07:01:03,678 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/64acca72-f35f-4763-85e7-7e28f5b39529 2024-11-07 07:01:03,688 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/a1c876c5-9cda-48ad-8976-02abfebfc240 2024-11-07 07:01:06,956 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2024-11-07 07:01:06,956 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-11633931-79170567 failed! 2024-11-07 07:01:07,016 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639 is 31.1.1.1 and allocation pool is NOT set 2024-11-07 07:01:07,016 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639 is 31.1.2.1 and allocation pool is NOT set 2024-11-07 07:01:09,086 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=9.42 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=1.16 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.155/5.288/9.422/4.133 ms') 2024-11-07 07:01:09,086 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-11633931-79170567 passed 2024-11-07 07:01:09,252 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:09,252 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-11633931-79170567, IP 31.1.1.4, Port 22 2024-11-07 07:01:09,322 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-11-07 07:01:09,428 - DEBUG - VM ctest-TestBasicVMVN-11633931-79170567 is NOT ready for SSH connections, VM status: ACTIVE 2024-11-07 07:01:14,428 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:14,429 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-11633931-79170567, IP 31.1.1.4, Port 22 2024-11-07 07:01:14,587 - DEBUG - VM ctest-TestBasicVMVN-11633931-79170567 is ready for SSH connections 2024-11-07 07:01:14,587 - INFO - Waiting for VM ctest-TestBasicVMVN-11633931-70348738 to be up.. 2024-11-07 07:01:14,675 - DEBUG - VM is in ACTIVE state now 2024-11-07 07:01:14,676 - INFO - VM name : ctest-TestBasicVMVN-11633931-70348738 2024-11-07 07:01:14,758 - DEBUG - VM ctest-TestBasicVMVN-11633931-70348738 ID is fde8bc85-a413-4e13-8173-5ccead67bfb4 2024-11-07 07:01:14,758 - DEBUG - VM ctest-TestBasicVMVN-11633931-70348738 launched on Node cn-jenkins-deploy-platform-ansible-os-2211-1 2024-11-07 07:01:14,843 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/fde8bc85-a413-4e13-8173-5ccead67bfb4 2024-11-07 07:01:14,852 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/1dc5a28a-55f1-4ce5-bcfa-c3f82a885eea 2024-11-07 07:01:16,105 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.92 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.359 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.359/1.638/2.918/1.279 ms') 2024-11-07 07:01:16,105 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-11633931-70348738 passed 2024-11-07 07:01:16,264 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:16,264 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-11633931-70348738, IP 31.1.2.4, Port 22 2024-11-07 07:01:16,442 - DEBUG - VM ctest-TestBasicVMVN-11633931-70348738 is ready for SSH connections 2024-11-07 07:01:16,442 - INFO - Waiting for VM ctest-TestBasicVMVN-11633931-47202004 to be up.. 2024-11-07 07:01:16,525 - DEBUG - VM is in ACTIVE state now 2024-11-07 07:01:16,525 - INFO - VM name : ctest-TestBasicVMVN-11633931-47202004 2024-11-07 07:01:16,612 - DEBUG - VM ctest-TestBasicVMVN-11633931-47202004 ID is 03cd3600-d785-4eca-b445-b1fc90117a6d 2024-11-07 07:01:16,612 - DEBUG - VM ctest-TestBasicVMVN-11633931-47202004 launched on Node cn-jenkins-deploy-platform-ansible-os-2211-1 2024-11-07 07:01:16,697 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine/03cd3600-d785-4eca-b445-b1fc90117a6d 2024-11-07 07:01:16,708 - DEBUG - Requesting: http://10.0.0.29:8082/virtual-machine-interface/aaf3e76f-2804-4b58-b6bc-0b60bcabc097 2024-11-07 07:01:17,963 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.13 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.363 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.363/1.747/3.131/1.384 ms') 2024-11-07 07:01:17,963 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-11633931-47202004 passed 2024-11-07 07:01:18,128 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:18,128 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-11633931-47202004, IP 31.1.1.3, Port 22 2024-11-07 07:01:18,288 - DEBUG - VM ctest-TestBasicVMVN-11633931-47202004 is ready for SSH connections 2024-11-07 07:01:18,288 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:18,288 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:18,288 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-11-07 07:01:22,267 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=997.078 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.743 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.836 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.743/332.885/997.078 ms 2024-11-07 07:01:22,267 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-11633931-79170567 passed 2024-11-07 07:01:22,268 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:22,268 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:22,268 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-11-07 07:01:25,896 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.340 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.756 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.725 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.725/1.607/3.340 ms 2024-11-07 07:01:25,897 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-11633931-70348738 passed 2024-11-07 07:01:25,897 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:25,897 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:25,897 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 07:01:25,897 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:25,897 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-07 07:01:26,070 - DEBUG - None 2024-11-07 07:01:26,070 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:26,070 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-07 07:01:26,246 - DEBUG - None 2024-11-07 07:01:26,246 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:26,246 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-07 07:01:26,864 - DEBUG - None 2024-11-07 07:01:26,864 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:26,864 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-11-07 07:01:29,067 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.800 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.399 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.749 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.800 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.662 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.662/1.882/4.399 ms 2024-11-07 07:01:29,067 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:29,067 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-11-07 07:01:31,306 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.053 ms 64 bytes from 31.1.2.4: seq=0 ttl=63 time=2.828 ms (DUP!) 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.856 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.394 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.945 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.835 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.531 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.394/1.920/3.856 ms 2024-11-07 07:01:31,306 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.29, gateway password: c0ntrail123 2024-11-07 07:01:31,306 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-11-07 07:01:33,549 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.241 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.123 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.955 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.539 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.920 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.645 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.589 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.539/2.287/4.955 ms 2024-11-07 07:01:33,549 - INFO - Deleting VM ctest-TestBasicVMVN-11633931-47202004 2024-11-07 07:01:33,617 - INFO - Detaching port 1dc5a28a-55f1-4ce5-bcfa-c3f82a885eea from VM ctest-TestBasicVMVN-11633931-70348738 2024-11-07 07:01:33,671 - INFO - Deleting VM ctest-TestBasicVMVN-11633931-70348738 2024-11-07 07:01:33,731 - INFO - Detaching port a1c876c5-9cda-48ad-8976-02abfebfc240 from VM ctest-TestBasicVMVN-11633931-79170567 2024-11-07 07:01:33,764 - INFO - Deleting VM ctest-TestBasicVMVN-11633931-79170567 2024-11-07 07:01:33,834 - INFO - Deleting VN ctest-vn-10586639 2024-11-07 07:01:34,033 - DEBUG - Response for delete_port : () 2024-11-07 07:01:34,285 - DEBUG - Response for delete_port : () 2024-11-07 07:01:34,335 - DEBUG - VN 2411b4aa-0a15-4e56-a826-9a6c7170c539 still in use: Unable to complete operation on network 2411b4aa-0a15-4e56-a826-9a6c7170c539. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-31be9421-ba50-4367-8bff-8a2a1aa70431'] 2024-11-07 07:01:34,335 - WARNING - Deleting VN ctest-vn-10586639 failed..Will retry 2024-11-07 07:01:36,478 - DEBUG - Response for deleting network () 2024-11-07 07:01:36,478 - DEBUG - Requesting: http://10.0.0.29:8082/routing-instance/1c04043c-90fb-4878-b066-d15ff4dda038 2024-11-07 07:01:36,485 - DEBUG - Response Code: 404 2024-11-07 07:01:36,485 - DEBUG - Requesting: http://10.0.0.29:8082/domains 2024-11-07 07:01:36,492 - DEBUG - Requesting: http://10.0.0.29:8082/domain/4b532f27-e9d0-42ad-8618-92fdbd522c96 2024-11-07 07:01:36,548 - DEBUG - Requesting: http://10.0.0.29:8082/project/9349ac43-8f07-42e5-981a-fc27b2466c61 2024-11-07 07:01:36,631 - INFO - Validated that VN ctest-vn-10586639 is not found in API Server 2024-11-07 07:01:36,644 - DEBUG - VN ctest-vn-10586639 is not present in Agent 10.0.0.29 2024-11-07 07:01:36,644 - INFO - Validated that VN ctest-vn-10586639 is not in any agent 2024-11-07 07:01:36,653 - DEBUG - VRF 2 is not seen in agent 10.0.0.29 2024-11-07 07:01:36,658 - DEBUG - Vrouter 10.0.0.29 does not have vrf 2 for VN ctest-vn-10586639 2024-11-07 07:01:36,658 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-11633931:ctest-vn-10586639 2024-11-07 07:01:36,669 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-10586639 info 2024-11-07 07:01:36,760 - INFO - IPAM: ctest-ipam-17301712 is not found in API Server 2024-11-07 07:01:36,772 - INFO - IPAM:ctest-ipam-17301712 is not found in control node 2024-11-07 07:01:37,026 - DEBUG - No XMPP flaps were noticed during the test 2024-11-07 07:01:37,026 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:46] 2024-11-07 07:01:37,026 - INFO - -------------------------------------------------------------------------------- 2024-11-07 07:01:37,807 - INFO - Deleted project: ctest-TestBasicVMVN-11633931, ID : 9349ac43-8f07-42e5-981a-fc27b2466c61