2024-11-07 02:37:04,513 - INFO - Domain Default found not creating 2024-11-07 02:37:04,706 - INFO - Project ctest-TestBasicVMVN-75879607 not found, creating it 2024-11-07 02:37:05,187 - INFO - Created Project:ctest-TestBasicVMVN-75879607, ID : 318f5eb2-9bbf-4343-b1c5-755248950ef5 2024-11-07 02:37:06,940 - INFO - ================================================================================ 2024-11-07 02:37:06,940 - INFO - STARTING TEST : test_generic_link_local_service 2024-11-07 02:37:06,940 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-11-07 02:37:07,197 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.20.0.11': '0'}} with 2024-11-07 02:37:07,197 - INFO - Initial checks done. Running the testcase now 2024-11-07 02:37:07,197 - INFO - 2024-11-07 02:37:07,807 - DEBUG - Response for create_network : {'network': {'id': 'ee16bd92-1549-4aa9-9c26-fe77064181e8', 'name': 'ctest-vn2_metadata-20240904', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'project_id': '318f5eb29bbf4343b1c5755248950ef5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-75879607', 'ctest-vn2_metadata-20240904'], 'port_security_enabled': True, 'description': ''}} 2024-11-07 02:37:08,009 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bedddbda-24fc-4fb5-a5ce-41d1e180ce50', 'name': '', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'network_id': 'ee16bd92-1549-4aa9-9c26-fe77064181e8', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '318f5eb29bbf4343b1c5755248950ef5'}} 2024-11-07 02:37:08,031 - INFO - Created VN ctest-vn2_metadata-20240904 2024-11-07 02:37:08,087 - DEBUG - VN ctest-vn2_metadata-20240904 UUID is ee16bd92-1549-4aa9-9c26-fe77064181e8 2024-11-07 02:37:08,279 - DEBUG - Services list from nova: [, , ] 2024-11-07 02:37:09,421 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2209-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2209-1) 2024-11-07 02:37:09,538 - DEBUG - Link local service introspect added 2024-11-07 02:37:09,588 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-11-07 02:37:14,679 - DEBUG - VM is in ACTIVE state now 2024-11-07 02:37:14,805 - INFO - Waiting for VM ctest-TestBasicVMVN-75879607-60813617 to be up.. 2024-11-07 02:37:14,806 - INFO - VM name : ctest-TestBasicVMVN-75879607-60813617 2024-11-07 02:37:14,887 - DEBUG - VM ctest-TestBasicVMVN-75879607-60813617 ID is fdb0c71a-85d4-43b6-bedf-441790d1070e 2024-11-07 02:37:14,888 - DEBUG - VM ctest-TestBasicVMVN-75879607-60813617 launched on Node cn-jenkins-deploy-platform-ansible-os-2209-1 2024-11-07 02:37:14,969 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/fdb0c71a-85d4-43b6-bedf-441790d1070e 2024-11-07 02:37:15,304 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/fdb0c71a-85d4-43b6-bedf-441790d1070e 2024-11-07 02:37:15,338 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/621b4594-870c-46a1-9381-479f45be8ec6 2024-11-07 02:37:18,594 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2024-11-07 02:37:18,595 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75879607-60813617 failed! 2024-11-07 02:37:18,650 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75879607:ctest-vn2_metadata-20240904 is 11.1.1.1 and allocation pool is NOT set 2024-11-07 02:37:20,718 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=9.13 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.92 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.921/6.024/9.128/3.103 ms') 2024-11-07 02:37:20,718 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75879607-60813617 passed 2024-11-07 02:37:20,866 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:20,866 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75879607-60813617, IP 11.1.1.3, Port 22 2024-11-07 02:37:20,922 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-11-07 02:37:21,034 - DEBUG - VM ctest-TestBasicVMVN-75879607-60813617 is NOT ready for SSH connections, VM status: ACTIVE 2024-11-07 02:37:26,036 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:26,036 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75879607-60813617, IP 11.1.1.3, Port 22 2024-11-07 02:37:26,194 - DEBUG - VM ctest-TestBasicVMVN-75879607-60813617 is ready for SSH connections 2024-11-07 02:37:26,194 - INFO - Retry 0 2024-11-07 02:37:26,194 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:37:26,194 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-11-07 02:37:27,832 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-11-07 02:37:27,832 - INFO - Generic metadata worked 2024-11-07 02:37:28,086 - DEBUG - Link local service introspect removed 2024-11-07 02:37:28,086 - INFO - Deleting VM ctest-TestBasicVMVN-75879607-60813617 2024-11-07 02:37:28,155 - INFO - Deleting VN ctest-vn2_metadata-20240904 2024-11-07 02:37:28,201 - DEBUG - VN ee16bd92-1549-4aa9-9c26-fe77064181e8 still in use: Unable to complete operation on network ee16bd92-1549-4aa9-9c26-fe77064181e8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-864bc59d-870c-4f3f-80e3-cabb7a7a953f'] 2024-11-07 02:37:28,202 - WARNING - Deleting VN ctest-vn2_metadata-20240904 failed..Will retry 2024-11-07 02:37:30,374 - DEBUG - Response for deleting network () 2024-11-07 02:37:30,630 - DEBUG - No XMPP flaps were noticed during the test 2024-11-07 02:37:30,630 - INFO - -------------------------------------------------------------------------------- 2024-11-07 02:37:30,633 - INFO - ================================================================================ 2024-11-07 02:37:30,633 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-11-07 02:37:30,633 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-11-07 02:37:30,920 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.20.0.11': '0'}} with 2024-11-07 02:37:30,921 - INFO - Initial checks done. Running the testcase now 2024-11-07 02:37:30,921 - INFO - 2024-11-07 02:37:31,452 - DEBUG - Response for create_network : {'network': {'id': 'be8d984b-dbc8-46d9-9600-0596963e05a8', 'name': 'ctest-vn-25555527', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'project_id': '318f5eb29bbf4343b1c5755248950ef5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestBasicVMVN-75879607', 'ctest-vn-25555527'], 'port_security_enabled': True, 'description': ''}} 2024-11-07 02:37:31,651 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ea292eb7-2abb-4195-a5b7-8df970accc9d', 'name': '', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'network_id': 'be8d984b-dbc8-46d9-9600-0596963e05a8', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '318f5eb29bbf4343b1c5755248950ef5'}} 2024-11-07 02:37:31,799 - DEBUG - Response for create_subnet : {'subnet': {'id': 'af774c39-b2fd-48d5-9fb0-7868800a79ad', 'name': '', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'network_id': 'be8d984b-dbc8-46d9-9600-0596963e05a8', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '318f5eb29bbf4343b1c5755248950ef5'}} 2024-11-07 02:37:31,822 - INFO - Created VN ctest-vn-25555527 2024-11-07 02:37:31,874 - DEBUG - VN ctest-vn-25555527 UUID is be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:32,286 - DEBUG - Response for create_port : {'port': {'name': 'fef14d1f-8fee-48e5-8782-a3a1dd3cee5f', 'id': 'fef14d1f-8fee-48e5-8782-a3a1dd3cee5f', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'network_id': 'be8d984b-dbc8-46d9-9600-0596963e05a8', 'mac_address': '02:fe:f1:4d:1f:8f', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': 'ea292eb7-2abb-4195-a5b7-8df970accc9d'}], 'security_groups': ['d1ee1d82-0b2c-4a8b-9d5a-56b877bb53e9'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '318f5eb29bbf4343b1c5755248950ef5'}} 2024-11-07 02:37:32,481 - DEBUG - Response for create_port : {'port': {'name': 'cb446511-a147-447b-9842-430712663d20', 'id': 'cb446511-a147-447b-9842-430712663d20', 'tenant_id': '318f5eb29bbf4343b1c5755248950ef5', 'network_id': 'be8d984b-dbc8-46d9-9600-0596963e05a8', 'mac_address': '02:cb:44:65:11:a1', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': 'af774c39-b2fd-48d5-9fb0-7868800a79ad'}], 'security_groups': ['d1ee1d82-0b2c-4a8b-9d5a-56b877bb53e9'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '318f5eb29bbf4343b1c5755248950ef5'}} 2024-11-07 02:37:32,930 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2209-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2209-1) 2024-11-07 02:37:33,348 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2209-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2209-1) 2024-11-07 02:37:34,654 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-2209-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-2209-1) 2024-11-07 02:37:34,654 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-11-07 02:37:34,662 - DEBUG - Requesting: http://10.0.0.40:8082/domain/3e6f894c-20ca-4ba3-93d9-ce2cc92c15eb 2024-11-07 02:37:34,679 - DEBUG - Requesting: http://10.0.0.40:8082/project/318f5eb2-9bbf-4343-b1c5-755248950ef5 2024-11-07 02:37:34,754 - DEBUG - Requesting: http://10.0.0.40:8082/network-ipam/75cca4b6-4d68-4e26-9614-086c9cfb320c 2024-11-07 02:37:34,767 - INFO - Verifications in API Server for IPAM: ctest-ipam-00704138 passed 2024-11-07 02:37:34,775 - DEBUG - Control-node 10.0.0.40 : IPAM object is : {'node_name': 'network-ipam:default-domain:ctest-TestBasicVMVN-75879607:ctest-ipam-00704138', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-75879607', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8488340500576226854', 'uuid-lslong': '10814277867806601740'}, 'enable': 'true', 'created': '2024-11-07T02:37:30', 'last-modified': '2024-11-07T02:37:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.612532'} 2024-11-07 02:37:34,775 - INFO - Verifications in Control node for IPAM: ctest-ipam-00704138 passed 2024-11-07 02:37:34,775 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-11-07 02:37:34,783 - DEBUG - Requesting: http://10.0.0.40:8082/domain/3e6f894c-20ca-4ba3-93d9-ce2cc92c15eb 2024-11-07 02:37:34,799 - DEBUG - Requesting: http://10.0.0.40:8082/project/318f5eb2-9bbf-4343-b1c5-755248950ef5 2024-11-07 02:37:34,888 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:34,910 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:34,930 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/7d5c39c6-fd62-4179-a9c7-f766e740bded 2024-11-07 02:37:34,941 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/7d5c39c6-fd62-4179-a9c7-f766e740bded 2024-11-07 02:37:34,956 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/91b56d49-317e-4457-80d5-3a72f5aaee69 2024-11-07 02:37:34,967 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-07 02:37:34,967 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:34,979 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/7d5c39c6-fd62-4179-a9c7-f766e740bded 2024-11-07 02:37:35,010 - INFO - Verified VN network id 8 for VN be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:35,010 - INFO - Verifications in API Server for VN ctest-vn-25555527 passed 2024-11-07 02:37:35,011 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:35,028 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/7d5c39c6-fd62-4179-a9c7-f766e740bded 2024-11-07 02:37:35,039 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/7d5c39c6-fd62-4179-a9c7-f766e740bded 2024-11-07 02:37:35,052 - DEBUG - Requesting: http://10.0.0.40:8082/route-target/91b56d49-317e-4457-80d5-3a72f5aaee69 2024-11-07 02:37:35,071 - DEBUG - Control-node 10.0.0.40 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-75879607', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13730798290499815129', 'uuid-lslong': '10808645250013070760'}, 'enable': 'true', 'created': '2024-11-07T02:37:31', 'last-modified': '2024-11-07T02:37:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:03.303501'} 2024-11-07 02:37:35,081 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-11-07 02:37:35,081 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-25555527 passed 2024-11-07 02:37:35,081 - DEBUG - ====Verifying policy data for ctest-vn-25555527 in API_Server ====== 2024-11-07 02:37:35,081 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-11-07 02:37:35,093 - DEBUG - Requesting: http://10.0.0.40:8082/domain/3e6f894c-20ca-4ba3-93d9-ce2cc92c15eb 2024-11-07 02:37:35,107 - DEBUG - Requesting: http://10.0.0.40:8082/project/318f5eb2-9bbf-4343-b1c5-755248950ef5 2024-11-07 02:37:35,194 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-network/be8d984b-dbc8-46d9-9600-0596963e05a8 2024-11-07 02:37:35,210 - DEBUG - =>VN ctest-vn-25555527 has no policy to be verified 2024-11-07 02:37:35,210 - DEBUG - Verifying the vn in opserver 2024-11-07 02:37:35,210 - DEBUG - Verifying the default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527 virtual network link through opserver 10.0.0.40 2024-11-07 02:37:35,210 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2024-11-07 02:37:35,624 - DEBUG - Requesting: http://10.0.0.40:8081/analytics/uves/virtual-networks 2024-11-07 02:37:35,721 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527', 'href': 'http://10.0.0.40:8081/analytics/uves/virtual-network/default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527?flat'} 2024-11-07 02:37:35,721 - INFO - Validated that VN default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527 is found in opserver 2024-11-07 02:37:35,730 - DEBUG - VRF ids for VN ctest-vn-25555527: {'10.0.0.40': '2'} 2024-11-07 02:37:35,730 - INFO - Waiting for VM ctest-TestBasicVMVN-75879607-13909423 to be up.. 2024-11-07 02:37:35,874 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-11-07 02:37:40,958 - DEBUG - VM is in ACTIVE state now 2024-11-07 02:37:40,958 - INFO - VM name : ctest-TestBasicVMVN-75879607-13909423 2024-11-07 02:37:41,045 - DEBUG - VM ctest-TestBasicVMVN-75879607-13909423 ID is 1af93790-b44b-4723-9eb7-cf9a0d55dfdd 2024-11-07 02:37:41,046 - DEBUG - VM ctest-TestBasicVMVN-75879607-13909423 launched on Node cn-jenkins-deploy-platform-ansible-os-2209-1 2024-11-07 02:37:41,142 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/1af93790-b44b-4723-9eb7-cf9a0d55dfdd 2024-11-07 02:37:41,153 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/fef14d1f-8fee-48e5-8782-a3a1dd3cee5f 2024-11-07 02:37:44,421 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2024-11-07 02:37:44,421 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75879607-13909423 failed! 2024-11-07 02:37:44,478 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527 is 31.1.1.1 and allocation pool is NOT set 2024-11-07 02:37:44,479 - DEBUG - Gateway for vn default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527 is 31.1.2.1 and allocation pool is NOT set 2024-11-07 02:37:46,539 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.02 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.87 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.868/2.943/3.018/0.075 ms') 2024-11-07 02:37:46,539 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-75879607-13909423 passed 2024-11-07 02:37:46,690 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:46,691 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75879607-13909423, IP 31.1.1.4, Port 22 2024-11-07 02:37:46,757 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-11-07 02:37:46,852 - DEBUG - VM ctest-TestBasicVMVN-75879607-13909423 is NOT ready for SSH connections, VM status: ACTIVE 2024-11-07 02:37:51,852 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:51,853 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75879607-13909423, IP 31.1.1.4, Port 22 2024-11-07 02:37:52,010 - DEBUG - VM ctest-TestBasicVMVN-75879607-13909423 is ready for SSH connections 2024-11-07 02:37:52,010 - INFO - Waiting for VM ctest-TestBasicVMVN-75879607-60659939 to be up.. 2024-11-07 02:37:52,097 - DEBUG - VM is in ACTIVE state now 2024-11-07 02:37:52,097 - INFO - VM name : ctest-TestBasicVMVN-75879607-60659939 2024-11-07 02:37:52,184 - DEBUG - VM ctest-TestBasicVMVN-75879607-60659939 ID is 5ea32dfa-0c39-4736-a8bb-9b0adb6081e7 2024-11-07 02:37:52,184 - DEBUG - VM ctest-TestBasicVMVN-75879607-60659939 launched on Node cn-jenkins-deploy-platform-ansible-os-2209-1 2024-11-07 02:37:52,266 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/5ea32dfa-0c39-4736-a8bb-9b0adb6081e7 2024-11-07 02:37:52,274 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/cb446511-a147-447b-9842-430712663d20 2024-11-07 02:37:53,513 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.22 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.426 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.426/1.824/3.222/1.398 ms') 2024-11-07 02:37:53,513 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-75879607-60659939 passed 2024-11-07 02:37:53,666 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:53,666 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75879607-60659939, IP 31.1.2.4, Port 22 2024-11-07 02:37:53,822 - DEBUG - VM ctest-TestBasicVMVN-75879607-60659939 is ready for SSH connections 2024-11-07 02:37:53,822 - INFO - Waiting for VM ctest-TestBasicVMVN-75879607-61610523 to be up.. 2024-11-07 02:37:53,906 - DEBUG - VM is in ACTIVE state now 2024-11-07 02:37:53,906 - INFO - VM name : ctest-TestBasicVMVN-75879607-61610523 2024-11-07 02:37:53,989 - DEBUG - VM ctest-TestBasicVMVN-75879607-61610523 ID is 9118ab11-fa50-49e5-b463-00666c411e43 2024-11-07 02:37:53,989 - DEBUG - VM ctest-TestBasicVMVN-75879607-61610523 launched on Node cn-jenkins-deploy-platform-ansible-os-2209-1 2024-11-07 02:37:54,073 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine/9118ab11-fa50-49e5-b463-00666c411e43 2024-11-07 02:37:54,085 - DEBUG - Requesting: http://10.0.0.40:8082/virtual-machine-interface/0513900a-4f74-4730-bdf2-9726c3a18793 2024-11-07 02:37:55,329 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.09 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=0.401 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.401/1.743/3.086/1.342 ms') 2024-11-07 02:37:55,329 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-TestBasicVMVN-75879607-61610523 passed 2024-11-07 02:37:55,482 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:55,483 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-75879607-61610523, IP 31.1.1.3, Port 22 2024-11-07 02:37:55,648 - DEBUG - VM ctest-TestBasicVMVN-75879607-61610523 is ready for SSH connections 2024-11-07 02:37:55,648 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:55,648 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:37:55,648 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-11-07 02:37:59,379 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=3.621 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=0.898 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=0.752 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.752/1.757/3.621 ms 2024-11-07 02:37:59,379 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-75879607-13909423 passed 2024-11-07 02:37:59,379 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:37:59,379 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:37:59,379 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-11-07 02:38:03,429 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=3.313 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=0.881 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=0.790 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.790/1.661/3.313 ms 2024-11-07 02:38:03,429 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-75879607-60659939 passed 2024-11-07 02:38:03,430 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:38:03,430 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:38:03,430 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-11-07 02:38:03,430 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:38:03,430 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-07 02:38:03,627 - DEBUG - None 2024-11-07 02:38:03,627 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:38:03,628 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-07 02:38:03,821 - DEBUG - None 2024-11-07 02:38:03,822 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.5, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:38:03,822 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-11-07 02:38:04,471 - DEBUG - None 2024-11-07 02:38:04,471 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:38:04,471 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-11-07 02:38:06,699 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.148 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.957 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.467 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.783 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.420 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.420/1.955/4.957 ms 2024-11-07 02:38:06,699 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:38:06,699 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-11-07 02:38:08,952 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.072 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.399 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.572 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.453 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.878 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.596 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.518 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.453/2.069/4.572 ms 2024-11-07 02:38:08,952 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.40, gateway password: c0ntrail123 2024-11-07 02:38:08,953 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-11-07 02:38:11,212 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.750 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.190 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=4.082 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.467 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.136 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.014 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.483 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.467/2.017/4.082 ms 2024-11-07 02:38:11,212 - INFO - Deleting VM ctest-TestBasicVMVN-75879607-61610523 2024-11-07 02:38:11,285 - INFO - Detaching port cb446511-a147-447b-9842-430712663d20 from VM ctest-TestBasicVMVN-75879607-60659939 2024-11-07 02:38:11,336 - INFO - Deleting VM ctest-TestBasicVMVN-75879607-60659939 2024-11-07 02:38:11,399 - INFO - Detaching port fef14d1f-8fee-48e5-8782-a3a1dd3cee5f from VM ctest-TestBasicVMVN-75879607-13909423 2024-11-07 02:38:11,431 - INFO - Deleting VM ctest-TestBasicVMVN-75879607-13909423 2024-11-07 02:38:11,499 - INFO - Deleting VN ctest-vn-25555527 2024-11-07 02:38:11,664 - DEBUG - Response for delete_port : () 2024-11-07 02:38:11,837 - DEBUG - Response for delete_port : () 2024-11-07 02:38:11,883 - DEBUG - VN be8d984b-dbc8-46d9-9600-0596963e05a8 still in use: Unable to complete operation on network be8d984b-dbc8-46d9-9600-0596963e05a8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d09a2dfd-a22a-45eb-aa30-98287726d51c'] 2024-11-07 02:38:11,883 - WARNING - Deleting VN ctest-vn-25555527 failed..Will retry 2024-11-07 02:38:14,015 - DEBUG - Response for deleting network () 2024-11-07 02:38:14,015 - DEBUG - Requesting: http://10.0.0.40:8082/routing-instance/7d5c39c6-fd62-4179-a9c7-f766e740bded 2024-11-07 02:38:14,021 - DEBUG - Response Code: 404 2024-11-07 02:38:14,021 - DEBUG - Requesting: http://10.0.0.40:8082/domains 2024-11-07 02:38:14,031 - DEBUG - Requesting: http://10.0.0.40:8082/domain/3e6f894c-20ca-4ba3-93d9-ce2cc92c15eb 2024-11-07 02:38:14,089 - DEBUG - Requesting: http://10.0.0.40:8082/project/318f5eb2-9bbf-4343-b1c5-755248950ef5 2024-11-07 02:38:14,161 - INFO - Validated that VN ctest-vn-25555527 is not found in API Server 2024-11-07 02:38:14,173 - DEBUG - VN ctest-vn-25555527 is not present in Agent 10.0.0.40 2024-11-07 02:38:14,173 - INFO - Validated that VN ctest-vn-25555527 is not in any agent 2024-11-07 02:38:14,179 - DEBUG - VRF 2 is not seen in agent 10.0.0.40 2024-11-07 02:38:14,186 - DEBUG - Vrouter 10.0.0.40 does not have vrf 2 for VN ctest-vn-25555527 2024-11-07 02:38:14,186 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-TestBasicVMVN-75879607:ctest-vn-25555527 2024-11-07 02:38:14,198 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-25555527 info 2024-11-07 02:38:14,286 - INFO - IPAM: ctest-ipam-00704138 is not found in API Server 2024-11-07 02:38:14,299 - INFO - IPAM:ctest-ipam-00704138 is not found in control node 2024-11-07 02:38:14,557 - DEBUG - No XMPP flaps were noticed during the test
2024-11-07 02:38:14,557 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:44]
2024-11-07 02:38:14,557 - INFO - -------------------------------------------------------------------------------- 2024-11-07 02:38:15,359 - INFO - Deleted project: ctest-TestBasicVMVN-75879607, ID : 318f5eb2-9bbf-4343-b1c5-755248950ef5