2024-09-13 21:36:59,637 - INFO - Reading existing Domain with UUID c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:36:59,653 - INFO - Using existing domain ['admin_domain'](c825d847-91d2-46e5-9bb6-0d300075fcb1) 2024-09-13 21:37:00,116 - INFO - Project ctest-TestBasicVMVN-23809186 not found, creating it 2024-09-13 21:37:01,290 - INFO - Created Project:ctest-TestBasicVMVN-23809186, ID : 3f304a03-0f52-4727-9e4f-b550221d8577 2024-09-13 21:37:09,057 - INFO - ================================================================================ 2024-09-13 21:37:09,060 - INFO - STARTING TEST : test_generic_link_local_service 2024-09-13 21:37:09,060 - INFO - TEST DESCRIPTION : Description: Test to validate generic linklocal service - running nova list from vm. 1.Create generic link local service to be able to wget to jenkins 2.Create a vm 3.Try wget to jenkins - passes if successful else fails Maintainer: sandipd@juniper.net 2024-09-13 21:37:10,044 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.12': '0', '10.0.0.41': '2'}, '10.0.0.36': {'10.0.0.12': '3', '10.0.0.41': '3'}} with 2024-09-13 21:37:10,045 - INFO - Initial checks done. Running the testcase now 2024-09-13 21:37:10,045 - INFO - 2024-09-13 21:37:13,237 - DEBUG - Response for create_network : {'network': {'id': '1a62215f-c1bb-401e-a1e1-13f1a3eb5236', 'name': 'ctest-vn2_metadata-51212315', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'project_id': '3f304a030f5247279e4fb550221d8577', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['admin_domain', 'ctest-TestBasicVMVN-23809186', 'ctest-vn2_metadata-51212315'], 'port_security_enabled': True, 'description': '', 'created_at': None, 'updated_at': None}} 2024-09-13 21:37:13,991 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aa611e38-32f6-4a94-a88a-f6765a646afe', 'name': '', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'network_id': '1a62215f-c1bb-401e-a1e1-13f1a3eb5236', 'ip_version': 4, 'cidr': '11.1.1.0/24', 'allocation_pools': [{'start': '11.1.1.2', 'end': '11.1.1.254'}], 'gateway_ip': '11.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2024-09-13T21:37:13.538869', 'updated_at': '2024-09-13T21:37:13.538869', 'dns_server_address': '11.1.1.2', 'tags': [], 'project_id': '3f304a030f5247279e4fb550221d8577'}} 2024-09-13 21:37:14,054 - INFO - Created VN ctest-vn2_metadata-51212315 2024-09-13 21:37:14,101 - DEBUG - VN ctest-vn2_metadata-51212315 UUID is 1a62215f-c1bb-401e-a1e1-13f1a3eb5236 2024-09-13 21:37:14,598 - DEBUG - Services list from nova: [, , , ] 2024-09-13 21:37:17,773 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-juju-os-424-1), Zone: (nova:an-jenkins-deploy-platform-juju-os-424-1) 2024-09-13 21:37:18,034 - DEBUG - Link local service introspect added 2024-09-13 21:37:18,164 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2024-09-13 21:37:23,325 - DEBUG - VM is in ACTIVE state now 2024-09-13 21:37:23,496 - INFO - Waiting for VM ctest-TestBasicVMVN-23809186-97262688 to be up.. 2024-09-13 21:37:23,496 - INFO - VM name : ctest-TestBasicVMVN-23809186-97262688 2024-09-13 21:37:23,656 - DEBUG - VM ctest-TestBasicVMVN-23809186-97262688 ID is cac6ef74-0fde-42f2-b3d0-4a6ef26b5996 2024-09-13 21:37:23,656 - DEBUG - VM ctest-TestBasicVMVN-23809186-97262688 launched on Node an-jenkins-deploy-platform-juju-os-424-1 2024-09-13 21:37:23,792 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/cac6ef74-0fde-42f2-b3d0-4a6ef26b5996 2024-09-13 21:37:24,149 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/cac6ef74-0fde-42f2-b3d0-4a6ef26b5996 2024-09-13 21:37:24,204 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/92738654-0fbf-4929-937c-0d199ca6fa23 2024-09-13 21:37:27,367 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2024-09-13 21:37:27,368 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-23809186-97262688 failed! 2024-09-13 21:37:27,389 - DEBUG - Gateway for vn admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn2_metadata-51212315 is 11.1.1.1 and allocation pool is NOT set 2024-09-13 21:37:31,430 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=7.05 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1012ms\r\nrtt min/avg/max/mdev = 7.049/7.049/7.049/0.000 ms') 2024-09-13 21:37:31,430 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-23809186-97262688 passed 2024-09-13 21:37:31,507 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:37:31,507 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-23809186-97262688, IP 11.1.1.3, Port 22 2024-09-13 21:37:31,597 - DEBUG - VM ctest-TestBasicVMVN-23809186-97262688 is ready for SSH connections 2024-09-13 21:37:31,597 - INFO - Retry 0 2024-09-13 21:37:31,598 - DEBUG - Running remote_cmd, Cmd : wget http://169.254.1.2:8083 --spider && echo "Successful", host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.36, gateway password: c0ntrail123 2024-09-13 21:37:31,598 - DEBUG - wget http://169.254.1.2:8083 --spider && echo "Successful" 2024-09-13 21:37:33,481 - DEBUG - Connecting to 169.254.1.2:8083 (169.254.1.2:8083) Successful 2024-09-13 21:37:33,481 - INFO - Generic metadata worked 2024-09-13 21:37:33,701 - DEBUG - Link local service introspect removed 2024-09-13 21:37:33,702 - INFO - Deleting VM ctest-TestBasicVMVN-23809186-97262688 2024-09-13 21:37:33,992 - INFO - Deleting VN ctest-vn2_metadata-51212315 2024-09-13 21:37:34,040 - DEBUG - VN 1a62215f-c1bb-401e-a1e1-13f1a3eb5236 still in use: Unable to complete operation on network 1a62215f-c1bb-401e-a1e1-13f1a3eb5236. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-35c10637-1eee-4446-8d1b-84500749253a'] 2024-09-13 21:37:34,041 - WARNING - Deleting VN ctest-vn2_metadata-51212315 failed..Will retry 2024-09-13 21:37:37,464 - DEBUG - Response for deleting network () 2024-09-13 21:37:38,173 - DEBUG - No XMPP flaps were noticed during the test 2024-09-13 21:37:38,174 - INFO - -------------------------------------------------------------------------------- 2024-09-13 21:37:38,181 - INFO - ================================================================================ 2024-09-13 21:37:38,181 - INFO - STARTING TEST : test_ping_within_vn_two_vms_two_different_subnets 2024-09-13 21:37:38,182 - INFO - TEST DESCRIPTION : Description: Validate Ping between 2 VMs in the same VN, 2 VMs in different VN subnets. Test steps: 1. Create 1 IPAM's. 2. Create 1 VN with 2 subnets and launch 2 VMs in them. 3. Ping between the VMs in the same VN should go thru fine. 4. Ping to the subnet broadcast and all-broadcast address. Pass criteria: VM in the same subnet will respond to both the pings, while the VM in a different VN should respond only to the all-broadcast address. Maintainer : ganeshahv@juniper.net 2024-09-13 21:37:38,921 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.12': '0', '10.0.0.41': '2'}, '10.0.0.36': {'10.0.0.12': '3', '10.0.0.41': '3'}} with 2024-09-13 21:37:38,921 - INFO - Initial checks done. Running the testcase now 2024-09-13 21:37:38,921 - INFO - 2024-09-13 21:37:39,460 - DEBUG - Response for create_network : {'network': {'id': '8f3aed01-78eb-4490-8d0b-4d550e237013', 'name': 'ctest-vn-34001789', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'project_id': '3f304a030f5247279e4fb550221d8577', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['admin_domain', 'ctest-TestBasicVMVN-23809186', 'ctest-vn-34001789'], 'port_security_enabled': True, 'description': '', 'created_at': None, 'updated_at': None}} 2024-09-13 21:37:39,693 - DEBUG - Response for create_subnet : {'subnet': {'id': '7b51c62b-3cf4-4006-9e49-321a93595e92', 'name': '', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'network_id': '8f3aed01-78eb-4490-8d0b-4d550e237013', 'ip_version': 4, 'cidr': '31.1.1.0/29', 'allocation_pools': [{'start': '31.1.1.2', 'end': '31.1.1.6'}], 'gateway_ip': '31.1.1.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2024-09-13T21:37:39.562443', 'updated_at': '2024-09-13T21:37:39.562443', 'dns_server_address': '31.1.1.2', 'tags': [], 'project_id': '3f304a030f5247279e4fb550221d8577'}} 2024-09-13 21:37:39,993 - DEBUG - Response for create_subnet : {'subnet': {'id': '400abf21-57e6-4c03-8e27-c3b0688f1b13', 'name': '', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'network_id': '8f3aed01-78eb-4490-8d0b-4d550e237013', 'ip_version': 4, 'cidr': '31.1.2.0/29', 'allocation_pools': [{'start': '31.1.2.2', 'end': '31.1.2.6'}], 'gateway_ip': '31.1.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'created_at': '2024-09-13T21:37:39.827150', 'updated_at': '2024-09-13T21:37:39.827150', 'dns_server_address': '31.1.2.2', 'tags': [], 'project_id': '3f304a030f5247279e4fb550221d8577'}} 2024-09-13 21:37:40,020 - INFO - Created VN ctest-vn-34001789 2024-09-13 21:37:40,041 - DEBUG - VN ctest-vn-34001789 UUID is 8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:40,597 - DEBUG - Response for create_port : {'port': {'name': '7695543f-43ae-4663-8f2f-52e14874a96c', 'id': '7695543f-43ae-4663-8f2f-52e14874a96c', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'network_id': '8f3aed01-78eb-4490-8d0b-4d550e237013', 'mac_address': '02:76:95:54:3f:43', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.1.4', 'subnet_id': '7b51c62b-3cf4-4006-9e49-321a93595e92'}], 'security_groups': ['ca7a4701-6369-48ab-98a5-6de85fcd5f9e'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'created_at': '2024-09-13T21:37:40.372651', 'updated_at': '2024-09-13T21:37:40.436543', 'project_id': '3f304a030f5247279e4fb550221d8577'}} 2024-09-13 21:37:40,914 - DEBUG - Response for create_port : {'port': {'name': '75a2cba7-345d-4121-83fa-5e331b9740e3', 'id': '75a2cba7-345d-4121-83fa-5e331b9740e3', 'tenant_id': '3f304a030f5247279e4fb550221d8577', 'network_id': '8f3aed01-78eb-4490-8d0b-4d550e237013', 'mac_address': '02:75:a2:cb:a7:34', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '31.1.2.4', 'subnet_id': '400abf21-57e6-4c03-8e27-c3b0688f1b13'}], 'security_groups': ['ca7a4701-6369-48ab-98a5-6de85fcd5f9e'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'created_at': '2024-09-13T21:37:40.707651', 'updated_at': '2024-09-13T21:37:40.773804', 'project_id': '3f304a030f5247279e4fb550221d8577'}} 2024-09-13 21:37:42,948 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-juju-os-424-2), Zone: (nova:an-jenkins-deploy-platform-juju-os-424-2) 2024-09-13 21:37:44,133 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-juju-os-424-1), Zone: (nova:an-jenkins-deploy-platform-juju-os-424-1) 2024-09-13 21:37:46,156 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-juju-os-424-2), Zone: (nova:an-jenkins-deploy-platform-juju-os-424-2) 2024-09-13 21:37:46,157 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:37:46,494 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:37:46,544 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:37:46,569 - DEBUG - Requesting: http://10.0.0.12:8082/project/3f304a03-0f52-4727-9e4f-b550221d8577 2024-09-13 21:37:46,692 - DEBUG - Requesting: http://10.0.0.12:8082/network-ipam/bd64341e-21b5-4ec9-8b02-8740a0eeafba 2024-09-13 21:37:46,711 - INFO - Verifications in API Server for IPAM: ctest-ipam-28033738 passed 2024-09-13 21:37:46,719 - DEBUG - Control-node 10.0.0.12 : IPAM object is : {'node_name': 'network-ipam:admin_domain:ctest-TestBasicVMVN-23809186:ctest-ipam-28033738', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-23809186', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13647090074858639049', 'uuid-lslong': '10016717232873058234'}, 'enable': 'true', 'created': '2024-09-13T21:37:38', 'last-modified': '2024-09-13T21:37:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.629358'} 2024-09-13 21:37:46,783 - DEBUG - Control-node 10.0.0.29 : IPAM object is : {'node_name': 'network-ipam:admin_domain:ctest-TestBasicVMVN-23809186:ctest-ipam-28033738', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-23809186', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13647090074858639049', 'uuid-lslong': '10016717232873058234'}, 'enable': 'true', 'created': '2024-09-13T21:37:38', 'last-modified': '2024-09-13T21:37:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:06.773706'} 2024-09-13 21:37:46,789 - DEBUG - Control-node 10.0.0.41 : IPAM object is : {'node_name': 'network-ipam:admin_domain:ctest-TestBasicVMVN-23809186:ctest-ipam-28033738', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-23809186', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13647090074858639049', 'uuid-lslong': '10016717232873058234'}, 'enable': 'true', 'created': '2024-09-13T21:37:38', 'last-modified': '2024-09-13T21:37:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.694128'} 2024-09-13 21:37:46,789 - INFO - Verifications in Control node for IPAM: ctest-ipam-28033738 passed 2024-09-13 21:37:46,789 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:37:46,798 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:37:46,816 - DEBUG - Requesting: http://10.0.0.12:8082/project/3f304a03-0f52-4727-9e4f-b550221d8577 2024-09-13 21:37:46,953 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:46,994 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:47,015 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/efcb692f-47f9-4fb7-a160-0251d9a08341 2024-09-13 21:37:47,029 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/efcb692f-47f9-4fb7-a160-0251d9a08341 2024-09-13 21:37:47,041 - DEBUG - Requesting: http://10.0.0.12:8082/route-target/2fa4ca78-3669-4793-a9d7-0c59169d59cc 2024-09-13 21:37:47,057 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:37:47,057 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:47,083 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/efcb692f-47f9-4fb7-a160-0251d9a08341 2024-09-13 21:37:47,113 - INFO - Verified VN network id 7 for VN 8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:47,113 - INFO - Verifications in API Server for VN ctest-vn-34001789 passed 2024-09-13 21:37:47,114 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:47,135 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/efcb692f-47f9-4fb7-a160-0251d9a08341 2024-09-13 21:37:47,151 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/efcb692f-47f9-4fb7-a160-0251d9a08341 2024-09-13 21:37:47,165 - DEBUG - Requesting: http://10.0.0.12:8082/route-target/2fa4ca78-3669-4793-a9d7-0c59169d59cc 2024-09-13 21:37:47,181 - DEBUG - Control-node 10.0.0.12 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789', 'interests': '0-1', 'advertised': '0-1', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-23809186', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10320822086652347536', 'uuid-lslong': '10163302011796418579'}, 'enable': 'true', 'created': '2024-09-13T21:37:39', 'last-modified': '2024-09-13T21:37:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.155341'} 2024-09-13 21:37:47,190 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:37:47,198 - DEBUG - Control-node 10.0.0.29 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-23809186', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10320822086652347536', 'uuid-lslong': '10163302011796418579'}, 'enable': 'true', 'created': '2024-09-13T21:37:39', 'last-modified': '2024-09-13T21:37:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.184449'} 2024-09-13 21:37:47,209 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:37:47,215 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestBasicVMVN-23809186', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10320822086652347536', 'uuid-lslong': '10163302011796418579'}, 'enable': 'true', 'created': '2024-09-13T21:37:39', 'last-modified': '2024-09-13T21:37:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:07.313776'} 2024-09-13 21:37:47,222 - DEBUG - Route Targets: ['target:64512:8000005'] 2024-09-13 21:37:47,222 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-34001789 passed 2024-09-13 21:37:47,223 - DEBUG - ====Verifying policy data for ctest-vn-34001789 in API_Server ====== 2024-09-13 21:37:47,223 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:37:47,244 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:37:47,265 - DEBUG - Requesting: http://10.0.0.12:8082/project/3f304a03-0f52-4727-9e4f-b550221d8577 2024-09-13 21:37:47,377 - DEBUG - Requesting: http://10.0.0.12:8082/virtual-network/8f3aed01-78eb-4490-8d0b-4d550e237013 2024-09-13 21:37:47,395 - DEBUG - =>VN ctest-vn-34001789 has no policy to be verified 2024-09-13 21:37:47,395 - DEBUG - Verifying the vn in opserver 2024-09-13 21:37:47,395 - DEBUG - Verifying the admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 virtual network link through opserver 10.0.0.12 2024-09-13 21:37:47,396 - DEBUG - Requesting: http://10.0.0.12:8081/analytics/uves/virtual-networks 2024-09-13 21:37:47,754 - DEBUG - Requesting: http://10.0.0.12:8081/analytics/uves/virtual-networks 2024-09-13 21:37:47,877 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789', 'href': 'http://10.0.0.12:8081/analytics/uves/virtual-network/admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789?flat'} 2024-09-13 21:37:47,877 - DEBUG - Verifying the admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 virtual network link through opserver 10.0.0.29 2024-09-13 21:37:47,877 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-09-13 21:37:48,219 - DEBUG - Requesting: http://10.0.0.29:8081/analytics/uves/virtual-networks 2024-09-13 21:37:48,313 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789', 'href': 'http://10.0.0.29:8081/analytics/uves/virtual-network/admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789?flat'} 2024-09-13 21:37:48,313 - DEBUG - Verifying the admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 virtual network link through opserver 10.0.0.41 2024-09-13 21:37:48,314 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2024-09-13 21:37:48,639 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2024-09-13 21:37:48,723 - DEBUG - vn link and name as {'name': 'admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789?flat'} 2024-09-13 21:37:48,723 - INFO - Validated that VN admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 is found in opserver 2024-09-13 21:37:48,738 - DEBUG - VRF ids for VN ctest-vn-34001789: {'10.0.0.27': '2', '10.0.0.36': '2'} 2024-09-13 21:37:48,739 - INFO - Waiting for VM ctest-TestBasicVMVN-23809186-99538575 to be up.. 2024-09-13 21:37:48,891 - DEBUG - VM is in ACTIVE state now 2024-09-13 21:37:48,891 - INFO - VM name : ctest-TestBasicVMVN-23809186-99538575 2024-09-13 21:37:49,023 - DEBUG - VM ctest-TestBasicVMVN-23809186-99538575 ID is e0be6f9c-4e89-4ef7-9e1a-e690a8ebd7ef 2024-09-13 21:37:49,023 - DEBUG - VM ctest-TestBasicVMVN-23809186-99538575 launched on Node an-jenkins-deploy-platform-juju-os-424-2 2024-09-13 21:37:49,152 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/e0be6f9c-4e89-4ef7-9e1a-e690a8ebd7ef 2024-09-13 21:37:49,164 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/7695543f-43ae-4663-8f2f-52e14874a96c 2024-09-13 21:37:52,318 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2024-09-13 21:37:52,318 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-23809186-99538575 failed! 2024-09-13 21:37:52,338 - DEBUG - Gateway for vn admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 is 31.1.1.1 and allocation pool is NOT set 2024-09-13 21:37:52,338 - DEBUG - Gateway for vn admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 is 31.1.2.1 and allocation pool is NOT set 2024-09-13 21:37:54,411 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.23 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.368 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.368/1.800/3.233/1.432 ms') 2024-09-13 21:37:54,412 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-23809186-99538575 passed 2024-09-13 21:37:54,450 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:37:54,450 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-23809186-99538575, IP 31.1.1.4, Port 22 2024-09-13 21:37:54,559 - DEBUG - VM ctest-TestBasicVMVN-23809186-99538575 is ready for SSH connections 2024-09-13 21:37:54,559 - INFO - Waiting for VM ctest-TestBasicVMVN-23809186-83159744 to be up.. 2024-09-13 21:37:54,804 - DEBUG - VM is in ACTIVE state now 2024-09-13 21:37:54,804 - INFO - VM name : ctest-TestBasicVMVN-23809186-83159744 2024-09-13 21:37:55,040 - DEBUG - VM ctest-TestBasicVMVN-23809186-83159744 ID is 920bf26b-f4be-4985-944f-c295c0a5135a 2024-09-13 21:37:55,040 - DEBUG - VM ctest-TestBasicVMVN-23809186-83159744 launched on Node an-jenkins-deploy-platform-juju-os-424-1 2024-09-13 21:37:55,171 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/920bf26b-f4be-4985-944f-c295c0a5135a 2024-09-13 21:37:55,184 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/75a2cba7-345d-4121-83fa-5e331b9740e3 2024-09-13 21:37:56,277 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=7.39 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.11 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.105/4.246/7.387/3.141 ms') 2024-09-13 21:37:56,278 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestBasicVMVN-23809186-83159744 passed 2024-09-13 21:37:56,316 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:37:56,317 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-23809186-83159744, IP 31.1.2.4, Port 22 2024-09-13 21:37:56,406 - DEBUG - VM ctest-TestBasicVMVN-23809186-83159744 is ready for SSH connections 2024-09-13 21:37:56,406 - INFO - Waiting for VM ctest-TestBasicVMVN-23809186-82431144 to be up.. 2024-09-13 21:37:56,540 - DEBUG - VM is in ACTIVE state now 2024-09-13 21:37:56,540 - INFO - VM name : ctest-TestBasicVMVN-23809186-82431144 2024-09-13 21:37:56,668 - DEBUG - VM ctest-TestBasicVMVN-23809186-82431144 ID is 4e34b4a1-911b-4b20-851d-05bf4d16909f 2024-09-13 21:37:56,668 - DEBUG - VM ctest-TestBasicVMVN-23809186-82431144 launched on Node an-jenkins-deploy-platform-juju-os-424-2 2024-09-13 21:37:56,795 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/4e34b4a1-911b-4b20-851d-05bf4d16909f 2024-09-13 21:37:56,807 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/6fbed7b3-ea46-403e-9892-b16390cae94b 2024-09-13 21:37:59,929 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=3.32 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1027ms\r\nrtt min/avg/max/mdev = 3.324/3.324/3.324/0.000 ms') 2024-09-13 21:37:59,930 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestBasicVMVN-23809186-82431144 passed 2024-09-13 21:38:00,006 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:00,006 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-23809186-82431144, IP 31.1.1.3, Port 22 2024-09-13 21:38:00,076 - DEBUG - Error on ssh to cirros@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2024-09-13 21:38:00,234 - DEBUG - VM ctest-TestBasicVMVN-23809186-82431144 is NOT ready for SSH connections, VM status: ACTIVE 2024-09-13 21:38:05,235 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:05,235 - DEBUG - Waiting to SSH to VM ctest-TestBasicVMVN-23809186-82431144, IP 31.1.1.3, Port 22 2024-09-13 21:38:06,154 - DEBUG - VM ctest-TestBasicVMVN-23809186-82431144 is ready for SSH connections 2024-09-13 21:38:06,154 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:06,154 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.2.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-09-13 21:38:06,154 - DEBUG - ping -s 56 -c 3 -W 1 31.1.2.4 2024-09-13 21:38:10,124 - DEBUG - PING 31.1.2.4 (31.1.2.4): 56 data bytes 64 bytes from 31.1.2.4: seq=0 ttl=63 time=6.358 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=1.223 ms 64 bytes from 31.1.2.4: seq=2 ttl=63 time=1.343 ms --- 31.1.2.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.223/2.974/6.358 ms 2024-09-13 21:38:10,124 - INFO - Ping to IP 31.1.2.4 from VM ctest-TestBasicVMVN-23809186-99538575 passed 2024-09-13 21:38:10,125 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:10,125 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.4, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.36, gateway password: c0ntrail123 2024-09-13 21:38:10,125 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.4 2024-09-13 21:38:13,748 - DEBUG - PING 31.1.1.4 (31.1.1.4): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=63 time=2.920 ms 64 bytes from 31.1.1.4: seq=1 ttl=63 time=1.177 ms 64 bytes from 31.1.1.4: seq=2 ttl=63 time=1.258 ms --- 31.1.1.4 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.177/1.785/2.920 ms 2024-09-13 21:38:13,748 - INFO - Ping to IP 31.1.1.4 from VM ctest-TestBasicVMVN-23809186-83159744 passed 2024-09-13 21:38:13,749 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:13,749 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:13,749 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2024-09-13 21:38:13,749 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-09-13 21:38:13,749 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-09-13 21:38:13,884 - DEBUG - None 2024-09-13 21:38:13,884 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.36, gateway password: c0ntrail123 2024-09-13 21:38:13,884 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-09-13 21:38:14,006 - DEBUG - None 2024-09-13 21:38:14,007 - DEBUG - Running remote_cmd, Cmd : echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-09-13 21:38:14,007 - DEBUG - echo 0 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 2024-09-13 21:38:14,770 - DEBUG - None 2024-09-13 21:38:14,770 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 31.1.1.7, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-09-13 21:38:14,770 - DEBUG - ping -s 56 -c 3 -W 1 31.1.1.7 2024-09-13 21:38:16,975 - DEBUG - PING 31.1.1.7 (31.1.1.7): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=2.474 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=6.849 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.392 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=1.563 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.344 ms --- 31.1.1.7 ping statistics --- 3 packets transmitted, 3 packets received, 2 duplicates, 0% packet loss round-trip min/avg/max = 0.344/2.324/6.849 ms 2024-09-13 21:38:16,975 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 224.0.0.1, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-09-13 21:38:16,975 - DEBUG - ping -s 56 -c 3 -W 1 224.0.0.1 2024-09-13 21:38:19,129 - DEBUG - PING 224.0.0.1 (224.0.0.1): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=1.928 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=3.779 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.497 ms 64 bytes from 31.1.1.3: seq=1 ttl=64 time=2.721 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=1845.629 ms (DUP!) 64 bytes from 31.1.2.4: seq=1 ttl=63 time=851.536 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=0.353 ms --- 224.0.0.1 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.353/386.634/1845.629 ms 2024-09-13 21:38:19,129 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 255.255.255.255, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2024-09-13 21:38:19,129 - DEBUG - ping -s 56 -c 3 -W 1 255.255.255.255 2024-09-13 21:38:21,314 - DEBUG - PING 255.255.255.255 (255.255.255.255): 56 data bytes 64 bytes from 31.1.1.4: seq=0 ttl=64 time=0.933 ms 64 bytes from 31.1.1.3: seq=0 ttl=64 time=4.229 ms (DUP!) 64 bytes from 31.1.2.4: seq=0 ttl=63 time=5.241 ms (DUP!) 64 bytes from 31.1.1.4: seq=1 ttl=64 time=0.642 ms 64 bytes from 31.1.2.4: seq=1 ttl=63 time=2.456 ms (DUP!) 64 bytes from 31.1.1.3: seq=1 ttl=64 time=3.935 ms (DUP!) 64 bytes from 31.1.1.4: seq=2 ttl=64 time=1.165 ms --- 255.255.255.255 ping statistics --- 3 packets transmitted, 3 packets received, 4 duplicates, 0% packet loss round-trip min/avg/max = 0.642/2.657/5.241 ms 2024-09-13 21:38:21,314 - INFO - Deleting VM ctest-TestBasicVMVN-23809186-82431144 2024-09-13 21:38:21,522 - INFO - Detaching port 75a2cba7-345d-4121-83fa-5e331b9740e3 from VM ctest-TestBasicVMVN-23809186-83159744 2024-09-13 21:38:21,593 - INFO - Deleting VM ctest-TestBasicVMVN-23809186-83159744 2024-09-13 21:38:21,768 - INFO - Detaching port 7695543f-43ae-4663-8f2f-52e14874a96c from VM ctest-TestBasicVMVN-23809186-99538575 2024-09-13 21:38:21,858 - INFO - Deleting VM ctest-TestBasicVMVN-23809186-99538575 2024-09-13 21:38:22,016 - INFO - Deleting VN ctest-vn-34001789 2024-09-13 21:38:22,399 - DEBUG - Response for delete_port : () 2024-09-13 21:38:26,947 - DEBUG - Response for delete_port : () 2024-09-13 21:38:27,191 - DEBUG - Response for deleting network () 2024-09-13 21:38:27,191 - DEBUG - Requesting: http://10.0.0.12:8082/routing-instance/efcb692f-47f9-4fb7-a160-0251d9a08341 2024-09-13 21:38:27,200 - DEBUG - Response Code: 404 2024-09-13 21:38:27,200 - DEBUG - Requesting: http://10.0.0.12:8082/domains 2024-09-13 21:38:27,208 - DEBUG - Requesting: http://10.0.0.12:8082/domain/c825d847-91d2-46e5-9bb6-0d300075fcb1 2024-09-13 21:38:27,220 - DEBUG - Requesting: http://10.0.0.12:8082/project/3f304a03-0f52-4727-9e4f-b550221d8577 2024-09-13 21:38:27,280 - INFO - Validated that VN ctest-vn-34001789 is not found in API Server 2024-09-13 21:38:27,294 - DEBUG - VN ctest-vn-34001789 is not present in Agent 10.0.0.27 2024-09-13 21:38:27,305 - DEBUG - VN ctest-vn-34001789 is not present in Agent 10.0.0.36 2024-09-13 21:38:27,305 - INFO - Validated that VN ctest-vn-34001789 is not in any agent 2024-09-13 21:38:27,312 - DEBUG - VRF 2 is not seen in agent 10.0.0.27 2024-09-13 21:38:27,318 - DEBUG - Vrouter 10.0.0.27 does not have vrf 2 for VN ctest-vn-34001789 2024-09-13 21:38:27,324 - DEBUG - VRF 2 is not seen in agent 10.0.0.36 2024-09-13 21:38:27,330 - DEBUG - Vrouter 10.0.0.36 does not have vrf 2 for VN ctest-vn-34001789 2024-09-13 21:38:27,330 - INFO - Validated that all vrouters do not have the route table for VN admin_domain:ctest-TestBasicVMVN-23809186:ctest-vn-34001789 2024-09-13 21:38:27,354 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-34001789 info 2024-09-13 21:38:27,430 - INFO - IPAM: ctest-ipam-28033738 is not found in API Server 2024-09-13 21:38:27,456 - INFO - IPAM:ctest-ipam-28033738 is not found in control node 2024-09-13 21:38:28,161 - DEBUG - No XMPP flaps were noticed during the test
2024-09-13 21:38:28,161 - INFO - END TEST : test_ping_within_vn_two_vms_two_different_subnets : PASSED[0:00:50]
2024-09-13 21:38:28,162 - INFO - -------------------------------------------------------------------------------- 2024-09-13 21:38:28,981 - INFO - Deleted project: ctest-TestBasicVMVN-23809186, ID : 3f304a03-0f52-4727-9e4f-b550221d8577