2026-03-26 06:07:31,515 - INFO - Domain Default found not creating 2026-03-26 06:07:32,468 - INFO - Project ctest-FloatingipBasicTestSanity-89112467 not found, creating it 2026-03-26 06:07:33,195 - INFO - Created Project:ctest-FloatingipBasicTestSanity-89112467, ID : 565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:35,089 - INFO - Using existing project ['default-domain', 'admin'](f7f19615-4d7b-418f-ab99-2562af90707c) 2026-03-26 06:07:35,969 - INFO - Adding rules to the default security group in Project admin 2026-03-26 06:07:36,317 - INFO - ================================================================================ 2026-03-26 06:07:36,317 - INFO - STARTING TEST : test_floating_ip 2026-03-26 06:07:36,317 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN. 2026-03-26 06:07:37,010 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.17': '0', '10.20.0.254': '0'}, '10.0.0.249': {'10.20.0.17': '0', '10.20.0.14': '0'}} with 2026-03-26 06:07:37,010 - INFO - Initial checks done. Running the testcase now 2026-03-26 06:07:37,010 - INFO - 2026-03-26 06:07:37,040 - DEBUG - Services list from nova: [, , , ] 2026-03-26 06:07:37,040 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5546-2', 'an-jenkins-deploy-platform-ansible-os-5546-1']} 2026-03-26 06:07:37,998 - DEBUG - Response for create_network : {'network': {'id': '0414f800-8b8d-4a3a-aea4-8920fda9209b', 'name': 'ctest-fvn-91458240', 'tenant_id': '565ffa27804e450dad5965aa4be75509', 'project_id': '565ffa27804e450dad5965aa4be75509', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-89112467', 'ctest-fvn-91458240'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 06:07:38,377 - DEBUG - Response for create_subnet : {'subnet': {'id': '0db993d1-a903-4a22-8cb6-d2dc84f61656', 'name': '', 'tenant_id': '565ffa27804e450dad5965aa4be75509', 'network_id': '0414f800-8b8d-4a3a-aea4-8920fda9209b', 'ip_version': 4, 'cidr': '106.10.132.128/26', 'allocation_pools': [{'start': '106.10.132.130', 'end': '106.10.132.190'}], 'gateway_ip': '106.10.132.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '106.10.132.130', 'tags': [], 'project_id': '565ffa27804e450dad5965aa4be75509'}} 2026-03-26 06:07:38,408 - INFO - Created VN ctest-fvn-91458240 2026-03-26 06:07:38,420 - DEBUG - VN ctest-fvn-91458240 UUID is 0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:38,526 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:38,874 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:38,925 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:07:38,952 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:39,093 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:39,111 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:39,123 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c1d1159-d150-4d80-807d-c52af14151ee 2026-03-26 06:07:39,134 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c1d1159-d150-4d80-807d-c52af14151ee 2026-03-26 06:07:39,145 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1b681fc7-6873-4db5-8257-72462256446a 2026-03-26 06:07:39,154 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-26 06:07:39,154 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:39,168 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c1d1159-d150-4d80-807d-c52af14151ee 2026-03-26 06:07:39,197 - INFO - Verified VN network id 6 for VN 0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:39,197 - INFO - Verifications in API Server for VN ctest-fvn-91458240 passed 2026-03-26 06:07:39,197 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:39,210 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c1d1159-d150-4d80-807d-c52af14151ee 2026-03-26 06:07:39,220 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c1d1159-d150-4d80-807d-c52af14151ee 2026-03-26 06:07:39,228 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1b681fc7-6873-4db5-8257-72462256446a 2026-03-26 06:07:39,243 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-89112467', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '294132556910905914', 'uuid-lslong': '12584334033567686811'}, 'enable': 'true', 'created': '2026-03-26T06:07:37', 'last-modified': '2026-03-26T06:07:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.949466'} 2026-03-26 06:07:39,251 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-26 06:07:39,257 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-89112467', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '294132556910905914', 'uuid-lslong': '12584334033567686811'}, 'enable': 'true', 'created': '2026-03-26T06:07:37', 'last-modified': '2026-03-26T06:07:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.969564'} 2026-03-26 06:07:39,266 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-26 06:07:39,273 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-89112467', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '294132556910905914', 'uuid-lslong': '12584334033567686811'}, 'enable': 'true', 'created': '2026-03-26T06:07:37', 'last-modified': '2026-03-26T06:07:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.983620'} 2026-03-26 06:07:39,282 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-26 06:07:39,282 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-91458240 passed 2026-03-26 06:07:39,282 - DEBUG - ====Verifying policy data for ctest-fvn-91458240 in API_Server ====== 2026-03-26 06:07:39,282 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:39,291 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:07:39,305 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:39,436 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:39,452 - DEBUG - =>VN ctest-fvn-91458240 has no policy to be verified 2026-03-26 06:07:39,452 - DEBUG - Verifying the vn in opserver 2026-03-26 06:07:39,452 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240 virtual network link through opserver 10.0.0.38 2026-03-26 06:07:39,452 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-03-26 06:07:39,824 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-03-26 06:07:39,913 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240?flat'} 2026-03-26 06:07:39,913 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240 virtual network link through opserver 10.0.0.242 2026-03-26 06:07:39,913 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-26 06:07:40,275 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-26 06:07:40,372 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240?flat'} 2026-03-26 06:07:40,372 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240 virtual network link through opserver 10.0.0.33 2026-03-26 06:07:40,372 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-26 06:07:40,726 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-26 06:07:40,819 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240?flat'} 2026-03-26 06:07:40,819 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240 is found in opserver 2026-03-26 06:07:40,844 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 06:07:40,857 - DEBUG - VRF ids for VN ctest-fvn-91458240: {} 2026-03-26 06:07:41,281 - DEBUG - Response for create_network : {'network': {'id': 'd072166e-8028-4843-8df6-d5e3c6d91a35', 'name': 'ctest-vn1-80120150', 'tenant_id': '565ffa27804e450dad5965aa4be75509', 'project_id': '565ffa27804e450dad5965aa4be75509', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-89112467', 'ctest-vn1-80120150'], 'port_security_enabled': True, 'description': ''}} 2026-03-26 06:07:41,601 - DEBUG - Response for create_subnet : {'subnet': {'id': '19516637-acb2-4f6f-ba49-8b8423957cd1', 'name': '', 'tenant_id': '565ffa27804e450dad5965aa4be75509', 'network_id': 'd072166e-8028-4843-8df6-d5e3c6d91a35', 'ip_version': 4, 'cidr': '208.29.108.64/26', 'allocation_pools': [{'start': '208.29.108.66', 'end': '208.29.108.126'}], 'gateway_ip': '208.29.108.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '208.29.108.66', 'tags': [], 'project_id': '565ffa27804e450dad5965aa4be75509'}} 2026-03-26 06:07:41,632 - INFO - Created VN ctest-vn1-80120150 2026-03-26 06:07:41,651 - DEBUG - VN ctest-vn1-80120150 UUID is d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:41,767 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:41,774 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:07:41,789 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:41,913 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:41,937 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:41,950 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5dc83156-029b-459e-afa7-153d5337cd07 2026-03-26 06:07:41,962 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5dc83156-029b-459e-afa7-153d5337cd07 2026-03-26 06:07:41,972 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/a02c9025-3892-421e-a81c-043cfe0a038f 2026-03-26 06:07:41,982 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-26 06:07:41,982 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:41,998 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5dc83156-029b-459e-afa7-153d5337cd07 2026-03-26 06:07:42,017 - INFO - Verified VN network id 7 for VN d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:42,017 - INFO - Verifications in API Server for VN ctest-vn1-80120150 passed 2026-03-26 06:07:42,017 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:42,032 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5dc83156-029b-459e-afa7-153d5337cd07 2026-03-26 06:07:42,042 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5dc83156-029b-459e-afa7-153d5337cd07 2026-03-26 06:07:42,051 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/a02c9025-3892-421e-a81c-043cfe0a038f 2026-03-26 06:07:42,065 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-89112467', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15020092371086362691', 'uuid-lslong': '10229598777889069621'}, 'enable': 'true', 'created': '2026-03-26T06:07:41', 'last-modified': '2026-03-26T06:07:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.539876'} 2026-03-26 06:07:42,073 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-26 06:07:42,080 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-89112467', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15020092371086362691', 'uuid-lslong': '10229598777889069621'}, 'enable': 'true', 'created': '2026-03-26T06:07:41', 'last-modified': '2026-03-26T06:07:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.559278'} 2026-03-26 06:07:42,088 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-26 06:07:42,097 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-89112467', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15020092371086362691', 'uuid-lslong': '10229598777889069621'}, 'enable': 'true', 'created': '2026-03-26T06:07:41', 'last-modified': '2026-03-26T06:07:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.586967'} 2026-03-26 06:07:42,113 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-26 06:07:42,113 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-80120150 passed 2026-03-26 06:07:42,113 - DEBUG - ====Verifying policy data for ctest-vn1-80120150 in API_Server ====== 2026-03-26 06:07:42,113 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:42,122 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:07:42,135 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:42,266 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/d072166e-8028-4843-8df6-d5e3c6d91a35 2026-03-26 06:07:42,284 - DEBUG - =>VN ctest-vn1-80120150 has no policy to be verified 2026-03-26 06:07:42,284 - DEBUG - Verifying the vn in opserver 2026-03-26 06:07:42,284 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150 virtual network link through opserver 10.0.0.38 2026-03-26 06:07:42,284 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-03-26 06:07:42,362 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150?flat'} 2026-03-26 06:07:42,363 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150 virtual network link through opserver 10.0.0.242 2026-03-26 06:07:42,363 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-26 06:07:42,443 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150?flat'} 2026-03-26 06:07:42,443 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150 virtual network link through opserver 10.0.0.33 2026-03-26 06:07:42,443 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-03-26 06:07:42,518 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150?flat'} 2026-03-26 06:07:42,518 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150 is found in opserver 2026-03-26 06:07:42,546 - DEBUG - Do not have enough data to verify VN in agent 2026-03-26 06:07:42,558 - DEBUG - VRF ids for VN ctest-vn1-80120150: {} 2026-03-26 06:07:43,941 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5546-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5546-2) 2026-03-26 06:07:46,332 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5546-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5546-1) 2026-03-26 06:07:46,566 - INFO - Creating Floating IP pool ctest-some-pool-39754384 in API Server 2026-03-26 06:07:46,840 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:46,852 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:07:46,869 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:47,022 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:47,037 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip-pool/70efa194-e879-469f-b6ed-50641ddece17 2026-03-26 06:07:47,059 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:07:47,068 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:07:47,090 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:07:47,212 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0414f800-8b8d-4a3a-aea4-8920fda9209b 2026-03-26 06:07:47,226 - DEBUG - FIP Pool ctest-some-pool-39754384 found in API Server 2026-03-26 06:07:47,226 - INFO - Verification for FIP pool ctest-some-pool-39754384 in API Server passed 2026-03-26 06:07:47,252 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-39754384 information 2026-03-26 06:07:47,264 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-39754384 information 2026-03-26 06:07:47,279 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-39754384 information 2026-03-26 06:07:47,279 - INFO - Verification for FIP pool ctest-some-pool-39754384 in Control-node passed 2026-03-26 06:07:47,279 - INFO - Waiting for VM ctest-vn1_vm1_name-25753536 to be up.. 2026-03-26 06:07:47,510 - DEBUG - VM is in ACTIVE state now 2026-03-26 06:07:47,511 - INFO - VM name : ctest-vn1_vm1_name-25753536 2026-03-26 06:07:47,685 - DEBUG - VM ctest-vn1_vm1_name-25753536 ID is 4faea58e-f9b9-4cb8-a5df-b4fb2c3bc1d5 2026-03-26 06:07:47,723 - DEBUG - VM ctest-vn1_vm1_name-25753536 launched on Node an-jenkins-deploy-platform-ansible-os-5546-2 2026-03-26 06:07:47,905 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/4faea58e-f9b9-4cb8-a5df-b4fb2c3bc1d5 2026-03-26 06:07:48,610 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/4faea58e-f9b9-4cb8-a5df-b4fb2c3bc1d5 2026-03-26 06:07:48,694 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/40179d1a-f18a-4472-a8a4-fabe6463da48 2026-03-26 06:07:51,897 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2026-03-26 06:07:51,897 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-25753536 failed! 2026-03-26 06:07:51,918 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150 is 208.29.108.65 and allocation pool is NOT set 2026-03-26 06:07:55,958 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1025ms') 2026-03-26 06:07:55,958 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-25753536 failed! 2026-03-26 06:07:55,977 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-vn1-80120150 is 208.29.108.65 and allocation pool is NOT set 2026-03-26 06:07:57,999 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.27 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.512 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.512/1.892/3.273/1.380 ms') 2026-03-26 06:07:57,999 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-25753536 passed 2026-03-26 06:07:58,121 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-03-26 06:07:58,121 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-25753536, IP 208.29.108.67, Port 22 2026-03-26 06:07:58,146 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-03-26 06:07:58,264 - DEBUG - VM ctest-vn1_vm1_name-25753536 is NOT ready for SSH connections, VM status: ACTIVE 2026-03-26 06:08:03,265 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-03-26 06:08:03,266 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-25753536, IP 208.29.108.67, Port 22 2026-03-26 06:08:03,343 - DEBUG - VM ctest-vn1_vm1_name-25753536 is ready for SSH connections 2026-03-26 06:08:03,548 - DEBUG - Created Floating IP : ('106.10.132.132', 'a6a31bd4-9bd7-4e23-87a9-5f011150a4e1') 2026-03-26 06:08:03,549 - DEBUG - Associating FIP 106.10.132.132 to 4faea58e-f9b9-4cb8-a5df-b4fb2c3bc1d5 2026-03-26 06:08:03,596 - DEBUG - Associating FIP ID a6a31bd4-9bd7-4e23-87a9-5f011150a4e1 with Port ID 40179d1a-f18a-4472-a8a4-fabe6463da48 2026-03-26 06:08:03,743 - INFO - Waiting for VM ctest-fvn_vm1_name-36729383 to be up.. 2026-03-26 06:08:03,882 - DEBUG - VM is in ACTIVE state now 2026-03-26 06:08:03,882 - INFO - VM name : ctest-fvn_vm1_name-36729383 2026-03-26 06:08:04,006 - DEBUG - VM ctest-fvn_vm1_name-36729383 ID is 6e8da97f-6539-4466-aca0-9d7d5b235695 2026-03-26 06:08:04,007 - DEBUG - VM ctest-fvn_vm1_name-36729383 launched on Node an-jenkins-deploy-platform-ansible-os-5546-1 2026-03-26 06:08:04,135 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/6e8da97f-6539-4466-aca0-9d7d5b235695 2026-03-26 06:08:04,147 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/e7dbc032-a147-4a07-a4d3-2a39a10f9b9c 2026-03-26 06:08:05,317 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.28 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.595 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.595/2.937/5.279/2.342 ms') 2026-03-26 06:08:05,317 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-36729383 passed 2026-03-26 06:08:05,432 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-03-26 06:08:05,432 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-36729383, IP 106.10.132.131, Port 22 2026-03-26 06:08:05,522 - DEBUG - VM ctest-fvn_vm1_name-36729383 is ready for SSH connections 2026-03-26 06:08:05,702 - INFO - Route for FIP 106.10.132.132 is fine on Control-node 10.0.0.242 2026-03-26 06:08:05,712 - INFO - Route for FIP 106.10.132.132 is fine on Control-node 10.0.0.38 2026-03-26 06:08:05,722 - INFO - Route for FIP 106.10.132.132 is fine on Control-node 10.0.0.33 2026-03-26 06:08:05,722 - INFO - FIP 106.10.132.132 verification for passed on all Control-nodes 2026-03-26 06:08:05,722 - INFO - FIP ID a6a31bd4-9bd7-4e23-87a9-5f011150a4e1(106.10.132.132) validation in Control node passed 2026-03-26 06:08:05,763 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.25', 'dip': '10.20.0.193', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:38:99:57'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '24', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.17', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None} 2026-03-26 06:08:05,763 - DEBUG - Route for FIP IP 106.10.132.132 is present in agent 10.0.0.22 2026-03-26 06:08:05,763 - DEBUG - FIP 106.10.132.132 verification for VM ctest-vn1_vm1_name-25753536 in Agent 10.0.0.22 passed 2026-03-26 06:08:05,791 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '16', 'valid': 'true', 'policy': 'enabled', 'itf': 'tap40179d1a-f1', 'mac': ['2:40:17:9d:1a:f1'], 'mcast': 'disabled', 'nh_index': '31', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.14', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-89112467:ctest-fvn-91458240'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None} 2026-03-26 06:08:05,791 - DEBUG - Route for FIP IP 106.10.132.132 is present in agent 10.0.0.249 2026-03-26 06:08:05,791 - DEBUG - FIP 106.10.132.132 verification for VM ctest-vn1_vm1_name-25753536 in Agent 10.0.0.249 passed 2026-03-26 06:08:05,791 - INFO - FIP ID a6a31bd4-9bd7-4e23-87a9-5f011150a4e1(106.10.132.132) validation in agents passed 2026-03-26 06:08:05,791 - DEBUG - Requesting: http://10.0.0.38:8082/floating-ip/a6a31bd4-9bd7-4e23-87a9-5f011150a4e1 2026-03-26 06:08:05,804 - DEBUG - FIP a6a31bd4-9bd7-4e23-87a9-5f011150a4e1 is present in API server 2026-03-26 06:08:05,804 - INFO - FIP ID a6a31bd4-9bd7-4e23-87a9-5f011150a4e1(106.10.132.132) validation in API Server passed 2026-03-26 06:08:05,804 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-03-26 06:08:05,804 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 106.10.132.131, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.249, gateway password: c0ntrail123 2026-03-26 06:08:05,805 - DEBUG - ping -s 56 -c 3 -W 1 106.10.132.131 2026-03-26 06:08:08,588 - DEBUG - PING 106.10.132.131 (106.10.132.131): 56 data bytes 64 bytes from 106.10.132.131: seq=0 ttl=64 time=9.544 ms 64 bytes from 106.10.132.131: seq=1 ttl=64 time=1.959 ms 64 bytes from 106.10.132.131: seq=2 ttl=64 time=1.557 ms --- 106.10.132.131 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 1.557/4.353/9.544 ms 2026-03-26 06:08:08,588 - INFO - Ping to IP 106.10.132.131 from VM ctest-vn1_vm1_name-25753536 passed 2026-03-26 06:08:08,588 - DEBUG - Disassociating port from FIP ID : a6a31bd4-9bd7-4e23-87a9-5f011150a4e1 2026-03-26 06:08:08,696 - DEBUG - Deleting FIP ID a6a31bd4-9bd7-4e23-87a9-5f011150a4e1 2026-03-26 06:08:08,845 - INFO - Deleting the FIP pool ctest-some-pool-39754384 2026-03-26 06:08:08,992 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-39754384 information 2026-03-26 06:08:09,001 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-39754384 information 2026-03-26 06:08:09,009 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-39754384 information 2026-03-26 06:08:09,010 - INFO - Deleting VM ctest-fvn_vm1_name-36729383 2026-03-26 06:08:09,119 - INFO - Deleting VM ctest-vn1_vm1_name-25753536 2026-03-26 06:08:09,207 - INFO - Deleting VN ctest-vn1-80120150 2026-03-26 06:08:09,275 - DEBUG - VN d072166e-8028-4843-8df6-d5e3c6d91a35 still in use: Unable to complete operation on network d072166e-8028-4843-8df6-d5e3c6d91a35. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-eb8fb2d8-b19a-4c6e-81b9-b76d0649f1d3'] 2026-03-26 06:08:09,275 - WARNING - Deleting VN ctest-vn1-80120150 failed..Will retry 2026-03-26 06:08:11,509 - DEBUG - Response for deleting network () 2026-03-26 06:08:11,509 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/5dc83156-029b-459e-afa7-153d5337cd07 2026-03-26 06:08:11,525 - DEBUG - Response Code: 404 2026-03-26 06:08:11,525 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:08:11,546 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:08:11,565 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:08:11,686 - INFO - Validated that VN ctest-vn1-80120150 is not found in API Server 2026-03-26 06:08:11,699 - DEBUG - VN ctest-vn1-80120150 is not present in Agent 10.0.0.22 2026-03-26 06:08:11,710 - DEBUG - VN ctest-vn1-80120150 is not present in Agent 10.0.0.249 2026-03-26 06:08:11,710 - INFO - Validated that VN ctest-vn1-80120150 is not in any agent 2026-03-26 06:08:11,749 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-80120150 info 2026-03-26 06:08:11,749 - INFO - Deleting VN ctest-fvn-91458240 2026-03-26 06:08:12,011 - DEBUG - Response for deleting network () 2026-03-26 06:08:12,011 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c1d1159-d150-4d80-807d-c52af14151ee 2026-03-26 06:08:12,024 - DEBUG - Response Code: 404 2026-03-26 06:08:12,024 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-03-26 06:08:12,036 - DEBUG - Requesting: http://10.0.0.38:8082/domain/da4d30e0-25e9-49cd-94d8-93ff5a173387 2026-03-26 06:08:12,052 - DEBUG - Requesting: http://10.0.0.38:8082/project/565ffa27-804e-450d-ad59-65aa4be75509 2026-03-26 06:08:12,171 - INFO - Validated that VN ctest-fvn-91458240 is not found in API Server 2026-03-26 06:08:12,189 - DEBUG - VN ctest-fvn-91458240 is not present in Agent 10.0.0.22 2026-03-26 06:08:12,203 - DEBUG - VN ctest-fvn-91458240 is not present in Agent 10.0.0.249 2026-03-26 06:08:12,203 - INFO - Validated that VN ctest-fvn-91458240 is not in any agent 2026-03-26 06:08:12,249 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-91458240 info 2026-03-26 06:08:13,620 - DEBUG - No XMPP flaps were noticed during the test 2026-03-26 06:08:13,621 - INFO - END TEST : test_floating_ip : PASSED[0:00:37] 2026-03-26 06:08:13,622 - INFO - -------------------------------------------------------------------------------- 2026-03-26 06:08:14,760 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-89112467, ID : 565ffa27-804e-450d-ad59-65aa4be75509