2026-03-30 04:14:20,332 - INFO - Domain Default found not creating
2026-03-30 04:14:20,566 - INFO - Project ctest-FloatingipBasicTestSanity-55887186 not found, creating it
2026-03-30 04:14:21,311 - INFO - Created Project:ctest-FloatingipBasicTestSanity-55887186, ID : 99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:23,362 - INFO - Using existing project ['default-domain', 'admin'](5eb5c387-50ec-491e-b367-383085e60b1e)
2026-03-30 04:14:24,380 - INFO - Adding rules to the default security group in Project admin
2026-03-30 04:14:24,719 - INFO - ================================================================================
2026-03-30 04:14:24,720 - INFO - STARTING TEST : test_floating_ip
2026-03-30 04:14:24,722 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN.
2026-03-30 04:14:25,425 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with
2026-03-30 04:14:25,425 - INFO - Initial checks done. Running the testcase now
2026-03-30 04:14:25,425 - INFO -
2026-03-30 04:14:25,483 - DEBUG - Services list from nova: [, , , ]
2026-03-30 04:14:25,483 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-5563-1', 'an-jenkins-deploy-platform-ansible-os-5563-2']}
2026-03-30 04:14:26,413 - DEBUG - Response for create_network : {'network': {'id': '041f4d16-9091-492c-9478-199982be8064', 'name': 'ctest-fvn-94901510', 'tenant_id': '99f2df2506b0485f9d1cac9f73fb9c63', 'project_id': '99f2df2506b0485f9d1cac9f73fb9c63', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-55887186', 'ctest-fvn-94901510'], 'port_security_enabled': True, 'description': ''}}
2026-03-30 04:14:26,741 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a458576b-d4dd-48da-9b38-68502aedd83f', 'name': '', 'tenant_id': '99f2df2506b0485f9d1cac9f73fb9c63', 'network_id': '041f4d16-9091-492c-9478-199982be8064', 'ip_version': 4, 'cidr': '5.60.242.192/26', 'allocation_pools': [{'start': '5.60.242.194', 'end': '5.60.242.254'}], 'gateway_ip': '5.60.242.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '5.60.242.194', 'tags': [], 'project_id': '99f2df2506b0485f9d1cac9f73fb9c63'}}
2026-03-30 04:14:26,777 - INFO - Created VN ctest-fvn-94901510
2026-03-30 04:14:26,811 - DEBUG - VN ctest-fvn-94901510 UUID is 041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:26,919 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:27,228 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:27,280 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:27,300 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:27,413 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:27,451 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:27,467 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/56f2fcb5-6c16-4ce4-8995-3fecfc4cc4ca
2026-03-30 04:14:27,481 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/56f2fcb5-6c16-4ce4-8995-3fecfc4cc4ca
2026-03-30 04:14:27,492 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/fa462775-f838-4dc7-8b3f-7eb4181e7746
2026-03-30 04:14:27,504 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-30 04:14:27,504 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:27,523 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/56f2fcb5-6c16-4ce4-8995-3fecfc4cc4ca
2026-03-30 04:14:27,546 - INFO - Verified VN network id 6 for VN 041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:27,546 - INFO - Verifications in API Server for VN ctest-fvn-94901510 passed
2026-03-30 04:14:27,546 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:27,564 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/56f2fcb5-6c16-4ce4-8995-3fecfc4cc4ca
2026-03-30 04:14:27,575 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/56f2fcb5-6c16-4ce4-8995-3fecfc4cc4ca
2026-03-30 04:14:27,584 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/fa462775-f838-4dc7-8b3f-7eb4181e7746
2026-03-30 04:14:27,599 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-55887186', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '297040859739801900', 'uuid-lslong': '10698329061932826724'}, 'enable': 'true', 'created': '2026-03-30T04:14:26', 'last-modified': '2026-03-30T04:14:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.938207'}
2026-03-30 04:14:27,606 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-30 04:14:27,615 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-55887186', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '297040859739801900', 'uuid-lslong': '10698329061932826724'}, 'enable': 'true', 'created': '2026-03-30T04:14:26', 'last-modified': '2026-03-30T04:14:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.938896'}
2026-03-30 04:14:27,622 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-30 04:14:27,627 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-55887186', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '297040859739801900', 'uuid-lslong': '10698329061932826724'}, 'enable': 'true', 'created': '2026-03-30T04:14:26', 'last-modified': '2026-03-30T04:14:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.957447'}
2026-03-30 04:14:27,634 - DEBUG - Route Targets: ['target:64512:8000005']
2026-03-30 04:14:27,634 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-94901510 passed
2026-03-30 04:14:27,634 - DEBUG - ====Verifying policy data for ctest-fvn-94901510 in API_Server ======
2026-03-30 04:14:27,634 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:27,643 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:27,658 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:27,788 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:27,803 - DEBUG - =>VN ctest-fvn-94901510 has no policy to be verified
2026-03-30 04:14:27,804 - DEBUG - Verifying the vn in opserver
2026-03-30 04:14:27,804 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510 virtual network link through opserver 10.0.0.249
2026-03-30 04:14:27,804 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-03-30 04:14:28,115 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-03-30 04:14:28,205 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510?flat'}
2026-03-30 04:14:28,205 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510 virtual network link through opserver 10.0.0.241
2026-03-30 04:14:28,205 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-03-30 04:14:28,535 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-03-30 04:14:28,615 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510?flat'}
2026-03-30 04:14:28,615 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510 virtual network link through opserver 10.0.0.141
2026-03-30 04:14:28,615 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2026-03-30 04:14:28,916 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2026-03-30 04:14:28,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510?flat'}
2026-03-30 04:14:28,997 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510 is found in opserver
2026-03-30 04:14:29,020 - DEBUG - Do not have enough data to verify VN in agent
2026-03-30 04:14:29,034 - DEBUG - VRF ids for VN ctest-fvn-94901510: {}
2026-03-30 04:14:29,445 - DEBUG - Response for create_network : {'network': {'id': 'd527ccfa-129a-4e4d-bacf-ff6605ae7d2f', 'name': 'ctest-vn1-71730926', 'tenant_id': '99f2df2506b0485f9d1cac9f73fb9c63', 'project_id': '99f2df2506b0485f9d1cac9f73fb9c63', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-55887186', 'ctest-vn1-71730926'], 'port_security_enabled': True, 'description': ''}}
2026-03-30 04:14:29,785 - DEBUG - Response for create_subnet : {'subnet': {'id': '55f1f276-07ce-402e-8fa5-1ee88380ad4b', 'name': '', 'tenant_id': '99f2df2506b0485f9d1cac9f73fb9c63', 'network_id': 'd527ccfa-129a-4e4d-bacf-ff6605ae7d2f', 'ip_version': 4, 'cidr': '14.113.159.128/26', 'allocation_pools': [{'start': '14.113.159.130', 'end': '14.113.159.190'}], 'gateway_ip': '14.113.159.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '14.113.159.130', 'tags': [], 'project_id': '99f2df2506b0485f9d1cac9f73fb9c63'}}
2026-03-30 04:14:29,813 - INFO - Created VN ctest-vn1-71730926
2026-03-30 04:14:29,827 - DEBUG - VN ctest-vn1-71730926 UUID is d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:29,921 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:29,931 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:29,944 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:30,074 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:30,094 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:30,109 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be67d201-32d4-4981-92ca-3e13b1ac785f
2026-03-30 04:14:30,121 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be67d201-32d4-4981-92ca-3e13b1ac785f
2026-03-30 04:14:30,131 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/0aab7863-66f9-4a57-8992-405c78b9547d
2026-03-30 04:14:30,141 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-30 04:14:30,141 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:30,160 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be67d201-32d4-4981-92ca-3e13b1ac785f
2026-03-30 04:14:30,186 - INFO - Verified VN network id 7 for VN d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:30,186 - INFO - Verifications in API Server for VN ctest-vn1-71730926 passed
2026-03-30 04:14:30,186 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:30,199 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be67d201-32d4-4981-92ca-3e13b1ac785f
2026-03-30 04:14:30,208 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be67d201-32d4-4981-92ca-3e13b1ac785f
2026-03-30 04:14:30,218 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/0aab7863-66f9-4a57-8992-405c78b9547d
2026-03-30 04:14:30,230 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-55887186', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15359470428596358733', 'uuid-lslong': '13461258624880770351'}, 'enable': 'true', 'created': '2026-03-30T04:14:29', 'last-modified': '2026-03-30T04:14:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.529968'}
2026-03-30 04:14:30,235 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-30 04:14:30,242 - DEBUG - Control-node 10.0.0.241 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-55887186', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15359470428596358733', 'uuid-lslong': '13461258624880770351'}, 'enable': 'true', 'created': '2026-03-30T04:14:29', 'last-modified': '2026-03-30T04:14:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.537912'}
2026-03-30 04:14:30,249 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-30 04:14:30,257 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-55887186', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15359470428596358733', 'uuid-lslong': '13461258624880770351'}, 'enable': 'true', 'created': '2026-03-30T04:14:29', 'last-modified': '2026-03-30T04:14:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.561584'}
2026-03-30 04:14:30,264 - DEBUG - Route Targets: ['target:64512:8000006']
2026-03-30 04:14:30,264 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-71730926 passed
2026-03-30 04:14:30,264 - DEBUG - ====Verifying policy data for ctest-vn1-71730926 in API_Server ======
2026-03-30 04:14:30,264 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:30,274 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:30,296 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:30,446 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d527ccfa-129a-4e4d-bacf-ff6605ae7d2f
2026-03-30 04:14:30,461 - DEBUG - =>VN ctest-vn1-71730926 has no policy to be verified
2026-03-30 04:14:30,461 - DEBUG - Verifying the vn in opserver
2026-03-30 04:14:30,461 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926 virtual network link through opserver 10.0.0.249
2026-03-30 04:14:30,461 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2026-03-30 04:14:30,533 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926?flat'}
2026-03-30 04:14:30,534 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926 virtual network link through opserver 10.0.0.241
2026-03-30 04:14:30,534 - DEBUG - Requesting: http://10.0.0.241:8081/analytics/uves/virtual-networks
2026-03-30 04:14:30,619 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926', 'href': 'http://10.0.0.241:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926?flat'}
2026-03-30 04:14:30,619 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926 virtual network link through opserver 10.0.0.141
2026-03-30 04:14:30,620 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2026-03-30 04:14:30,725 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926?flat'}
2026-03-30 04:14:30,725 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926 is found in opserver
2026-03-30 04:14:30,750 - DEBUG - Do not have enough data to verify VN in agent
2026-03-30 04:14:30,764 - DEBUG - VRF ids for VN ctest-vn1-71730926: {}
2026-03-30 04:14:32,176 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5563-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5563-1)
2026-03-30 04:14:33,683 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5563-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5563-2)
2026-03-30 04:14:33,873 - INFO - Creating Floating IP pool ctest-some-pool-57673497 in API Server
2026-03-30 04:14:34,055 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:34,062 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:34,077 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:34,220 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:34,238 - DEBUG - Requesting: http://10.0.0.249:8082/floating-ip-pool/d1c7a4ee-c87d-4285-abcb-15d87cc0c34f
2026-03-30 04:14:34,248 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:34,256 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:34,270 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:34,427 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/041f4d16-9091-492c-9478-199982be8064
2026-03-30 04:14:34,448 - DEBUG - FIP Pool ctest-some-pool-57673497 found in API Server
2026-03-30 04:14:34,448 - INFO - Verification for FIP pool ctest-some-pool-57673497 in API Server passed
2026-03-30 04:14:34,464 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-57673497 information
2026-03-30 04:14:34,477 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-57673497 information
2026-03-30 04:14:34,482 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-57673497 information
2026-03-30 04:14:34,482 - INFO - Verification for FIP pool ctest-some-pool-57673497 in Control-node passed
2026-03-30 04:14:34,483 - INFO - Waiting for VM ctest-vn1_vm1_name-85259516 to be up..
2026-03-30 04:14:34,613 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2026-03-30 04:14:39,711 - DEBUG - VM is in ACTIVE state now
2026-03-30 04:14:39,711 - INFO - VM name : ctest-vn1_vm1_name-85259516
2026-03-30 04:14:39,838 - DEBUG - VM ctest-vn1_vm1_name-85259516 ID is 31320895-4dc2-4e2f-83b9-5d47e45b3755
2026-03-30 04:14:39,870 - DEBUG - VM ctest-vn1_vm1_name-85259516 launched on Node an-jenkins-deploy-platform-ansible-os-5563-1
2026-03-30 04:14:39,964 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/31320895-4dc2-4e2f-83b9-5d47e45b3755
2026-03-30 04:14:40,267 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/31320895-4dc2-4e2f-83b9-5d47e45b3755
2026-03-30 04:14:40,313 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/75f24ed5-83e7-4c78-a07e-0d26f424ecbc
2026-03-30 04:14:43,514 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1032ms')
2026-03-30 04:14:43,514 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-85259516 failed!
2026-03-30 04:14:43,538 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-vn1-71730926 is 14.113.159.129 and allocation pool is NOT set
2026-03-30 04:14:45,560 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.09 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.456 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.456/1.770/3.085/1.314 ms')
2026-03-30 04:14:45,561 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-85259516 passed
2026-03-30 04:14:45,688 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:14:45,688 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-85259516, IP 14.113.159.131, Port 22
2026-03-30 04:14:45,762 - DEBUG - VM ctest-vn1_vm1_name-85259516 is ready for SSH connections
2026-03-30 04:14:45,981 - DEBUG - Created Floating IP : ('5.60.242.196', 'c5fffef7-e124-42a5-b415-b3230eef1ae8')
2026-03-30 04:14:45,981 - DEBUG - Associating FIP 5.60.242.196 to 31320895-4dc2-4e2f-83b9-5d47e45b3755
2026-03-30 04:14:46,023 - DEBUG - Associating FIP ID c5fffef7-e124-42a5-b415-b3230eef1ae8 with Port ID 75f24ed5-83e7-4c78-a07e-0d26f424ecbc
2026-03-30 04:14:46,169 - INFO - Waiting for VM ctest-fvn_vm1_name-86359898 to be up..
2026-03-30 04:14:46,298 - DEBUG - VM is in ACTIVE state now
2026-03-30 04:14:46,298 - INFO - VM name : ctest-fvn_vm1_name-86359898
2026-03-30 04:14:46,421 - DEBUG - VM ctest-fvn_vm1_name-86359898 ID is 47d780bc-ef6e-4fe8-bc6d-b8c8019fe013
2026-03-30 04:14:46,421 - DEBUG - VM ctest-fvn_vm1_name-86359898 launched on Node an-jenkins-deploy-platform-ansible-os-5563-2
2026-03-30 04:14:46,537 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine/47d780bc-ef6e-4fe8-bc6d-b8c8019fe013
2026-03-30 04:14:46,549 - DEBUG - Requesting: http://10.0.0.141:8082/virtual-machine-interface/267f2f29-570e-4e46-8015-fd46fe8fa0b3
2026-03-30 04:14:47,735 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.21 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.82 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.815/3.014/4.213/1.199 ms')
2026-03-30 04:14:47,735 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-86359898 passed
2026-03-30 04:14:47,855 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:14:47,855 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-86359898, IP 5.60.242.195, Port 22
2026-03-30 04:14:47,880 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-03-30 04:14:48,006 - DEBUG - VM ctest-fvn_vm1_name-86359898 is NOT ready for SSH connections, VM status: ACTIVE
2026-03-30 04:14:53,007 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:14:53,008 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-86359898, IP 5.60.242.195, Port 22
2026-03-30 04:14:53,094 - DEBUG - VM ctest-fvn_vm1_name-86359898 is ready for SSH connections
2026-03-30 04:14:53,315 - INFO - Route for FIP 5.60.242.196 is fine on Control-node 10.0.0.241
2026-03-30 04:14:53,330 - INFO - Route for FIP 5.60.242.196 is fine on Control-node 10.0.0.249
2026-03-30 04:14:53,330 - INFO - FIP 5.60.242.196 verification for passed on all Control-nodes
2026-03-30 04:14:53,330 - INFO - FIP ID c5fffef7-e124-42a5-b415-b3230eef1ae8(5.60.242.196) validation in Control node passed
2026-03-30 04:14:53,358 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '14', 'valid': 'true', 'policy': 'enabled', 'itf': 'tap75f24ed5-83', 'mac': ['2:75:f2:4e:d5:83'], 'mcast': 'disabled', 'nh_index': '30', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.17', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-03-30 04:14:53,358 - DEBUG - Route for FIP IP 5.60.242.196 is present in agent 10.0.0.129
2026-03-30 04:14:53,358 - DEBUG - FIP 5.60.242.196 verification for VM ctest-vn1_vm1_name-85259516 in Agent 10.0.0.129 passed
2026-03-30 04:14:53,387 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.254', 'dip': '10.20.0.192', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:1c:18:5f'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '25', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.17', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-55887186:ctest-fvn-94901510'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2026-03-30 04:14:53,387 - DEBUG - Route for FIP IP 5.60.242.196 is present in agent 10.0.0.27
2026-03-30 04:14:53,387 - DEBUG - FIP 5.60.242.196 verification for VM ctest-vn1_vm1_name-85259516 in Agent 10.0.0.27 passed
2026-03-30 04:14:53,387 - INFO - FIP ID c5fffef7-e124-42a5-b415-b3230eef1ae8(5.60.242.196) validation in agents passed
2026-03-30 04:14:53,387 - DEBUG - Requesting: http://10.0.0.249:8082/floating-ip/c5fffef7-e124-42a5-b415-b3230eef1ae8
2026-03-30 04:14:53,403 - DEBUG - FIP c5fffef7-e124-42a5-b415-b3230eef1ae8 is present in API server
2026-03-30 04:14:53,404 - INFO - FIP ID c5fffef7-e124-42a5-b415-b3230eef1ae8(5.60.242.196) validation in API Server passed
2026-03-30 04:14:53,404 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-03-30 04:14:53,404 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 5.60.242.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.129, gateway password: c0ntrail123
2026-03-30 04:14:53,404 - DEBUG - ping -s 56 -c 3 -W 1 5.60.242.195
2026-03-30 04:14:56,373 - DEBUG - PING 5.60.242.195 (5.60.242.195): 56 data bytes
64 bytes from 5.60.242.195: seq=0 ttl=64 time=8.229 ms
64 bytes from 5.60.242.195: seq=1 ttl=64 time=2.246 ms
64 bytes from 5.60.242.195: seq=2 ttl=64 time=1.854 ms
--- 5.60.242.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.854/4.109/8.229 ms
2026-03-30 04:14:56,373 - INFO - Ping to IP 5.60.242.195 from VM ctest-vn1_vm1_name-85259516 passed
2026-03-30 04:14:56,374 - DEBUG - Disassociating port from FIP ID : c5fffef7-e124-42a5-b415-b3230eef1ae8
2026-03-30 04:14:56,472 - DEBUG - Deleting FIP ID c5fffef7-e124-42a5-b415-b3230eef1ae8
2026-03-30 04:14:56,585 - INFO - Deleting the FIP pool ctest-some-pool-57673497
2026-03-30 04:14:56,728 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-57673497 information
2026-03-30 04:14:56,735 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-57673497 information
2026-03-30 04:14:56,743 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-57673497 information
2026-03-30 04:14:56,743 - INFO - Deleting VM ctest-fvn_vm1_name-86359898
2026-03-30 04:14:56,827 - INFO - Deleting VM ctest-vn1_vm1_name-85259516
2026-03-30 04:14:56,938 - INFO - Deleting VN ctest-vn1-71730926
2026-03-30 04:14:56,995 - DEBUG - VN d527ccfa-129a-4e4d-bacf-ff6605ae7d2f still in use: Unable to complete operation on network d527ccfa-129a-4e4d-bacf-ff6605ae7d2f. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-5c84df85-5ac2-419d-8f43-f3196e63cc55']
2026-03-30 04:14:56,995 - WARNING - Deleting VN ctest-vn1-71730926 failed..Will retry
2026-03-30 04:14:59,181 - DEBUG - Response for deleting network ()
2026-03-30 04:14:59,181 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/be67d201-32d4-4981-92ca-3e13b1ac785f
2026-03-30 04:14:59,193 - DEBUG - Response Code: 404
2026-03-30 04:14:59,193 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:59,200 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:59,227 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:59,324 - INFO - Validated that VN ctest-vn1-71730926 is not found in API Server
2026-03-30 04:14:59,335 - DEBUG - VN ctest-vn1-71730926 is not present in Agent 10.0.0.129
2026-03-30 04:14:59,348 - DEBUG - VN ctest-vn1-71730926 is not present in Agent 10.0.0.27
2026-03-30 04:14:59,348 - INFO - Validated that VN ctest-vn1-71730926 is not in any agent
2026-03-30 04:14:59,384 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-71730926 info
2026-03-30 04:14:59,384 - INFO - Deleting VN ctest-fvn-94901510
2026-03-30 04:14:59,611 - DEBUG - Response for deleting network ()
2026-03-30 04:14:59,611 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/56f2fcb5-6c16-4ce4-8995-3fecfc4cc4ca
2026-03-30 04:14:59,618 - DEBUG - Response Code: 404
2026-03-30 04:14:59,618 - DEBUG - Requesting: http://10.0.0.249:8082/domains
2026-03-30 04:14:59,633 - DEBUG - Requesting: http://10.0.0.249:8082/domain/915c2541-ccc7-4e90-b8b1-1d89c2512d73
2026-03-30 04:14:59,654 - DEBUG - Requesting: http://10.0.0.249:8082/project/99f2df25-06b0-485f-9d1c-ac9f73fb9c63
2026-03-30 04:14:59,759 - INFO - Validated that VN ctest-fvn-94901510 is not found in API Server
2026-03-30 04:14:59,771 - DEBUG - VN ctest-fvn-94901510 is not present in Agent 10.0.0.129
2026-03-30 04:14:59,784 - DEBUG - VN ctest-fvn-94901510 is not present in Agent 10.0.0.27
2026-03-30 04:14:59,784 - INFO - Validated that VN ctest-fvn-94901510 is not in any agent
2026-03-30 04:14:59,822 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-94901510 info
2026-03-30 04:15:01,168 - DEBUG - No XMPP flaps were noticed during the test
2026-03-30 04:15:01,168 - INFO - END TEST : test_floating_ip : PASSED[0:00:37]
2026-03-30 04:15:01,168 - INFO - --------------------------------------------------------------------------------
2026-03-30 04:15:02,023 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-55887186, ID : 99f2df25-06b0-485f-9d1c-ac9f73fb9c63