2025-01-20 02:18:07,013 - INFO - Domain Default found not creating
2025-01-20 02:18:07,281 - INFO - Project ctest-FloatingipBasicTestSanity-53644544 not found, creating it
2025-01-20 02:18:08,090 - INFO - Created Project:ctest-FloatingipBasicTestSanity-53644544, ID : 7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:09,989 - INFO - Using existing project ['default-domain', 'admin'](ccfc212d-5b83-40c2-8a46-5c3c54ae0d1e)
2025-01-20 02:18:10,847 - INFO - Adding rules to the default security group in Project admin
2025-01-20 02:18:11,214 - INFO - ================================================================================
2025-01-20 02:18:11,214 - INFO - STARTING TEST : test_floating_ip
2025-01-20 02:18:11,214 - INFO - TEST DESCRIPTION : Test to validate floating-ip Assignment to a VM. It creates a VM, assigns a FIP to it and pings to a IP in the FIP VN.
2025-01-20 02:18:11,895 - WARNING - Test is running with cores: {'10.0.0.22': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-2.1737337815'], '10.0.0.49': ['core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337623', 'core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-3.1737337815']}
2025-01-20 02:18:11,915 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.20.0.18': '0', '10.20.0.7': '0'}, '10.0.0.56': {'10.20.0.18': '0', '10.20.0.11': '0'}} with
2025-01-20 02:18:11,916 - INFO - Initial checks done. Running the testcase now
2025-01-20 02:18:11,916 - INFO -
2025-01-20 02:18:11,942 - DEBUG - Services list from nova: [, , , ]
2025-01-20 02:18:11,942 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-2650-2', 'an-jenkins-deploy-platform-ansible-os-2650-1']}
2025-01-20 02:18:12,874 - DEBUG - Response for create_network : {'network': {'id': '02498935-cf63-4798-af38-19eb99918cab', 'name': 'ctest-fvn-10107916', 'tenant_id': '7ed42ece35144da289eda7ab9c1a06bb', 'project_id': '7ed42ece35144da289eda7ab9c1a06bb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-53644544', 'ctest-fvn-10107916'], 'port_security_enabled': True, 'description': ''}}
2025-01-20 02:18:13,280 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a3a4abb5-c508-404b-919a-463f7ffac1d8', 'name': '', 'tenant_id': '7ed42ece35144da289eda7ab9c1a06bb', 'network_id': '02498935-cf63-4798-af38-19eb99918cab', 'ip_version': 4, 'cidr': '154.55.9.192/26', 'allocation_pools': [{'start': '154.55.9.194', 'end': '154.55.9.254'}], 'gateway_ip': '154.55.9.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '154.55.9.194', 'tags': [], 'project_id': '7ed42ece35144da289eda7ab9c1a06bb'}}
2025-01-20 02:18:13,317 - INFO - Created VN ctest-fvn-10107916
2025-01-20 02:18:13,335 - DEBUG - VN ctest-fvn-10107916 UUID is 02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:13,435 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:13,752 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:13,792 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:13,819 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:13,963 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:13,992 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:14,008 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/bfbd0b3a-ac52-44db-a401-7c1c4b1421af
2025-01-20 02:18:14,027 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/bfbd0b3a-ac52-44db-a401-7c1c4b1421af
2025-01-20 02:18:14,043 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/82a707ac-57ca-4c94-a885-41abe6c239c8
2025-01-20 02:18:14,056 - DEBUG - Route Targets: ['target:64512:8000005']
2025-01-20 02:18:14,056 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:14,074 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/bfbd0b3a-ac52-44db-a401-7c1c4b1421af
2025-01-20 02:18:14,104 - INFO - Verified VN network id 6 for VN 02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:14,104 - INFO - Verifications in API Server for VN ctest-fvn-10107916 passed
2025-01-20 02:18:14,105 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:14,121 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/bfbd0b3a-ac52-44db-a401-7c1c4b1421af
2025-01-20 02:18:14,140 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/bfbd0b3a-ac52-44db-a401-7c1c4b1421af
2025-01-20 02:18:14,154 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/82a707ac-57ca-4c94-a885-41abe6c239c8
2025-01-20 02:18:14,176 - DEBUG - Control-node 10.0.0.42 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-53644544', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '164813725581395864', 'uuid-lslong': '12625870055017647275'}, 'enable': 'true', 'created': '2025-01-20T02:18:12', 'last-modified': '2025-01-20T02:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.006507'}
2025-01-20 02:18:14,186 - DEBUG - Route Targets: ['target:64512:8000005']
2025-01-20 02:18:14,193 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-53644544', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '164813725581395864', 'uuid-lslong': '12625870055017647275'}, 'enable': 'true', 'created': '2025-01-20T02:18:12', 'last-modified': '2025-01-20T02:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.015042'}
2025-01-20 02:18:14,202 - DEBUG - Route Targets: ['target:64512:8000005']
2025-01-20 02:18:14,213 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-53644544', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '164813725581395864', 'uuid-lslong': '12625870055017647275'}, 'enable': 'true', 'created': '2025-01-20T02:18:12', 'last-modified': '2025-01-20T02:18:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.037289'}
2025-01-20 02:18:14,224 - DEBUG - Route Targets: ['target:64512:8000005']
2025-01-20 02:18:14,224 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fvn-10107916 passed
2025-01-20 02:18:14,224 - DEBUG - ====Verifying policy data for ctest-fvn-10107916 in API_Server ======
2025-01-20 02:18:14,225 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:14,234 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:14,258 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:14,412 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:14,431 - DEBUG - =>VN ctest-fvn-10107916 has no policy to be verified
2025-01-20 02:18:14,432 - DEBUG - Verifying the vn in opserver
2025-01-20 02:18:14,432 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 virtual network link through opserver 10.0.0.42
2025-01-20 02:18:14,432 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks
2025-01-20 02:18:14,755 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks
2025-01-20 02:18:14,836 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916', 'href': 'http://10.0.0.42:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916?flat'}
2025-01-20 02:18:14,836 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 virtual network link through opserver 10.0.0.22
2025-01-20 02:18:14,836 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2025-01-20 02:18:15,153 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2025-01-20 02:18:15,228 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916?flat'}
2025-01-20 02:18:15,228 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 virtual network link through opserver 10.0.0.49
2025-01-20 02:18:15,228 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks
2025-01-20 02:18:15,540 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks
2025-01-20 02:18:15,631 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916?flat'}
2025-01-20 02:18:15,631 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916 is found in opserver
2025-01-20 02:18:15,663 - DEBUG - Do not have enough data to verify VN in agent
2025-01-20 02:18:15,682 - DEBUG - VRF ids for VN ctest-fvn-10107916: {}
2025-01-20 02:18:16,170 - DEBUG - Response for create_network : {'network': {'id': '35838c98-4570-4fab-813c-67a7a51c43d5', 'name': 'ctest-vn1-42957588', 'tenant_id': '7ed42ece35144da289eda7ab9c1a06bb', 'project_id': '7ed42ece35144da289eda7ab9c1a06bb', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FloatingipBasicTestSanity-53644544', 'ctest-vn1-42957588'], 'port_security_enabled': True, 'description': ''}}
2025-01-20 02:18:16,532 - DEBUG - Response for create_subnet : {'subnet': {'id': '9a175fb8-d0c8-402d-9f7b-ddf07dbdb68d', 'name': '', 'tenant_id': '7ed42ece35144da289eda7ab9c1a06bb', 'network_id': '35838c98-4570-4fab-813c-67a7a51c43d5', 'ip_version': 4, 'cidr': '15.88.156.0/26', 'allocation_pools': [{'start': '15.88.156.2', 'end': '15.88.156.62'}], 'gateway_ip': '15.88.156.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.88.156.2', 'tags': [], 'project_id': '7ed42ece35144da289eda7ab9c1a06bb'}}
2025-01-20 02:18:16,566 - INFO - Created VN ctest-vn1-42957588
2025-01-20 02:18:16,587 - DEBUG - VN ctest-vn1-42957588 UUID is 35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:16,692 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:16,702 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:16,719 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:16,857 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:16,880 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:16,894 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/715fcbdf-3d49-4318-982f-866c88265060
2025-01-20 02:18:16,905 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/715fcbdf-3d49-4318-982f-866c88265060
2025-01-20 02:18:16,916 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/5b06434f-85a0-4532-ae49-936bdfaa29d3
2025-01-20 02:18:16,929 - DEBUG - Route Targets: ['target:64512:8000006']
2025-01-20 02:18:16,929 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:16,947 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/715fcbdf-3d49-4318-982f-866c88265060
2025-01-20 02:18:16,972 - INFO - Verified VN network id 7 for VN 35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:16,973 - INFO - Verifications in API Server for VN ctest-vn1-42957588 passed
2025-01-20 02:18:16,973 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:16,987 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/715fcbdf-3d49-4318-982f-866c88265060
2025-01-20 02:18:17,003 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/715fcbdf-3d49-4318-982f-866c88265060
2025-01-20 02:18:17,016 - DEBUG - Requesting: http://10.0.0.42:8082/route-target/5b06434f-85a0-4532-ae49-936bdfaa29d3
2025-01-20 02:18:17,038 - DEBUG - Control-node 10.0.0.42 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-53644544', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3856080291587182507', 'uuid-lslong': '9312432099222635477'}, 'enable': 'true', 'created': '2025-01-20T02:18:16', 'last-modified': '2025-01-20T02:18:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.624665'}
2025-01-20 02:18:17,047 - DEBUG - Route Targets: ['target:64512:8000006']
2025-01-20 02:18:17,055 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-53644544', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3856080291587182507', 'uuid-lslong': '9312432099222635477'}, 'enable': 'true', 'created': '2025-01-20T02:18:16', 'last-modified': '2025-01-20T02:18:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.627115'}
2025-01-20 02:18:17,064 - DEBUG - Route Targets: ['target:64512:8000006']
2025-01-20 02:18:17,072 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FloatingipBasicTestSanity-53644544', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3856080291587182507', 'uuid-lslong': '9312432099222635477'}, 'enable': 'true', 'created': '2025-01-20T02:18:16', 'last-modified': '2025-01-20T02:18:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.657071'}
2025-01-20 02:18:17,081 - DEBUG - Route Targets: ['target:64512:8000006']
2025-01-20 02:18:17,081 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-42957588 passed
2025-01-20 02:18:17,082 - DEBUG - ====Verifying policy data for ctest-vn1-42957588 in API_Server ======
2025-01-20 02:18:17,082 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:17,092 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:17,109 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:17,247 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/35838c98-4570-4fab-813c-67a7a51c43d5
2025-01-20 02:18:17,262 - DEBUG - =>VN ctest-vn1-42957588 has no policy to be verified
2025-01-20 02:18:17,262 - DEBUG - Verifying the vn in opserver
2025-01-20 02:18:17,262 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 virtual network link through opserver 10.0.0.42
2025-01-20 02:18:17,262 - DEBUG - Requesting: http://10.0.0.42:8081/analytics/uves/virtual-networks
2025-01-20 02:18:17,345 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588', 'href': 'http://10.0.0.42:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588?flat'}
2025-01-20 02:18:17,345 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 virtual network link through opserver 10.0.0.22
2025-01-20 02:18:17,345 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks
2025-01-20 02:18:17,415 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588?flat'}
2025-01-20 02:18:17,415 - DEBUG - Verifying the default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 virtual network link through opserver 10.0.0.49
2025-01-20 02:18:17,415 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks
2025-01-20 02:18:17,485 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588?flat'}
2025-01-20 02:18:17,485 - INFO - Validated that VN default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 is found in opserver
2025-01-20 02:18:17,517 - DEBUG - Do not have enough data to verify VN in agent
2025-01-20 02:18:17,534 - DEBUG - VRF ids for VN ctest-vn1-42957588: {}
2025-01-20 02:18:18,802 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-2650-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-2650-2)
2025-01-20 02:18:20,588 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-2650-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-2650-1)
2025-01-20 02:18:20,768 - INFO - Creating Floating IP pool ctest-some-pool-61646292 in API Server
2025-01-20 02:18:20,969 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:20,994 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:21,020 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:21,183 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:21,200 - DEBUG - Requesting: http://10.0.0.42:8082/floating-ip-pool/6f0e153f-8191-46ee-934e-93da85b85884
2025-01-20 02:18:21,211 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:21,222 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:21,250 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:21,374 - DEBUG - Requesting: http://10.0.0.42:8082/virtual-network/02498935-cf63-4798-af38-19eb99918cab
2025-01-20 02:18:21,403 - DEBUG - FIP Pool ctest-some-pool-61646292 found in API Server
2025-01-20 02:18:21,403 - INFO - Verification for FIP pool ctest-some-pool-61646292 in API Server passed
2025-01-20 02:18:21,439 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-61646292 information
2025-01-20 02:18:21,450 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-61646292 information
2025-01-20 02:18:21,461 - DEBUG - Control-node Ifmap-view has FIP pool ctest-some-pool-61646292 information
2025-01-20 02:18:21,461 - INFO - Verification for FIP pool ctest-some-pool-61646292 in Control-node passed
2025-01-20 02:18:21,461 - INFO - Waiting for VM ctest-vn1_vm1_name-96793799 to be up..
2025-01-20 02:18:21,578 - DEBUG - VM is still in BUILD state, Expected: ACTIVE
2025-01-20 02:18:26,695 - DEBUG - VM is in ACTIVE state now
2025-01-20 02:18:26,696 - INFO - VM name : ctest-vn1_vm1_name-96793799
2025-01-20 02:18:26,811 - DEBUG - VM ctest-vn1_vm1_name-96793799 ID is a586f188-0ea7-4e31-9913-ae1f524b3032
2025-01-20 02:18:26,848 - DEBUG - VM ctest-vn1_vm1_name-96793799 launched on Node an-jenkins-deploy-platform-ansible-os-2650-2
2025-01-20 02:18:26,963 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/a586f188-0ea7-4e31-9913-ae1f524b3032
2025-01-20 02:18:27,277 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/a586f188-0ea7-4e31-9913-ae1f524b3032
2025-01-20 02:18:27,324 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e
2025-01-20 02:18:30,532 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms')
2025-01-20 02:18:30,533 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-96793799 failed!
2025-01-20 02:18:30,551 - DEBUG - Gateway for vn default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-vn1-42957588 is 15.88.156.1 and allocation pool is NOT set
2025-01-20 02:18:32,588 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=13.4 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.23 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.232/7.302/13.373/6.070 ms')
2025-01-20 02:18:32,588 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vn1_vm1_name-96793799 passed
2025-01-20 02:18:32,733 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-01-20 02:18:32,733 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-96793799, IP 15.88.156.3, Port 22
2025-01-20 02:18:32,759 - DEBUG - Error on ssh to cirros@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-01-20 02:18:32,870 - DEBUG - VM ctest-vn1_vm1_name-96793799 is NOT ready for SSH connections, VM status: ACTIVE
2025-01-20 02:18:37,870 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-01-20 02:18:37,870 - DEBUG - Waiting to SSH to VM ctest-vn1_vm1_name-96793799, IP 15.88.156.3, Port 22
2025-01-20 02:18:37,961 - DEBUG - VM ctest-vn1_vm1_name-96793799 is ready for SSH connections
2025-01-20 02:18:38,179 - DEBUG - Created Floating IP : ('154.55.9.196', '67c48aaf-dc27-4883-bd65-54fc13e103a9')
2025-01-20 02:18:38,179 - DEBUG - Associating FIP 154.55.9.196 to a586f188-0ea7-4e31-9913-ae1f524b3032
2025-01-20 02:18:38,227 - DEBUG - Associating FIP ID 67c48aaf-dc27-4883-bd65-54fc13e103a9 with Port ID 7ff2c356-09bc-457f-b2c1-b6fdd2da8c9e
2025-01-20 02:18:38,366 - INFO - Waiting for VM ctest-fvn_vm1_name-78613946 to be up..
2025-01-20 02:18:38,496 - DEBUG - VM is in ACTIVE state now
2025-01-20 02:18:38,496 - INFO - VM name : ctest-fvn_vm1_name-78613946
2025-01-20 02:18:38,602 - DEBUG - VM ctest-fvn_vm1_name-78613946 ID is fb948169-b1ec-4650-8b9a-f2dd4cac23c7
2025-01-20 02:18:38,602 - DEBUG - VM ctest-fvn_vm1_name-78613946 launched on Node an-jenkins-deploy-platform-ansible-os-2650-1
2025-01-20 02:18:38,734 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/fb948169-b1ec-4650-8b9a-f2dd4cac23c7
2025-01-20 02:18:38,748 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/4ac5e18a-ac55-4e2f-aae1-038747c09aa0
2025-01-20 02:18:39,945 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.06 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.563 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.563/2.809/5.056/2.246 ms')
2025-01-20 02:18:39,945 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-fvn_vm1_name-78613946 passed
2025-01-20 02:18:40,073 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-01-20 02:18:40,073 - DEBUG - Waiting to SSH to VM ctest-fvn_vm1_name-78613946, IP 154.55.9.195, Port 22
2025-01-20 02:18:40,165 - DEBUG - VM ctest-fvn_vm1_name-78613946 is ready for SSH connections
2025-01-20 02:18:40,362 - INFO - Route for FIP 154.55.9.196 is fine on Control-node 10.0.0.42
2025-01-20 02:18:40,375 - INFO - Route for FIP 154.55.9.196 is fine on Control-node 10.0.0.49
2025-01-20 02:18:40,391 - INFO - Route for FIP 154.55.9.196 is fine on Control-node 10.0.0.22
2025-01-20 02:18:40,391 - INFO - FIP 154.55.9.196 verification for passed on all Control-nodes
2025-01-20 02:18:40,391 - INFO - FIP ID 67c48aaf-dc27-4883-bd65-54fc13e103a9(154.55.9.196) validation in Control node passed
2025-01-20 02:18:40,424 - DEBUG - agent_label query returned:{'nh': {'type': 'tunnel', 'ref_count': '15', 'valid': 'true', 'policy': 'disabled', 'sip': '10.20.0.13', 'dip': '10.20.0.8', 'vrf': 'default-domain:default-project:ip-fabric:__default__', 'mac': ['fa:16:3e:5c:a3:98'], 'tunnel_type': 'MPLSoUDP', 'nh_index': '26', 'vxlan_flag': 'false', 'intf_flags': '0', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.7', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2025-01-20 02:18:40,424 - DEBUG - Route for FIP IP 154.55.9.196 is present in agent 10.0.0.45
2025-01-20 02:18:40,425 - DEBUG - FIP 154.55.9.196 verification for VM ctest-vn1_vm1_name-96793799 in Agent 10.0.0.45 passed
2025-01-20 02:18:40,457 - DEBUG - agent_label query returned:{'nh': {'type': 'interface', 'ref_count': '14', 'valid': 'true', 'policy': 'enabled', 'itf': 'tap7ff2c356-09', 'mac': ['2:7f:f2:c3:56:9'], 'mcast': 'disabled', 'nh_index': '31', 'vxlan_flag': 'false', 'intf_flags': '1', 'isid': '0', 'learning_enabled': 'false', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'crypt_all_traffic': 'false', 'crypt_path_available': 'false', 'crypt_interface': None}, 'label': '25', 'vxlan_id': '0', 'peer': '10.20.0.11', 'dest_vn_list': ['default-domain:ctest-FloatingipBasicTestSanity-53644544:ctest-fvn-10107916'], 'unresolved': 'false', 'sg_list': ['8000004'], 'supported_tunnel_type': 'MPLSoGRE MPLSoUDP ', 'active_tunnel_type': 'MPLSoUDP', 'stale': 'false', 'path_preference_data': {'sequence': '0', 'preference': '200', 'ecmp': 'true'}, 'active_label': '25', 'ecmp_hashing_fields': 'l3-source-address,l3-destination-address,l4-protocol,l4-source-port,l4-destination-port,', 'communities': None, 'peer_sequence_number': '1', 'etree_leaf': 'false', 'layer2_control_word': 'false', 'tag_list': None, 'inactive': 'false', 'origin_vn': None}
2025-01-20 02:18:40,457 - DEBUG - Route for FIP IP 154.55.9.196 is present in agent 10.0.0.56
2025-01-20 02:18:40,457 - DEBUG - FIP 154.55.9.196 verification for VM ctest-vn1_vm1_name-96793799 in Agent 10.0.0.56 passed
2025-01-20 02:18:40,458 - INFO - FIP ID 67c48aaf-dc27-4883-bd65-54fc13e103a9(154.55.9.196) validation in agents passed
2025-01-20 02:18:40,458 - DEBUG - Requesting: http://10.0.0.42:8082/floating-ip/67c48aaf-dc27-4883-bd65-54fc13e103a9
2025-01-20 02:18:40,474 - DEBUG - FIP 67c48aaf-dc27-4883-bd65-54fc13e103a9 is present in API server
2025-01-20 02:18:40,474 - INFO - FIP ID 67c48aaf-dc27-4883-bd65-54fc13e103a9(154.55.9.196) validation in API Server passed
2025-01-20 02:18:40,475 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-01-20 02:18:40,475 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 154.55.9.195, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2025-01-20 02:18:40,475 - DEBUG - ping -s 56 -c 3 -W 1 154.55.9.195
2025-01-20 02:18:43,568 - DEBUG - PING 154.55.9.195 (154.55.9.195): 56 data bytes
64 bytes from 154.55.9.195: seq=0 ttl=64 time=9.168 ms
64 bytes from 154.55.9.195: seq=1 ttl=64 time=1.388 ms
64 bytes from 154.55.9.195: seq=2 ttl=64 time=1.439 ms
--- 154.55.9.195 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 1.388/3.998/9.168 ms
2025-01-20 02:18:43,569 - INFO - Ping to IP 154.55.9.195 from VM ctest-vn1_vm1_name-96793799 passed
2025-01-20 02:18:43,569 - DEBUG - Disassociating port from FIP ID : 67c48aaf-dc27-4883-bd65-54fc13e103a9
2025-01-20 02:18:43,687 - DEBUG - Deleting FIP ID 67c48aaf-dc27-4883-bd65-54fc13e103a9
2025-01-20 02:18:43,810 - INFO - Deleting the FIP pool ctest-some-pool-61646292
2025-01-20 02:18:43,958 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-61646292 information
2025-01-20 02:18:43,979 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-61646292 information
2025-01-20 02:18:43,987 - DEBUG - Control-node Ifmap-view does not have FIP pool ctest-some-pool-61646292 information
2025-01-20 02:18:43,987 - INFO - Deleting VM ctest-fvn_vm1_name-78613946
2025-01-20 02:18:44,085 - INFO - Deleting VM ctest-vn1_vm1_name-96793799
2025-01-20 02:18:44,181 - INFO - Deleting VN ctest-vn1-42957588
2025-01-20 02:18:44,235 - DEBUG - VN 35838c98-4570-4fab-813c-67a7a51c43d5 still in use: Unable to complete operation on network 35838c98-4570-4fab-813c-67a7a51c43d5. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-6210f730-b0c6-431c-aaed-d942bdf97cdd']
2025-01-20 02:18:44,235 - WARNING - Deleting VN ctest-vn1-42957588 failed..Will retry
2025-01-20 02:18:46,480 - DEBUG - Response for deleting network ()
2025-01-20 02:18:46,480 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/715fcbdf-3d49-4318-982f-866c88265060
2025-01-20 02:18:46,493 - DEBUG - Response Code: 404
2025-01-20 02:18:46,493 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:46,526 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:46,549 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:46,680 - INFO - Validated that VN ctest-vn1-42957588 is not found in API Server
2025-01-20 02:18:46,699 - DEBUG - VN ctest-vn1-42957588 is not present in Agent 10.0.0.45
2025-01-20 02:18:46,714 - DEBUG - VN ctest-vn1-42957588 is not present in Agent 10.0.0.56
2025-01-20 02:18:46,714 - INFO - Validated that VN ctest-vn1-42957588 is not in any agent
2025-01-20 02:18:46,761 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-42957588 info
2025-01-20 02:18:46,761 - INFO - Deleting VN ctest-fvn-10107916
2025-01-20 02:18:46,990 - DEBUG - Response for deleting network ()
2025-01-20 02:18:46,990 - DEBUG - Requesting: http://10.0.0.42:8082/routing-instance/bfbd0b3a-ac52-44db-a401-7c1c4b1421af
2025-01-20 02:18:47,000 - DEBUG - Response Code: 404
2025-01-20 02:18:47,000 - DEBUG - Requesting: http://10.0.0.42:8082/domains
2025-01-20 02:18:47,011 - DEBUG - Requesting: http://10.0.0.42:8082/domain/5e738284-bb49-4a6f-8f2b-7e012ef06d36
2025-01-20 02:18:47,041 - DEBUG - Requesting: http://10.0.0.42:8082/project/7ed42ece-3514-4da2-89ed-a7ab9c1a06bb
2025-01-20 02:18:47,158 - INFO - Validated that VN ctest-fvn-10107916 is not found in API Server
2025-01-20 02:18:47,176 - DEBUG - VN ctest-fvn-10107916 is not present in Agent 10.0.0.45
2025-01-20 02:18:47,192 - DEBUG - VN ctest-fvn-10107916 is not present in Agent 10.0.0.56
2025-01-20 02:18:47,192 - INFO - Validated that VN ctest-fvn-10107916 is not in any agent
2025-01-20 02:18:47,237 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fvn-10107916 info
2025-01-20 02:18:48,562 - DEBUG - No XMPP flaps were noticed during the test
2025-01-20 02:18:48,562 - INFO - END TEST : test_floating_ip : PASSED[0:00:37]
2025-01-20 02:18:48,562 - INFO - --------------------------------------------------------------------------------
2025-01-20 02:18:49,453 - INFO - Deleted project: ctest-FloatingipBasicTestSanity-53644544, ID : 7ed42ece-3514-4da2-89ed-a7ab9c1a06bb