2025-11-10 02:58:52,670 - INFO - Domain Default found not creating 2025-11-10 02:58:52,844 - INFO - Project ctest-TestSvcHC-67923078 not found, creating it 2025-11-10 02:58:53,367 - INFO - Created Project:ctest-TestSvcHC-67923078, ID : 99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:58:55,064 - INFO - ================================================================================ 2025-11-10 02:58:55,065 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-10 02:58:56,349 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.18': '0'}} with 2025-11-10 02:58:56,349 - INFO - Initial checks done. Running the testcase now 2025-11-10 02:58:56,349 - INFO - 2025-11-10 02:58:57,016 - DEBUG - Response for create_network : {'network': {'id': '696721e2-ce4f-47b2-b844-ada09743feb2', 'name': 'ctest-mgmt_vn-55396934', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-mgmt_vn-55396934'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:58:57,264 - DEBUG - Response for create_subnet : {'subnet': {'id': '446ce6a3-92b5-4f19-9d65-0858423a3fe9', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': '696721e2-ce4f-47b2-b844-ada09743feb2', 'ip_version': 4, 'cidr': '62.202.98.64/26', 'allocation_pools': [{'start': '62.202.98.66', 'end': '62.202.98.126'}], 'gateway_ip': '62.202.98.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '62.202.98.66', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:58:57,288 - INFO - Created VN ctest-mgmt_vn-55396934 2025-11-10 02:58:57,302 - DEBUG - VN ctest-mgmt_vn-55396934 UUID is 696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:57,374 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:58:57,696 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:58:57,724 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:58:57,740 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:58:57,839 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:57,852 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:57,865 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b076285e-52ae-449a-9eab-a800f7299ad6 2025-11-10 02:58:57,875 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b076285e-52ae-449a-9eab-a800f7299ad6 2025-11-10 02:58:57,883 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/d1979b64-02d1-4daf-8451-801f7d33e3bb 2025-11-10 02:58:57,892 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:58:57,892 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:57,903 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b076285e-52ae-449a-9eab-a800f7299ad6 2025-11-10 02:58:57,921 - INFO - Verified VN network id 15 for VN 696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:57,922 - INFO - Verifications in API Server for VN ctest-mgmt_vn-55396934 passed 2025-11-10 02:58:57,922 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:57,932 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b076285e-52ae-449a-9eab-a800f7299ad6 2025-11-10 02:58:57,940 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b076285e-52ae-449a-9eab-a800f7299ad6 2025-11-10 02:58:57,947 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/d1979b64-02d1-4daf-8451-801f7d33e3bb 2025-11-10 02:58:57,959 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7595076554591258546', 'uuid-lslong': '13277928506639253170'}, 'enable': 'true', 'created': '2025-11-10T02:58:56', 'last-modified': '2025-11-10T02:58:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.760879'} 2025-11-10 02:58:57,965 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:58:57,970 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7595076554591258546', 'uuid-lslong': '13277928506639253170'}, 'enable': 'true', 'created': '2025-11-10T02:58:56', 'last-modified': '2025-11-10T02:58:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771518'} 2025-11-10 02:58:57,976 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:58:57,981 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7595076554591258546', 'uuid-lslong': '13277928506639253170'}, 'enable': 'true', 'created': '2025-11-10T02:58:56', 'last-modified': '2025-11-10T02:58:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.783796'} 2025-11-10 02:58:57,986 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:58:57,986 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-55396934 passed 2025-11-10 02:58:57,986 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-55396934 in API_Server ====== 2025-11-10 02:58:57,986 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:58:57,992 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:58:58,003 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:58:58,097 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/696721e2-ce4f-47b2-b844-ada09743feb2 2025-11-10 02:58:58,107 - DEBUG - =>VN ctest-mgmt_vn-55396934 has no policy to be verified 2025-11-10 02:58:58,107 - DEBUG - Verifying the vn in opserver 2025-11-10 02:58:58,107 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934 virtual network link through opserver 10.0.0.22 2025-11-10 02:58:58,107 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:58:58,451 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:58:58,804 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934?flat'} 2025-11-10 02:58:58,804 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934 virtual network link through opserver 10.0.0.50 2025-11-10 02:58:58,804 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:58:59,106 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:58:59,465 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934?flat'} 2025-11-10 02:58:59,465 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934 virtual network link through opserver 10.0.0.23 2025-11-10 02:58:59,465 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:58:59,767 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:58:59,822 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934?flat'} 2025-11-10 02:58:59,822 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-55396934 is found in opserver 2025-11-10 02:58:59,844 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:58:59,854 - DEBUG - VRF ids for VN ctest-mgmt_vn-55396934: {} 2025-11-10 02:59:00,146 - DEBUG - Response for create_network : {'network': {'id': '1ee9792e-8968-4202-8a95-3a3a57b12aea', 'name': 'ctest-left_vn-54923111', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-left_vn-54923111'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:00,378 - DEBUG - Response for create_subnet : {'subnet': {'id': '2700957a-1f81-4e77-b5a5-256f40419939', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': '1ee9792e-8968-4202-8a95-3a3a57b12aea', 'ip_version': 4, 'cidr': '36.158.149.128/26', 'allocation_pools': [{'start': '36.158.149.130', 'end': '36.158.149.190'}], 'gateway_ip': '36.158.149.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '36.158.149.130', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:00,400 - INFO - Created VN ctest-left_vn-54923111 2025-11-10 02:59:00,411 - DEBUG - VN ctest-left_vn-54923111 UUID is 1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,486 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:00,498 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:00,513 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:00,616 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,636 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,649 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4a7defb4-0da6-424f-bdbd-13a5f3e53dde 2025-11-10 02:59:00,659 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4a7defb4-0da6-424f-bdbd-13a5f3e53dde 2025-11-10 02:59:00,671 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f8d58361-c8fd-4f77-8cd3-392626236961 2025-11-10 02:59:00,680 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:00,680 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,690 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4a7defb4-0da6-424f-bdbd-13a5f3e53dde 2025-11-10 02:59:00,708 - INFO - Verified VN network id 16 for VN 1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,708 - INFO - Verifications in API Server for VN ctest-left_vn-54923111 passed 2025-11-10 02:59:00,709 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,722 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4a7defb4-0da6-424f-bdbd-13a5f3e53dde 2025-11-10 02:59:00,730 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4a7defb4-0da6-424f-bdbd-13a5f3e53dde 2025-11-10 02:59:00,738 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f8d58361-c8fd-4f77-8cd3-392626236961 2025-11-10 02:59:00,752 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2227444731492188674', 'uuid-lslong': '9985951771017685738'}, 'enable': 'true', 'created': '2025-11-10T02:59:00', 'last-modified': '2025-11-10T02:59:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431802'} 2025-11-10 02:59:00,759 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:00,766 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2227444731492188674', 'uuid-lslong': '9985951771017685738'}, 'enable': 'true', 'created': '2025-11-10T02:59:00', 'last-modified': '2025-11-10T02:59:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446561'} 2025-11-10 02:59:00,774 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:00,780 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2227444731492188674', 'uuid-lslong': '9985951771017685738'}, 'enable': 'true', 'created': '2025-11-10T02:59:00', 'last-modified': '2025-11-10T02:59:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465118'} 2025-11-10 02:59:00,787 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:00,787 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-54923111 passed 2025-11-10 02:59:00,787 - DEBUG - ====Verifying policy data for ctest-left_vn-54923111 in API_Server ====== 2025-11-10 02:59:00,787 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:00,794 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:00,806 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:00,895 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1ee9792e-8968-4202-8a95-3a3a57b12aea 2025-11-10 02:59:00,910 - DEBUG - =>VN ctest-left_vn-54923111 has no policy to be verified 2025-11-10 02:59:00,910 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:00,910 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:00,910 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:00,974 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111?flat'} 2025-11-10 02:59:00,974 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:00,974 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:01,033 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111?flat'} 2025-11-10 02:59:01,033 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:01,033 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:01,089 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111?flat'} 2025-11-10 02:59:01,089 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-54923111 is found in opserver 2025-11-10 02:59:01,114 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:01,126 - DEBUG - VRF ids for VN ctest-left_vn-54923111: {} 2025-11-10 02:59:01,392 - DEBUG - Response for create_network : {'network': {'id': '8e115fa3-9cc5-4413-a27c-8481372a4af5', 'name': 'ctest-right_vn-77509542', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-right_vn-77509542'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:01,656 - DEBUG - Response for create_subnet : {'subnet': {'id': '7d89c33e-4687-4d16-ac9d-ddd4fe3fd532', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': '8e115fa3-9cc5-4413-a27c-8481372a4af5', 'ip_version': 4, 'cidr': '195.232.200.128/26', 'allocation_pools': [{'start': '195.232.200.130', 'end': '195.232.200.190'}], 'gateway_ip': '195.232.200.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '195.232.200.130', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:01,687 - INFO - Created VN ctest-right_vn-77509542 2025-11-10 02:59:01,702 - DEBUG - VN ctest-right_vn-77509542 UUID is 8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:01,796 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:01,803 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:01,820 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:01,910 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:01,931 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:01,943 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c0eeb34d-8251-40c7-aae9-7f188c6181c3 2025-11-10 02:59:01,953 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c0eeb34d-8251-40c7-aae9-7f188c6181c3 2025-11-10 02:59:01,962 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/8beecac6-7a72-429d-9be0-4a735ec88875 2025-11-10 02:59:01,970 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:01,970 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:01,979 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c0eeb34d-8251-40c7-aae9-7f188c6181c3 2025-11-10 02:59:01,999 - INFO - Verified VN network id 17 for VN 8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:02,000 - INFO - Verifications in API Server for VN ctest-right_vn-77509542 passed 2025-11-10 02:59:02,000 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:02,016 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c0eeb34d-8251-40c7-aae9-7f188c6181c3 2025-11-10 02:59:02,027 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c0eeb34d-8251-40c7-aae9-7f188c6181c3 2025-11-10 02:59:02,035 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/8beecac6-7a72-429d-9be0-4a735ec88875 2025-11-10 02:59:02,049 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10237068584304329747', 'uuid-lslong': '11708378821767613173'}, 'enable': 'true', 'created': '2025-11-10T02:59:01', 'last-modified': '2025-11-10T02:59:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450036'} 2025-11-10 02:59:02,057 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:02,064 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10237068584304329747', 'uuid-lslong': '11708378821767613173'}, 'enable': 'true', 'created': '2025-11-10T02:59:01', 'last-modified': '2025-11-10T02:59:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.464549'} 2025-11-10 02:59:02,072 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:02,078 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10237068584304329747', 'uuid-lslong': '11708378821767613173'}, 'enable': 'true', 'created': '2025-11-10T02:59:01', 'last-modified': '2025-11-10T02:59:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478895'} 2025-11-10 02:59:02,085 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:02,085 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-77509542 passed 2025-11-10 02:59:02,085 - DEBUG - ====Verifying policy data for ctest-right_vn-77509542 in API_Server ====== 2025-11-10 02:59:02,085 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:02,098 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:02,109 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:02,198 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/8e115fa3-9cc5-4413-a27c-8481372a4af5 2025-11-10 02:59:02,216 - DEBUG - =>VN ctest-right_vn-77509542 has no policy to be verified 2025-11-10 02:59:02,216 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:02,216 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:02,216 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:02,276 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542?flat'} 2025-11-10 02:59:02,276 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:02,276 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:02,349 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542?flat'} 2025-11-10 02:59:02,349 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:02,349 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:02,406 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542?flat'} 2025-11-10 02:59:02,406 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-77509542 is found in opserver 2025-11-10 02:59:02,430 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:02,440 - DEBUG - VRF ids for VN ctest-right_vn-77509542: {} 2025-11-10 02:59:02,503 - DEBUG - Services list from nova: [, , , ] 2025-11-10 02:59:03,622 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4674-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4674-1) 2025-11-10 02:59:04,935 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4674-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4674-2) 2025-11-10 02:59:04,935 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-48718367'] 2025-11-10 02:59:05,262 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-48718367'] created succesfully 2025-11-10 02:59:05,635 - DEBUG - Image by name tiny_nat_fw not found 2025-11-10 02:59:05,635 - DEBUG - Installing image tiny_nat_fw 2025-11-10 02:59:05,635 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-10 02:59:05,635 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-10 02:59:05,635 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-10 02:59:05,635 - DEBUG - Unzip image 2025-11-10 02:59:05,635 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-10 02:59:05,661 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-10 02:59:05,662 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-48718367'] 2025-11-10 02:59:05,756 - INFO - Service template: ['default-domain', 'ctest-service_template_1-48718367'] deleted successfully. 2025-11-10 02:59:05,757 - INFO - Skip interface_detach for VM ctest-right_vm-68811433 in state BUILD 2025-11-10 02:59:05,757 - INFO - Deleting VM ctest-right_vm-68811433 2025-11-10 02:59:05,816 - ERROR - VM ctest-right_vm-68811433 has failed to come up 2025-11-10 02:59:05,816 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:05,816 - ERROR - VM ctest-right_vm-68811433 has failed to come up 2025-11-10 02:59:05,816 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:05,946 - INFO - Skip interface_detach for VM ctest-left_vm-66656556 in state BUILD 2025-11-10 02:59:05,946 - INFO - Deleting VM ctest-left_vm-66656556 2025-11-10 02:59:05,946 - ERROR - VM ctest-left_vm-66656556 has failed to come up 2025-11-10 02:59:05,946 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:05,946 - ERROR - VM ctest-left_vm-66656556 has failed to come up 2025-11-10 02:59:05,946 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:06,043 - INFO - Deleting VN ctest-right_vn-77509542 2025-11-10 02:59:06,131 - DEBUG - VN 8e115fa3-9cc5-4413-a27c-8481372a4af5 still in use: Unable to complete operation on network 8e115fa3-9cc5-4413-a27c-8481372a4af5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d2cabcd6-3862-4d0b-88bb-c99359415559'] 2025-11-10 02:59:06,131 - WARNING - Deleting VN ctest-right_vn-77509542 failed..Will retry 2025-11-10 02:59:08,289 - DEBUG - Response for deleting network () 2025-11-10 02:59:08,289 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/c0eeb34d-8251-40c7-aae9-7f188c6181c3 2025-11-10 02:59:08,297 - DEBUG - Response Code: 404 2025-11-10 02:59:08,297 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:08,313 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:08,384 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:08,480 - INFO - Validated that VN ctest-right_vn-77509542 is not found in API Server 2025-11-10 02:59:08,491 - DEBUG - VN ctest-right_vn-77509542 is not present in Agent 10.0.0.65 2025-11-10 02:59:08,502 - DEBUG - VN ctest-right_vn-77509542 is not present in Agent 10.0.0.130 2025-11-10 02:59:08,502 - INFO - Validated that VN ctest-right_vn-77509542 is not in any agent 2025-11-10 02:59:08,536 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-77509542 info 2025-11-10 02:59:08,536 - INFO - Deleting VN ctest-left_vn-54923111 2025-11-10 02:59:08,747 - DEBUG - Response for deleting network () 2025-11-10 02:59:08,747 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4a7defb4-0da6-424f-bdbd-13a5f3e53dde 2025-11-10 02:59:08,767 - DEBUG - Response Code: 404 2025-11-10 02:59:08,768 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:08,777 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:08,789 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:08,883 - INFO - Validated that VN ctest-left_vn-54923111 is not found in API Server 2025-11-10 02:59:08,894 - DEBUG - VN ctest-left_vn-54923111 is not present in Agent 10.0.0.65 2025-11-10 02:59:08,907 - DEBUG - VN ctest-left_vn-54923111 is not present in Agent 10.0.0.130 2025-11-10 02:59:08,907 - INFO - Validated that VN ctest-left_vn-54923111 is not in any agent 2025-11-10 02:59:08,939 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-54923111 info 2025-11-10 02:59:08,939 - INFO - Deleting VN ctest-mgmt_vn-55396934 2025-11-10 02:59:09,084 - DEBUG - Response for deleting network () 2025-11-10 02:59:09,084 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b076285e-52ae-449a-9eab-a800f7299ad6 2025-11-10 02:59:09,091 - DEBUG - Response Code: 404 2025-11-10 02:59:09,092 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:09,103 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:09,119 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:09,203 - INFO - Validated that VN ctest-mgmt_vn-55396934 is not found in API Server 2025-11-10 02:59:09,217 - DEBUG - VN ctest-mgmt_vn-55396934 is not present in Agent 10.0.0.65 2025-11-10 02:59:09,226 - DEBUG - VN ctest-mgmt_vn-55396934 is not present in Agent 10.0.0.130 2025-11-10 02:59:09,226 - INFO - Validated that VN ctest-mgmt_vn-55396934 is not in any agent 2025-11-10 02:59:09,257 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-55396934 info 2025-11-10 02:59:10,543 - DEBUG - No XMPP flaps were noticed during the test 2025-11-10 02:59:10,543 - INFO - 2025-11-10 02:59:10,543 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-11-10 02:59:10,543 - INFO - -------------------------------------------------------------------------------- 2025-11-10 02:59:10,547 - INFO - ================================================================================ 2025-11-10 02:59:10,547 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-10 02:59:11,829 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.193': '0', '10.20.0.129': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.18': '0'}} with 2025-11-10 02:59:11,829 - INFO - Initial checks done. Running the testcase now 2025-11-10 02:59:11,829 - INFO - 2025-11-10 02:59:12,157 - DEBUG - Response for create_network : {'network': {'id': 'd983c034-8673-49a6-897b-151a4da597ca', 'name': 'ctest-mgmt_vn-17543862', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-mgmt_vn-17543862'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:12,415 - DEBUG - Response for create_subnet : {'subnet': {'id': '28de2b73-da68-44eb-a160-cb4241870957', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': 'd983c034-8673-49a6-897b-151a4da597ca', 'ip_version': 4, 'cidr': '177.4.37.192/26', 'allocation_pools': [{'start': '177.4.37.194', 'end': '177.4.37.254'}], 'gateway_ip': '177.4.37.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '177.4.37.194', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:12,441 - INFO - Created VN ctest-mgmt_vn-17543862 2025-11-10 02:59:12,453 - DEBUG - VN ctest-mgmt_vn-17543862 UUID is d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,540 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:12,547 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:12,560 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:12,665 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,680 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,689 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9464cee8-7700-48b4-92e0-945fef35e79f 2025-11-10 02:59:12,699 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9464cee8-7700-48b4-92e0-945fef35e79f 2025-11-10 02:59:12,706 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/6e6d5f79-0db0-4e49-ad65-4b8c4f1a9c76 2025-11-10 02:59:12,714 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:59:12,714 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,723 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9464cee8-7700-48b4-92e0-945fef35e79f 2025-11-10 02:59:12,740 - INFO - Verified VN network id 15 for VN d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,741 - INFO - Verifications in API Server for VN ctest-mgmt_vn-17543862 passed 2025-11-10 02:59:12,741 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,750 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9464cee8-7700-48b4-92e0-945fef35e79f 2025-11-10 02:59:12,759 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9464cee8-7700-48b4-92e0-945fef35e79f 2025-11-10 02:59:12,767 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/6e6d5f79-0db0-4e49-ad65-4b8c4f1a9c76 2025-11-10 02:59:12,779 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15673582460005992870', 'uuid-lslong': '9906535008047568842'}, 'enable': 'true', 'created': '2025-11-10T02:59:12', 'last-modified': '2025-11-10T02:59:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419010'} 2025-11-10 02:59:12,784 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:59:12,790 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15673582460005992870', 'uuid-lslong': '9906535008047568842'}, 'enable': 'true', 'created': '2025-11-10T02:59:12', 'last-modified': '2025-11-10T02:59:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430782'} 2025-11-10 02:59:12,795 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:59:12,800 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15673582460005992870', 'uuid-lslong': '9906535008047568842'}, 'enable': 'true', 'created': '2025-11-10T02:59:12', 'last-modified': '2025-11-10T02:59:12', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.440723'} 2025-11-10 02:59:12,806 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-10 02:59:12,806 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-17543862 passed 2025-11-10 02:59:12,807 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-17543862 in API_Server ====== 2025-11-10 02:59:12,807 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:12,814 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:12,827 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:12,924 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d983c034-8673-49a6-897b-151a4da597ca 2025-11-10 02:59:12,936 - DEBUG - =>VN ctest-mgmt_vn-17543862 has no policy to be verified 2025-11-10 02:59:12,936 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:12,936 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:12,936 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:12,949 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862?flat'} 2025-11-10 02:59:12,949 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:12,949 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:12,962 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862?flat'} 2025-11-10 02:59:12,962 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:12,963 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:12,977 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862?flat'} 2025-11-10 02:59:12,977 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-mgmt_vn-17543862 is found in opserver 2025-11-10 02:59:13,002 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:13,016 - DEBUG - VRF ids for VN ctest-mgmt_vn-17543862: {} 2025-11-10 02:59:13,326 - DEBUG - Response for create_network : {'network': {'id': 'ce870f51-9051-4d42-b096-11cd9ca0d2b0', 'name': 'ctest-left_vn-44466865', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-left_vn-44466865'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:13,637 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fbc237ae-f605-40b7-aec5-0fd8a0e57814', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': 'ce870f51-9051-4d42-b096-11cd9ca0d2b0', 'ip_version': 4, 'cidr': '54.194.92.192/26', 'allocation_pools': [{'start': '54.194.92.194', 'end': '54.194.92.254'}], 'gateway_ip': '54.194.92.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '54.194.92.194', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:13,660 - INFO - Created VN ctest-left_vn-44466865 2025-11-10 02:59:13,674 - DEBUG - VN ctest-left_vn-44466865 UUID is ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:13,748 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:13,756 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:13,770 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:13,868 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:13,880 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:13,891 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/363e7cec-33b0-4dfc-8102-a131da70f6fe 2025-11-10 02:59:13,899 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/363e7cec-33b0-4dfc-8102-a131da70f6fe 2025-11-10 02:59:13,906 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/65050f07-dc09-4407-858a-060fe5df880b 2025-11-10 02:59:13,914 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:13,915 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:13,925 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/363e7cec-33b0-4dfc-8102-a131da70f6fe 2025-11-10 02:59:13,941 - INFO - Verified VN network id 16 for VN ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:13,941 - INFO - Verifications in API Server for VN ctest-left_vn-44466865 passed 2025-11-10 02:59:13,942 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:13,951 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/363e7cec-33b0-4dfc-8102-a131da70f6fe 2025-11-10 02:59:13,961 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/363e7cec-33b0-4dfc-8102-a131da70f6fe 2025-11-10 02:59:13,970 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/65050f07-dc09-4407-858a-060fe5df880b 2025-11-10 02:59:13,982 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14881880336657108290', 'uuid-lslong': '12724377371975668400'}, 'enable': 'true', 'created': '2025-11-10T02:59:13', 'last-modified': '2025-11-10T02:59:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403165'} 2025-11-10 02:59:13,987 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:13,994 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14881880336657108290', 'uuid-lslong': '12724377371975668400'}, 'enable': 'true', 'created': '2025-11-10T02:59:13', 'last-modified': '2025-11-10T02:59:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418868'} 2025-11-10 02:59:14,002 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:14,009 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14881880336657108290', 'uuid-lslong': '12724377371975668400'}, 'enable': 'true', 'created': '2025-11-10T02:59:13', 'last-modified': '2025-11-10T02:59:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428645'} 2025-11-10 02:59:14,016 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-10 02:59:14,017 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-44466865 passed 2025-11-10 02:59:14,017 - DEBUG - ====Verifying policy data for ctest-left_vn-44466865 in API_Server ====== 2025-11-10 02:59:14,017 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:14,027 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:14,051 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:14,167 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/ce870f51-9051-4d42-b096-11cd9ca0d2b0 2025-11-10 02:59:14,178 - DEBUG - =>VN ctest-left_vn-44466865 has no policy to be verified 2025-11-10 02:59:14,178 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:14,178 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:14,178 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:14,196 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865?flat'} 2025-11-10 02:59:14,196 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:14,196 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:14,216 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865?flat'} 2025-11-10 02:59:14,216 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:14,216 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:14,232 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865?flat'} 2025-11-10 02:59:14,232 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-left_vn-44466865 is found in opserver 2025-11-10 02:59:14,257 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:14,270 - DEBUG - VRF ids for VN ctest-left_vn-44466865: {} 2025-11-10 02:59:14,567 - DEBUG - Response for create_network : {'network': {'id': 'd336db3d-1c24-4280-95ee-814ea98c0614', 'name': 'ctest-right_vn-11676166', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-right_vn-11676166'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:14,833 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e0d61318-f5e0-440c-83e9-e302f8c9d5e6', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': 'd336db3d-1c24-4280-95ee-814ea98c0614', 'ip_version': 4, 'cidr': '169.241.77.64/26', 'allocation_pools': [{'start': '169.241.77.66', 'end': '169.241.77.126'}], 'gateway_ip': '169.241.77.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '169.241.77.66', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:14,856 - INFO - Created VN ctest-right_vn-11676166 2025-11-10 02:59:14,870 - DEBUG - VN ctest-right_vn-11676166 UUID is d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:14,957 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:14,964 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:14,978 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:15,075 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:15,086 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:15,095 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e4983f1b-5b3a-4895-8a29-9fa9f7904d37 2025-11-10 02:59:15,102 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e4983f1b-5b3a-4895-8a29-9fa9f7904d37 2025-11-10 02:59:15,109 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/e5fcff92-c440-4e99-99f9-7803f5313edc 2025-11-10 02:59:15,116 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:15,116 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:15,124 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e4983f1b-5b3a-4895-8a29-9fa9f7904d37 2025-11-10 02:59:15,141 - INFO - Verified VN network id 17 for VN d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:15,141 - INFO - Verifications in API Server for VN ctest-right_vn-11676166 passed 2025-11-10 02:59:15,141 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:15,150 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e4983f1b-5b3a-4895-8a29-9fa9f7904d37 2025-11-10 02:59:15,157 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e4983f1b-5b3a-4895-8a29-9fa9f7904d37 2025-11-10 02:59:15,167 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/e5fcff92-c440-4e99-99f9-7803f5313edc 2025-11-10 02:59:15,179 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15219593046256796288', 'uuid-lslong': '10803714730960356884'}, 'enable': 'true', 'created': '2025-11-10T02:59:14', 'last-modified': '2025-11-10T02:59:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413272'} 2025-11-10 02:59:15,184 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:15,190 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15219593046256796288', 'uuid-lslong': '10803714730960356884'}, 'enable': 'true', 'created': '2025-11-10T02:59:14', 'last-modified': '2025-11-10T02:59:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420672'} 2025-11-10 02:59:15,196 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:15,201 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15219593046256796288', 'uuid-lslong': '10803714730960356884'}, 'enable': 'true', 'created': '2025-11-10T02:59:14', 'last-modified': '2025-11-10T02:59:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435137'} 2025-11-10 02:59:15,208 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-10 02:59:15,208 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-11676166 passed 2025-11-10 02:59:15,208 - DEBUG - ====Verifying policy data for ctest-right_vn-11676166 in API_Server ====== 2025-11-10 02:59:15,208 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:15,214 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:15,227 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:15,333 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/d336db3d-1c24-4280-95ee-814ea98c0614 2025-11-10 02:59:15,343 - DEBUG - =>VN ctest-right_vn-11676166 has no policy to be verified 2025-11-10 02:59:15,343 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:15,343 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:15,344 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:15,357 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166?flat'} 2025-11-10 02:59:15,357 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:15,357 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:15,372 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166?flat'} 2025-11-10 02:59:15,373 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:15,373 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:15,388 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166?flat'} 2025-11-10 02:59:15,389 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-right_vn-11676166 is found in opserver 2025-11-10 02:59:15,417 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:15,432 - DEBUG - VRF ids for VN ctest-right_vn-11676166: {} 2025-11-10 02:59:15,711 - DEBUG - Response for create_network : {'network': {'id': 'bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2', 'name': 'ctest-trans_left_vn-42965280', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-trans_left_vn-42965280'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:15,939 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fcf7718b-a3ca-4903-a846-a93f9c65bb38', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': 'bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2', 'ip_version': 4, 'cidr': '40.196.92.0/26', 'allocation_pools': [{'start': '40.196.92.2', 'end': '40.196.92.62'}], 'gateway_ip': '40.196.92.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '40.196.92.2', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:15,960 - INFO - Created VN ctest-trans_left_vn-42965280 2025-11-10 02:59:15,972 - DEBUG - VN ctest-trans_left_vn-42965280 UUID is bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,051 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:16,057 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:16,068 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:16,163 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,173 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,183 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/165cfbdc-dc11-4cfd-935f-eb96bfff8e09 2025-11-10 02:59:16,192 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/165cfbdc-dc11-4cfd-935f-eb96bfff8e09 2025-11-10 02:59:16,199 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/9ba6a2f5-98d1-4454-8046-c870d3ba0d35 2025-11-10 02:59:16,207 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-10 02:59:16,207 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,217 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/165cfbdc-dc11-4cfd-935f-eb96bfff8e09 2025-11-10 02:59:16,234 - INFO - Verified VN network id 18 for VN bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,234 - INFO - Verifications in API Server for VN ctest-trans_left_vn-42965280 passed 2025-11-10 02:59:16,234 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,244 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/165cfbdc-dc11-4cfd-935f-eb96bfff8e09 2025-11-10 02:59:16,252 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/165cfbdc-dc11-4cfd-935f-eb96bfff8e09 2025-11-10 02:59:16,261 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/9ba6a2f5-98d1-4454-8046-c870d3ba0d35 2025-11-10 02:59:16,275 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13659254487592683675', 'uuid-lslong': '13122146456761531330'}, 'enable': 'true', 'created': '2025-11-10T02:59:15', 'last-modified': '2025-11-10T02:59:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398046'} 2025-11-10 02:59:16,286 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-10 02:59:16,295 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13659254487592683675', 'uuid-lslong': '13122146456761531330'}, 'enable': 'true', 'created': '2025-11-10T02:59:15', 'last-modified': '2025-11-10T02:59:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416704'} 2025-11-10 02:59:16,303 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-10 02:59:16,309 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13659254487592683675', 'uuid-lslong': '13122146456761531330'}, 'enable': 'true', 'created': '2025-11-10T02:59:15', 'last-modified': '2025-11-10T02:59:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432905'} 2025-11-10 02:59:16,315 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-10 02:59:16,315 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-42965280 passed 2025-11-10 02:59:16,316 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-42965280 in API_Server ====== 2025-11-10 02:59:16,316 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:16,323 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:16,336 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:16,428 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/bd8f6b96-2d9f-489b-b61b-3aada5ebfbc2 2025-11-10 02:59:16,443 - DEBUG - =>VN ctest-trans_left_vn-42965280 has no policy to be verified 2025-11-10 02:59:16,443 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:16,443 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:16,443 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:16,457 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280?flat'} 2025-11-10 02:59:16,457 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:16,457 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:16,471 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280?flat'} 2025-11-10 02:59:16,471 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:16,471 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:16,485 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280?flat'} 2025-11-10 02:59:16,485 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-trans_left_vn-42965280 is found in opserver 2025-11-10 02:59:16,512 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:16,525 - DEBUG - VRF ids for VN ctest-trans_left_vn-42965280: {} 2025-11-10 02:59:16,802 - DEBUG - Response for create_network : {'network': {'id': '0601f679-2719-4947-9bb6-e2b63c539c67', 'name': 'ctest-trans_right_vn-56448275', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-67923078', 'ctest-trans_right_vn-56448275'], 'port_security_enabled': True, 'description': ''}} 2025-11-10 02:59:17,007 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e81e0363-42a4-4aab-8ec9-831a2a754fe5', 'name': '', 'tenant_id': '99ad2ad8d3664d659f207ab85e69e5c3', 'network_id': '0601f679-2719-4947-9bb6-e2b63c539c67', 'ip_version': 4, 'cidr': '146.112.81.192/26', 'allocation_pools': [{'start': '146.112.81.194', 'end': '146.112.81.254'}], 'gateway_ip': '146.112.81.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '146.112.81.194', 'tags': [], 'project_id': '99ad2ad8d3664d659f207ab85e69e5c3'}} 2025-11-10 02:59:17,031 - INFO - Created VN ctest-trans_right_vn-56448275 2025-11-10 02:59:17,045 - DEBUG - VN ctest-trans_right_vn-56448275 UUID is 0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,127 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:17,134 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:17,147 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:17,243 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,260 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,269 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b6922197-eab8-48db-994a-0c346fcecf7b 2025-11-10 02:59:17,276 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b6922197-eab8-48db-994a-0c346fcecf7b 2025-11-10 02:59:17,283 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/da1cdbd6-2eb0-4a2a-81be-40806d86f6d4 2025-11-10 02:59:17,290 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-10 02:59:17,291 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,300 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b6922197-eab8-48db-994a-0c346fcecf7b 2025-11-10 02:59:17,316 - INFO - Verified VN network id 19 for VN 0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,316 - INFO - Verifications in API Server for VN ctest-trans_right_vn-56448275 passed 2025-11-10 02:59:17,316 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,327 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b6922197-eab8-48db-994a-0c346fcecf7b 2025-11-10 02:59:17,336 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b6922197-eab8-48db-994a-0c346fcecf7b 2025-11-10 02:59:17,345 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/da1cdbd6-2eb0-4a2a-81be-40806d86f6d4 2025-11-10 02:59:17,358 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '432898039411722567', 'uuid-lslong': '11220404793964207207'}, 'enable': 'true', 'created': '2025-11-10T02:59:16', 'last-modified': '2025-11-10T02:59:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.397714'} 2025-11-10 02:59:17,364 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-10 02:59:17,370 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '432898039411722567', 'uuid-lslong': '11220404793964207207'}, 'enable': 'true', 'created': '2025-11-10T02:59:16', 'last-modified': '2025-11-10T02:59:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414159'} 2025-11-10 02:59:17,376 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-10 02:59:17,383 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-67923078', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '432898039411722567', 'uuid-lslong': '11220404793964207207'}, 'enable': 'true', 'created': '2025-11-10T02:59:16', 'last-modified': '2025-11-10T02:59:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423002'} 2025-11-10 02:59:17,389 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-10 02:59:17,389 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-56448275 passed 2025-11-10 02:59:17,389 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-56448275 in API_Server ====== 2025-11-10 02:59:17,389 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:17,395 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:17,406 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:17,498 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/0601f679-2719-4947-9bb6-e2b63c539c67 2025-11-10 02:59:17,509 - DEBUG - =>VN ctest-trans_right_vn-56448275 has no policy to be verified 2025-11-10 02:59:17,509 - DEBUG - Verifying the vn in opserver 2025-11-10 02:59:17,509 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275 virtual network link through opserver 10.0.0.22 2025-11-10 02:59:17,509 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-10 02:59:17,522 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275?flat'} 2025-11-10 02:59:17,522 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275 virtual network link through opserver 10.0.0.50 2025-11-10 02:59:17,522 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-11-10 02:59:17,536 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275?flat'} 2025-11-10 02:59:17,536 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275 virtual network link through opserver 10.0.0.23 2025-11-10 02:59:17,536 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-10 02:59:17,551 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275?flat'} 2025-11-10 02:59:17,551 - INFO - Validated that VN default-domain:ctest-TestSvcHC-67923078:ctest-trans_right_vn-56448275 is found in opserver 2025-11-10 02:59:17,573 - DEBUG - Do not have enough data to verify VN in agent 2025-11-10 02:59:17,583 - DEBUG - VRF ids for VN ctest-trans_right_vn-56448275: {} 2025-11-10 02:59:18,688 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4674-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4674-2) 2025-11-10 02:59:20,053 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4674-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4674-1) 2025-11-10 02:59:20,053 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-80328653'] 2025-11-10 02:59:20,364 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-80328653'] created succesfully 2025-11-10 02:59:20,701 - DEBUG - Image by name tiny_trans_fw not found 2025-11-10 02:59:20,701 - DEBUG - Installing image tiny_trans_fw 2025-11-10 02:59:20,701 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-10 02:59:20,701 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-10 02:59:20,701 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-10 02:59:20,701 - DEBUG - Unzip image 2025-11-10 02:59:20,701 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-10 02:59:20,735 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-10 02:59:20,737 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-80328653'] 2025-11-10 02:59:20,845 - INFO - Service template: ['default-domain', 'ctest-service_template_1-80328653'] deleted successfully. 2025-11-10 02:59:20,845 - INFO - Skip interface_detach for VM ctest-right_vm-94595430 in state BUILD 2025-11-10 02:59:20,845 - INFO - Deleting VM ctest-right_vm-94595430 2025-11-10 02:59:20,845 - ERROR - VM ctest-right_vm-94595430 has failed to come up 2025-11-10 02:59:20,845 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:20,845 - ERROR - VM ctest-right_vm-94595430 has failed to come up 2025-11-10 02:59:20,845 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:20,950 - INFO - Skip interface_detach for VM ctest-left_vm-29639478 in state BUILD 2025-11-10 02:59:20,950 - INFO - Deleting VM ctest-left_vm-29639478 2025-11-10 02:59:20,951 - ERROR - VM ctest-left_vm-29639478 has failed to come up 2025-11-10 02:59:20,951 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:20,951 - ERROR - VM ctest-left_vm-29639478 has failed to come up 2025-11-10 02:59:20,951 - ERROR - Nova failed to get host of the VM 2025-11-10 02:59:21,027 - INFO - Deleting VN ctest-trans_right_vn-56448275 2025-11-10 02:59:21,204 - DEBUG - Response for deleting network () 2025-11-10 02:59:21,204 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b6922197-eab8-48db-994a-0c346fcecf7b 2025-11-10 02:59:21,211 - DEBUG - Response Code: 404 2025-11-10 02:59:21,211 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:21,220 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:21,257 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:21,354 - INFO - Validated that VN ctest-trans_right_vn-56448275 is not found in API Server 2025-11-10 02:59:21,365 - DEBUG - VN ctest-trans_right_vn-56448275 is not present in Agent 10.0.0.65 2025-11-10 02:59:21,390 - DEBUG - VN ctest-trans_right_vn-56448275 is not present in Agent 10.0.0.130 2025-11-10 02:59:21,390 - INFO - Validated that VN ctest-trans_right_vn-56448275 is not in any agent 2025-11-10 02:59:21,429 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-56448275 info 2025-11-10 02:59:21,429 - INFO - Deleting VN ctest-trans_left_vn-42965280 2025-11-10 02:59:21,592 - DEBUG - Response for deleting network () 2025-11-10 02:59:21,593 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/165cfbdc-dc11-4cfd-935f-eb96bfff8e09 2025-11-10 02:59:21,603 - DEBUG - Response Code: 404 2025-11-10 02:59:21,603 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:21,614 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:21,632 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:21,737 - INFO - Validated that VN ctest-trans_left_vn-42965280 is not found in API Server 2025-11-10 02:59:21,754 - DEBUG - VN ctest-trans_left_vn-42965280 is not present in Agent 10.0.0.65 2025-11-10 02:59:21,770 - DEBUG - VN ctest-trans_left_vn-42965280 is not present in Agent 10.0.0.130 2025-11-10 02:59:21,770 - INFO - Validated that VN ctest-trans_left_vn-42965280 is not in any agent 2025-11-10 02:59:21,823 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-42965280 info 2025-11-10 02:59:21,823 - INFO - Deleting VN ctest-right_vn-11676166 2025-11-10 02:59:21,880 - DEBUG - VN d336db3d-1c24-4280-95ee-814ea98c0614 still in use: Unable to complete operation on network d336db3d-1c24-4280-95ee-814ea98c0614. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-bd42794c-b3f4-492f-ab21-d9228d251007'] 2025-11-10 02:59:21,880 - WARNING - Deleting VN ctest-right_vn-11676166 failed..Will retry 2025-11-10 02:59:24,066 - DEBUG - Response for deleting network () 2025-11-10 02:59:24,067 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e4983f1b-5b3a-4895-8a29-9fa9f7904d37 2025-11-10 02:59:24,073 - DEBUG - Response Code: 404 2025-11-10 02:59:24,073 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:24,079 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:24,089 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:24,189 - INFO - Validated that VN ctest-right_vn-11676166 is not found in API Server 2025-11-10 02:59:24,202 - DEBUG - VN ctest-right_vn-11676166 is not present in Agent 10.0.0.65 2025-11-10 02:59:24,212 - DEBUG - VN ctest-right_vn-11676166 is not present in Agent 10.0.0.130 2025-11-10 02:59:24,212 - INFO - Validated that VN ctest-right_vn-11676166 is not in any agent 2025-11-10 02:59:24,250 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-11676166 info 2025-11-10 02:59:24,250 - INFO - Deleting VN ctest-left_vn-44466865 2025-11-10 02:59:24,431 - DEBUG - Response for deleting network () 2025-11-10 02:59:24,431 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/363e7cec-33b0-4dfc-8102-a131da70f6fe 2025-11-10 02:59:24,446 - DEBUG - Response Code: 404 2025-11-10 02:59:24,446 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:24,463 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:24,484 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:24,573 - INFO - Validated that VN ctest-left_vn-44466865 is not found in API Server 2025-11-10 02:59:24,585 - DEBUG - VN ctest-left_vn-44466865 is not present in Agent 10.0.0.65 2025-11-10 02:59:24,599 - DEBUG - VN ctest-left_vn-44466865 is not present in Agent 10.0.0.130 2025-11-10 02:59:24,599 - INFO - Validated that VN ctest-left_vn-44466865 is not in any agent 2025-11-10 02:59:24,649 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-44466865 info 2025-11-10 02:59:24,651 - INFO - Deleting VN ctest-mgmt_vn-17543862 2025-11-10 02:59:24,955 - DEBUG - Response for deleting network () 2025-11-10 02:59:24,955 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/9464cee8-7700-48b4-92e0-945fef35e79f 2025-11-10 02:59:24,962 - DEBUG - Response Code: 404 2025-11-10 02:59:24,962 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-10 02:59:24,969 - DEBUG - Requesting: http://10.0.0.22:8082/domain/dbdabfa7-f87c-4117-b05b-68cc6fd252ce 2025-11-10 02:59:24,996 - DEBUG - Requesting: http://10.0.0.22:8082/project/99ad2ad8-d366-4d65-9f20-7ab85e69e5c3 2025-11-10 02:59:25,101 - INFO - Validated that VN ctest-mgmt_vn-17543862 is not found in API Server 2025-11-10 02:59:25,112 - DEBUG - VN ctest-mgmt_vn-17543862 is not present in Agent 10.0.0.65 2025-11-10 02:59:25,122 - DEBUG - VN ctest-mgmt_vn-17543862 is not present in Agent 10.0.0.130 2025-11-10 02:59:25,123 - INFO - Validated that VN ctest-mgmt_vn-17543862 is not in any agent 2025-11-10 02:59:25,154 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-17543862 info 2025-11-10 02:59:26,426 - DEBUG - No XMPP flaps were noticed during the test 2025-11-10 02:59:26,426 - INFO - 2025-11-10 02:59:26,426 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2025-11-10 02:59:26,427 - INFO - -------------------------------------------------------------------------------- 2025-11-10 02:59:27,228 - INFO - Deleted project: ctest-TestSvcHC-67923078, ID : 99ad2ad8-d366-4d65-9f20-7ab85e69e5c3