2025-10-29 18:57:12,151 - INFO - Domain Default found not creating 2025-10-29 18:57:12,495 - INFO - Project ctest-TestSvcHC-16362819 not found, creating it 2025-10-29 18:57:13,137 - INFO - Created Project:ctest-TestSvcHC-16362819, ID : 74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:15,055 - INFO - ================================================================================ 2025-10-29 18:57:15,055 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-29 18:57:16,485 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.201': '0', '10.20.0.200': '0'}, '10.0.0.27': {'10.20.0.201': '0', '10.20.0.200': '0'}} with 2025-10-29 18:57:16,485 - INFO - Initial checks done. Running the testcase now 2025-10-29 18:57:16,485 - INFO - 2025-10-29 18:57:17,248 - DEBUG - Response for create_network : {'network': {'id': '1e1fa9f4-d859-4cb0-a5f7-748971923500', 'name': 'ctest-mgmt_vn-80436413', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-mgmt_vn-80436413'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:17,527 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aa1e0f38-ed42-4190-85d0-004583413e74', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': '1e1fa9f4-d859-4cb0-a5f7-748971923500', 'ip_version': 4, 'cidr': '180.66.6.192/26', 'allocation_pools': [{'start': '180.66.6.194', 'end': '180.66.6.254'}], 'gateway_ip': '180.66.6.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '180.66.6.194', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:17,550 - INFO - Created VN ctest-mgmt_vn-80436413 2025-10-29 18:57:17,561 - DEBUG - VN ctest-mgmt_vn-80436413 UUID is 1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:17,644 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:17,943 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:17,976 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:17,993 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:18,110 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:18,123 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:18,133 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1e1113b3-e346-43d3-b750-5eab87b18781 2025-10-29 18:57:18,144 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1e1113b3-e346-43d3-b750-5eab87b18781 2025-10-29 18:57:18,151 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/4964d435-5998-4c55-b997-3c23149a19cf 2025-10-29 18:57:18,158 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:18,158 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:18,172 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1e1113b3-e346-43d3-b750-5eab87b18781 2025-10-29 18:57:18,189 - INFO - Verified VN network id 11 for VN 1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:18,189 - INFO - Verifications in API Server for VN ctest-mgmt_vn-80436413 passed 2025-10-29 18:57:18,190 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:18,201 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1e1113b3-e346-43d3-b750-5eab87b18781 2025-10-29 18:57:18,213 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1e1113b3-e346-43d3-b750-5eab87b18781 2025-10-29 18:57:18,223 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/4964d435-5998-4c55-b997-3c23149a19cf 2025-10-29 18:57:18,236 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2170640414482713776', 'uuid-lslong': '11959155469170390272'}, 'enable': 'true', 'created': '2025-10-29T18:57:17', 'last-modified': '2025-10-29T18:57:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.758203'} 2025-10-29 18:57:18,244 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:18,253 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2170640414482713776', 'uuid-lslong': '11959155469170390272'}, 'enable': 'true', 'created': '2025-10-29T18:57:17', 'last-modified': '2025-10-29T18:57:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.780209'} 2025-10-29 18:57:18,262 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:18,267 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2170640414482713776', 'uuid-lslong': '11959155469170390272'}, 'enable': 'true', 'created': '2025-10-29T18:57:17', 'last-modified': '2025-10-29T18:57:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.796767'} 2025-10-29 18:57:18,274 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:18,274 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-80436413 passed 2025-10-29 18:57:18,274 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-80436413 in API_Server ====== 2025-10-29 18:57:18,274 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:18,280 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:18,298 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:18,404 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e1fa9f4-d859-4cb0-a5f7-748971923500 2025-10-29 18:57:18,423 - DEBUG - =>VN ctest-mgmt_vn-80436413 has no policy to be verified 2025-10-29 18:57:18,423 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:18,423 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:18,423 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:18,935 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:18,998 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413?flat'} 2025-10-29 18:57:18,998 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:18,998 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:19,351 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:19,412 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413?flat'} 2025-10-29 18:57:19,412 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:19,413 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:19,718 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:19,792 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413?flat'} 2025-10-29 18:57:19,792 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-80436413 is found in opserver 2025-10-29 18:57:19,828 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:19,845 - DEBUG - VRF ids for VN ctest-mgmt_vn-80436413: {} 2025-10-29 18:57:20,142 - DEBUG - Response for create_network : {'network': {'id': '1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d', 'name': 'ctest-left_vn-32149168', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-left_vn-32149168'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:20,423 - DEBUG - Response for create_subnet : {'subnet': {'id': '93564966-73c9-4b11-bb86-5a6dfa232698', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': '1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d', 'ip_version': 4, 'cidr': '123.3.53.64/26', 'allocation_pools': [{'start': '123.3.53.66', 'end': '123.3.53.126'}], 'gateway_ip': '123.3.53.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '123.3.53.66', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:20,449 - INFO - Created VN ctest-left_vn-32149168 2025-10-29 18:57:20,464 - DEBUG - VN ctest-left_vn-32149168 UUID is 1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,555 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:20,561 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:20,577 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:20,686 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,699 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,710 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/8a3851a5-490d-429f-a126-85e55afb2cf0 2025-10-29 18:57:20,719 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/8a3851a5-490d-429f-a126-85e55afb2cf0 2025-10-29 18:57:20,730 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/0827b532-1993-4dbf-87f7-8e7db2ab6479 2025-10-29 18:57:20,741 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:20,741 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,753 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/8a3851a5-490d-429f-a126-85e55afb2cf0 2025-10-29 18:57:20,772 - INFO - Verified VN network id 12 for VN 1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,772 - INFO - Verifications in API Server for VN ctest-left_vn-32149168 passed 2025-10-29 18:57:20,772 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,784 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/8a3851a5-490d-429f-a126-85e55afb2cf0 2025-10-29 18:57:20,792 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/8a3851a5-490d-429f-a126-85e55afb2cf0 2025-10-29 18:57:20,800 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/0827b532-1993-4dbf-87f7-8e7db2ab6479 2025-10-29 18:57:20,814 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2166098271543316474', 'uuid-lslong': '13507271253616977709'}, 'enable': 'true', 'created': '2025-10-29T18:57:20', 'last-modified': '2025-10-29T18:57:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462437'} 2025-10-29 18:57:20,819 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:20,824 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2166098271543316474', 'uuid-lslong': '13507271253616977709'}, 'enable': 'true', 'created': '2025-10-29T18:57:20', 'last-modified': '2025-10-29T18:57:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443704'} 2025-10-29 18:57:20,832 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:20,840 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2166098271543316474', 'uuid-lslong': '13507271253616977709'}, 'enable': 'true', 'created': '2025-10-29T18:57:20', 'last-modified': '2025-10-29T18:57:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485164'} 2025-10-29 18:57:20,848 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:20,848 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-32149168 passed 2025-10-29 18:57:20,848 - DEBUG - ====Verifying policy data for ctest-left_vn-32149168 in API_Server ====== 2025-10-29 18:57:20,848 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:20,856 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:20,867 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:20,958 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1e0f86e6-c7ed-4ffa-bb73-77a3fcaf672d 2025-10-29 18:57:20,967 - DEBUG - =>VN ctest-left_vn-32149168 has no policy to be verified 2025-10-29 18:57:20,967 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:20,967 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:20,967 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:21,036 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168?flat'} 2025-10-29 18:57:21,036 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:21,036 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:21,105 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168?flat'} 2025-10-29 18:57:21,105 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:21,105 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:21,160 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168?flat'} 2025-10-29 18:57:21,160 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-32149168 is found in opserver 2025-10-29 18:57:21,191 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:21,206 - DEBUG - VRF ids for VN ctest-left_vn-32149168: {} 2025-10-29 18:57:21,512 - DEBUG - Response for create_network : {'network': {'id': '271bd7c9-7035-4ae5-99fb-56e6462b4b5b', 'name': 'ctest-right_vn-73030808', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-right_vn-73030808'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:21,790 - DEBUG - Response for create_subnet : {'subnet': {'id': '5107f052-e882-43f3-b80b-e282fcbbb905', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': '271bd7c9-7035-4ae5-99fb-56e6462b4b5b', 'ip_version': 4, 'cidr': '51.181.87.64/26', 'allocation_pools': [{'start': '51.181.87.66', 'end': '51.181.87.126'}], 'gateway_ip': '51.181.87.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '51.181.87.66', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:21,811 - INFO - Created VN ctest-right_vn-73030808 2025-10-29 18:57:21,822 - DEBUG - VN ctest-right_vn-73030808 UUID is 271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:21,898 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:21,905 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:21,916 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:22,020 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:22,031 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:22,042 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a4da185-6726-4987-abdb-5114b4d460fb 2025-10-29 18:57:22,052 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a4da185-6726-4987-abdb-5114b4d460fb 2025-10-29 18:57:22,062 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/ec9b206c-bc64-4c66-8eab-d1c9dfa35f38 2025-10-29 18:57:22,071 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:22,071 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:22,083 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a4da185-6726-4987-abdb-5114b4d460fb 2025-10-29 18:57:22,100 - INFO - Verified VN network id 13 for VN 271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:22,100 - INFO - Verifications in API Server for VN ctest-right_vn-73030808 passed 2025-10-29 18:57:22,100 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:22,112 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a4da185-6726-4987-abdb-5114b4d460fb 2025-10-29 18:57:22,120 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a4da185-6726-4987-abdb-5114b4d460fb 2025-10-29 18:57:22,129 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/ec9b206c-bc64-4c66-8eab-d1c9dfa35f38 2025-10-29 18:57:22,143 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2818083252021316325', 'uuid-lslong': '11095557653977058139'}, 'enable': 'true', 'created': '2025-10-29T18:57:21', 'last-modified': '2025-10-29T18:57:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405072'} 2025-10-29 18:57:22,149 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:22,155 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2818083252021316325', 'uuid-lslong': '11095557653977058139'}, 'enable': 'true', 'created': '2025-10-29T18:57:21', 'last-modified': '2025-10-29T18:57:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432862'} 2025-10-29 18:57:22,162 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:22,172 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2818083252021316325', 'uuid-lslong': '11095557653977058139'}, 'enable': 'true', 'created': '2025-10-29T18:57:21', 'last-modified': '2025-10-29T18:57:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449043'} 2025-10-29 18:57:22,179 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:22,179 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-73030808 passed 2025-10-29 18:57:22,179 - DEBUG - ====Verifying policy data for ctest-right_vn-73030808 in API_Server ====== 2025-10-29 18:57:22,179 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:22,187 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:22,200 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:22,315 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/271bd7c9-7035-4ae5-99fb-56e6462b4b5b 2025-10-29 18:57:22,332 - DEBUG - =>VN ctest-right_vn-73030808 has no policy to be verified 2025-10-29 18:57:22,332 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:22,332 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:22,332 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:22,388 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808?flat'} 2025-10-29 18:57:22,388 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:22,388 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:22,455 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808?flat'} 2025-10-29 18:57:22,455 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:22,455 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:22,528 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808?flat'} 2025-10-29 18:57:22,528 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-73030808 is found in opserver 2025-10-29 18:57:22,580 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:22,605 - DEBUG - VRF ids for VN ctest-right_vn-73030808: {} 2025-10-29 18:57:22,714 - DEBUG - Services list from nova: [, , , ] 2025-10-29 18:57:23,997 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-2) 2025-10-29 18:57:25,404 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-1) 2025-10-29 18:57:25,404 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-73067329'] 2025-10-29 18:57:25,704 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-73067329'] created succesfully 2025-10-29 18:57:26,083 - DEBUG - Image by name tiny_nat_fw not found 2025-10-29 18:57:26,083 - DEBUG - Installing image tiny_nat_fw 2025-10-29 18:57:26,083 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-29 18:57:26,084 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-29 18:57:26,084 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-29 18:57:26,084 - DEBUG - Unzip image 2025-10-29 18:57:26,084 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-29 18:57:26,103 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-29 18:57:26,106 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-73067329'] 2025-10-29 18:57:26,194 - INFO - Service template: ['default-domain', 'ctest-service_template_1-73067329'] deleted successfully. 2025-10-29 18:57:26,194 - INFO - Skip interface_detach for VM ctest-right_vm-65453797 in state BUILD 2025-10-29 18:57:26,194 - INFO - Deleting VM ctest-right_vm-65453797 2025-10-29 18:57:26,224 - ERROR - VM ctest-right_vm-65453797 has failed to come up 2025-10-29 18:57:26,224 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:26,224 - ERROR - VM ctest-right_vm-65453797 has failed to come up 2025-10-29 18:57:26,224 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:26,287 - INFO - Skip interface_detach for VM ctest-left_vm-10179373 in state BUILD 2025-10-29 18:57:26,288 - INFO - Deleting VM ctest-left_vm-10179373 2025-10-29 18:57:26,288 - ERROR - VM ctest-left_vm-10179373 has failed to come up 2025-10-29 18:57:26,288 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:26,288 - ERROR - VM ctest-left_vm-10179373 has failed to come up 2025-10-29 18:57:26,288 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:26,372 - INFO - Deleting VN ctest-right_vn-73030808 2025-10-29 18:57:26,450 - DEBUG - VN 271bd7c9-7035-4ae5-99fb-56e6462b4b5b still in use: Unable to complete operation on network 271bd7c9-7035-4ae5-99fb-56e6462b4b5b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-bef590e0-b29a-4998-a7bc-8d560fc0be1b'] 2025-10-29 18:57:26,451 - WARNING - Deleting VN ctest-right_vn-73030808 failed..Will retry 2025-10-29 18:57:28,672 - DEBUG - Response for deleting network () 2025-10-29 18:57:28,672 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/4a4da185-6726-4987-abdb-5114b4d460fb 2025-10-29 18:57:28,683 - DEBUG - Response Code: 404 2025-10-29 18:57:28,683 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:28,707 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:28,729 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:28,839 - INFO - Validated that VN ctest-right_vn-73030808 is not found in API Server 2025-10-29 18:57:28,860 - DEBUG - VN ctest-right_vn-73030808 is not present in Agent 10.0.0.73 2025-10-29 18:57:28,872 - DEBUG - VN ctest-right_vn-73030808 is not present in Agent 10.0.0.27 2025-10-29 18:57:28,872 - INFO - Validated that VN ctest-right_vn-73030808 is not in any agent 2025-10-29 18:57:28,917 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-73030808 info 2025-10-29 18:57:28,917 - INFO - Deleting VN ctest-left_vn-32149168 2025-10-29 18:57:29,117 - DEBUG - Response for deleting network () 2025-10-29 18:57:29,118 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/8a3851a5-490d-429f-a126-85e55afb2cf0 2025-10-29 18:57:29,138 - DEBUG - Response Code: 404 2025-10-29 18:57:29,138 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:29,146 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:29,158 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:29,259 - INFO - Validated that VN ctest-left_vn-32149168 is not found in API Server 2025-10-29 18:57:29,296 - DEBUG - VN ctest-left_vn-32149168 is not present in Agent 10.0.0.73 2025-10-29 18:57:29,306 - DEBUG - VN ctest-left_vn-32149168 is not present in Agent 10.0.0.27 2025-10-29 18:57:29,306 - INFO - Validated that VN ctest-left_vn-32149168 is not in any agent 2025-10-29 18:57:29,344 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-32149168 info 2025-10-29 18:57:29,344 - INFO - Deleting VN ctest-mgmt_vn-80436413 2025-10-29 18:57:29,499 - DEBUG - Response for deleting network () 2025-10-29 18:57:29,500 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1e1113b3-e346-43d3-b750-5eab87b18781 2025-10-29 18:57:29,509 - DEBUG - Response Code: 404 2025-10-29 18:57:29,509 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:29,517 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:29,538 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:29,639 - INFO - Validated that VN ctest-mgmt_vn-80436413 is not found in API Server 2025-10-29 18:57:29,664 - DEBUG - VN ctest-mgmt_vn-80436413 is not present in Agent 10.0.0.73 2025-10-29 18:57:29,674 - DEBUG - VN ctest-mgmt_vn-80436413 is not present in Agent 10.0.0.27 2025-10-29 18:57:29,674 - INFO - Validated that VN ctest-mgmt_vn-80436413 is not in any agent 2025-10-29 18:57:29,720 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-80436413 info 2025-10-29 18:57:31,115 - DEBUG - No XMPP flaps were noticed during the test 2025-10-29 18:57:31,115 - INFO - 2025-10-29 18:57:31,115 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16] 2025-10-29 18:57:31,115 - INFO - -------------------------------------------------------------------------------- 2025-10-29 18:57:31,121 - INFO - ================================================================================ 2025-10-29 18:57:31,124 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-29 18:57:32,569 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.201': '0', '10.20.0.200': '0'}, '10.0.0.27': {'10.20.0.201': '0', '10.20.0.200': '0'}} with 2025-10-29 18:57:32,569 - INFO - Initial checks done. Running the testcase now 2025-10-29 18:57:32,569 - INFO - 2025-10-29 18:57:32,869 - DEBUG - Response for create_network : {'network': {'id': '6b2d8ccb-e47f-4ee2-a836-945961ffcb30', 'name': 'ctest-mgmt_vn-77421162', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-mgmt_vn-77421162'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:33,145 - DEBUG - Response for create_subnet : {'subnet': {'id': '42492ed6-e1ec-409a-88c2-16e18696c890', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': '6b2d8ccb-e47f-4ee2-a836-945961ffcb30', 'ip_version': 4, 'cidr': '52.85.42.0/26', 'allocation_pools': [{'start': '52.85.42.2', 'end': '52.85.42.62'}], 'gateway_ip': '52.85.42.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '52.85.42.2', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:33,167 - INFO - Created VN ctest-mgmt_vn-77421162 2025-10-29 18:57:33,180 - DEBUG - VN ctest-mgmt_vn-77421162 UUID is 6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,262 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:33,272 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:33,289 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:33,385 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,405 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,417 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7eb66578-9d48-448c-a64b-6f3e59e1b7d0 2025-10-29 18:57:33,425 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7eb66578-9d48-448c-a64b-6f3e59e1b7d0 2025-10-29 18:57:33,434 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6709a0f1-fa02-479b-8dec-8fba34c1ef33 2025-10-29 18:57:33,441 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:33,442 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,452 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7eb66578-9d48-448c-a64b-6f3e59e1b7d0 2025-10-29 18:57:33,472 - INFO - Verified VN network id 11 for VN 6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,472 - INFO - Verifications in API Server for VN ctest-mgmt_vn-77421162 passed 2025-10-29 18:57:33,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,484 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7eb66578-9d48-448c-a64b-6f3e59e1b7d0 2025-10-29 18:57:33,501 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7eb66578-9d48-448c-a64b-6f3e59e1b7d0 2025-10-29 18:57:33,513 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6709a0f1-fa02-479b-8dec-8fba34c1ef33 2025-10-29 18:57:33,529 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7722983743350066914', 'uuid-lslong': '12121038558731422512'}, 'enable': 'true', 'created': '2025-10-29T18:57:32', 'last-modified': '2025-10-29T18:57:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438294'} 2025-10-29 18:57:33,536 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:33,543 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7722983743350066914', 'uuid-lslong': '12121038558731422512'}, 'enable': 'true', 'created': '2025-10-29T18:57:32', 'last-modified': '2025-10-29T18:57:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459921'} 2025-10-29 18:57:33,550 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:33,559 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7722983743350066914', 'uuid-lslong': '12121038558731422512'}, 'enable': 'true', 'created': '2025-10-29T18:57:32', 'last-modified': '2025-10-29T18:57:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465458'} 2025-10-29 18:57:33,565 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:33,565 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-77421162 passed 2025-10-29 18:57:33,566 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-77421162 in API_Server ====== 2025-10-29 18:57:33,566 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:33,575 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:33,592 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:33,717 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/6b2d8ccb-e47f-4ee2-a836-945961ffcb30 2025-10-29 18:57:33,733 - DEBUG - =>VN ctest-mgmt_vn-77421162 has no policy to be verified 2025-10-29 18:57:33,733 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:33,733 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:33,733 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:33,747 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162?flat'} 2025-10-29 18:57:33,747 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:33,747 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:33,764 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162?flat'} 2025-10-29 18:57:33,764 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:33,764 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:33,781 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162?flat'} 2025-10-29 18:57:33,781 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-mgmt_vn-77421162 is found in opserver 2025-10-29 18:57:33,816 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:33,835 - DEBUG - VRF ids for VN ctest-mgmt_vn-77421162: {} 2025-10-29 18:57:34,149 - DEBUG - Response for create_network : {'network': {'id': 'd67a5b2a-7260-44c2-8f78-b22bac8f805b', 'name': 'ctest-left_vn-45101022', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-left_vn-45101022'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:34,397 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a03e3f3c-b703-44aa-b078-a9dfa484321b', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': 'd67a5b2a-7260-44c2-8f78-b22bac8f805b', 'ip_version': 4, 'cidr': '57.154.86.128/26', 'allocation_pools': [{'start': '57.154.86.130', 'end': '57.154.86.190'}], 'gateway_ip': '57.154.86.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '57.154.86.130', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:34,423 - INFO - Created VN ctest-left_vn-45101022 2025-10-29 18:57:34,438 - DEBUG - VN ctest-left_vn-45101022 UUID is d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,509 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:34,519 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:34,532 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:34,641 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,657 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,667 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0e771b36-a482-4e09-84b7-3cc20cfa88af 2025-10-29 18:57:34,675 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0e771b36-a482-4e09-84b7-3cc20cfa88af 2025-10-29 18:57:34,683 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d5da67b9-aa6d-4731-b5d9-78d3af77f8c7 2025-10-29 18:57:34,702 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:34,702 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,721 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0e771b36-a482-4e09-84b7-3cc20cfa88af 2025-10-29 18:57:34,746 - INFO - Verified VN network id 12 for VN d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,746 - INFO - Verifications in API Server for VN ctest-left_vn-45101022 passed 2025-10-29 18:57:34,746 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,763 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0e771b36-a482-4e09-84b7-3cc20cfa88af 2025-10-29 18:57:34,777 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0e771b36-a482-4e09-84b7-3cc20cfa88af 2025-10-29 18:57:34,787 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d5da67b9-aa6d-4731-b5d9-78d3af77f8c7 2025-10-29 18:57:34,807 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15454765309140944066', 'uuid-lslong': '10338208845277397083'}, 'enable': 'true', 'created': '2025-10-29T18:57:34', 'last-modified': '2025-10-29T18:57:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491856'} 2025-10-29 18:57:34,822 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:34,830 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15454765309140944066', 'uuid-lslong': '10338208845277397083'}, 'enable': 'true', 'created': '2025-10-29T18:57:34', 'last-modified': '2025-10-29T18:57:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.519409'} 2025-10-29 18:57:34,839 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:34,846 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15454765309140944066', 'uuid-lslong': '10338208845277397083'}, 'enable': 'true', 'created': '2025-10-29T18:57:34', 'last-modified': '2025-10-29T18:57:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532524'} 2025-10-29 18:57:34,854 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:34,855 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-45101022 passed 2025-10-29 18:57:34,855 - DEBUG - ====Verifying policy data for ctest-left_vn-45101022 in API_Server ====== 2025-10-29 18:57:34,855 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:34,863 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:34,877 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:34,981 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d67a5b2a-7260-44c2-8f78-b22bac8f805b 2025-10-29 18:57:34,991 - DEBUG - =>VN ctest-left_vn-45101022 has no policy to be verified 2025-10-29 18:57:34,992 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:34,992 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:34,992 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:35,005 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022?flat'} 2025-10-29 18:57:35,005 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:35,005 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:35,020 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022?flat'} 2025-10-29 18:57:35,020 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:35,020 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:35,034 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022?flat'} 2025-10-29 18:57:35,034 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-left_vn-45101022 is found in opserver 2025-10-29 18:57:35,076 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:35,100 - DEBUG - VRF ids for VN ctest-left_vn-45101022: {} 2025-10-29 18:57:35,454 - DEBUG - Response for create_network : {'network': {'id': 'c9dee9ce-a4d7-4bc9-9577-b15efee82387', 'name': 'ctest-right_vn-71310095', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-right_vn-71310095'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:35,723 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd2ae29c3-33c1-46fc-8172-4f5d9c9009c2', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': 'c9dee9ce-a4d7-4bc9-9577-b15efee82387', 'ip_version': 4, 'cidr': '50.97.2.0/26', 'allocation_pools': [{'start': '50.97.2.2', 'end': '50.97.2.62'}], 'gateway_ip': '50.97.2.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '50.97.2.2', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:35,751 - INFO - Created VN ctest-right_vn-71310095 2025-10-29 18:57:35,763 - DEBUG - VN ctest-right_vn-71310095 UUID is c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:35,847 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:35,855 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:35,870 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:35,991 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:36,008 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:36,020 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/10b4f2f2-b0bc-4fcf-bb61-014802a3e99e 2025-10-29 18:57:36,035 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/10b4f2f2-b0bc-4fcf-bb61-014802a3e99e 2025-10-29 18:57:36,057 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/5c8ac655-1c9d-4205-9072-b3ba4abad503 2025-10-29 18:57:36,067 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:36,067 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:36,076 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/10b4f2f2-b0bc-4fcf-bb61-014802a3e99e 2025-10-29 18:57:36,094 - INFO - Verified VN network id 13 for VN c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:36,095 - INFO - Verifications in API Server for VN ctest-right_vn-71310095 passed 2025-10-29 18:57:36,095 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:36,117 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/10b4f2f2-b0bc-4fcf-bb61-014802a3e99e 2025-10-29 18:57:36,124 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/10b4f2f2-b0bc-4fcf-bb61-014802a3e99e 2025-10-29 18:57:36,132 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/5c8ac655-1c9d-4205-9072-b3ba4abad503 2025-10-29 18:57:36,144 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14546320920191388617', 'uuid-lslong': '10770272055441499015'}, 'enable': 'true', 'created': '2025-10-29T18:57:35', 'last-modified': '2025-10-29T18:57:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492050'} 2025-10-29 18:57:36,149 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:36,154 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14546320920191388617', 'uuid-lslong': '10770272055441499015'}, 'enable': 'true', 'created': '2025-10-29T18:57:35', 'last-modified': '2025-10-29T18:57:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492729'} 2025-10-29 18:57:36,160 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:36,165 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14546320920191388617', 'uuid-lslong': '10770272055441499015'}, 'enable': 'true', 'created': '2025-10-29T18:57:35', 'last-modified': '2025-10-29T18:57:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510518'} 2025-10-29 18:57:36,173 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:36,174 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-71310095 passed 2025-10-29 18:57:36,174 - DEBUG - ====Verifying policy data for ctest-right_vn-71310095 in API_Server ====== 2025-10-29 18:57:36,175 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:36,182 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:36,200 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:36,302 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c9dee9ce-a4d7-4bc9-9577-b15efee82387 2025-10-29 18:57:36,313 - DEBUG - =>VN ctest-right_vn-71310095 has no policy to be verified 2025-10-29 18:57:36,314 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:36,314 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:36,314 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:36,328 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095?flat'} 2025-10-29 18:57:36,328 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:36,328 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:36,345 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095?flat'} 2025-10-29 18:57:36,345 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:36,345 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:36,362 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095?flat'} 2025-10-29 18:57:36,362 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-right_vn-71310095 is found in opserver 2025-10-29 18:57:36,393 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:36,409 - DEBUG - VRF ids for VN ctest-right_vn-71310095: {} 2025-10-29 18:57:36,686 - DEBUG - Response for create_network : {'network': {'id': 'ce2194c1-3ac9-470c-bcfd-c379242f9b49', 'name': 'ctest-trans_left_vn-93759317', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-trans_left_vn-93759317'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:36,968 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dbfb6dd2-0307-4c56-a08d-2f992b76eede', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': 'ce2194c1-3ac9-470c-bcfd-c379242f9b49', 'ip_version': 4, 'cidr': '92.49.157.0/26', 'allocation_pools': [{'start': '92.49.157.2', 'end': '92.49.157.62'}], 'gateway_ip': '92.49.157.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '92.49.157.2', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:36,988 - INFO - Created VN ctest-trans_left_vn-93759317 2025-10-29 18:57:37,001 - DEBUG - VN ctest-trans_left_vn-93759317 UUID is ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,082 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:37,092 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:37,104 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:37,221 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,242 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,255 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ad5a7cdc-8958-42d3-a85d-c3aa14d076bb 2025-10-29 18:57:37,268 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ad5a7cdc-8958-42d3-a85d-c3aa14d076bb 2025-10-29 18:57:37,277 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/2b8da51b-bafb-42a5-9543-333dff8964b9 2025-10-29 18:57:37,286 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:57:37,286 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,298 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ad5a7cdc-8958-42d3-a85d-c3aa14d076bb 2025-10-29 18:57:37,319 - INFO - Verified VN network id 14 for VN ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,319 - INFO - Verifications in API Server for VN ctest-trans_left_vn-93759317 passed 2025-10-29 18:57:37,319 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,334 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ad5a7cdc-8958-42d3-a85d-c3aa14d076bb 2025-10-29 18:57:37,343 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ad5a7cdc-8958-42d3-a85d-c3aa14d076bb 2025-10-29 18:57:37,352 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/2b8da51b-bafb-42a5-9543-333dff8964b9 2025-10-29 18:57:37,367 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14853316603680474892', 'uuid-lslong': '13618255773303806793'}, 'enable': 'true', 'created': '2025-10-29T18:57:36', 'last-modified': '2025-10-29T18:57:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.480869'} 2025-10-29 18:57:37,373 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:57:37,380 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14853316603680474892', 'uuid-lslong': '13618255773303806793'}, 'enable': 'true', 'created': '2025-10-29T18:57:36', 'last-modified': '2025-10-29T18:57:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490367'} 2025-10-29 18:57:37,387 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:57:37,392 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14853316603680474892', 'uuid-lslong': '13618255773303806793'}, 'enable': 'true', 'created': '2025-10-29T18:57:36', 'last-modified': '2025-10-29T18:57:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501791'} 2025-10-29 18:57:37,402 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:57:37,403 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-93759317 passed 2025-10-29 18:57:37,403 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-93759317 in API_Server ====== 2025-10-29 18:57:37,403 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:37,413 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:37,432 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:37,565 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce2194c1-3ac9-470c-bcfd-c379242f9b49 2025-10-29 18:57:37,577 - DEBUG - =>VN ctest-trans_left_vn-93759317 has no policy to be verified 2025-10-29 18:57:37,577 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:37,577 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:37,577 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:37,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317?flat'} 2025-10-29 18:57:37,594 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:37,594 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:37,611 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317?flat'} 2025-10-29 18:57:37,611 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:37,611 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:37,625 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317?flat'} 2025-10-29 18:57:37,625 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-trans_left_vn-93759317 is found in opserver 2025-10-29 18:57:37,660 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:37,681 - DEBUG - VRF ids for VN ctest-trans_left_vn-93759317: {} 2025-10-29 18:57:38,005 - DEBUG - Response for create_network : {'network': {'id': 'e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9', 'name': 'ctest-trans_right_vn-15985383', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'project_id': '74b041f5a6a04b8d84703ff803a55ea0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-16362819', 'ctest-trans_right_vn-15985383'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:38,251 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a06d934f-c90d-4c08-b2b5-e98b11133dbd', 'name': '', 'tenant_id': '74b041f5a6a04b8d84703ff803a55ea0', 'network_id': 'e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9', 'ip_version': 4, 'cidr': '84.55.33.128/26', 'allocation_pools': [{'start': '84.55.33.130', 'end': '84.55.33.190'}], 'gateway_ip': '84.55.33.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '84.55.33.130', 'tags': [], 'project_id': '74b041f5a6a04b8d84703ff803a55ea0'}} 2025-10-29 18:57:38,277 - INFO - Created VN ctest-trans_right_vn-15985383 2025-10-29 18:57:38,303 - DEBUG - VN ctest-trans_right_vn-15985383 UUID is e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,394 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:38,399 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:38,410 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:38,508 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,522 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,535 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/13e578e9-f91c-4a54-a737-1774ca02f60f 2025-10-29 18:57:38,542 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/13e578e9-f91c-4a54-a737-1774ca02f60f 2025-10-29 18:57:38,550 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/e0e15668-3311-4348-ba2c-fe7790e3f5f4 2025-10-29 18:57:38,560 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:57:38,560 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,578 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/13e578e9-f91c-4a54-a737-1774ca02f60f 2025-10-29 18:57:38,598 - INFO - Verified VN network id 15 for VN e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,599 - INFO - Verifications in API Server for VN ctest-trans_right_vn-15985383 passed 2025-10-29 18:57:38,599 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,613 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/13e578e9-f91c-4a54-a737-1774ca02f60f 2025-10-29 18:57:38,621 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/13e578e9-f91c-4a54-a737-1774ca02f60f 2025-10-29 18:57:38,628 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/e0e15668-3311-4348-ba2c-fe7790e3f5f4 2025-10-29 18:57:38,638 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16835858831110786242', 'uuid-lslong': '13458976526637826537'}, 'enable': 'true', 'created': '2025-10-29T18:57:37', 'last-modified': '2025-10-29T18:57:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460478'} 2025-10-29 18:57:38,643 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:57:38,649 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16835858831110786242', 'uuid-lslong': '13458976526637826537'}, 'enable': 'true', 'created': '2025-10-29T18:57:37', 'last-modified': '2025-10-29T18:57:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471769'} 2025-10-29 18:57:38,657 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:57:38,663 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-16362819', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16835858831110786242', 'uuid-lslong': '13458976526637826537'}, 'enable': 'true', 'created': '2025-10-29T18:57:37', 'last-modified': '2025-10-29T18:57:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485571'} 2025-10-29 18:57:38,669 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:57:38,669 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-15985383 passed 2025-10-29 18:57:38,669 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-15985383 in API_Server ====== 2025-10-29 18:57:38,669 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:38,677 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:38,686 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:38,852 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e9a4fc68-1cfb-4cc2-bac7-e3d79e9181e9 2025-10-29 18:57:38,864 - DEBUG - =>VN ctest-trans_right_vn-15985383 has no policy to be verified 2025-10-29 18:57:38,864 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:38,864 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:38,864 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:38,876 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383?flat'} 2025-10-29 18:57:38,876 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:38,876 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:38,889 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383?flat'} 2025-10-29 18:57:38,889 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:38,890 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:38,901 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383?flat'} 2025-10-29 18:57:38,901 - INFO - Validated that VN default-domain:ctest-TestSvcHC-16362819:ctest-trans_right_vn-15985383 is found in opserver 2025-10-29 18:57:38,931 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:38,947 - DEBUG - VRF ids for VN ctest-trans_right_vn-15985383: {} 2025-10-29 18:57:40,120 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-1) 2025-10-29 18:57:41,654 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-2) 2025-10-29 18:57:41,654 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-59448276'] 2025-10-29 18:57:41,972 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-59448276'] created succesfully 2025-10-29 18:57:42,350 - DEBUG - Image by name tiny_trans_fw not found 2025-10-29 18:57:42,350 - DEBUG - Installing image tiny_trans_fw 2025-10-29 18:57:42,350 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-29 18:57:42,350 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-29 18:57:42,350 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-29 18:57:42,350 - DEBUG - Unzip image 2025-10-29 18:57:42,350 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-29 18:57:42,377 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-29 18:57:42,390 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-59448276'] 2025-10-29 18:57:42,541 - INFO - Service template: ['default-domain', 'ctest-service_template_1-59448276'] deleted successfully. 2025-10-29 18:57:42,541 - INFO - Skip interface_detach for VM ctest-right_vm-22898232 in state BUILD 2025-10-29 18:57:42,541 - INFO - Deleting VM ctest-right_vm-22898232 2025-10-29 18:57:42,541 - ERROR - VM ctest-right_vm-22898232 has failed to come up 2025-10-29 18:57:42,541 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:42,541 - ERROR - VM ctest-right_vm-22898232 has failed to come up 2025-10-29 18:57:42,541 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:42,669 - INFO - Skip interface_detach for VM ctest-left_vm-44687420 in state BUILD 2025-10-29 18:57:42,669 - INFO - Deleting VM ctest-left_vm-44687420 2025-10-29 18:57:42,669 - ERROR - VM ctest-left_vm-44687420 has failed to come up 2025-10-29 18:57:42,669 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:42,669 - ERROR - VM ctest-left_vm-44687420 has failed to come up 2025-10-29 18:57:42,669 - ERROR - Nova failed to get host of the VM 2025-10-29 18:57:42,744 - INFO - Deleting VN ctest-trans_right_vn-15985383 2025-10-29 18:57:42,963 - DEBUG - Response for deleting network () 2025-10-29 18:57:42,964 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/13e578e9-f91c-4a54-a737-1774ca02f60f 2025-10-29 18:57:42,972 - DEBUG - Response Code: 404 2025-10-29 18:57:42,973 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:42,986 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:43,013 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:43,117 - INFO - Validated that VN ctest-trans_right_vn-15985383 is not found in API Server 2025-10-29 18:57:43,141 - DEBUG - VN ctest-trans_right_vn-15985383 is not present in Agent 10.0.0.73 2025-10-29 18:57:43,205 - DEBUG - VN ctest-trans_right_vn-15985383 is not present in Agent 10.0.0.27 2025-10-29 18:57:43,205 - INFO - Validated that VN ctest-trans_right_vn-15985383 is not in any agent 2025-10-29 18:57:43,239 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-15985383 info 2025-10-29 18:57:43,239 - INFO - Deleting VN ctest-trans_left_vn-93759317 2025-10-29 18:57:43,490 - DEBUG - Response for deleting network () 2025-10-29 18:57:43,491 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ad5a7cdc-8958-42d3-a85d-c3aa14d076bb 2025-10-29 18:57:43,498 - DEBUG - Response Code: 404 2025-10-29 18:57:43,498 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:43,504 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:43,515 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:43,669 - INFO - Validated that VN ctest-trans_left_vn-93759317 is not found in API Server 2025-10-29 18:57:43,696 - DEBUG - VN ctest-trans_left_vn-93759317 is not present in Agent 10.0.0.73 2025-10-29 18:57:43,712 - DEBUG - VN ctest-trans_left_vn-93759317 is not present in Agent 10.0.0.27 2025-10-29 18:57:43,712 - INFO - Validated that VN ctest-trans_left_vn-93759317 is not in any agent 2025-10-29 18:57:43,758 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-93759317 info 2025-10-29 18:57:43,758 - INFO - Deleting VN ctest-right_vn-71310095 2025-10-29 18:57:43,808 - DEBUG - VN c9dee9ce-a4d7-4bc9-9577-b15efee82387 still in use: Unable to complete operation on network c9dee9ce-a4d7-4bc9-9577-b15efee82387. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-342ba559-9248-4cc1-8e55-5040a25890d0'] 2025-10-29 18:57:43,808 - WARNING - Deleting VN ctest-right_vn-71310095 failed..Will retry 2025-10-29 18:57:46,052 - DEBUG - Response for deleting network () 2025-10-29 18:57:46,052 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/10b4f2f2-b0bc-4fcf-bb61-014802a3e99e 2025-10-29 18:57:46,065 - DEBUG - Response Code: 404 2025-10-29 18:57:46,066 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:46,072 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:46,127 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:46,244 - INFO - Validated that VN ctest-right_vn-71310095 is not found in API Server 2025-10-29 18:57:46,273 - DEBUG - VN ctest-right_vn-71310095 is not present in Agent 10.0.0.73 2025-10-29 18:57:46,292 - DEBUG - VN ctest-right_vn-71310095 is not present in Agent 10.0.0.27 2025-10-29 18:57:46,292 - INFO - Validated that VN ctest-right_vn-71310095 is not in any agent 2025-10-29 18:57:46,353 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-71310095 info 2025-10-29 18:57:46,354 - INFO - Deleting VN ctest-left_vn-45101022 2025-10-29 18:57:46,548 - DEBUG - Response for deleting network () 2025-10-29 18:57:46,548 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/0e771b36-a482-4e09-84b7-3cc20cfa88af 2025-10-29 18:57:46,558 - DEBUG - Response Code: 404 2025-10-29 18:57:46,559 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:46,567 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:46,593 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:46,690 - INFO - Validated that VN ctest-left_vn-45101022 is not found in API Server 2025-10-29 18:57:46,716 - DEBUG - VN ctest-left_vn-45101022 is not present in Agent 10.0.0.73 2025-10-29 18:57:46,727 - DEBUG - VN ctest-left_vn-45101022 is not present in Agent 10.0.0.27 2025-10-29 18:57:46,727 - INFO - Validated that VN ctest-left_vn-45101022 is not in any agent 2025-10-29 18:57:46,778 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-45101022 info 2025-10-29 18:57:46,778 - INFO - Deleting VN ctest-mgmt_vn-77421162 2025-10-29 18:57:46,925 - DEBUG - Response for deleting network () 2025-10-29 18:57:46,925 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7eb66578-9d48-448c-a64b-6f3e59e1b7d0 2025-10-29 18:57:46,930 - DEBUG - Response Code: 404 2025-10-29 18:57:46,930 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:46,935 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:46,947 - DEBUG - Requesting: http://10.0.0.249:8082/project/74b041f5-a6a0-4b8d-8470-3ff803a55ea0 2025-10-29 18:57:47,046 - INFO - Validated that VN ctest-mgmt_vn-77421162 is not found in API Server 2025-10-29 18:57:47,072 - DEBUG - VN ctest-mgmt_vn-77421162 is not present in Agent 10.0.0.73 2025-10-29 18:57:47,082 - DEBUG - VN ctest-mgmt_vn-77421162 is not present in Agent 10.0.0.27 2025-10-29 18:57:47,082 - INFO - Validated that VN ctest-mgmt_vn-77421162 is not in any agent 2025-10-29 18:57:47,124 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-77421162 info 2025-10-29 18:57:48,565 - DEBUG - No XMPP flaps were noticed during the test 2025-10-29 18:57:48,565 - INFO - 2025-10-29 18:57:48,565 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17] 2025-10-29 18:57:48,566 - INFO - -------------------------------------------------------------------------------- 2025-10-29 18:57:49,400 - INFO - Deleted project: ctest-TestSvcHC-16362819, ID : 74b041f5-a6a0-4b8d-8470-3ff803a55ea0