2025-08-28 03:04:36,362 - INFO - Domain Default found not creating 2025-08-28 03:04:36,518 - INFO - Project ctest-TestSvcHC-19454889 not found, creating it 2025-08-28 03:04:37,116 - INFO - Created Project:ctest-TestSvcHC-19454889, ID : 384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:38,632 - INFO - ================================================================================ 2025-08-28 03:04:38,632 - INFO - STARTING TEST : test_svc_hc_basic 2025-08-28 03:04:39,893 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0', '10.20.0.254': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-28 03:04:39,893 - INFO - Initial checks done. Running the testcase now 2025-08-28 03:04:39,894 - INFO - 2025-08-28 03:04:40,538 - DEBUG - Response for create_network : {'network': {'id': '1d81e31f-ce63-487b-8ba6-8b66e556d29b', 'name': 'ctest-mgmt_vn-51723572', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-mgmt_vn-51723572'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:40,764 - DEBUG - Response for create_subnet : {'subnet': {'id': '67d54eb7-b138-45dd-8009-7ffe4c0a6c91', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': '1d81e31f-ce63-487b-8ba6-8b66e556d29b', 'ip_version': 4, 'cidr': '162.219.245.0/26', 'allocation_pools': [{'start': '162.219.245.2', 'end': '162.219.245.62'}], 'gateway_ip': '162.219.245.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '162.219.245.2', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:40,791 - INFO - Created VN ctest-mgmt_vn-51723572 2025-08-28 03:04:40,802 - DEBUG - VN ctest-mgmt_vn-51723572 UUID is 1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:40,878 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:41,173 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:41,200 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:41,220 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:41,310 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:41,327 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:41,337 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8fb061d1-fe3a-4c84-8a7a-d166bc442be4 2025-08-28 03:04:41,343 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8fb061d1-fe3a-4c84-8a7a-d166bc442be4 2025-08-28 03:04:41,350 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/cab329c4-d5c4-4400-9860-9d1d59534df3 2025-08-28 03:04:41,357 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:41,357 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:41,366 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8fb061d1-fe3a-4c84-8a7a-d166bc442be4 2025-08-28 03:04:41,379 - INFO - Verified VN network id 12 for VN 1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:41,379 - INFO - Verifications in API Server for VN ctest-mgmt_vn-51723572 passed 2025-08-28 03:04:41,379 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:41,388 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8fb061d1-fe3a-4c84-8a7a-d166bc442be4 2025-08-28 03:04:41,395 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8fb061d1-fe3a-4c84-8a7a-d166bc442be4 2025-08-28 03:04:41,401 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/cab329c4-d5c4-4400-9860-9d1d59534df3 2025-08-28 03:04:41,412 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2126230224841689211', 'uuid-lslong': '10062883691456549531'}, 'enable': 'true', 'created': '2025-08-28T03:04:40', 'last-modified': '2025-08-28T03:04:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.700425'} 2025-08-28 03:04:41,418 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:41,424 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2126230224841689211', 'uuid-lslong': '10062883691456549531'}, 'enable': 'true', 'created': '2025-08-28T03:04:40', 'last-modified': '2025-08-28T03:04:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714707'} 2025-08-28 03:04:41,430 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:41,434 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2126230224841689211', 'uuid-lslong': '10062883691456549531'}, 'enable': 'true', 'created': '2025-08-28T03:04:40', 'last-modified': '2025-08-28T03:04:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.727547'} 2025-08-28 03:04:41,439 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:41,439 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-51723572 passed 2025-08-28 03:04:41,439 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-51723572 in API_Server ====== 2025-08-28 03:04:41,439 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:41,445 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:41,455 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:41,548 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d81e31f-ce63-487b-8ba6-8b66e556d29b 2025-08-28 03:04:41,559 - DEBUG - =>VN ctest-mgmt_vn-51723572 has no policy to be verified 2025-08-28 03:04:41,559 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:41,559 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:41,560 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:41,854 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:41,912 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572?flat'} 2025-08-28 03:04:41,912 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:41,912 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:42,211 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:42,265 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572?flat'} 2025-08-28 03:04:42,265 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:42,266 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:42,557 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:42,607 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572?flat'} 2025-08-28 03:04:42,607 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-51723572 is found in opserver 2025-08-28 03:04:42,627 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:42,637 - DEBUG - VRF ids for VN ctest-mgmt_vn-51723572: {} 2025-08-28 03:04:42,872 - DEBUG - Response for create_network : {'network': {'id': '030212a0-b449-4c65-94e1-597a4998defe', 'name': 'ctest-left_vn-28128418', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-left_vn-28128418'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:43,114 - DEBUG - Response for create_subnet : {'subnet': {'id': '95cbdf03-fb61-43e8-9039-8a8f09178608', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': '030212a0-b449-4c65-94e1-597a4998defe', 'ip_version': 4, 'cidr': '69.98.84.128/26', 'allocation_pools': [{'start': '69.98.84.130', 'end': '69.98.84.190'}], 'gateway_ip': '69.98.84.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '69.98.84.130', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:43,135 - INFO - Created VN ctest-left_vn-28128418 2025-08-28 03:04:43,147 - DEBUG - VN ctest-left_vn-28128418 UUID is 030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,214 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:43,224 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:43,234 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:43,319 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,332 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,348 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4eead340-5024-4014-b049-17d166b8f90f 2025-08-28 03:04:43,354 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4eead340-5024-4014-b049-17d166b8f90f 2025-08-28 03:04:43,362 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/d0a9d8cf-ef78-4625-a6f6-d9fcbc6b66a7 2025-08-28 03:04:43,370 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:43,370 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,380 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4eead340-5024-4014-b049-17d166b8f90f 2025-08-28 03:04:43,396 - INFO - Verified VN network id 13 for VN 030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,396 - INFO - Verifications in API Server for VN ctest-left_vn-28128418 passed 2025-08-28 03:04:43,396 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,405 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4eead340-5024-4014-b049-17d166b8f90f 2025-08-28 03:04:43,410 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4eead340-5024-4014-b049-17d166b8f90f 2025-08-28 03:04:43,417 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/d0a9d8cf-ef78-4625-a6f6-d9fcbc6b66a7 2025-08-28 03:04:43,427 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216756213495975013', 'uuid-lslong': '10727954169128869630'}, 'enable': 'true', 'created': '2025-08-28T03:04:42', 'last-modified': '2025-08-28T03:04:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402235'} 2025-08-28 03:04:43,432 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:43,437 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216756213495975013', 'uuid-lslong': '10727954169128869630'}, 'enable': 'true', 'created': '2025-08-28T03:04:42', 'last-modified': '2025-08-28T03:04:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411820'} 2025-08-28 03:04:43,444 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:43,449 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '216756213495975013', 'uuid-lslong': '10727954169128869630'}, 'enable': 'true', 'created': '2025-08-28T03:04:42', 'last-modified': '2025-08-28T03:04:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419780'} 2025-08-28 03:04:43,453 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:43,454 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-28128418 passed 2025-08-28 03:04:43,454 - DEBUG - ====Verifying policy data for ctest-left_vn-28128418 in API_Server ====== 2025-08-28 03:04:43,454 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:43,459 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:43,470 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:43,572 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/030212a0-b449-4c65-94e1-597a4998defe 2025-08-28 03:04:43,584 - DEBUG - =>VN ctest-left_vn-28128418 has no policy to be verified 2025-08-28 03:04:43,584 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:43,584 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:43,584 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:43,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418?flat'} 2025-08-28 03:04:43,643 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:43,643 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:43,710 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418?flat'} 2025-08-28 03:04:43,710 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:43,710 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:43,769 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418?flat'} 2025-08-28 03:04:43,769 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-28128418 is found in opserver 2025-08-28 03:04:43,789 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:43,799 - DEBUG - VRF ids for VN ctest-left_vn-28128418: {} 2025-08-28 03:04:44,099 - DEBUG - Response for create_network : {'network': {'id': '822c123e-a0ed-4221-a13d-f24a0e05beba', 'name': 'ctest-right_vn-43988403', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-right_vn-43988403'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:44,610 - DEBUG - Response for create_subnet : {'subnet': {'id': '0382a5e8-c46f-40e7-bf7f-594027ac6789', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': '822c123e-a0ed-4221-a13d-f24a0e05beba', 'ip_version': 4, 'cidr': '158.4.188.0/26', 'allocation_pools': [{'start': '158.4.188.2', 'end': '158.4.188.62'}], 'gateway_ip': '158.4.188.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '158.4.188.2', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:44,631 - INFO - Created VN ctest-right_vn-43988403 2025-08-28 03:04:44,641 - DEBUG - VN ctest-right_vn-43988403 UUID is 822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:44,712 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:44,719 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:44,732 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:44,827 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:44,838 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:44,846 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a11b2769-ddf1-4d50-a6a8-e01984ef6467 2025-08-28 03:04:44,855 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a11b2769-ddf1-4d50-a6a8-e01984ef6467 2025-08-28 03:04:44,862 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b8c7cfe2-6fdd-4cb3-86ad-450e6d1b16c1 2025-08-28 03:04:44,869 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:44,869 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:44,877 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a11b2769-ddf1-4d50-a6a8-e01984ef6467 2025-08-28 03:04:44,890 - INFO - Verified VN network id 14 for VN 822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:44,891 - INFO - Verifications in API Server for VN ctest-right_vn-43988403 passed 2025-08-28 03:04:44,891 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:44,900 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a11b2769-ddf1-4d50-a6a8-e01984ef6467 2025-08-28 03:04:44,907 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a11b2769-ddf1-4d50-a6a8-e01984ef6467 2025-08-28 03:04:44,914 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/b8c7cfe2-6fdd-4cb3-86ad-450e6d1b16c1 2025-08-28 03:04:44,928 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9379892184103076385', 'uuid-lslong': '11618709013562506938'}, 'enable': 'true', 'created': '2025-08-28T03:04:44', 'last-modified': '2025-08-28T03:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.680402'} 2025-08-28 03:04:44,943 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:44,949 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9379892184103076385', 'uuid-lslong': '11618709013562506938'}, 'enable': 'true', 'created': '2025-08-28T03:04:44', 'last-modified': '2025-08-28T03:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.701745'} 2025-08-28 03:04:44,957 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:44,962 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9379892184103076385', 'uuid-lslong': '11618709013562506938'}, 'enable': 'true', 'created': '2025-08-28T03:04:44', 'last-modified': '2025-08-28T03:04:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.717022'} 2025-08-28 03:04:44,969 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:44,969 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-43988403 passed 2025-08-28 03:04:44,969 - DEBUG - ====Verifying policy data for ctest-right_vn-43988403 in API_Server ====== 2025-08-28 03:04:44,969 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:44,978 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:44,991 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:45,084 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/822c123e-a0ed-4221-a13d-f24a0e05beba 2025-08-28 03:04:45,095 - DEBUG - =>VN ctest-right_vn-43988403 has no policy to be verified 2025-08-28 03:04:45,095 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:45,095 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:45,095 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:45,145 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403?flat'} 2025-08-28 03:04:45,145 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:45,145 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:45,156 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403?flat'} 2025-08-28 03:04:45,156 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:45,156 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:45,167 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403?flat'} 2025-08-28 03:04:45,167 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-43988403 is found in opserver 2025-08-28 03:04:45,189 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:45,200 - DEBUG - VRF ids for VN ctest-right_vn-43988403: {} 2025-08-28 03:04:45,250 - DEBUG - Services list from nova: [, , , ] 2025-08-28 03:04:46,235 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3956-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3956-1) 2025-08-28 03:04:47,442 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3956-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3956-2) 2025-08-28 03:04:47,442 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-88637224'] 2025-08-28 03:04:47,726 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-88637224'] created succesfully 2025-08-28 03:04:48,082 - DEBUG - Image by name tiny_nat_fw not found 2025-08-28 03:04:48,082 - DEBUG - Installing image tiny_nat_fw 2025-08-28 03:04:48,082 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-28 03:04:48,082 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-28 03:04:48,082 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-28 03:04:48,082 - DEBUG - Unzip image 2025-08-28 03:04:48,082 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-28 03:04:48,102 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-08-28 03:04:48,103 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-88637224'] 2025-08-28 03:04:48,210 - INFO - Service template: ['default-domain', 'ctest-service_template_1-88637224'] deleted successfully. 2025-08-28 03:04:48,210 - INFO - Skip interface_detach for VM ctest-right_vm-78729430 in state BUILD 2025-08-28 03:04:48,210 - INFO - Deleting VM ctest-right_vm-78729430 2025-08-28 03:04:48,247 - ERROR - VM ctest-right_vm-78729430 has failed to come up 2025-08-28 03:04:48,247 - ERROR - Nova failed to get host of the VM 2025-08-28 03:04:48,247 - ERROR - VM ctest-right_vm-78729430 has failed to come up 2025-08-28 03:04:48,247 - ERROR - Nova failed to get host of the VM 2025-08-28 03:04:48,355 - INFO - Skip interface_detach for VM ctest-left_vm-29932109 in state BUILD 2025-08-28 03:04:48,355 - INFO - Deleting VM ctest-left_vm-29932109 2025-08-28 03:04:48,355 - ERROR - VM ctest-left_vm-29932109 has failed to come up 2025-08-28 03:04:48,355 - ERROR - Nova failed to get host of the VM 2025-08-28 03:04:48,355 - ERROR - VM ctest-left_vm-29932109 has failed to come up 2025-08-28 03:04:48,355 - ERROR - Nova failed to get host of the VM 2025-08-28 03:04:48,420 - INFO - Deleting VN ctest-right_vn-43988403 2025-08-28 03:04:48,464 - DEBUG - VN 822c123e-a0ed-4221-a13d-f24a0e05beba still in use: Unable to complete operation on network 822c123e-a0ed-4221-a13d-f24a0e05beba. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-954c4a72-8598-400a-8d44-c65e4ffba9b4'] 2025-08-28 03:04:48,464 - WARNING - Deleting VN ctest-right_vn-43988403 failed..Will retry 2025-08-28 03:04:50,613 - DEBUG - Response for deleting network () 2025-08-28 03:04:50,613 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/a11b2769-ddf1-4d50-a6a8-e01984ef6467 2025-08-28 03:04:50,629 - DEBUG - Response Code: 404 2025-08-28 03:04:50,629 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:50,642 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:50,701 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:50,789 - INFO - Validated that VN ctest-right_vn-43988403 is not found in API Server 2025-08-28 03:04:50,800 - DEBUG - VN ctest-right_vn-43988403 is not present in Agent 10.0.0.65 2025-08-28 03:04:50,809 - DEBUG - VN ctest-right_vn-43988403 is not present in Agent 10.0.0.27 2025-08-28 03:04:50,809 - INFO - Validated that VN ctest-right_vn-43988403 is not in any agent 2025-08-28 03:04:50,839 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-43988403 info 2025-08-28 03:04:50,840 - INFO - Deleting VN ctest-left_vn-28128418 2025-08-28 03:04:50,998 - DEBUG - Response for deleting network () 2025-08-28 03:04:50,998 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/4eead340-5024-4014-b049-17d166b8f90f 2025-08-28 03:04:51,004 - DEBUG - Response Code: 404 2025-08-28 03:04:51,008 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:51,014 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:51,036 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:51,123 - INFO - Validated that VN ctest-left_vn-28128418 is not found in API Server 2025-08-28 03:04:51,133 - DEBUG - VN ctest-left_vn-28128418 is not present in Agent 10.0.0.65 2025-08-28 03:04:51,144 - DEBUG - VN ctest-left_vn-28128418 is not present in Agent 10.0.0.27 2025-08-28 03:04:51,144 - INFO - Validated that VN ctest-left_vn-28128418 is not in any agent 2025-08-28 03:04:51,171 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-28128418 info 2025-08-28 03:04:51,171 - INFO - Deleting VN ctest-mgmt_vn-51723572 2025-08-28 03:04:51,307 - DEBUG - Response for deleting network () 2025-08-28 03:04:51,307 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/8fb061d1-fe3a-4c84-8a7a-d166bc442be4 2025-08-28 03:04:51,314 - DEBUG - Response Code: 404 2025-08-28 03:04:51,314 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:51,323 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:51,342 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:51,439 - INFO - Validated that VN ctest-mgmt_vn-51723572 is not found in API Server 2025-08-28 03:04:51,450 - DEBUG - VN ctest-mgmt_vn-51723572 is not present in Agent 10.0.0.65 2025-08-28 03:04:51,462 - DEBUG - VN ctest-mgmt_vn-51723572 is not present in Agent 10.0.0.27 2025-08-28 03:04:51,462 - INFO - Validated that VN ctest-mgmt_vn-51723572 is not in any agent 2025-08-28 03:04:51,498 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-51723572 info 2025-08-28 03:04:52,769 - DEBUG - No XMPP flaps were noticed during the test 2025-08-28 03:04:52,769 - INFO -
2025-08-28 03:04:52,769 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14]
2025-08-28 03:04:52,769 - INFO - -------------------------------------------------------------------------------- 2025-08-28 03:04:52,772 - INFO - ================================================================================ 2025-08-28 03:04:52,772 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-08-28 03:04:54,028 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.17': '0', '10.20.0.254': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-28 03:04:54,028 - INFO - Initial checks done. Running the testcase now 2025-08-28 03:04:54,028 - INFO - 2025-08-28 03:04:54,279 - DEBUG - Response for create_network : {'network': {'id': 'dbd6c869-30a7-408f-b68d-8cdd8cb2a47a', 'name': 'ctest-mgmt_vn-64263954', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-mgmt_vn-64263954'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:54,512 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab174f51-afa9-4a80-961c-732c467e6f07', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': 'dbd6c869-30a7-408f-b68d-8cdd8cb2a47a', 'ip_version': 4, 'cidr': '4.38.89.128/26', 'allocation_pools': [{'start': '4.38.89.130', 'end': '4.38.89.190'}], 'gateway_ip': '4.38.89.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.38.89.130', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:54,531 - INFO - Created VN ctest-mgmt_vn-64263954 2025-08-28 03:04:54,541 - DEBUG - VN ctest-mgmt_vn-64263954 UUID is dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,608 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:54,614 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:54,625 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:54,719 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,730 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,738 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/295068e2-2f3b-471b-9183-1e1d07ee844f 2025-08-28 03:04:54,744 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/295068e2-2f3b-471b-9183-1e1d07ee844f 2025-08-28 03:04:54,750 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/6e49595d-9cf9-4479-9a95-3bb80ae2afa7 2025-08-28 03:04:54,755 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:54,755 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,763 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/295068e2-2f3b-471b-9183-1e1d07ee844f 2025-08-28 03:04:54,779 - INFO - Verified VN network id 12 for VN dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,779 - INFO - Verifications in API Server for VN ctest-mgmt_vn-64263954 passed 2025-08-28 03:04:54,779 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,787 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/295068e2-2f3b-471b-9183-1e1d07ee844f 2025-08-28 03:04:54,793 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/295068e2-2f3b-471b-9183-1e1d07ee844f 2025-08-28 03:04:54,799 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/6e49595d-9cf9-4479-9a95-3bb80ae2afa7 2025-08-28 03:04:54,811 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15841069093435687055', 'uuid-lslong': '13154324969795265658'}, 'enable': 'true', 'created': '2025-08-28T03:04:54', 'last-modified': '2025-08-28T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.346812'} 2025-08-28 03:04:54,818 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:54,823 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15841069093435687055', 'uuid-lslong': '13154324969795265658'}, 'enable': 'true', 'created': '2025-08-28T03:04:54', 'last-modified': '2025-08-28T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.359462'} 2025-08-28 03:04:54,828 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:54,834 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15841069093435687055', 'uuid-lslong': '13154324969795265658'}, 'enable': 'true', 'created': '2025-08-28T03:04:54', 'last-modified': '2025-08-28T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367724'} 2025-08-28 03:04:54,840 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-28 03:04:54,840 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-64263954 passed 2025-08-28 03:04:54,840 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-64263954 in API_Server ====== 2025-08-28 03:04:54,840 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:54,846 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:54,855 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:54,949 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/dbd6c869-30a7-408f-b68d-8cdd8cb2a47a 2025-08-28 03:04:54,962 - DEBUG - =>VN ctest-mgmt_vn-64263954 has no policy to be verified 2025-08-28 03:04:54,962 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:54,962 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:54,962 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:54,974 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954?flat'} 2025-08-28 03:04:54,974 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:54,974 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:54,986 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954?flat'} 2025-08-28 03:04:54,986 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:54,986 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:54,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954?flat'} 2025-08-28 03:04:54,997 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-mgmt_vn-64263954 is found in opserver 2025-08-28 03:04:55,016 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:55,024 - DEBUG - VRF ids for VN ctest-mgmt_vn-64263954: {} 2025-08-28 03:04:55,271 - DEBUG - Response for create_network : {'network': {'id': 'c6130023-d0fc-4748-8870-dcdc3445fcb7', 'name': 'ctest-left_vn-84047017', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-left_vn-84047017'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:55,482 - DEBUG - Response for create_subnet : {'subnet': {'id': '1f63992d-cdfc-4eed-b48f-52a51f75f112', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': 'c6130023-d0fc-4748-8870-dcdc3445fcb7', 'ip_version': 4, 'cidr': '219.119.155.128/26', 'allocation_pools': [{'start': '219.119.155.130', 'end': '219.119.155.190'}], 'gateway_ip': '219.119.155.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.119.155.130', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:55,503 - INFO - Created VN ctest-left_vn-84047017 2025-08-28 03:04:55,516 - DEBUG - VN ctest-left_vn-84047017 UUID is c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,584 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:55,591 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:55,603 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:55,688 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,698 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,707 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bdacb77b-46b0-4b69-ba15-d2c242eeca10 2025-08-28 03:04:55,715 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bdacb77b-46b0-4b69-ba15-d2c242eeca10 2025-08-28 03:04:55,722 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/010c9ace-701e-48d6-ae9d-90b8ef91062a 2025-08-28 03:04:55,728 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:55,728 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,736 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bdacb77b-46b0-4b69-ba15-d2c242eeca10 2025-08-28 03:04:55,750 - INFO - Verified VN network id 13 for VN c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,750 - INFO - Verifications in API Server for VN ctest-left_vn-84047017 passed 2025-08-28 03:04:55,750 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,759 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bdacb77b-46b0-4b69-ba15-d2c242eeca10 2025-08-28 03:04:55,766 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bdacb77b-46b0-4b69-ba15-d2c242eeca10 2025-08-28 03:04:55,773 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/010c9ace-701e-48d6-ae9d-90b8ef91062a 2025-08-28 03:04:55,785 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14272751797897283400', 'uuid-lslong': '9831600824877710519'}, 'enable': 'true', 'created': '2025-08-28T03:04:55', 'last-modified': '2025-08-28T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.352093'} 2025-08-28 03:04:55,790 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:55,795 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14272751797897283400', 'uuid-lslong': '9831600824877710519'}, 'enable': 'true', 'created': '2025-08-28T03:04:55', 'last-modified': '2025-08-28T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.366729'} 2025-08-28 03:04:55,801 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:55,805 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14272751797897283400', 'uuid-lslong': '9831600824877710519'}, 'enable': 'true', 'created': '2025-08-28T03:04:55', 'last-modified': '2025-08-28T03:04:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372547'} 2025-08-28 03:04:55,810 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-28 03:04:55,810 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-84047017 passed 2025-08-28 03:04:55,810 - DEBUG - ====Verifying policy data for ctest-left_vn-84047017 in API_Server ====== 2025-08-28 03:04:55,810 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:55,816 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:55,826 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:55,914 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/c6130023-d0fc-4748-8870-dcdc3445fcb7 2025-08-28 03:04:55,923 - DEBUG - =>VN ctest-left_vn-84047017 has no policy to be verified 2025-08-28 03:04:55,923 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:55,923 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:55,923 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:55,935 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017?flat'} 2025-08-28 03:04:55,935 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:55,935 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:55,990 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017?flat'} 2025-08-28 03:04:55,990 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:55,990 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:56,043 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017?flat'} 2025-08-28 03:04:56,044 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-left_vn-84047017 is found in opserver 2025-08-28 03:04:56,063 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:56,073 - DEBUG - VRF ids for VN ctest-left_vn-84047017: {} 2025-08-28 03:04:56,315 - DEBUG - Response for create_network : {'network': {'id': '8e0ebf74-26ec-41b0-a7d2-031c965310a4', 'name': 'ctest-right_vn-62039768', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-right_vn-62039768'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:56,614 - DEBUG - Response for create_subnet : {'subnet': {'id': '7c355b15-3a10-4c0c-b0b5-c950be731bd5', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': '8e0ebf74-26ec-41b0-a7d2-031c965310a4', 'ip_version': 4, 'cidr': '94.193.224.128/26', 'allocation_pools': [{'start': '94.193.224.130', 'end': '94.193.224.190'}], 'gateway_ip': '94.193.224.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '94.193.224.130', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:56,638 - INFO - Created VN ctest-right_vn-62039768 2025-08-28 03:04:56,653 - DEBUG - VN ctest-right_vn-62039768 UUID is 8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:56,728 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:56,735 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:56,747 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:56,845 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:56,857 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:56,865 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/055849e6-ed8a-4fb0-bfc9-7c62cad4792a 2025-08-28 03:04:56,872 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/055849e6-ed8a-4fb0-bfc9-7c62cad4792a 2025-08-28 03:04:56,879 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/93bbbdf0-2730-4bc5-b2a8-33d8335dc149 2025-08-28 03:04:56,885 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:56,885 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:56,894 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/055849e6-ed8a-4fb0-bfc9-7c62cad4792a 2025-08-28 03:04:56,908 - INFO - Verified VN network id 14 for VN 8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:56,908 - INFO - Verifications in API Server for VN ctest-right_vn-62039768 passed 2025-08-28 03:04:56,908 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:56,918 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/055849e6-ed8a-4fb0-bfc9-7c62cad4792a 2025-08-28 03:04:56,924 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/055849e6-ed8a-4fb0-bfc9-7c62cad4792a 2025-08-28 03:04:56,931 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/93bbbdf0-2730-4bc5-b2a8-33d8335dc149 2025-08-28 03:04:56,943 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10236329508649845168', 'uuid-lslong': '12092731370759196836'}, 'enable': 'true', 'created': '2025-08-28T03:04:56', 'last-modified': '2025-08-28T03:04:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.409852'} 2025-08-28 03:04:56,948 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:56,953 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10236329508649845168', 'uuid-lslong': '12092731370759196836'}, 'enable': 'true', 'created': '2025-08-28T03:04:56', 'last-modified': '2025-08-28T03:04:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419492'} 2025-08-28 03:04:56,958 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:56,963 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10236329508649845168', 'uuid-lslong': '12092731370759196836'}, 'enable': 'true', 'created': '2025-08-28T03:04:56', 'last-modified': '2025-08-28T03:04:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430818'} 2025-08-28 03:04:56,968 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-28 03:04:56,968 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-62039768 passed 2025-08-28 03:04:56,968 - DEBUG - ====Verifying policy data for ctest-right_vn-62039768 in API_Server ====== 2025-08-28 03:04:56,968 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:56,974 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:56,986 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:57,075 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8e0ebf74-26ec-41b0-a7d2-031c965310a4 2025-08-28 03:04:57,085 - DEBUG - =>VN ctest-right_vn-62039768 has no policy to be verified 2025-08-28 03:04:57,085 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:57,085 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:57,085 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:57,096 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768?flat'} 2025-08-28 03:04:57,096 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:57,096 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:57,109 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768?flat'} 2025-08-28 03:04:57,109 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:57,109 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:57,121 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768?flat'} 2025-08-28 03:04:57,121 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-right_vn-62039768 is found in opserver 2025-08-28 03:04:57,139 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:57,149 - DEBUG - VRF ids for VN ctest-right_vn-62039768: {} 2025-08-28 03:04:57,425 - DEBUG - Response for create_network : {'network': {'id': 'b135167a-4826-4855-9ac6-eb32e7846930', 'name': 'ctest-trans_left_vn-62827015', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-trans_left_vn-62827015'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:57,653 - DEBUG - Response for create_subnet : {'subnet': {'id': '94a8332e-cff3-4f62-882a-06c9cd51bc3f', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': 'b135167a-4826-4855-9ac6-eb32e7846930', 'ip_version': 4, 'cidr': '82.35.143.0/26', 'allocation_pools': [{'start': '82.35.143.2', 'end': '82.35.143.62'}], 'gateway_ip': '82.35.143.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '82.35.143.2', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:57,674 - INFO - Created VN ctest-trans_left_vn-62827015 2025-08-28 03:04:57,683 - DEBUG - VN ctest-trans_left_vn-62827015 UUID is b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:57,751 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:57,758 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:57,774 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:57,858 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:57,871 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:57,880 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/49e75d12-d3fb-4f96-832e-31d689268fb8 2025-08-28 03:04:57,886 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/49e75d12-d3fb-4f96-832e-31d689268fb8 2025-08-28 03:04:57,892 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/066ec300-d428-4dad-b9d8-834877184a03 2025-08-28 03:04:57,897 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-28 03:04:57,898 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:57,906 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/49e75d12-d3fb-4f96-832e-31d689268fb8 2025-08-28 03:04:57,920 - INFO - Verified VN network id 15 for VN b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:57,920 - INFO - Verifications in API Server for VN ctest-trans_left_vn-62827015 passed 2025-08-28 03:04:57,920 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:57,929 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/49e75d12-d3fb-4f96-832e-31d689268fb8 2025-08-28 03:04:57,936 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/49e75d12-d3fb-4f96-832e-31d689268fb8 2025-08-28 03:04:57,942 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/066ec300-d428-4dad-b9d8-834877184a03 2025-08-28 03:04:57,953 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12769137032931199061', 'uuid-lslong': '11152860131094718768'}, 'enable': 'true', 'created': '2025-08-28T03:04:57', 'last-modified': '2025-08-28T03:04:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.342890'} 2025-08-28 03:04:57,959 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-28 03:04:57,965 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12769137032931199061', 'uuid-lslong': '11152860131094718768'}, 'enable': 'true', 'created': '2025-08-28T03:04:57', 'last-modified': '2025-08-28T03:04:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364217'} 2025-08-28 03:04:57,970 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-28 03:04:57,975 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12769137032931199061', 'uuid-lslong': '11152860131094718768'}, 'enable': 'true', 'created': '2025-08-28T03:04:57', 'last-modified': '2025-08-28T03:04:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.369773'} 2025-08-28 03:04:57,980 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-28 03:04:57,981 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-62827015 passed 2025-08-28 03:04:57,981 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-62827015 in API_Server ====== 2025-08-28 03:04:57,981 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:57,988 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:57,997 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:58,091 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/b135167a-4826-4855-9ac6-eb32e7846930 2025-08-28 03:04:58,100 - DEBUG - =>VN ctest-trans_left_vn-62827015 has no policy to be verified 2025-08-28 03:04:58,100 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:58,100 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:58,101 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:58,113 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015?flat'} 2025-08-28 03:04:58,114 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:58,114 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:58,126 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015?flat'} 2025-08-28 03:04:58,126 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:58,126 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:58,137 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015?flat'} 2025-08-28 03:04:58,137 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-trans_left_vn-62827015 is found in opserver 2025-08-28 03:04:58,157 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:58,166 - DEBUG - VRF ids for VN ctest-trans_left_vn-62827015: {} 2025-08-28 03:04:58,408 - DEBUG - Response for create_network : {'network': {'id': '1e19eb07-bad0-4b43-ac25-965ba0197f4c', 'name': 'ctest-trans_right_vn-04069970', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'project_id': '384149b49e804daba5e91f57eb2463e0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-19454889', 'ctest-trans_right_vn-04069970'], 'port_security_enabled': True, 'description': ''}} 2025-08-28 03:04:58,653 - DEBUG - Response for create_subnet : {'subnet': {'id': '2b11de0a-01a0-4c28-8bdd-d9f36b9c145b', 'name': '', 'tenant_id': '384149b49e804daba5e91f57eb2463e0', 'network_id': '1e19eb07-bad0-4b43-ac25-965ba0197f4c', 'ip_version': 4, 'cidr': '149.241.48.64/26', 'allocation_pools': [{'start': '149.241.48.66', 'end': '149.241.48.126'}], 'gateway_ip': '149.241.48.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.241.48.66', 'tags': [], 'project_id': '384149b49e804daba5e91f57eb2463e0'}} 2025-08-28 03:04:58,680 - INFO - Created VN ctest-trans_right_vn-04069970 2025-08-28 03:04:58,690 - DEBUG - VN ctest-trans_right_vn-04069970 UUID is 1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:58,761 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:58,768 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:58,781 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:58,871 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:58,884 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:58,895 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/fe19ef97-c4a0-4b6b-8d35-65aaf32c97a7 2025-08-28 03:04:58,905 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/fe19ef97-c4a0-4b6b-8d35-65aaf32c97a7 2025-08-28 03:04:58,912 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/37425d69-c657-49c2-860c-2cb77fe6ef0d 2025-08-28 03:04:58,918 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-28 03:04:58,918 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:58,927 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/fe19ef97-c4a0-4b6b-8d35-65aaf32c97a7 2025-08-28 03:04:58,941 - INFO - Verified VN network id 16 for VN 1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:58,941 - INFO - Verifications in API Server for VN ctest-trans_right_vn-04069970 passed 2025-08-28 03:04:58,942 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:58,951 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/fe19ef97-c4a0-4b6b-8d35-65aaf32c97a7 2025-08-28 03:04:58,958 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/fe19ef97-c4a0-4b6b-8d35-65aaf32c97a7 2025-08-28 03:04:58,966 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/37425d69-c657-49c2-860c-2cb77fe6ef0d 2025-08-28 03:04:58,976 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2169023113987115843', 'uuid-lslong': '12404486068934115148'}, 'enable': 'true', 'created': '2025-08-28T03:04:58', 'last-modified': '2025-08-28T03:04:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.372602'} 2025-08-28 03:04:58,981 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-28 03:04:58,986 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2169023113987115843', 'uuid-lslong': '12404486068934115148'}, 'enable': 'true', 'created': '2025-08-28T03:04:58', 'last-modified': '2025-08-28T03:04:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384530'} 2025-08-28 03:04:58,993 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-28 03:04:58,997 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-19454889', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2169023113987115843', 'uuid-lslong': '12404486068934115148'}, 'enable': 'true', 'created': '2025-08-28T03:04:58', 'last-modified': '2025-08-28T03:04:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396224'} 2025-08-28 03:04:59,003 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-28 03:04:59,003 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-04069970 passed 2025-08-28 03:04:59,003 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-04069970 in API_Server ====== 2025-08-28 03:04:59,003 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:04:59,009 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:04:59,020 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:04:59,121 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1e19eb07-bad0-4b43-ac25-965ba0197f4c 2025-08-28 03:04:59,131 - DEBUG - =>VN ctest-trans_right_vn-04069970 has no policy to be verified 2025-08-28 03:04:59,131 - DEBUG - Verifying the vn in opserver 2025-08-28 03:04:59,132 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970 virtual network link through opserver 10.0.0.19 2025-08-28 03:04:59,132 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-28 03:04:59,143 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970?flat'} 2025-08-28 03:04:59,143 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970 virtual network link through opserver 10.0.0.38 2025-08-28 03:04:59,143 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-28 03:04:59,155 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970?flat'} 2025-08-28 03:04:59,155 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970 virtual network link through opserver 10.0.0.41 2025-08-28 03:04:59,155 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-08-28 03:04:59,166 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970?flat'} 2025-08-28 03:04:59,166 - INFO - Validated that VN default-domain:ctest-TestSvcHC-19454889:ctest-trans_right_vn-04069970 is found in opserver 2025-08-28 03:04:59,185 - DEBUG - Do not have enough data to verify VN in agent 2025-08-28 03:04:59,193 - DEBUG - VRF ids for VN ctest-trans_right_vn-04069970: {} 2025-08-28 03:05:00,250 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3956-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3956-2) 2025-08-28 03:05:01,595 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3956-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3956-1) 2025-08-28 03:05:01,596 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-71470928'] 2025-08-28 03:05:01,904 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-71470928'] created succesfully 2025-08-28 03:05:02,282 - DEBUG - Image by name tiny_trans_fw not found 2025-08-28 03:05:02,282 - DEBUG - Installing image tiny_trans_fw 2025-08-28 03:05:02,282 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-28 03:05:02,282 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-28 03:05:02,282 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-28 03:05:02,282 - DEBUG - Unzip image 2025-08-28 03:05:02,282 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-28 03:05:02,300 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-08-28 03:05:02,301 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-71470928'] 2025-08-28 03:05:02,393 - INFO - Service template: ['default-domain', 'ctest-service_template_1-71470928'] deleted successfully. 2025-08-28 03:05:02,394 - INFO - Skip interface_detach for VM ctest-right_vm-31266673 in state BUILD 2025-08-28 03:05:02,394 - INFO - Deleting VM ctest-right_vm-31266673 2025-08-28 03:05:02,394 - ERROR - VM ctest-right_vm-31266673 has failed to come up 2025-08-28 03:05:02,394 - ERROR - Nova failed to get host of the VM 2025-08-28 03:05:02,394 - ERROR - VM ctest-right_vm-31266673 has failed to come up 2025-08-28 03:05:02,394 - ERROR - Nova failed to get host of the VM 2025-08-28 03:05:02,515 - INFO - Skip interface_detach for VM ctest-left_vm-51731687 in state BUILD 2025-08-28 03:05:02,516 - INFO - Deleting VM ctest-left_vm-51731687 2025-08-28 03:05:02,516 - ERROR - VM ctest-left_vm-51731687 has failed to come up 2025-08-28 03:05:02,516 - ERROR - Nova failed to get host of the VM 2025-08-28 03:05:02,516 - ERROR - VM ctest-left_vm-51731687 has failed to come up 2025-08-28 03:05:02,516 - ERROR - Nova failed to get host of the VM 2025-08-28 03:05:02,620 - INFO - Deleting VN ctest-trans_right_vn-04069970 2025-08-28 03:05:02,787 - DEBUG - Response for deleting network () 2025-08-28 03:05:02,788 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/fe19ef97-c4a0-4b6b-8d35-65aaf32c97a7 2025-08-28 03:05:02,793 - DEBUG - Response Code: 404 2025-08-28 03:05:02,793 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:05:02,798 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:05:02,823 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:05:02,917 - INFO - Validated that VN ctest-trans_right_vn-04069970 is not found in API Server 2025-08-28 03:05:02,969 - DEBUG - VN ctest-trans_right_vn-04069970 is not present in Agent 10.0.0.65 2025-08-28 03:05:02,979 - DEBUG - VN ctest-trans_right_vn-04069970 is not present in Agent 10.0.0.27 2025-08-28 03:05:02,979 - INFO - Validated that VN ctest-trans_right_vn-04069970 is not in any agent 2025-08-28 03:05:03,012 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-04069970 info 2025-08-28 03:05:03,012 - INFO - Deleting VN ctest-trans_left_vn-62827015 2025-08-28 03:05:03,193 - DEBUG - Response for deleting network () 2025-08-28 03:05:03,193 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/49e75d12-d3fb-4f96-832e-31d689268fb8 2025-08-28 03:05:03,222 - DEBUG - Response Code: 404 2025-08-28 03:05:03,223 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:05:03,233 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:05:03,250 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:05:03,369 - INFO - Validated that VN ctest-trans_left_vn-62827015 is not found in API Server 2025-08-28 03:05:03,403 - DEBUG - VN ctest-trans_left_vn-62827015 is not present in Agent 10.0.0.65 2025-08-28 03:05:03,415 - DEBUG - VN ctest-trans_left_vn-62827015 is not present in Agent 10.0.0.27 2025-08-28 03:05:03,415 - INFO - Validated that VN ctest-trans_left_vn-62827015 is not in any agent 2025-08-28 03:05:03,479 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-62827015 info 2025-08-28 03:05:03,479 - INFO - Deleting VN ctest-right_vn-62039768 2025-08-28 03:05:03,537 - DEBUG - VN 8e0ebf74-26ec-41b0-a7d2-031c965310a4 still in use: Unable to complete operation on network 8e0ebf74-26ec-41b0-a7d2-031c965310a4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-5a018189-47a4-4538-8176-b9b5f3b91df7'] 2025-08-28 03:05:03,538 - WARNING - Deleting VN ctest-right_vn-62039768 failed..Will retry 2025-08-28 03:05:05,686 - DEBUG - Response for deleting network () 2025-08-28 03:05:05,687 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/055849e6-ed8a-4fb0-bfc9-7c62cad4792a 2025-08-28 03:05:05,692 - DEBUG - Response Code: 404 2025-08-28 03:05:05,692 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:05:05,702 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:05:05,718 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:05:05,813 - INFO - Validated that VN ctest-right_vn-62039768 is not found in API Server 2025-08-28 03:05:05,823 - DEBUG - VN ctest-right_vn-62039768 is not present in Agent 10.0.0.65 2025-08-28 03:05:05,832 - DEBUG - VN ctest-right_vn-62039768 is not present in Agent 10.0.0.27 2025-08-28 03:05:05,832 - INFO - Validated that VN ctest-right_vn-62039768 is not in any agent 2025-08-28 03:05:05,863 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-62039768 info 2025-08-28 03:05:05,863 - INFO - Deleting VN ctest-left_vn-84047017 2025-08-28 03:05:06,007 - DEBUG - Response for deleting network () 2025-08-28 03:05:06,007 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/bdacb77b-46b0-4b69-ba15-d2c242eeca10 2025-08-28 03:05:06,014 - DEBUG - Response Code: 404 2025-08-28 03:05:06,014 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:05:06,020 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:05:06,036 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:05:06,125 - INFO - Validated that VN ctest-left_vn-84047017 is not found in API Server 2025-08-28 03:05:06,135 - DEBUG - VN ctest-left_vn-84047017 is not present in Agent 10.0.0.65 2025-08-28 03:05:06,146 - DEBUG - VN ctest-left_vn-84047017 is not present in Agent 10.0.0.27 2025-08-28 03:05:06,146 - INFO - Validated that VN ctest-left_vn-84047017 is not in any agent 2025-08-28 03:05:06,178 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-84047017 info 2025-08-28 03:05:06,178 - INFO - Deleting VN ctest-mgmt_vn-64263954 2025-08-28 03:05:06,326 - DEBUG - Response for deleting network () 2025-08-28 03:05:06,326 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/295068e2-2f3b-471b-9183-1e1d07ee844f 2025-08-28 03:05:06,332 - DEBUG - Response Code: 404 2025-08-28 03:05:06,332 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-08-28 03:05:06,349 - DEBUG - Requesting: http://10.0.0.19:8082/domain/692c5a68-a199-4232-a07c-1cd4918de9d4 2025-08-28 03:05:06,403 - DEBUG - Requesting: http://10.0.0.19:8082/project/384149b4-9e80-4dab-a5e9-1f57eb2463e0 2025-08-28 03:05:06,496 - INFO - Validated that VN ctest-mgmt_vn-64263954 is not found in API Server 2025-08-28 03:05:06,519 - DEBUG - VN ctest-mgmt_vn-64263954 is not present in Agent 10.0.0.65 2025-08-28 03:05:06,532 - DEBUG - VN ctest-mgmt_vn-64263954 is not present in Agent 10.0.0.27 2025-08-28 03:05:06,532 - INFO - Validated that VN ctest-mgmt_vn-64263954 is not in any agent 2025-08-28 03:05:06,564 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-64263954 info 2025-08-28 03:05:07,833 - DEBUG - No XMPP flaps were noticed during the test 2025-08-28 03:05:07,834 - INFO -
2025-08-28 03:05:07,834 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]
2025-08-28 03:05:07,834 - INFO - -------------------------------------------------------------------------------- 2025-08-28 03:05:08,563 - INFO - Deleted project: ctest-TestSvcHC-19454889, ID : 384149b4-9e80-4dab-a5e9-1f57eb2463e0