2025-08-11 17:05:48,871 - INFO - Domain Default found not creating 2025-08-11 17:05:49,009 - INFO - Project ctest-TestSvcHC-27378307 not found, creating it 2025-08-11 17:05:49,527 - INFO - Created Project:ctest-TestSvcHC-27378307, ID : 787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:50,943 - INFO - ================================================================================ 2025-08-11 17:05:50,943 - INFO - STARTING TEST : test_svc_hc_basic 2025-08-11 17:05:52,211 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.192': '0', '10.20.0.193': '0'}, '10.0.0.249': {'10.20.0.193': '0', '10.20.0.192': '0'}} with 2025-08-11 17:05:52,211 - INFO - Initial checks done. Running the testcase now 2025-08-11 17:05:52,211 - INFO - 2025-08-11 17:05:52,877 - DEBUG - Response for create_network : {'network': {'id': 'f36819d1-2efa-47e7-9375-c08a0aeeecfc', 'name': 'ctest-mgmt_vn-25520112', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-mgmt_vn-25520112'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:05:53,117 - DEBUG - Response for create_subnet : {'subnet': {'id': '034b38b4-0545-46a3-9aeb-fa49f5d0039a', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': 'f36819d1-2efa-47e7-9375-c08a0aeeecfc', 'ip_version': 4, 'cidr': '95.150.55.128/26', 'allocation_pools': [{'start': '95.150.55.130', 'end': '95.150.55.190'}], 'gateway_ip': '95.150.55.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '95.150.55.130', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:05:53,140 - INFO - Created VN ctest-mgmt_vn-25520112 2025-08-11 17:05:53,155 - DEBUG - VN ctest-mgmt_vn-25520112 UUID is f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,221 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:53,510 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:53,536 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:05:53,553 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:53,642 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,662 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,671 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fcad425e-d8ab-4c61-a548-9e25006037b4 2025-08-11 17:05:53,678 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fcad425e-d8ab-4c61-a548-9e25006037b4 2025-08-11 17:05:53,685 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5b1a3748-1d98-40dc-92ba-e061f2ebfe6e 2025-08-11 17:05:53,693 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:05:53,693 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,704 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fcad425e-d8ab-4c61-a548-9e25006037b4 2025-08-11 17:05:53,720 - INFO - Verified VN network id 12 for VN f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,721 - INFO - Verifications in API Server for VN ctest-mgmt_vn-25520112 passed 2025-08-11 17:05:53,721 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,730 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fcad425e-d8ab-4c61-a548-9e25006037b4 2025-08-11 17:05:53,738 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fcad425e-d8ab-4c61-a548-9e25006037b4 2025-08-11 17:05:53,746 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5b1a3748-1d98-40dc-92ba-e061f2ebfe6e 2025-08-11 17:05:53,759 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17539297135021410279', 'uuid-lslong': '10625610594972003580'}, 'enable': 'true', 'created': '2025-08-11T17:05:52', 'last-modified': '2025-08-11T17:05:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.701066'} 2025-08-11 17:05:53,766 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:05:53,773 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17539297135021410279', 'uuid-lslong': '10625610594972003580'}, 'enable': 'true', 'created': '2025-08-11T17:05:52', 'last-modified': '2025-08-11T17:05:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.715814'} 2025-08-11 17:05:53,779 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:05:53,784 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17539297135021410279', 'uuid-lslong': '10625610594972003580'}, 'enable': 'true', 'created': '2025-08-11T17:05:52', 'last-modified': '2025-08-11T17:05:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.726539'} 2025-08-11 17:05:53,791 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:05:53,791 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-25520112 passed 2025-08-11 17:05:53,791 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-25520112 in API_Server ====== 2025-08-11 17:05:53,791 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:53,797 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:05:53,810 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:53,895 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/f36819d1-2efa-47e7-9375-c08a0aeeecfc 2025-08-11 17:05:53,917 - DEBUG - =>VN ctest-mgmt_vn-25520112 has no policy to be verified 2025-08-11 17:05:53,917 - DEBUG - Verifying the vn in opserver 2025-08-11 17:05:53,917 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112 virtual network link through opserver 10.0.0.27 2025-08-11 17:05:53,917 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:05:54,208 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:05:54,256 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112?flat'} 2025-08-11 17:05:54,256 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112 virtual network link through opserver 10.0.0.23 2025-08-11 17:05:54,256 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:05:54,543 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:05:54,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112?flat'} 2025-08-11 17:05:54,595 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112 virtual network link through opserver 10.0.0.19 2025-08-11 17:05:54,595 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:05:54,882 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:05:54,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112?flat'} 2025-08-11 17:05:54,932 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-25520112 is found in opserver 2025-08-11 17:05:54,953 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:05:54,962 - DEBUG - VRF ids for VN ctest-mgmt_vn-25520112: {} 2025-08-11 17:05:55,200 - DEBUG - Response for create_network : {'network': {'id': 'fae5f25f-3563-41f9-839d-7cf8073ec5d9', 'name': 'ctest-left_vn-89855541', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-left_vn-89855541'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:05:55,394 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c9f9465f-1d90-4cc8-9b9b-945378d5692a', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': 'fae5f25f-3563-41f9-839d-7cf8073ec5d9', 'ip_version': 4, 'cidr': '150.204.237.192/26', 'allocation_pools': [{'start': '150.204.237.194', 'end': '150.204.237.254'}], 'gateway_ip': '150.204.237.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '150.204.237.194', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:05:55,424 - INFO - Created VN ctest-left_vn-89855541 2025-08-11 17:05:55,437 - DEBUG - VN ctest-left_vn-89855541 UUID is fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,503 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:55,508 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:05:55,520 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:55,621 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,632 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,644 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bffdc201-389e-469e-a9f4-c1657ae092a9 2025-08-11 17:05:55,651 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bffdc201-389e-469e-a9f4-c1657ae092a9 2025-08-11 17:05:55,658 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/890b0e70-d3b7-4469-ae2c-702f6950d19b 2025-08-11 17:05:55,667 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:05:55,667 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,676 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bffdc201-389e-469e-a9f4-c1657ae092a9 2025-08-11 17:05:55,692 - INFO - Verified VN network id 13 for VN fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,692 - INFO - Verifications in API Server for VN ctest-left_vn-89855541 passed 2025-08-11 17:05:55,692 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,702 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bffdc201-389e-469e-a9f4-c1657ae092a9 2025-08-11 17:05:55,708 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bffdc201-389e-469e-a9f4-c1657ae092a9 2025-08-11 17:05:55,715 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/890b0e70-d3b7-4469-ae2c-702f6950d19b 2025-08-11 17:05:55,726 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18079122769880236537', 'uuid-lslong': '9483873795027420633'}, 'enable': 'true', 'created': '2025-08-11T17:05:55', 'last-modified': '2025-08-11T17:05:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.365334'} 2025-08-11 17:05:55,731 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:05:55,737 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18079122769880236537', 'uuid-lslong': '9483873795027420633'}, 'enable': 'true', 'created': '2025-08-11T17:05:55', 'last-modified': '2025-08-11T17:05:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376343'} 2025-08-11 17:05:55,742 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:05:55,748 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18079122769880236537', 'uuid-lslong': '9483873795027420633'}, 'enable': 'true', 'created': '2025-08-11T17:05:55', 'last-modified': '2025-08-11T17:05:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391716'} 2025-08-11 17:05:55,755 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:05:55,755 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-89855541 passed 2025-08-11 17:05:55,755 - DEBUG - ====Verifying policy data for ctest-left_vn-89855541 in API_Server ====== 2025-08-11 17:05:55,755 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:55,761 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:05:55,772 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:55,854 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/fae5f25f-3563-41f9-839d-7cf8073ec5d9 2025-08-11 17:05:55,868 - DEBUG - =>VN ctest-left_vn-89855541 has no policy to be verified 2025-08-11 17:05:55,868 - DEBUG - Verifying the vn in opserver 2025-08-11 17:05:55,868 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541 virtual network link through opserver 10.0.0.27 2025-08-11 17:05:55,868 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:05:55,927 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541?flat'} 2025-08-11 17:05:55,927 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541 virtual network link through opserver 10.0.0.23 2025-08-11 17:05:55,927 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:05:55,974 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541?flat'} 2025-08-11 17:05:55,974 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541 virtual network link through opserver 10.0.0.19 2025-08-11 17:05:55,974 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:05:56,021 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541?flat'} 2025-08-11 17:05:56,021 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-89855541 is found in opserver 2025-08-11 17:05:56,042 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:05:56,052 - DEBUG - VRF ids for VN ctest-left_vn-89855541: {} 2025-08-11 17:05:56,303 - DEBUG - Response for create_network : {'network': {'id': '215f8cce-d6f9-4d8e-a305-cfdb16a7a09a', 'name': 'ctest-right_vn-69226989', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-right_vn-69226989'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:05:56,511 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a05ef373-6e31-4a76-9075-15e32c481d7c', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': '215f8cce-d6f9-4d8e-a305-cfdb16a7a09a', 'ip_version': 4, 'cidr': '112.192.168.192/26', 'allocation_pools': [{'start': '112.192.168.194', 'end': '112.192.168.254'}], 'gateway_ip': '112.192.168.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '112.192.168.194', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:05:56,532 - INFO - Created VN ctest-right_vn-69226989 2025-08-11 17:05:56,544 - DEBUG - VN ctest-right_vn-69226989 UUID is 215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,607 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:56,612 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:05:56,622 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:56,708 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,722 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,732 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8fa129a2-2878-4c2d-ad06-8bc7edb310e6 2025-08-11 17:05:56,740 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8fa129a2-2878-4c2d-ad06-8bc7edb310e6 2025-08-11 17:05:56,748 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/9f5f6e71-af25-4f41-8f0a-5228fbe3fe61 2025-08-11 17:05:56,755 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:05:56,755 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,764 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8fa129a2-2878-4c2d-ad06-8bc7edb310e6 2025-08-11 17:05:56,779 - INFO - Verified VN network id 14 for VN 215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,779 - INFO - Verifications in API Server for VN ctest-right_vn-69226989 passed 2025-08-11 17:05:56,779 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,788 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8fa129a2-2878-4c2d-ad06-8bc7edb310e6 2025-08-11 17:05:56,794 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8fa129a2-2878-4c2d-ad06-8bc7edb310e6 2025-08-11 17:05:56,800 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/9f5f6e71-af25-4f41-8f0a-5228fbe3fe61 2025-08-11 17:05:56,812 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2404795546036948366', 'uuid-lslong': '11747023742950678682'}, 'enable': 'true', 'created': '2025-08-11T17:05:56', 'last-modified': '2025-08-11T17:05:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.343581'} 2025-08-11 17:05:56,818 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:05:56,823 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2404795546036948366', 'uuid-lslong': '11747023742950678682'}, 'enable': 'true', 'created': '2025-08-11T17:05:56', 'last-modified': '2025-08-11T17:05:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.359684'} 2025-08-11 17:05:56,829 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:05:56,835 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2404795546036948366', 'uuid-lslong': '11747023742950678682'}, 'enable': 'true', 'created': '2025-08-11T17:05:56', 'last-modified': '2025-08-11T17:05:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.367378'} 2025-08-11 17:05:56,841 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:05:56,841 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-69226989 passed 2025-08-11 17:05:56,841 - DEBUG - ====Verifying policy data for ctest-right_vn-69226989 in API_Server ====== 2025-08-11 17:05:56,841 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:05:56,847 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:05:56,857 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:05:56,945 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/215f8cce-d6f9-4d8e-a305-cfdb16a7a09a 2025-08-11 17:05:56,954 - DEBUG - =>VN ctest-right_vn-69226989 has no policy to be verified 2025-08-11 17:05:56,954 - DEBUG - Verifying the vn in opserver 2025-08-11 17:05:56,954 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989 virtual network link through opserver 10.0.0.27 2025-08-11 17:05:56,954 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:05:57,003 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989?flat'} 2025-08-11 17:05:57,003 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989 virtual network link through opserver 10.0.0.23 2025-08-11 17:05:57,003 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:05:57,050 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989?flat'} 2025-08-11 17:05:57,050 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989 virtual network link through opserver 10.0.0.19 2025-08-11 17:05:57,050 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:05:57,095 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989?flat'} 2025-08-11 17:05:57,095 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-69226989 is found in opserver 2025-08-11 17:05:57,116 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:05:57,126 - DEBUG - VRF ids for VN ctest-right_vn-69226989: {} 2025-08-11 17:05:57,175 - DEBUG - Services list from nova: [, , , ] 2025-08-11 17:05:58,133 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-2) 2025-08-11 17:05:59,340 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-1) 2025-08-11 17:05:59,341 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-90844610'] 2025-08-11 17:05:59,639 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-90844610'] created succesfully 2025-08-11 17:05:59,971 - DEBUG - Image by name tiny_nat_fw not found 2025-08-11 17:05:59,971 - DEBUG - Installing image tiny_nat_fw 2025-08-11 17:05:59,971 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-11 17:05:59,972 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-11 17:05:59,972 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-11 17:05:59,972 - DEBUG - Unzip image 2025-08-11 17:05:59,972 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-11 17:06:00,000 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-08-11 17:06:00,002 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-90844610'] 2025-08-11 17:06:00,146 - INFO - Service template: ['default-domain', 'ctest-service_template_1-90844610'] deleted successfully. 2025-08-11 17:06:00,147 - INFO - Skip interface_detach for VM ctest-right_vm-44453641 in state BUILD 2025-08-11 17:06:00,147 - INFO - Deleting VM ctest-right_vm-44453641 2025-08-11 17:06:00,175 - ERROR - VM ctest-right_vm-44453641 has failed to come up 2025-08-11 17:06:00,175 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:00,175 - ERROR - VM ctest-right_vm-44453641 has failed to come up 2025-08-11 17:06:00,175 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:00,234 - INFO - Skip interface_detach for VM ctest-left_vm-63498940 in state BUILD 2025-08-11 17:06:00,234 - INFO - Deleting VM ctest-left_vm-63498940 2025-08-11 17:06:00,234 - ERROR - VM ctest-left_vm-63498940 has failed to come up 2025-08-11 17:06:00,235 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:00,235 - ERROR - VM ctest-left_vm-63498940 has failed to come up 2025-08-11 17:06:00,235 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:00,302 - INFO - Deleting VN ctest-right_vn-69226989 2025-08-11 17:06:00,337 - DEBUG - VN 215f8cce-d6f9-4d8e-a305-cfdb16a7a09a still in use: Unable to complete operation on network 215f8cce-d6f9-4d8e-a305-cfdb16a7a09a. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-de9fb975-ab65-413b-b229-80dcf6c44416'] 2025-08-11 17:06:00,338 - WARNING - Deleting VN ctest-right_vn-69226989 failed..Will retry 2025-08-11 17:06:02,470 - DEBUG - Response for deleting network () 2025-08-11 17:06:02,470 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8fa129a2-2878-4c2d-ad06-8bc7edb310e6 2025-08-11 17:06:02,476 - DEBUG - Response Code: 404 2025-08-11 17:06:02,476 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:02,485 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:02,501 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:02,580 - INFO - Validated that VN ctest-right_vn-69226989 is not found in API Server 2025-08-11 17:06:02,592 - DEBUG - VN ctest-right_vn-69226989 is not present in Agent 10.0.0.141 2025-08-11 17:06:02,602 - DEBUG - VN ctest-right_vn-69226989 is not present in Agent 10.0.0.249 2025-08-11 17:06:02,602 - INFO - Validated that VN ctest-right_vn-69226989 is not in any agent 2025-08-11 17:06:02,636 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-69226989 info 2025-08-11 17:06:02,636 - INFO - Deleting VN ctest-left_vn-89855541 2025-08-11 17:06:02,781 - DEBUG - Response for deleting network () 2025-08-11 17:06:02,781 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/bffdc201-389e-469e-a9f4-c1657ae092a9 2025-08-11 17:06:02,795 - DEBUG - Response Code: 404 2025-08-11 17:06:02,796 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:02,802 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:02,856 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:02,936 - INFO - Validated that VN ctest-left_vn-89855541 is not found in API Server 2025-08-11 17:06:02,948 - DEBUG - VN ctest-left_vn-89855541 is not present in Agent 10.0.0.141 2025-08-11 17:06:02,959 - DEBUG - VN ctest-left_vn-89855541 is not present in Agent 10.0.0.249 2025-08-11 17:06:02,960 - INFO - Validated that VN ctest-left_vn-89855541 is not in any agent 2025-08-11 17:06:02,991 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-89855541 info 2025-08-11 17:06:02,991 - INFO - Deleting VN ctest-mgmt_vn-25520112 2025-08-11 17:06:03,161 - DEBUG - Response for deleting network () 2025-08-11 17:06:03,161 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/fcad425e-d8ab-4c61-a548-9e25006037b4 2025-08-11 17:06:03,167 - DEBUG - Response Code: 404 2025-08-11 17:06:03,167 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:03,172 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:03,198 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:03,286 - INFO - Validated that VN ctest-mgmt_vn-25520112 is not found in API Server 2025-08-11 17:06:03,300 - DEBUG - VN ctest-mgmt_vn-25520112 is not present in Agent 10.0.0.141 2025-08-11 17:06:03,312 - DEBUG - VN ctest-mgmt_vn-25520112 is not present in Agent 10.0.0.249 2025-08-11 17:06:03,312 - INFO - Validated that VN ctest-mgmt_vn-25520112 is not in any agent 2025-08-11 17:06:03,343 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-25520112 info 2025-08-11 17:06:04,599 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 17:06:04,599 - INFO -
2025-08-11 17:06:04,599 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14]
2025-08-11 17:06:04,599 - INFO - -------------------------------------------------------------------------------- 2025-08-11 17:06:04,602 - INFO - ================================================================================ 2025-08-11 17:06:04,602 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-08-11 17:06:05,846 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.192': '0', '10.20.0.193': '0'}, '10.0.0.249': {'10.20.0.193': '0', '10.20.0.192': '0'}} with 2025-08-11 17:06:05,846 - INFO - Initial checks done. Running the testcase now 2025-08-11 17:06:05,846 - INFO - 2025-08-11 17:06:06,090 - DEBUG - Response for create_network : {'network': {'id': 'c34de5a6-2902-45e3-926d-4e76f0a64afa', 'name': 'ctest-mgmt_vn-32395229', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-mgmt_vn-32395229'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:06:06,341 - DEBUG - Response for create_subnet : {'subnet': {'id': '11fb319c-cfae-43ee-956c-8ad58737c64b', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': 'c34de5a6-2902-45e3-926d-4e76f0a64afa', 'ip_version': 4, 'cidr': '76.100.78.192/26', 'allocation_pools': [{'start': '76.100.78.194', 'end': '76.100.78.254'}], 'gateway_ip': '76.100.78.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '76.100.78.194', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:06:06,361 - INFO - Created VN ctest-mgmt_vn-32395229 2025-08-11 17:06:06,374 - DEBUG - VN ctest-mgmt_vn-32395229 UUID is c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,451 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:06,456 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:06,467 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:06,556 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,567 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,575 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a3816287-baf9-4a6e-b602-56b2e94d60ce 2025-08-11 17:06:06,583 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a3816287-baf9-4a6e-b602-56b2e94d60ce 2025-08-11 17:06:06,590 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/941d934e-5f1a-48f0-9d78-82b78bd41a81 2025-08-11 17:06:06,596 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:06:06,596 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,605 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a3816287-baf9-4a6e-b602-56b2e94d60ce 2025-08-11 17:06:06,621 - INFO - Verified VN network id 12 for VN c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,621 - INFO - Verifications in API Server for VN ctest-mgmt_vn-32395229 passed 2025-08-11 17:06:06,621 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,633 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a3816287-baf9-4a6e-b602-56b2e94d60ce 2025-08-11 17:06:06,641 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a3816287-baf9-4a6e-b602-56b2e94d60ce 2025-08-11 17:06:06,649 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/941d934e-5f1a-48f0-9d78-82b78bd41a81 2025-08-11 17:06:06,661 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14073156912418014691', 'uuid-lslong': '10551175774749477626'}, 'enable': 'true', 'created': '2025-08-11T17:06:06', 'last-modified': '2025-08-11T17:06:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.365849'} 2025-08-11 17:06:06,667 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:06:06,672 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14073156912418014691', 'uuid-lslong': '10551175774749477626'}, 'enable': 'true', 'created': '2025-08-11T17:06:06', 'last-modified': '2025-08-11T17:06:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.381152'} 2025-08-11 17:06:06,678 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:06:06,685 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14073156912418014691', 'uuid-lslong': '10551175774749477626'}, 'enable': 'true', 'created': '2025-08-11T17:06:06', 'last-modified': '2025-08-11T17:06:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.389243'} 2025-08-11 17:06:06,691 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-11 17:06:06,691 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-32395229 passed 2025-08-11 17:06:06,692 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-32395229 in API_Server ====== 2025-08-11 17:06:06,692 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:06,699 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:06,710 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:06,797 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c34de5a6-2902-45e3-926d-4e76f0a64afa 2025-08-11 17:06:06,808 - DEBUG - =>VN ctest-mgmt_vn-32395229 has no policy to be verified 2025-08-11 17:06:06,808 - DEBUG - Verifying the vn in opserver 2025-08-11 17:06:06,808 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229 virtual network link through opserver 10.0.0.27 2025-08-11 17:06:06,808 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:06:06,820 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229?flat'} 2025-08-11 17:06:06,820 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229 virtual network link through opserver 10.0.0.23 2025-08-11 17:06:06,820 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:06:06,831 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229?flat'} 2025-08-11 17:06:06,831 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229 virtual network link through opserver 10.0.0.19 2025-08-11 17:06:06,831 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:06:06,843 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229?flat'} 2025-08-11 17:06:06,843 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-mgmt_vn-32395229 is found in opserver 2025-08-11 17:06:06,865 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:06:06,875 - DEBUG - VRF ids for VN ctest-mgmt_vn-32395229: {} 2025-08-11 17:06:07,134 - DEBUG - Response for create_network : {'network': {'id': 'dbd18b87-92ec-4b18-9f90-9f556deee772', 'name': 'ctest-left_vn-13190027', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-left_vn-13190027'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:06:07,355 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd9ed587f-1b6f-4e67-a63e-b2b266fe3e40', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': 'dbd18b87-92ec-4b18-9f90-9f556deee772', 'ip_version': 4, 'cidr': '132.219.88.128/26', 'allocation_pools': [{'start': '132.219.88.130', 'end': '132.219.88.190'}], 'gateway_ip': '132.219.88.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '132.219.88.130', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:06:07,377 - INFO - Created VN ctest-left_vn-13190027 2025-08-11 17:06:07,392 - DEBUG - VN ctest-left_vn-13190027 UUID is dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,458 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:07,464 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:07,476 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:07,566 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,581 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,590 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/51945f22-375b-4973-aec2-49fc8dc33936 2025-08-11 17:06:07,597 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/51945f22-375b-4973-aec2-49fc8dc33936 2025-08-11 17:06:07,604 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/2dcdf910-7900-4a4f-8135-afbd01feb6d4 2025-08-11 17:06:07,611 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:06:07,611 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,620 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/51945f22-375b-4973-aec2-49fc8dc33936 2025-08-11 17:06:07,635 - INFO - Verified VN network id 13 for VN dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,635 - INFO - Verifications in API Server for VN ctest-left_vn-13190027 passed 2025-08-11 17:06:07,636 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,645 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/51945f22-375b-4973-aec2-49fc8dc33936 2025-08-11 17:06:07,653 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/51945f22-375b-4973-aec2-49fc8dc33936 2025-08-11 17:06:07,660 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/2dcdf910-7900-4a4f-8135-afbd01feb6d4 2025-08-11 17:06:07,672 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15839594778840550168', 'uuid-lslong': '11497865037942286194'}, 'enable': 'true', 'created': '2025-08-11T17:06:07', 'last-modified': '2025-08-11T17:06:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.360160'} 2025-08-11 17:06:07,680 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:06:07,685 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15839594778840550168', 'uuid-lslong': '11497865037942286194'}, 'enable': 'true', 'created': '2025-08-11T17:06:07', 'last-modified': '2025-08-11T17:06:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.386544'} 2025-08-11 17:06:07,691 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:06:07,698 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15839594778840550168', 'uuid-lslong': '11497865037942286194'}, 'enable': 'true', 'created': '2025-08-11T17:06:07', 'last-modified': '2025-08-11T17:06:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.389070'} 2025-08-11 17:06:07,705 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-11 17:06:07,705 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-13190027 passed 2025-08-11 17:06:07,705 - DEBUG - ====Verifying policy data for ctest-left_vn-13190027 in API_Server ====== 2025-08-11 17:06:07,705 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:07,711 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:07,725 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:07,832 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/dbd18b87-92ec-4b18-9f90-9f556deee772 2025-08-11 17:06:07,843 - DEBUG - =>VN ctest-left_vn-13190027 has no policy to be verified 2025-08-11 17:06:07,843 - DEBUG - Verifying the vn in opserver 2025-08-11 17:06:07,843 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027 virtual network link through opserver 10.0.0.27 2025-08-11 17:06:07,843 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:06:07,855 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027?flat'} 2025-08-11 17:06:07,855 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027 virtual network link through opserver 10.0.0.23 2025-08-11 17:06:07,855 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:06:07,869 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027?flat'} 2025-08-11 17:06:07,869 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027 virtual network link through opserver 10.0.0.19 2025-08-11 17:06:07,869 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:06:07,881 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027?flat'} 2025-08-11 17:06:07,881 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-left_vn-13190027 is found in opserver 2025-08-11 17:06:07,902 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:06:07,912 - DEBUG - VRF ids for VN ctest-left_vn-13190027: {} 2025-08-11 17:06:08,172 - DEBUG - Response for create_network : {'network': {'id': '4b3ed12b-11a2-41f2-b18d-c39859be2c89', 'name': 'ctest-right_vn-63418925', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-right_vn-63418925'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:06:08,393 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b526d689-49b7-416b-984c-878d38159e38', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': '4b3ed12b-11a2-41f2-b18d-c39859be2c89', 'ip_version': 4, 'cidr': '79.174.199.128/26', 'allocation_pools': [{'start': '79.174.199.130', 'end': '79.174.199.190'}], 'gateway_ip': '79.174.199.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '79.174.199.130', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:06:08,414 - INFO - Created VN ctest-right_vn-63418925 2025-08-11 17:06:08,425 - DEBUG - VN ctest-right_vn-63418925 UUID is 4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,502 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:08,508 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:08,519 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:08,611 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,623 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,632 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b01af4fd-8448-4bda-89e2-0f69da94f26b 2025-08-11 17:06:08,641 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b01af4fd-8448-4bda-89e2-0f69da94f26b 2025-08-11 17:06:08,648 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5a4745b2-f176-4f4d-bbc2-703eeb040ca9 2025-08-11 17:06:08,655 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:06:08,655 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,664 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b01af4fd-8448-4bda-89e2-0f69da94f26b 2025-08-11 17:06:08,681 - INFO - Verified VN network id 14 for VN 4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,681 - INFO - Verifications in API Server for VN ctest-right_vn-63418925 passed 2025-08-11 17:06:08,682 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,691 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b01af4fd-8448-4bda-89e2-0f69da94f26b 2025-08-11 17:06:08,701 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b01af4fd-8448-4bda-89e2-0f69da94f26b 2025-08-11 17:06:08,708 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/5a4745b2-f176-4f4d-bbc2-703eeb040ca9 2025-08-11 17:06:08,721 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5422000984310301170', 'uuid-lslong': '12794097175537527945'}, 'enable': 'true', 'created': '2025-08-11T17:06:08', 'last-modified': '2025-08-11T17:06:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.383271'} 2025-08-11 17:06:08,727 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:06:08,733 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5422000984310301170', 'uuid-lslong': '12794097175537527945'}, 'enable': 'true', 'created': '2025-08-11T17:06:08', 'last-modified': '2025-08-11T17:06:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392966'} 2025-08-11 17:06:08,739 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:06:08,745 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5422000984310301170', 'uuid-lslong': '12794097175537527945'}, 'enable': 'true', 'created': '2025-08-11T17:06:08', 'last-modified': '2025-08-11T17:06:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408055'} 2025-08-11 17:06:08,752 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-11 17:06:08,752 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-63418925 passed 2025-08-11 17:06:08,752 - DEBUG - ====Verifying policy data for ctest-right_vn-63418925 in API_Server ====== 2025-08-11 17:06:08,752 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:08,769 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:08,781 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:08,881 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/4b3ed12b-11a2-41f2-b18d-c39859be2c89 2025-08-11 17:06:08,898 - DEBUG - =>VN ctest-right_vn-63418925 has no policy to be verified 2025-08-11 17:06:08,898 - DEBUG - Verifying the vn in opserver 2025-08-11 17:06:08,898 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925 virtual network link through opserver 10.0.0.27 2025-08-11 17:06:08,898 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:06:08,909 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925?flat'} 2025-08-11 17:06:08,909 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925 virtual network link through opserver 10.0.0.23 2025-08-11 17:06:08,909 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:06:08,921 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925?flat'} 2025-08-11 17:06:08,921 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925 virtual network link through opserver 10.0.0.19 2025-08-11 17:06:08,922 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:06:08,935 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925?flat'} 2025-08-11 17:06:08,935 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-right_vn-63418925 is found in opserver 2025-08-11 17:06:08,957 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:06:08,971 - DEBUG - VRF ids for VN ctest-right_vn-63418925: {} 2025-08-11 17:06:09,251 - DEBUG - Response for create_network : {'network': {'id': '5446a3e5-b69a-4af7-ad45-44f571380856', 'name': 'ctest-trans_left_vn-13660172', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-trans_left_vn-13660172'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:06:09,498 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b94d3b71-c6e4-4d55-af25-8046e51e48a7', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': '5446a3e5-b69a-4af7-ad45-44f571380856', 'ip_version': 4, 'cidr': '205.3.178.128/26', 'allocation_pools': [{'start': '205.3.178.130', 'end': '205.3.178.190'}], 'gateway_ip': '205.3.178.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '205.3.178.130', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:06:09,519 - INFO - Created VN ctest-trans_left_vn-13660172 2025-08-11 17:06:09,532 - DEBUG - VN ctest-trans_left_vn-13660172 UUID is 5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:09,608 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:09,617 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:09,629 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:09,733 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:09,746 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:09,757 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4d4bbc9e-5913-4573-ad6e-e3e627d4aa98 2025-08-11 17:06:09,767 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4d4bbc9e-5913-4573-ad6e-e3e627d4aa98 2025-08-11 17:06:09,775 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/53663e3b-2647-4ace-93bb-72f41fd4cbe5 2025-08-11 17:06:09,785 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 17:06:09,785 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:09,797 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4d4bbc9e-5913-4573-ad6e-e3e627d4aa98 2025-08-11 17:06:09,815 - INFO - Verified VN network id 15 for VN 5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:09,816 - INFO - Verifications in API Server for VN ctest-trans_left_vn-13660172 passed 2025-08-11 17:06:09,816 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:09,826 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4d4bbc9e-5913-4573-ad6e-e3e627d4aa98 2025-08-11 17:06:09,833 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4d4bbc9e-5913-4573-ad6e-e3e627d4aa98 2025-08-11 17:06:09,841 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/53663e3b-2647-4ace-93bb-72f41fd4cbe5 2025-08-11 17:06:09,859 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6072721354562095863', 'uuid-lslong': '12485461362911742038'}, 'enable': 'true', 'created': '2025-08-11T17:06:09', 'last-modified': '2025-08-11T17:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411556'} 2025-08-11 17:06:09,868 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 17:06:09,874 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6072721354562095863', 'uuid-lslong': '12485461362911742038'}, 'enable': 'true', 'created': '2025-08-11T17:06:09', 'last-modified': '2025-08-11T17:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427415'} 2025-08-11 17:06:09,880 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 17:06:09,886 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6072721354562095863', 'uuid-lslong': '12485461362911742038'}, 'enable': 'true', 'created': '2025-08-11T17:06:09', 'last-modified': '2025-08-11T17:06:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.441449'} 2025-08-11 17:06:09,892 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-11 17:06:09,892 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-13660172 passed 2025-08-11 17:06:09,893 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-13660172 in API_Server ====== 2025-08-11 17:06:09,893 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:09,898 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:09,912 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:10,012 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/5446a3e5-b69a-4af7-ad45-44f571380856 2025-08-11 17:06:10,022 - DEBUG - =>VN ctest-trans_left_vn-13660172 has no policy to be verified 2025-08-11 17:06:10,022 - DEBUG - Verifying the vn in opserver 2025-08-11 17:06:10,022 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172 virtual network link through opserver 10.0.0.27 2025-08-11 17:06:10,022 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:06:10,036 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172?flat'} 2025-08-11 17:06:10,036 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172 virtual network link through opserver 10.0.0.23 2025-08-11 17:06:10,036 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:06:10,049 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172?flat'} 2025-08-11 17:06:10,049 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172 virtual network link through opserver 10.0.0.19 2025-08-11 17:06:10,049 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:06:10,063 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172?flat'} 2025-08-11 17:06:10,063 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-trans_left_vn-13660172 is found in opserver 2025-08-11 17:06:10,087 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:06:10,096 - DEBUG - VRF ids for VN ctest-trans_left_vn-13660172: {} 2025-08-11 17:06:10,343 - DEBUG - Response for create_network : {'network': {'id': 'a0f3aaff-d63a-42fd-a49b-58dae5ae80a5', 'name': 'ctest-trans_right_vn-77047247', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'project_id': '787fa238095a4ad398cb20594bc9999b', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-27378307', 'ctest-trans_right_vn-77047247'], 'port_security_enabled': True, 'description': ''}} 2025-08-11 17:06:10,613 - DEBUG - Response for create_subnet : {'subnet': {'id': '8fd5baa8-c3ed-489f-8592-c8077f919cf5', 'name': '', 'tenant_id': '787fa238095a4ad398cb20594bc9999b', 'network_id': 'a0f3aaff-d63a-42fd-a49b-58dae5ae80a5', 'ip_version': 4, 'cidr': '136.68.141.0/26', 'allocation_pools': [{'start': '136.68.141.2', 'end': '136.68.141.62'}], 'gateway_ip': '136.68.141.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.68.141.2', 'tags': [], 'project_id': '787fa238095a4ad398cb20594bc9999b'}} 2025-08-11 17:06:10,635 - INFO - Created VN ctest-trans_right_vn-77047247 2025-08-11 17:06:10,649 - DEBUG - VN ctest-trans_right_vn-77047247 UUID is a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:10,733 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:10,739 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:10,750 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:10,888 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:10,933 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:10,948 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9d55a3d4-8288-4992-a568-46cf5bdcf0cf 2025-08-11 17:06:10,959 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9d55a3d4-8288-4992-a568-46cf5bdcf0cf 2025-08-11 17:06:10,970 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/530c004c-627d-4169-8ab7-744b83610d15 2025-08-11 17:06:10,979 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 17:06:10,979 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:10,989 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9d55a3d4-8288-4992-a568-46cf5bdcf0cf 2025-08-11 17:06:11,008 - INFO - Verified VN network id 16 for VN a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:11,009 - INFO - Verifications in API Server for VN ctest-trans_right_vn-77047247 passed 2025-08-11 17:06:11,009 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:11,018 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9d55a3d4-8288-4992-a568-46cf5bdcf0cf 2025-08-11 17:06:11,025 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9d55a3d4-8288-4992-a568-46cf5bdcf0cf 2025-08-11 17:06:11,032 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/530c004c-627d-4169-8ab7-744b83610d15 2025-08-11 17:06:11,044 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11597801481196684029', 'uuid-lslong': '11861171740789866661'}, 'enable': 'true', 'created': '2025-08-11T17:06:10', 'last-modified': '2025-08-11T17:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.502538'} 2025-08-11 17:06:11,057 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 17:06:11,063 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11597801481196684029', 'uuid-lslong': '11861171740789866661'}, 'enable': 'true', 'created': '2025-08-11T17:06:10', 'last-modified': '2025-08-11T17:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.521552'} 2025-08-11 17:06:11,069 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 17:06:11,075 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-27378307', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11597801481196684029', 'uuid-lslong': '11861171740789866661'}, 'enable': 'true', 'created': '2025-08-11T17:06:10', 'last-modified': '2025-08-11T17:06:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.534689'} 2025-08-11 17:06:11,082 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-11 17:06:11,083 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-77047247 passed 2025-08-11 17:06:11,083 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-77047247 in API_Server ====== 2025-08-11 17:06:11,083 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:11,089 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:11,101 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:11,193 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a0f3aaff-d63a-42fd-a49b-58dae5ae80a5 2025-08-11 17:06:11,203 - DEBUG - =>VN ctest-trans_right_vn-77047247 has no policy to be verified 2025-08-11 17:06:11,203 - DEBUG - Verifying the vn in opserver 2025-08-11 17:06:11,203 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247 virtual network link through opserver 10.0.0.27 2025-08-11 17:06:11,204 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-11 17:06:11,216 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247?flat'} 2025-08-11 17:06:11,216 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247 virtual network link through opserver 10.0.0.23 2025-08-11 17:06:11,216 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-11 17:06:11,227 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247?flat'} 2025-08-11 17:06:11,227 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247 virtual network link through opserver 10.0.0.19 2025-08-11 17:06:11,227 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-08-11 17:06:11,240 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247?flat'} 2025-08-11 17:06:11,240 - INFO - Validated that VN default-domain:ctest-TestSvcHC-27378307:ctest-trans_right_vn-77047247 is found in opserver 2025-08-11 17:06:11,264 - DEBUG - Do not have enough data to verify VN in agent 2025-08-11 17:06:11,275 - DEBUG - VRF ids for VN ctest-trans_right_vn-77047247: {} 2025-08-11 17:06:12,253 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-1) 2025-08-11 17:06:13,486 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3816-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3816-2) 2025-08-11 17:06:13,487 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-94855401'] 2025-08-11 17:06:13,785 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-94855401'] created succesfully 2025-08-11 17:06:14,085 - DEBUG - Image by name tiny_trans_fw not found 2025-08-11 17:06:14,085 - DEBUG - Installing image tiny_trans_fw 2025-08-11 17:06:14,085 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-11 17:06:14,085 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-11 17:06:14,085 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-11 17:06:14,085 - DEBUG - Unzip image 2025-08-11 17:06:14,085 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-11 17:06:14,101 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-08-11 17:06:14,102 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-94855401'] 2025-08-11 17:06:14,231 - INFO - Service template: ['default-domain', 'ctest-service_template_1-94855401'] deleted successfully. 2025-08-11 17:06:14,231 - INFO - Skip interface_detach for VM ctest-right_vm-34807971 in state BUILD 2025-08-11 17:06:14,231 - INFO - Deleting VM ctest-right_vm-34807971 2025-08-11 17:06:14,231 - ERROR - VM ctest-right_vm-34807971 has failed to come up 2025-08-11 17:06:14,231 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:14,232 - ERROR - VM ctest-right_vm-34807971 has failed to come up 2025-08-11 17:06:14,232 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:14,314 - INFO - Skip interface_detach for VM ctest-left_vm-02965017 in state BUILD 2025-08-11 17:06:14,314 - INFO - Deleting VM ctest-left_vm-02965017 2025-08-11 17:06:14,314 - ERROR - VM ctest-left_vm-02965017 has failed to come up 2025-08-11 17:06:14,314 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:14,314 - ERROR - VM ctest-left_vm-02965017 has failed to come up 2025-08-11 17:06:14,314 - ERROR - Nova failed to get host of the VM 2025-08-11 17:06:14,403 - INFO - Deleting VN ctest-trans_right_vn-77047247 2025-08-11 17:06:14,552 - DEBUG - Response for deleting network () 2025-08-11 17:06:14,552 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/9d55a3d4-8288-4992-a568-46cf5bdcf0cf 2025-08-11 17:06:14,566 - DEBUG - Response Code: 404 2025-08-11 17:06:14,566 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:14,578 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:14,593 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:14,690 - INFO - Validated that VN ctest-trans_right_vn-77047247 is not found in API Server 2025-08-11 17:06:14,703 - DEBUG - VN ctest-trans_right_vn-77047247 is not present in Agent 10.0.0.141 2025-08-11 17:06:14,719 - DEBUG - VN ctest-trans_right_vn-77047247 is not present in Agent 10.0.0.249 2025-08-11 17:06:14,719 - INFO - Validated that VN ctest-trans_right_vn-77047247 is not in any agent 2025-08-11 17:06:14,754 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-77047247 info 2025-08-11 17:06:14,754 - INFO - Deleting VN ctest-trans_left_vn-13660172 2025-08-11 17:06:14,899 - DEBUG - Response for deleting network () 2025-08-11 17:06:14,899 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4d4bbc9e-5913-4573-ad6e-e3e627d4aa98 2025-08-11 17:06:14,905 - DEBUG - Response Code: 404 2025-08-11 17:06:14,906 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:14,916 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:14,945 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:15,054 - INFO - Validated that VN ctest-trans_left_vn-13660172 is not found in API Server 2025-08-11 17:06:15,073 - DEBUG - VN ctest-trans_left_vn-13660172 is not present in Agent 10.0.0.141 2025-08-11 17:06:15,116 - DEBUG - VN ctest-trans_left_vn-13660172 is not present in Agent 10.0.0.249 2025-08-11 17:06:15,116 - INFO - Validated that VN ctest-trans_left_vn-13660172 is not in any agent 2025-08-11 17:06:15,167 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-13660172 info 2025-08-11 17:06:15,167 - INFO - Deleting VN ctest-right_vn-63418925 2025-08-11 17:06:15,210 - DEBUG - VN 4b3ed12b-11a2-41f2-b18d-c39859be2c89 still in use: Unable to complete operation on network 4b3ed12b-11a2-41f2-b18d-c39859be2c89. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-cff63a22-a25d-442a-aab2-6ebd8691c393'] 2025-08-11 17:06:15,211 - WARNING - Deleting VN ctest-right_vn-63418925 failed..Will retry 2025-08-11 17:06:17,365 - DEBUG - Response for deleting network () 2025-08-11 17:06:17,366 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b01af4fd-8448-4bda-89e2-0f69da94f26b 2025-08-11 17:06:17,374 - DEBUG - Response Code: 404 2025-08-11 17:06:17,374 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:17,379 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:17,441 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:17,546 - INFO - Validated that VN ctest-right_vn-63418925 is not found in API Server 2025-08-11 17:06:17,557 - DEBUG - VN ctest-right_vn-63418925 is not present in Agent 10.0.0.141 2025-08-11 17:06:17,567 - DEBUG - VN ctest-right_vn-63418925 is not present in Agent 10.0.0.249 2025-08-11 17:06:17,567 - INFO - Validated that VN ctest-right_vn-63418925 is not in any agent 2025-08-11 17:06:17,599 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-63418925 info 2025-08-11 17:06:17,599 - INFO - Deleting VN ctest-left_vn-13190027 2025-08-11 17:06:17,771 - DEBUG - Response for deleting network () 2025-08-11 17:06:17,772 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/51945f22-375b-4973-aec2-49fc8dc33936 2025-08-11 17:06:17,783 - DEBUG - Response Code: 404 2025-08-11 17:06:17,783 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:17,791 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:17,803 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:17,901 - INFO - Validated that VN ctest-left_vn-13190027 is not found in API Server 2025-08-11 17:06:17,917 - DEBUG - VN ctest-left_vn-13190027 is not present in Agent 10.0.0.141 2025-08-11 17:06:17,928 - DEBUG - VN ctest-left_vn-13190027 is not present in Agent 10.0.0.249 2025-08-11 17:06:17,928 - INFO - Validated that VN ctest-left_vn-13190027 is not in any agent 2025-08-11 17:06:17,963 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-13190027 info 2025-08-11 17:06:17,963 - INFO - Deleting VN ctest-mgmt_vn-32395229 2025-08-11 17:06:18,105 - DEBUG - Response for deleting network () 2025-08-11 17:06:18,105 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/a3816287-baf9-4a6e-b602-56b2e94d60ce 2025-08-11 17:06:18,111 - DEBUG - Response Code: 404 2025-08-11 17:06:18,111 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-11 17:06:18,116 - DEBUG - Requesting: http://10.0.0.27:8082/domain/4bc87c47-8b22-47dc-8747-cffafaf5f39a 2025-08-11 17:06:18,137 - DEBUG - Requesting: http://10.0.0.27:8082/project/787fa238-095a-4ad3-98cb-20594bc9999b 2025-08-11 17:06:18,233 - INFO - Validated that VN ctest-mgmt_vn-32395229 is not found in API Server 2025-08-11 17:06:18,244 - DEBUG - VN ctest-mgmt_vn-32395229 is not present in Agent 10.0.0.141 2025-08-11 17:06:18,255 - DEBUG - VN ctest-mgmt_vn-32395229 is not present in Agent 10.0.0.249 2025-08-11 17:06:18,255 - INFO - Validated that VN ctest-mgmt_vn-32395229 is not in any agent 2025-08-11 17:06:18,288 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-32395229 info 2025-08-11 17:06:19,566 - DEBUG - No XMPP flaps were noticed during the test 2025-08-11 17:06:19,566 - INFO -
2025-08-11 17:06:19,566 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]
2025-08-11 17:06:19,567 - INFO - -------------------------------------------------------------------------------- 2025-08-11 17:06:20,300 - INFO - Deleted project: ctest-TestSvcHC-27378307, ID : 787fa238-095a-4ad3-98cb-20594bc9999b