2025-09-04 03:09:25,047 - INFO - Domain Default found not creating 2025-09-04 03:09:25,201 - INFO - Project ctest-TestSvcHC-15974803 not found, creating it 2025-09-04 03:09:25,737 - INFO - Created Project:ctest-TestSvcHC-15974803, ID : c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:27,219 - INFO - ================================================================================ 2025-09-04 03:09:27,219 - INFO - STARTING TEST : test_svc_hc_basic 2025-09-04 03:09:28,501 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.242': {'10.20.0.25': '0', '10.20.0.254': '0'}} with 2025-09-04 03:09:28,501 - INFO - Initial checks done. Running the testcase now 2025-09-04 03:09:28,501 - INFO - 2025-09-04 03:09:29,137 - DEBUG - Response for create_network : {'network': {'id': '8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8', 'name': 'ctest-mgmt_vn-06941638', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-mgmt_vn-06941638'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:29,440 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a075411b-9ab2-4ffd-aa76-8584b8eb2b7d', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': '8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8', 'ip_version': 4, 'cidr': '207.133.236.192/26', 'allocation_pools': [{'start': '207.133.236.194', 'end': '207.133.236.254'}], 'gateway_ip': '207.133.236.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '207.133.236.194', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:29,461 - INFO - Created VN ctest-mgmt_vn-06941638 2025-09-04 03:09:29,474 - DEBUG - VN ctest-mgmt_vn-06941638 UUID is 8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:29,542 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:29,841 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:29,872 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:29,890 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:29,982 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:29,999 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:30,010 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/5d77f054-255e-4d56-beca-f4c12958601c 2025-09-04 03:09:30,017 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/5d77f054-255e-4d56-beca-f4c12958601c 2025-09-04 03:09:30,024 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/76862408-1ab9-4d6a-9beb-374ce23987e9 2025-09-04 03:09:30,030 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:30,030 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:30,039 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/5d77f054-255e-4d56-beca-f4c12958601c 2025-09-04 03:09:30,055 - INFO - Verified VN network id 13 for VN 8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:30,055 - INFO - Verifications in API Server for VN ctest-mgmt_vn-06941638 passed 2025-09-04 03:09:30,055 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:30,064 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/5d77f054-255e-4d56-beca-f4c12958601c 2025-09-04 03:09:30,072 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/5d77f054-255e-4d56-beca-f4c12958601c 2025-09-04 03:09:30,080 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/76862408-1ab9-4d6a-9beb-374ce23987e9 2025-09-04 03:09:30,090 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9381490361027743566', 'uuid-lslong': '9349301850439823288'}, 'enable': 'true', 'created': '2025-09-04T03:09:29', 'last-modified': '2025-09-04T03:09:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.711623'} 2025-09-04 03:09:30,095 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:30,100 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9381490361027743566', 'uuid-lslong': '9349301850439823288'}, 'enable': 'true', 'created': '2025-09-04T03:09:29', 'last-modified': '2025-09-04T03:09:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.718098'} 2025-09-04 03:09:30,106 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:30,111 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9381490361027743566', 'uuid-lslong': '9349301850439823288'}, 'enable': 'true', 'created': '2025-09-04T03:09:29', 'last-modified': '2025-09-04T03:09:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.734753'} 2025-09-04 03:09:30,117 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:30,117 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-06941638 passed 2025-09-04 03:09:30,117 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-06941638 in API_Server ====== 2025-09-04 03:09:30,118 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:30,123 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:30,135 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:30,228 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/8231bfc7-30cf-4f4e-81bf-647f8d5e2fb8 2025-09-04 03:09:30,237 - DEBUG - =>VN ctest-mgmt_vn-06941638 has no policy to be verified 2025-09-04 03:09:30,237 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:30,237 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:30,237 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:30,535 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:30,597 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638?flat'} 2025-09-04 03:09:30,597 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:30,597 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:30,894 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:30,952 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638?flat'} 2025-09-04 03:09:30,952 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:30,952 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:31,253 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:31,306 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638?flat'} 2025-09-04 03:09:31,307 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-06941638 is found in opserver 2025-09-04 03:09:31,326 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:31,335 - DEBUG - VRF ids for VN ctest-mgmt_vn-06941638: {} 2025-09-04 03:09:31,607 - DEBUG - Response for create_network : {'network': {'id': '78a60f12-df0a-4645-a810-7864d254cf6b', 'name': 'ctest-left_vn-94109925', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-left_vn-94109925'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:31,823 - DEBUG - Response for create_subnet : {'subnet': {'id': '6319db80-02dc-4ed9-8fb6-3ffd49664e25', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': '78a60f12-df0a-4645-a810-7864d254cf6b', 'ip_version': 4, 'cidr': '126.201.90.192/26', 'allocation_pools': [{'start': '126.201.90.194', 'end': '126.201.90.254'}], 'gateway_ip': '126.201.90.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '126.201.90.194', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:31,848 - INFO - Created VN ctest-left_vn-94109925 2025-09-04 03:09:31,860 - DEBUG - VN ctest-left_vn-94109925 UUID is 78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:31,932 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:31,940 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:31,951 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:32,045 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:32,058 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:32,069 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f81d8ccf-553b-474f-8454-672b1a70625e 2025-09-04 03:09:32,078 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f81d8ccf-553b-474f-8454-672b1a70625e 2025-09-04 03:09:32,086 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/d6b05eb0-0e08-4400-be7d-d5967476c406 2025-09-04 03:09:32,093 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:32,093 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:32,102 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f81d8ccf-553b-474f-8454-672b1a70625e 2025-09-04 03:09:32,118 - INFO - Verified VN network id 14 for VN 78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:32,118 - INFO - Verifications in API Server for VN ctest-left_vn-94109925 passed 2025-09-04 03:09:32,118 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:32,128 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f81d8ccf-553b-474f-8454-672b1a70625e 2025-09-04 03:09:32,135 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f81d8ccf-553b-474f-8454-672b1a70625e 2025-09-04 03:09:32,142 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/d6b05eb0-0e08-4400-be7d-d5967476c406 2025-09-04 03:09:32,157 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8693652704411141701', 'uuid-lslong': '12110311772420099947'}, 'enable': 'true', 'created': '2025-09-04T03:09:31', 'last-modified': '2025-09-04T03:09:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.391914'} 2025-09-04 03:09:32,162 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:32,168 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8693652704411141701', 'uuid-lslong': '12110311772420099947'}, 'enable': 'true', 'created': '2025-09-04T03:09:31', 'last-modified': '2025-09-04T03:09:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404902'} 2025-09-04 03:09:32,174 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:32,179 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8693652704411141701', 'uuid-lslong': '12110311772420099947'}, 'enable': 'true', 'created': '2025-09-04T03:09:31', 'last-modified': '2025-09-04T03:09:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413470'} 2025-09-04 03:09:32,184 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:32,184 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-94109925 passed 2025-09-04 03:09:32,185 - DEBUG - ====Verifying policy data for ctest-left_vn-94109925 in API_Server ====== 2025-09-04 03:09:32,185 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:32,191 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:32,202 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:32,297 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/78a60f12-df0a-4645-a810-7864d254cf6b 2025-09-04 03:09:32,308 - DEBUG - =>VN ctest-left_vn-94109925 has no policy to be verified 2025-09-04 03:09:32,308 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:32,308 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:32,308 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:32,366 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925?flat'} 2025-09-04 03:09:32,366 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:32,366 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:32,422 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925?flat'} 2025-09-04 03:09:32,422 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:32,422 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:32,472 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925?flat'} 2025-09-04 03:09:32,472 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-94109925 is found in opserver 2025-09-04 03:09:32,492 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:32,502 - DEBUG - VRF ids for VN ctest-left_vn-94109925: {} 2025-09-04 03:09:32,781 - DEBUG - Response for create_network : {'network': {'id': '5db58644-6a1c-456b-b034-8b46182324b2', 'name': 'ctest-right_vn-79601373', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-right_vn-79601373'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:33,037 - DEBUG - Response for create_subnet : {'subnet': {'id': '23aeb938-6b72-469c-b032-e16cccc68427', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': '5db58644-6a1c-456b-b034-8b46182324b2', 'ip_version': 4, 'cidr': '76.99.171.0/26', 'allocation_pools': [{'start': '76.99.171.2', 'end': '76.99.171.62'}], 'gateway_ip': '76.99.171.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '76.99.171.2', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:33,069 - INFO - Created VN ctest-right_vn-79601373 2025-09-04 03:09:33,080 - DEBUG - VN ctest-right_vn-79601373 UUID is 5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,156 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:33,163 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:33,175 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:33,287 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,306 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,315 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e52a4b32-aad2-4947-b72f-33266de7115b 2025-09-04 03:09:33,326 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e52a4b32-aad2-4947-b72f-33266de7115b 2025-09-04 03:09:33,334 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/b7ae0d04-a002-4a38-9842-9510bbb6953b 2025-09-04 03:09:33,341 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:33,341 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,352 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e52a4b32-aad2-4947-b72f-33266de7115b 2025-09-04 03:09:33,370 - INFO - Verified VN network id 15 for VN 5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,371 - INFO - Verifications in API Server for VN ctest-right_vn-79601373 passed 2025-09-04 03:09:33,371 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,385 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e52a4b32-aad2-4947-b72f-33266de7115b 2025-09-04 03:09:33,393 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e52a4b32-aad2-4947-b72f-33266de7115b 2025-09-04 03:09:33,401 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/b7ae0d04-a002-4a38-9842-9510bbb6953b 2025-09-04 03:09:33,414 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6752450844708062571', 'uuid-lslong': '12696926382633198770'}, 'enable': 'true', 'created': '2025-09-04T03:09:32', 'last-modified': '2025-09-04T03:09:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436244'} 2025-09-04 03:09:33,420 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:33,425 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6752450844708062571', 'uuid-lslong': '12696926382633198770'}, 'enable': 'true', 'created': '2025-09-04T03:09:32', 'last-modified': '2025-09-04T03:09:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449256'} 2025-09-04 03:09:33,432 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:33,438 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6752450844708062571', 'uuid-lslong': '12696926382633198770'}, 'enable': 'true', 'created': '2025-09-04T03:09:32', 'last-modified': '2025-09-04T03:09:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460901'} 2025-09-04 03:09:33,443 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:33,443 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-79601373 passed 2025-09-04 03:09:33,443 - DEBUG - ====Verifying policy data for ctest-right_vn-79601373 in API_Server ====== 2025-09-04 03:09:33,443 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:33,451 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:33,463 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:33,577 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/5db58644-6a1c-456b-b034-8b46182324b2 2025-09-04 03:09:33,589 - DEBUG - =>VN ctest-right_vn-79601373 has no policy to be verified 2025-09-04 03:09:33,590 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:33,590 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:33,590 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:33,645 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373?flat'} 2025-09-04 03:09:33,646 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:33,646 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:33,715 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373?flat'} 2025-09-04 03:09:33,715 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:33,715 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:33,773 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373?flat'} 2025-09-04 03:09:33,773 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-79601373 is found in opserver 2025-09-04 03:09:33,802 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:33,814 - DEBUG - VRF ids for VN ctest-right_vn-79601373: {} 2025-09-04 03:09:33,879 - DEBUG - Services list from nova: [, , , ] 2025-09-04 03:09:34,906 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-1) 2025-09-04 03:09:36,202 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-2) 2025-09-04 03:09:36,202 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-99009460'] 2025-09-04 03:09:36,496 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-99009460'] created succesfully 2025-09-04 03:09:36,885 - DEBUG - Image by name tiny_nat_fw not found 2025-09-04 03:09:36,885 - DEBUG - Installing image tiny_nat_fw 2025-09-04 03:09:36,885 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-04 03:09:36,885 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-04 03:09:36,885 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-04 03:09:36,885 - DEBUG - Unzip image 2025-09-04 03:09:36,885 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-04 03:09:36,910 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-04 03:09:36,911 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-99009460'] 2025-09-04 03:09:37,068 - INFO - Service template: ['default-domain', 'ctest-service_template_1-99009460'] deleted successfully. 2025-09-04 03:09:37,069 - INFO - Skip interface_detach for VM ctest-right_vm-34063967 in state BUILD 2025-09-04 03:09:37,069 - INFO - Deleting VM ctest-right_vm-34063967 2025-09-04 03:09:37,120 - ERROR - VM ctest-right_vm-34063967 has failed to come up 2025-09-04 03:09:37,120 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:37,120 - ERROR - VM ctest-right_vm-34063967 has failed to come up 2025-09-04 03:09:37,120 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:37,234 - INFO - Skip interface_detach for VM ctest-left_vm-22900270 in state BUILD 2025-09-04 03:09:37,234 - INFO - Deleting VM ctest-left_vm-22900270 2025-09-04 03:09:37,234 - ERROR - VM ctest-left_vm-22900270 has failed to come up 2025-09-04 03:09:37,234 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:37,235 - ERROR - VM ctest-left_vm-22900270 has failed to come up 2025-09-04 03:09:37,235 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:37,316 - INFO - Deleting VN ctest-right_vn-79601373 2025-09-04 03:09:37,365 - DEBUG - VN 5db58644-6a1c-456b-b034-8b46182324b2 still in use: Unable to complete operation on network 5db58644-6a1c-456b-b034-8b46182324b2. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-80b93bd6-00c4-4c43-b261-1bf32ef44998'] 2025-09-04 03:09:37,365 - WARNING - Deleting VN ctest-right_vn-79601373 failed..Will retry 2025-09-04 03:09:39,571 - DEBUG - Response for deleting network () 2025-09-04 03:09:39,571 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e52a4b32-aad2-4947-b72f-33266de7115b 2025-09-04 03:09:39,593 - DEBUG - Response Code: 404 2025-09-04 03:09:39,595 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:39,604 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:39,621 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:39,711 - INFO - Validated that VN ctest-right_vn-79601373 is not found in API Server 2025-09-04 03:09:39,726 - DEBUG - VN ctest-right_vn-79601373 is not present in Agent 10.0.0.241 2025-09-04 03:09:39,737 - DEBUG - VN ctest-right_vn-79601373 is not present in Agent 10.0.0.242 2025-09-04 03:09:39,737 - INFO - Validated that VN ctest-right_vn-79601373 is not in any agent 2025-09-04 03:09:39,771 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-79601373 info 2025-09-04 03:09:39,772 - INFO - Deleting VN ctest-left_vn-94109925 2025-09-04 03:09:39,927 - DEBUG - Response for deleting network () 2025-09-04 03:09:39,927 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f81d8ccf-553b-474f-8454-672b1a70625e 2025-09-04 03:09:39,934 - DEBUG - Response Code: 404 2025-09-04 03:09:39,934 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:39,950 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:39,973 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:40,058 - INFO - Validated that VN ctest-left_vn-94109925 is not found in API Server 2025-09-04 03:09:40,070 - DEBUG - VN ctest-left_vn-94109925 is not present in Agent 10.0.0.241 2025-09-04 03:09:40,083 - DEBUG - VN ctest-left_vn-94109925 is not present in Agent 10.0.0.242 2025-09-04 03:09:40,083 - INFO - Validated that VN ctest-left_vn-94109925 is not in any agent 2025-09-04 03:09:40,120 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-94109925 info 2025-09-04 03:09:40,120 - INFO - Deleting VN ctest-mgmt_vn-06941638 2025-09-04 03:09:40,273 - DEBUG - Response for deleting network () 2025-09-04 03:09:40,274 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/5d77f054-255e-4d56-beca-f4c12958601c 2025-09-04 03:09:40,281 - DEBUG - Response Code: 404 2025-09-04 03:09:40,282 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:40,287 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:40,305 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:40,389 - INFO - Validated that VN ctest-mgmt_vn-06941638 is not found in API Server 2025-09-04 03:09:40,401 - DEBUG - VN ctest-mgmt_vn-06941638 is not present in Agent 10.0.0.241 2025-09-04 03:09:40,411 - DEBUG - VN ctest-mgmt_vn-06941638 is not present in Agent 10.0.0.242 2025-09-04 03:09:40,412 - INFO - Validated that VN ctest-mgmt_vn-06941638 is not in any agent 2025-09-04 03:09:40,449 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-06941638 info 2025-09-04 03:09:41,726 - DEBUG - No XMPP flaps were noticed during the test 2025-09-04 03:09:41,726 - INFO -
2025-09-04 03:09:41,726 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:14]
2025-09-04 03:09:41,726 - INFO - -------------------------------------------------------------------------------- 2025-09-04 03:09:41,730 - INFO - ================================================================================ 2025-09-04 03:09:41,730 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-09-04 03:09:43,012 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.20.0.25': '0', '10.20.0.254': '0'}, '10.0.0.242': {'10.20.0.25': '0', '10.20.0.254': '0'}} with 2025-09-04 03:09:43,012 - INFO - Initial checks done. Running the testcase now 2025-09-04 03:09:43,012 - INFO - 2025-09-04 03:09:43,265 - DEBUG - Response for create_network : {'network': {'id': '424ca57c-6a2c-4ab9-8799-b5f480eb9a3d', 'name': 'ctest-mgmt_vn-34037988', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-mgmt_vn-34037988'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:43,530 - DEBUG - Response for create_subnet : {'subnet': {'id': '3c71ad57-853c-4178-b444-20a50240bdc7', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': '424ca57c-6a2c-4ab9-8799-b5f480eb9a3d', 'ip_version': 4, 'cidr': '182.157.129.64/26', 'allocation_pools': [{'start': '182.157.129.66', 'end': '182.157.129.126'}], 'gateway_ip': '182.157.129.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '182.157.129.66', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:43,553 - INFO - Created VN ctest-mgmt_vn-34037988 2025-09-04 03:09:43,564 - DEBUG - VN ctest-mgmt_vn-34037988 UUID is 424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:43,641 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:43,648 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:43,659 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:43,754 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:43,765 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:43,778 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:43,799 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:43,813 - DEBUG - Route Targets: [] 2025-09-04 03:09:43,813 - DEBUG - RT names not yet present for VN ctest-mgmt_vn-34037988 2025-09-04 03:09:48,814 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:48,821 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:48,834 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:48,928 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:48,937 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:48,948 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:48,960 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:48,969 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/aca21103-6ab8-44e9-ae55-3435ea7edc9c 2025-09-04 03:09:48,977 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:48,977 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:48,987 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:49,003 - INFO - Verified VN network id 13 for VN 424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:49,003 - INFO - Verifications in API Server for VN ctest-mgmt_vn-34037988 passed 2025-09-04 03:09:49,003 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:49,013 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:49,022 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:09:49,028 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/aca21103-6ab8-44e9-ae55-3435ea7edc9c 2025-09-04 03:09:49,043 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4777375258509068985', 'uuid-lslong': '9771040928296573501'}, 'enable': 'true', 'created': '2025-09-04T03:09:43', 'last-modified': '2025-09-04T03:09:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.572508'} 2025-09-04 03:09:49,049 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:49,055 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4777375258509068985', 'uuid-lslong': '9771040928296573501'}, 'enable': 'true', 'created': '2025-09-04T03:09:43', 'last-modified': '2025-09-04T03:09:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.584489'} 2025-09-04 03:09:49,061 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:49,066 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4777375258509068985', 'uuid-lslong': '9771040928296573501'}, 'enable': 'true', 'created': '2025-09-04T03:09:43', 'last-modified': '2025-09-04T03:09:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.597696'} 2025-09-04 03:09:49,071 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-04 03:09:49,071 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-34037988 passed 2025-09-04 03:09:49,072 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-34037988 in API_Server ====== 2025-09-04 03:09:49,072 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:49,078 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:49,090 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:49,189 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/424ca57c-6a2c-4ab9-8799-b5f480eb9a3d 2025-09-04 03:09:49,198 - DEBUG - =>VN ctest-mgmt_vn-34037988 has no policy to be verified 2025-09-04 03:09:49,198 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:49,198 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:49,198 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:49,210 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988?flat'} 2025-09-04 03:09:49,210 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:49,210 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:49,227 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988?flat'} 2025-09-04 03:09:49,227 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:49,227 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:49,242 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988?flat'} 2025-09-04 03:09:49,242 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-mgmt_vn-34037988 is found in opserver 2025-09-04 03:09:49,260 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:49,270 - DEBUG - VRF ids for VN ctest-mgmt_vn-34037988: {} 2025-09-04 03:09:49,528 - DEBUG - Response for create_network : {'network': {'id': 'ee75bc50-39a2-4f4e-a420-b11fde1a3c50', 'name': 'ctest-left_vn-28726799', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-left_vn-28726799'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:49,756 - DEBUG - Response for create_subnet : {'subnet': {'id': 'be7f5725-34ef-4957-b730-31699bc73e54', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': 'ee75bc50-39a2-4f4e-a420-b11fde1a3c50', 'ip_version': 4, 'cidr': '9.238.139.0/26', 'allocation_pools': [{'start': '9.238.139.2', 'end': '9.238.139.62'}], 'gateway_ip': '9.238.139.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '9.238.139.2', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:49,777 - INFO - Created VN ctest-left_vn-28726799 2025-09-04 03:09:49,791 - DEBUG - VN ctest-left_vn-28726799 UUID is ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:49,869 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:49,875 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:49,886 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:49,983 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:49,995 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:50,003 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6f35950b-ab00-4a53-99e6-6ceeb3318f33 2025-09-04 03:09:50,010 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6f35950b-ab00-4a53-99e6-6ceeb3318f33 2025-09-04 03:09:50,016 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/bf9bb381-7f41-49df-b332-4467cad7f2d1 2025-09-04 03:09:50,022 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:50,022 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:50,030 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6f35950b-ab00-4a53-99e6-6ceeb3318f33 2025-09-04 03:09:50,044 - INFO - Verified VN network id 14 for VN ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:50,044 - INFO - Verifications in API Server for VN ctest-left_vn-28726799 passed 2025-09-04 03:09:50,044 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:50,054 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6f35950b-ab00-4a53-99e6-6ceeb3318f33 2025-09-04 03:09:50,060 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6f35950b-ab00-4a53-99e6-6ceeb3318f33 2025-09-04 03:09:50,067 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/bf9bb381-7f41-49df-b332-4467cad7f2d1 2025-09-04 03:09:50,080 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17182847006052339534', 'uuid-lslong': '11826647371903286352'}, 'enable': 'true', 'created': '2025-09-04T03:09:49', 'last-modified': '2025-09-04T03:09:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387180'} 2025-09-04 03:09:50,085 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:50,091 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17182847006052339534', 'uuid-lslong': '11826647371903286352'}, 'enable': 'true', 'created': '2025-09-04T03:09:49', 'last-modified': '2025-09-04T03:09:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398933'} 2025-09-04 03:09:50,097 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:50,101 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17182847006052339534', 'uuid-lslong': '11826647371903286352'}, 'enable': 'true', 'created': '2025-09-04T03:09:49', 'last-modified': '2025-09-04T03:09:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407994'} 2025-09-04 03:09:50,107 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-04 03:09:50,107 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-28726799 passed 2025-09-04 03:09:50,107 - DEBUG - ====Verifying policy data for ctest-left_vn-28726799 in API_Server ====== 2025-09-04 03:09:50,107 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:50,113 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:50,125 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:50,213 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/ee75bc50-39a2-4f4e-a420-b11fde1a3c50 2025-09-04 03:09:50,224 - DEBUG - =>VN ctest-left_vn-28726799 has no policy to be verified 2025-09-04 03:09:50,224 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:50,224 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:50,224 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:50,236 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799?flat'} 2025-09-04 03:09:50,236 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:50,236 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:50,249 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799?flat'} 2025-09-04 03:09:50,249 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:50,249 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:50,261 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799?flat'} 2025-09-04 03:09:50,261 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-left_vn-28726799 is found in opserver 2025-09-04 03:09:50,282 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:50,291 - DEBUG - VRF ids for VN ctest-left_vn-28726799: {} 2025-09-04 03:09:50,544 - DEBUG - Response for create_network : {'network': {'id': 'e327fd02-b5ec-4907-90a6-1ce2a0f7bca6', 'name': 'ctest-right_vn-81914320', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-right_vn-81914320'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:50,762 - DEBUG - Response for create_subnet : {'subnet': {'id': '00569656-4ce9-467a-ac49-a27d757c4436', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': 'e327fd02-b5ec-4907-90a6-1ce2a0f7bca6', 'ip_version': 4, 'cidr': '38.105.8.64/26', 'allocation_pools': [{'start': '38.105.8.66', 'end': '38.105.8.126'}], 'gateway_ip': '38.105.8.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '38.105.8.66', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:50,790 - INFO - Created VN ctest-right_vn-81914320 2025-09-04 03:09:50,802 - DEBUG - VN ctest-right_vn-81914320 UUID is e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:50,880 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:50,886 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:50,897 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:50,994 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:51,005 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:51,014 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e5dd81c7-ab96-496a-b16d-e53fdfbaaf3d 2025-09-04 03:09:51,024 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e5dd81c7-ab96-496a-b16d-e53fdfbaaf3d 2025-09-04 03:09:51,031 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/ec58b45e-eae1-42e4-bc62-537c4df4fafd 2025-09-04 03:09:51,038 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:51,038 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:51,048 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e5dd81c7-ab96-496a-b16d-e53fdfbaaf3d 2025-09-04 03:09:51,063 - INFO - Verified VN network id 15 for VN e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:51,063 - INFO - Verifications in API Server for VN ctest-right_vn-81914320 passed 2025-09-04 03:09:51,063 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:51,073 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e5dd81c7-ab96-496a-b16d-e53fdfbaaf3d 2025-09-04 03:09:51,080 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e5dd81c7-ab96-496a-b16d-e53fdfbaaf3d 2025-09-04 03:09:51,086 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/ec58b45e-eae1-42e4-bc62-537c4df4fafd 2025-09-04 03:09:51,098 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16368329558785280263', 'uuid-lslong': '10423050147284368550'}, 'enable': 'true', 'created': '2025-09-04T03:09:50', 'last-modified': '2025-09-04T03:09:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405186'} 2025-09-04 03:09:51,104 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:51,109 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16368329558785280263', 'uuid-lslong': '10423050147284368550'}, 'enable': 'true', 'created': '2025-09-04T03:09:50', 'last-modified': '2025-09-04T03:09:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424644'} 2025-09-04 03:09:51,116 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:51,121 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16368329558785280263', 'uuid-lslong': '10423050147284368550'}, 'enable': 'true', 'created': '2025-09-04T03:09:50', 'last-modified': '2025-09-04T03:09:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429643'} 2025-09-04 03:09:51,127 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-04 03:09:51,127 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-81914320 passed 2025-09-04 03:09:51,127 - DEBUG - ====Verifying policy data for ctest-right_vn-81914320 in API_Server ====== 2025-09-04 03:09:51,127 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:51,134 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:51,147 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:51,241 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 2025-09-04 03:09:51,255 - DEBUG - =>VN ctest-right_vn-81914320 has no policy to be verified 2025-09-04 03:09:51,255 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:51,255 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:51,255 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:51,271 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320?flat'} 2025-09-04 03:09:51,271 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:51,271 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:51,286 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320?flat'} 2025-09-04 03:09:51,286 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:51,286 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:51,300 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320?flat'} 2025-09-04 03:09:51,300 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-right_vn-81914320 is found in opserver 2025-09-04 03:09:51,320 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:51,329 - DEBUG - VRF ids for VN ctest-right_vn-81914320: {} 2025-09-04 03:09:51,614 - DEBUG - Response for create_network : {'network': {'id': '91e5fa62-2b84-4f74-bbde-0b351b7a4d37', 'name': 'ctest-trans_left_vn-86046063', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-trans_left_vn-86046063'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:51,887 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd0971d19-ba1e-48fb-9343-5027541dcdb7', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': '91e5fa62-2b84-4f74-bbde-0b351b7a4d37', 'ip_version': 4, 'cidr': '145.117.162.64/26', 'allocation_pools': [{'start': '145.117.162.66', 'end': '145.117.162.126'}], 'gateway_ip': '145.117.162.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '145.117.162.66', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:51,909 - INFO - Created VN ctest-trans_left_vn-86046063 2025-09-04 03:09:51,921 - DEBUG - VN ctest-trans_left_vn-86046063 UUID is 91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:51,994 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:52,000 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:52,011 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:52,104 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:52,117 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:52,127 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/4e650c24-cf0d-4c02-bed8-11c09fd5ed49 2025-09-04 03:09:52,139 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/4e650c24-cf0d-4c02-bed8-11c09fd5ed49 2025-09-04 03:09:52,146 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/f73aa290-2f56-4629-9687-152c1e85d1bc 2025-09-04 03:09:52,152 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-04 03:09:52,152 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:52,162 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/4e650c24-cf0d-4c02-bed8-11c09fd5ed49 2025-09-04 03:09:52,180 - INFO - Verified VN network id 16 for VN 91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:52,181 - INFO - Verifications in API Server for VN ctest-trans_left_vn-86046063 passed 2025-09-04 03:09:52,181 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:52,192 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/4e650c24-cf0d-4c02-bed8-11c09fd5ed49 2025-09-04 03:09:52,199 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/4e650c24-cf0d-4c02-bed8-11c09fd5ed49 2025-09-04 03:09:52,206 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/f73aa290-2f56-4629-9687-152c1e85d1bc 2025-09-04 03:09:52,219 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10513084204710121332', 'uuid-lslong': '13537269852644461879'}, 'enable': 'true', 'created': '2025-09-04T03:09:51', 'last-modified': '2025-09-04T03:09:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400440'} 2025-09-04 03:09:52,224 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-04 03:09:52,231 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10513084204710121332', 'uuid-lslong': '13537269852644461879'}, 'enable': 'true', 'created': '2025-09-04T03:09:51', 'last-modified': '2025-09-04T03:09:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411374'} 2025-09-04 03:09:52,236 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-04 03:09:52,241 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10513084204710121332', 'uuid-lslong': '13537269852644461879'}, 'enable': 'true', 'created': '2025-09-04T03:09:51', 'last-modified': '2025-09-04T03:09:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422636'} 2025-09-04 03:09:52,246 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-04 03:09:52,246 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-86046063 passed 2025-09-04 03:09:52,247 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-86046063 in API_Server ====== 2025-09-04 03:09:52,247 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:52,252 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:52,262 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:52,356 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/91e5fa62-2b84-4f74-bbde-0b351b7a4d37 2025-09-04 03:09:52,366 - DEBUG - =>VN ctest-trans_left_vn-86046063 has no policy to be verified 2025-09-04 03:09:52,366 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:52,366 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:52,366 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:52,378 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063?flat'} 2025-09-04 03:09:52,378 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:52,378 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:52,390 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063?flat'} 2025-09-04 03:09:52,390 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:52,390 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:52,403 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063?flat'} 2025-09-04 03:09:52,403 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-trans_left_vn-86046063 is found in opserver 2025-09-04 03:09:52,423 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:52,432 - DEBUG - VRF ids for VN ctest-trans_left_vn-86046063: {} 2025-09-04 03:09:52,701 - DEBUG - Response for create_network : {'network': {'id': 'de01e442-ee9c-4a98-899f-121ef2c10a6e', 'name': 'ctest-trans_right_vn-39206756', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'project_id': 'c5e36870f66644469e77c4b1d725a2a0', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-15974803', 'ctest-trans_right_vn-39206756'], 'port_security_enabled': True, 'description': ''}} 2025-09-04 03:09:52,994 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e8a27106-4d96-4e50-b121-dc700dc32c17', 'name': '', 'tenant_id': 'c5e36870f66644469e77c4b1d725a2a0', 'network_id': 'de01e442-ee9c-4a98-899f-121ef2c10a6e', 'ip_version': 4, 'cidr': '207.238.163.0/26', 'allocation_pools': [{'start': '207.238.163.2', 'end': '207.238.163.62'}], 'gateway_ip': '207.238.163.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '207.238.163.2', 'tags': [], 'project_id': 'c5e36870f66644469e77c4b1d725a2a0'}} 2025-09-04 03:09:53,015 - INFO - Created VN ctest-trans_right_vn-39206756 2025-09-04 03:09:53,030 - DEBUG - VN ctest-trans_right_vn-39206756 UUID is de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,097 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:53,104 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:53,117 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:53,221 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,237 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,245 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f70482a2-a229-4144-8246-98c0c781abd3 2025-09-04 03:09:53,253 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f70482a2-a229-4144-8246-98c0c781abd3 2025-09-04 03:09:53,259 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/86d2aae4-f3f2-4057-bda0-b15eb528b8f7 2025-09-04 03:09:53,266 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-04 03:09:53,266 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,275 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f70482a2-a229-4144-8246-98c0c781abd3 2025-09-04 03:09:53,297 - INFO - Verified VN network id 17 for VN de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,297 - INFO - Verifications in API Server for VN ctest-trans_right_vn-39206756 passed 2025-09-04 03:09:53,297 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,306 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f70482a2-a229-4144-8246-98c0c781abd3 2025-09-04 03:09:53,324 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f70482a2-a229-4144-8246-98c0c781abd3 2025-09-04 03:09:53,333 - DEBUG - Requesting: http://10.0.0.57:8082/route-target/86d2aae4-f3f2-4057-bda0-b15eb528b8f7 2025-09-04 03:09:53,347 - DEBUG - Control-node 10.0.0.57 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15997318327518907032', 'uuid-lslong': '9916664828624177774'}, 'enable': 'true', 'created': '2025-09-04T03:09:52', 'last-modified': '2025-09-04T03:09:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453404'} 2025-09-04 03:09:53,354 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-04 03:09:53,359 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15997318327518907032', 'uuid-lslong': '9916664828624177774'}, 'enable': 'true', 'created': '2025-09-04T03:09:52', 'last-modified': '2025-09-04T03:09:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.456462'} 2025-09-04 03:09:53,368 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-04 03:09:53,374 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-15974803', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15997318327518907032', 'uuid-lslong': '9916664828624177774'}, 'enable': 'true', 'created': '2025-09-04T03:09:52', 'last-modified': '2025-09-04T03:09:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.475749'} 2025-09-04 03:09:53,379 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-04 03:09:53,379 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-39206756 passed 2025-09-04 03:09:53,380 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-39206756 in API_Server ====== 2025-09-04 03:09:53,380 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:53,386 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:53,397 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:53,488 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-network/de01e442-ee9c-4a98-899f-121ef2c10a6e 2025-09-04 03:09:53,497 - DEBUG - =>VN ctest-trans_right_vn-39206756 has no policy to be verified 2025-09-04 03:09:53,497 - DEBUG - Verifying the vn in opserver 2025-09-04 03:09:53,497 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756 virtual network link through opserver 10.0.0.57 2025-09-04 03:09:53,497 - DEBUG - Requesting: http://10.0.0.57:8081/analytics/uves/virtual-networks 2025-09-04 03:09:53,512 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756', 'href': 'http://10.0.0.57:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756?flat'} 2025-09-04 03:09:53,512 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756 virtual network link through opserver 10.0.0.38 2025-09-04 03:09:53,512 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-04 03:09:53,527 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756?flat'} 2025-09-04 03:09:53,527 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756 virtual network link through opserver 10.0.0.131 2025-09-04 03:09:53,527 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-09-04 03:09:53,538 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756?flat'} 2025-09-04 03:09:53,538 - INFO - Validated that VN default-domain:ctest-TestSvcHC-15974803:ctest-trans_right_vn-39206756 is found in opserver 2025-09-04 03:09:53,564 - DEBUG - Do not have enough data to verify VN in agent 2025-09-04 03:09:53,575 - DEBUG - VRF ids for VN ctest-trans_right_vn-39206756: {} 2025-09-04 03:09:54,730 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-2) 2025-09-04 03:09:56,268 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4012-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4012-1) 2025-09-04 03:09:56,268 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-04012349'] 2025-09-04 03:09:56,603 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-04012349'] created succesfully 2025-09-04 03:09:56,996 - DEBUG - Image by name tiny_trans_fw not found 2025-09-04 03:09:56,996 - DEBUG - Installing image tiny_trans_fw 2025-09-04 03:09:56,996 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-04 03:09:56,997 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-04 03:09:56,997 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-04 03:09:56,997 - DEBUG - Unzip image 2025-09-04 03:09:56,997 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-04 03:09:57,032 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-09-04 03:09:57,036 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-04012349'] 2025-09-04 03:09:57,144 - INFO - Service template: ['default-domain', 'ctest-service_template_1-04012349'] deleted successfully. 2025-09-04 03:09:57,144 - INFO - Skip interface_detach for VM ctest-right_vm-19340978 in state BUILD 2025-09-04 03:09:57,145 - INFO - Deleting VM ctest-right_vm-19340978 2025-09-04 03:09:57,145 - ERROR - VM ctest-right_vm-19340978 has failed to come up 2025-09-04 03:09:57,145 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:57,145 - ERROR - VM ctest-right_vm-19340978 has failed to come up 2025-09-04 03:09:57,145 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:57,252 - INFO - Skip interface_detach for VM ctest-left_vm-14932504 in state BUILD 2025-09-04 03:09:57,252 - INFO - Deleting VM ctest-left_vm-14932504 2025-09-04 03:09:57,252 - ERROR - VM ctest-left_vm-14932504 has failed to come up 2025-09-04 03:09:57,252 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:57,252 - ERROR - VM ctest-left_vm-14932504 has failed to come up 2025-09-04 03:09:57,252 - ERROR - Nova failed to get host of the VM 2025-09-04 03:09:57,345 - INFO - Deleting VN ctest-trans_right_vn-39206756 2025-09-04 03:09:57,531 - DEBUG - Response for deleting network () 2025-09-04 03:09:57,531 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/f70482a2-a229-4144-8246-98c0c781abd3 2025-09-04 03:09:57,544 - DEBUG - Response Code: 404 2025-09-04 03:09:57,544 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:57,550 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:57,563 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:57,673 - INFO - Validated that VN ctest-trans_right_vn-39206756 is not found in API Server 2025-09-04 03:09:57,687 - DEBUG - VN ctest-trans_right_vn-39206756 is not present in Agent 10.0.0.241 2025-09-04 03:09:57,698 - DEBUG - VN ctest-trans_right_vn-39206756 is not present in Agent 10.0.0.242 2025-09-04 03:09:57,698 - INFO - Validated that VN ctest-trans_right_vn-39206756 is not in any agent 2025-09-04 03:09:57,746 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-39206756 info 2025-09-04 03:09:57,746 - INFO - Deleting VN ctest-trans_left_vn-86046063 2025-09-04 03:09:57,910 - DEBUG - Response for deleting network () 2025-09-04 03:09:57,910 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/4e650c24-cf0d-4c02-bed8-11c09fd5ed49 2025-09-04 03:09:57,921 - DEBUG - Response Code: 404 2025-09-04 03:09:57,922 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:09:57,927 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:09:57,940 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:09:58,066 - INFO - Validated that VN ctest-trans_left_vn-86046063 is not found in API Server 2025-09-04 03:09:58,078 - DEBUG - VN ctest-trans_left_vn-86046063 is not present in Agent 10.0.0.241 2025-09-04 03:09:58,090 - DEBUG - VN ctest-trans_left_vn-86046063 is not present in Agent 10.0.0.242 2025-09-04 03:09:58,090 - INFO - Validated that VN ctest-trans_left_vn-86046063 is not in any agent 2025-09-04 03:09:58,147 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-86046063 info 2025-09-04 03:09:58,147 - INFO - Deleting VN ctest-right_vn-81914320 2025-09-04 03:09:58,218 - DEBUG - VN e327fd02-b5ec-4907-90a6-1ce2a0f7bca6 still in use: Unable to complete operation on network e327fd02-b5ec-4907-90a6-1ce2a0f7bca6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-976d337d-4cab-4c3d-ac20-a71c7813d244'] 2025-09-04 03:09:58,218 - WARNING - Deleting VN ctest-right_vn-81914320 failed..Will retry 2025-09-04 03:10:00,392 - DEBUG - Response for deleting network () 2025-09-04 03:10:00,392 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/e5dd81c7-ab96-496a-b16d-e53fdfbaaf3d 2025-09-04 03:10:00,398 - DEBUG - Response Code: 404 2025-09-04 03:10:00,398 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:10:00,413 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:10:00,431 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:10:00,537 - INFO - Validated that VN ctest-right_vn-81914320 is not found in API Server 2025-09-04 03:10:00,549 - DEBUG - VN ctest-right_vn-81914320 is not present in Agent 10.0.0.241 2025-09-04 03:10:00,560 - DEBUG - VN ctest-right_vn-81914320 is not present in Agent 10.0.0.242 2025-09-04 03:10:00,561 - INFO - Validated that VN ctest-right_vn-81914320 is not in any agent 2025-09-04 03:10:00,593 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-81914320 info 2025-09-04 03:10:00,593 - INFO - Deleting VN ctest-left_vn-28726799 2025-09-04 03:10:00,828 - DEBUG - Response for deleting network () 2025-09-04 03:10:00,828 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/6f35950b-ab00-4a53-99e6-6ceeb3318f33 2025-09-04 03:10:00,836 - DEBUG - Response Code: 404 2025-09-04 03:10:00,836 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:10:00,855 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:10:00,870 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:10:00,964 - INFO - Validated that VN ctest-left_vn-28726799 is not found in API Server 2025-09-04 03:10:00,975 - DEBUG - VN ctest-left_vn-28726799 is not present in Agent 10.0.0.241 2025-09-04 03:10:00,984 - DEBUG - VN ctest-left_vn-28726799 is not present in Agent 10.0.0.242 2025-09-04 03:10:00,985 - INFO - Validated that VN ctest-left_vn-28726799 is not in any agent 2025-09-04 03:10:01,018 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-28726799 info 2025-09-04 03:10:01,018 - INFO - Deleting VN ctest-mgmt_vn-34037988 2025-09-04 03:10:01,183 - DEBUG - Response for deleting network () 2025-09-04 03:10:01,184 - DEBUG - Requesting: http://10.0.0.57:8082/routing-instance/cacadb2d-7c1f-40f1-93ed-7fec20ae3b37 2025-09-04 03:10:01,191 - DEBUG - Response Code: 404 2025-09-04 03:10:01,191 - DEBUG - Requesting: http://10.0.0.57:8082/domains 2025-09-04 03:10:01,203 - DEBUG - Requesting: http://10.0.0.57:8082/domain/e0173f19-70be-4782-8849-f3657660486c 2025-09-04 03:10:01,217 - DEBUG - Requesting: http://10.0.0.57:8082/project/c5e36870-f666-4446-9e77-c4b1d725a2a0 2025-09-04 03:10:01,310 - INFO - Validated that VN ctest-mgmt_vn-34037988 is not found in API Server 2025-09-04 03:10:01,323 - DEBUG - VN ctest-mgmt_vn-34037988 is not present in Agent 10.0.0.241 2025-09-04 03:10:01,334 - DEBUG - VN ctest-mgmt_vn-34037988 is not present in Agent 10.0.0.242 2025-09-04 03:10:01,334 - INFO - Validated that VN ctest-mgmt_vn-34037988 is not in any agent 2025-09-04 03:10:01,368 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-34037988 info 2025-09-04 03:10:02,653 - DEBUG - No XMPP flaps were noticed during the test 2025-09-04 03:10:02,653 - INFO -
2025-09-04 03:10:02,653 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:21]
2025-09-04 03:10:02,653 - INFO - -------------------------------------------------------------------------------- 2025-09-04 03:10:03,419 - INFO - Deleted project: ctest-TestSvcHC-15974803, ID : c5e36870-f666-4446-9e77-c4b1d725a2a0