2025-10-30 11:11:34,688 - INFO - Domain Default found not creating 2025-10-30 11:11:34,865 - INFO - Project ctest-TestSvcHC-34212603 not found, creating it 2025-10-30 11:11:35,438 - INFO - Created Project:ctest-TestSvcHC-34212603, ID : 087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:36,998 - INFO - ================================================================================ 2025-10-30 11:11:36,998 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-30 11:11:38,300 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.131': '0', '10.20.0.128': '0'}, '10.0.0.27': {'10.20.0.145': '0', '10.20.0.128': '0'}} with 2025-10-30 11:11:38,300 - INFO - Initial checks done. Running the testcase now 2025-10-30 11:11:38,300 - INFO - 2025-10-30 11:11:39,009 - DEBUG - Response for create_network : {'network': {'id': '195a52c9-94c6-4daa-ad2a-181d4d79c3ad', 'name': 'ctest-mgmt_vn-34128463', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-mgmt_vn-34128463'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:39,280 - DEBUG - Response for create_subnet : {'subnet': {'id': '99d97df4-03e9-481d-85ac-5e5d42a6fed6', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': '195a52c9-94c6-4daa-ad2a-181d4d79c3ad', 'ip_version': 4, 'cidr': '112.184.140.0/26', 'allocation_pools': [{'start': '112.184.140.2', 'end': '112.184.140.62'}], 'gateway_ip': '112.184.140.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '112.184.140.2', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:39,304 - INFO - Created VN ctest-mgmt_vn-34128463 2025-10-30 11:11:39,319 - DEBUG - VN ctest-mgmt_vn-34128463 UUID is 195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:39,411 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:39,738 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:39,769 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:39,787 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:39,885 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:39,905 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:39,916 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/350bcc07-75fd-4c1a-ab37-372bed576208 2025-10-30 11:11:39,928 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/350bcc07-75fd-4c1a-ab37-372bed576208 2025-10-30 11:11:39,938 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6d0b592f-66ca-4964-882a-d1d5af6e3f72 2025-10-30 11:11:39,947 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:39,947 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:39,958 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/350bcc07-75fd-4c1a-ab37-372bed576208 2025-10-30 11:11:39,982 - INFO - Verified VN network id 15 for VN 195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:39,982 - INFO - Verifications in API Server for VN ctest-mgmt_vn-34128463 passed 2025-10-30 11:11:39,982 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:39,993 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/350bcc07-75fd-4c1a-ab37-372bed576208 2025-10-30 11:11:40,002 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/350bcc07-75fd-4c1a-ab37-372bed576208 2025-10-30 11:11:40,010 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6d0b592f-66ca-4964-882a-d1d5af6e3f72 2025-10-30 11:11:40,027 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1826863624590085546', 'uuid-lslong': '12477812231716324269'}, 'enable': 'true', 'created': '2025-10-30T11:11:38', 'last-modified': '2025-10-30T11:11:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.798620'} 2025-10-30 11:11:40,035 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:40,043 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1826863624590085546', 'uuid-lslong': '12477812231716324269'}, 'enable': 'true', 'created': '2025-10-30T11:11:38', 'last-modified': '2025-10-30T11:11:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.815408'} 2025-10-30 11:11:40,050 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:40,057 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1826863624590085546', 'uuid-lslong': '12477812231716324269'}, 'enable': 'true', 'created': '2025-10-30T11:11:38', 'last-modified': '2025-10-30T11:11:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.829921'} 2025-10-30 11:11:40,064 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:40,064 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-34128463 passed 2025-10-30 11:11:40,064 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-34128463 in API_Server ====== 2025-10-30 11:11:40,065 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:40,071 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:40,083 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:40,186 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/195a52c9-94c6-4daa-ad2a-181d4d79c3ad 2025-10-30 11:11:40,196 - DEBUG - =>VN ctest-mgmt_vn-34128463 has no policy to be verified 2025-10-30 11:11:40,197 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:40,197 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:40,197 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:40,510 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:40,578 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463?flat'} 2025-10-30 11:11:40,578 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:40,578 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:40,889 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:40,963 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463?flat'} 2025-10-30 11:11:40,963 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:40,963 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:41,270 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:41,336 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463?flat'} 2025-10-30 11:11:41,336 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-34128463 is found in opserver 2025-10-30 11:11:41,362 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:41,375 - DEBUG - VRF ids for VN ctest-mgmt_vn-34128463: {} 2025-10-30 11:11:41,667 - DEBUG - Response for create_network : {'network': {'id': '0ec51884-7a99-49c3-8c3a-4b540543da98', 'name': 'ctest-left_vn-14495485', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-left_vn-14495485'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:41,899 - DEBUG - Response for create_subnet : {'subnet': {'id': '13801cf3-8609-49d4-b19d-773c712c2e82', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': '0ec51884-7a99-49c3-8c3a-4b540543da98', 'ip_version': 4, 'cidr': '16.99.220.192/26', 'allocation_pools': [{'start': '16.99.220.194', 'end': '16.99.220.254'}], 'gateway_ip': '16.99.220.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '16.99.220.194', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:41,927 - INFO - Created VN ctest-left_vn-14495485 2025-10-30 11:11:41,943 - DEBUG - VN ctest-left_vn-14495485 UUID is 0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,032 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:42,042 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:42,058 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:42,156 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,170 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,181 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f6361922-df0f-4fa3-a3d2-8370ff695f3a 2025-10-30 11:11:42,191 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f6361922-df0f-4fa3-a3d2-8370ff695f3a 2025-10-30 11:11:42,199 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a07b7401-b7e6-42e4-b9b6-d267dd018d1d 2025-10-30 11:11:42,207 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:42,207 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,217 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f6361922-df0f-4fa3-a3d2-8370ff695f3a 2025-10-30 11:11:42,241 - INFO - Verified VN network id 16 for VN 0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,241 - INFO - Verifications in API Server for VN ctest-left_vn-14495485 passed 2025-10-30 11:11:42,241 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,253 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f6361922-df0f-4fa3-a3d2-8370ff695f3a 2025-10-30 11:11:42,262 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f6361922-df0f-4fa3-a3d2-8370ff695f3a 2025-10-30 11:11:42,271 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a07b7401-b7e6-42e4-b9b6-d267dd018d1d 2025-10-30 11:11:42,286 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1064283844214606275', 'uuid-lslong': '10104471538196798104'}, 'enable': 'true', 'created': '2025-10-30T11:11:41', 'last-modified': '2025-10-30T11:11:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.458308'} 2025-10-30 11:11:42,294 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:42,301 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1064283844214606275', 'uuid-lslong': '10104471538196798104'}, 'enable': 'true', 'created': '2025-10-30T11:11:41', 'last-modified': '2025-10-30T11:11:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.473618'} 2025-10-30 11:11:42,308 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:42,313 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1064283844214606275', 'uuid-lslong': '10104471538196798104'}, 'enable': 'true', 'created': '2025-10-30T11:11:41', 'last-modified': '2025-10-30T11:11:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.484709'} 2025-10-30 11:11:42,320 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:42,321 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-14495485 passed 2025-10-30 11:11:42,321 - DEBUG - ====Verifying policy data for ctest-left_vn-14495485 in API_Server ====== 2025-10-30 11:11:42,321 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:42,328 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:42,339 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:42,438 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/0ec51884-7a99-49c3-8c3a-4b540543da98 2025-10-30 11:11:42,448 - DEBUG - =>VN ctest-left_vn-14495485 has no policy to be verified 2025-10-30 11:11:42,448 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:42,448 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:42,448 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:42,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485?flat'} 2025-10-30 11:11:42,511 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:42,511 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:42,576 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485?flat'} 2025-10-30 11:11:42,576 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:42,576 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:42,639 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485?flat'} 2025-10-30 11:11:42,639 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-14495485 is found in opserver 2025-10-30 11:11:42,663 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:42,675 - DEBUG - VRF ids for VN ctest-left_vn-14495485: {} 2025-10-30 11:11:43,003 - DEBUG - Response for create_network : {'network': {'id': '82297408-580c-4693-b163-bfc5a847acce', 'name': 'ctest-right_vn-93566454', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-right_vn-93566454'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:43,282 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c29ad541-9a7e-4e65-ad84-b38c09cf1995', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': '82297408-580c-4693-b163-bfc5a847acce', 'ip_version': 4, 'cidr': '199.211.145.0/26', 'allocation_pools': [{'start': '199.211.145.2', 'end': '199.211.145.62'}], 'gateway_ip': '199.211.145.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '199.211.145.2', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:43,311 - INFO - Created VN ctest-right_vn-93566454 2025-10-30 11:11:43,326 - DEBUG - VN ctest-right_vn-93566454 UUID is 82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,412 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:43,419 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:43,432 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:43,545 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,563 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,578 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2df80785-a0e8-4e9d-966d-752bdec295a4 2025-10-30 11:11:43,589 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2df80785-a0e8-4e9d-966d-752bdec295a4 2025-10-30 11:11:43,601 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/57db49c1-dcab-4814-a617-0834313fa1b7 2025-10-30 11:11:43,616 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:43,616 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,630 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2df80785-a0e8-4e9d-966d-752bdec295a4 2025-10-30 11:11:43,651 - INFO - Verified VN network id 17 for VN 82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,651 - INFO - Verifications in API Server for VN ctest-right_vn-93566454 passed 2025-10-30 11:11:43,651 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,663 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2df80785-a0e8-4e9d-966d-752bdec295a4 2025-10-30 11:11:43,672 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2df80785-a0e8-4e9d-966d-752bdec295a4 2025-10-30 11:11:43,682 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/57db49c1-dcab-4814-a617-0834313fa1b7 2025-10-30 11:11:43,701 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9379155278161528467', 'uuid-lslong': '12782271023060331726'}, 'enable': 'true', 'created': '2025-10-30T11:11:42', 'last-modified': '2025-10-30T11:11:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481349'} 2025-10-30 11:11:43,709 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:43,715 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9379155278161528467', 'uuid-lslong': '12782271023060331726'}, 'enable': 'true', 'created': '2025-10-30T11:11:42', 'last-modified': '2025-10-30T11:11:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491089'} 2025-10-30 11:11:43,722 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:43,729 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9379155278161528467', 'uuid-lslong': '12782271023060331726'}, 'enable': 'true', 'created': '2025-10-30T11:11:42', 'last-modified': '2025-10-30T11:11:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510679'} 2025-10-30 11:11:43,738 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:43,738 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-93566454 passed 2025-10-30 11:11:43,738 - DEBUG - ====Verifying policy data for ctest-right_vn-93566454 in API_Server ====== 2025-10-30 11:11:43,738 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:43,747 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:43,762 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:43,871 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/82297408-580c-4693-b163-bfc5a847acce 2025-10-30 11:11:43,883 - DEBUG - =>VN ctest-right_vn-93566454 has no policy to be verified 2025-10-30 11:11:43,883 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:43,883 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:43,883 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:43,943 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454?flat'} 2025-10-30 11:11:43,943 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:43,943 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:44,011 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454?flat'} 2025-10-30 11:11:44,011 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:44,011 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:44,088 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454?flat'} 2025-10-30 11:11:44,088 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-93566454 is found in opserver 2025-10-30 11:11:44,115 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:44,128 - DEBUG - VRF ids for VN ctest-right_vn-93566454: {} 2025-10-30 11:11:44,194 - DEBUG - Services list from nova: [, , , ] 2025-10-30 11:11:45,372 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-1) 2025-10-30 11:11:46,999 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-2) 2025-10-30 11:11:46,999 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-84529900'] 2025-10-30 11:11:47,453 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-84529900'] created succesfully 2025-10-30 11:11:47,872 - DEBUG - Image by name tiny_nat_fw not found 2025-10-30 11:11:47,872 - DEBUG - Installing image tiny_nat_fw 2025-10-30 11:11:47,872 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-30 11:11:47,872 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-30 11:11:47,872 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-30 11:11:47,873 - DEBUG - Unzip image 2025-10-30 11:11:47,873 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-30 11:11:47,891 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-30 11:11:47,892 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-84529900'] 2025-10-30 11:11:48,025 - INFO - Service template: ['default-domain', 'ctest-service_template_1-84529900'] deleted successfully. 2025-10-30 11:11:48,025 - INFO - Skip interface_detach for VM ctest-right_vm-43356324 in state BUILD 2025-10-30 11:11:48,025 - INFO - Deleting VM ctest-right_vm-43356324 2025-10-30 11:11:48,056 - ERROR - VM ctest-right_vm-43356324 has failed to come up 2025-10-30 11:11:48,056 - ERROR - Nova failed to get host of the VM 2025-10-30 11:11:48,056 - ERROR - VM ctest-right_vm-43356324 has failed to come up 2025-10-30 11:11:48,057 - ERROR - Nova failed to get host of the VM 2025-10-30 11:11:48,144 - INFO - Skip interface_detach for VM ctest-left_vm-11551947 in state BUILD 2025-10-30 11:11:48,144 - INFO - Deleting VM ctest-left_vm-11551947 2025-10-30 11:11:48,144 - ERROR - VM ctest-left_vm-11551947 has failed to come up 2025-10-30 11:11:48,144 - ERROR - Nova failed to get host of the VM 2025-10-30 11:11:48,144 - ERROR - VM ctest-left_vm-11551947 has failed to come up 2025-10-30 11:11:48,144 - ERROR - Nova failed to get host of the VM 2025-10-30 11:11:48,228 - INFO - Deleting VN ctest-right_vn-93566454 2025-10-30 11:11:48,299 - DEBUG - VN 82297408-580c-4693-b163-bfc5a847acce still in use: Unable to complete operation on network 82297408-580c-4693-b163-bfc5a847acce. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-96b3e3b4-b1ec-49d6-a949-7afd0ce84599'] 2025-10-30 11:11:48,299 - WARNING - Deleting VN ctest-right_vn-93566454 failed..Will retry 2025-10-30 11:11:50,520 - DEBUG - Response for deleting network () 2025-10-30 11:11:50,521 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2df80785-a0e8-4e9d-966d-752bdec295a4 2025-10-30 11:11:50,535 - DEBUG - Response Code: 404 2025-10-30 11:11:50,535 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:50,547 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:50,565 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:50,669 - INFO - Validated that VN ctest-right_vn-93566454 is not found in API Server 2025-10-30 11:11:50,681 - DEBUG - VN ctest-right_vn-93566454 is not present in Agent 10.0.0.41 2025-10-30 11:11:50,692 - DEBUG - VN ctest-right_vn-93566454 is not present in Agent 10.0.0.27 2025-10-30 11:11:50,692 - INFO - Validated that VN ctest-right_vn-93566454 is not in any agent 2025-10-30 11:11:50,726 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-93566454 info 2025-10-30 11:11:50,726 - INFO - Deleting VN ctest-left_vn-14495485 2025-10-30 11:11:50,921 - DEBUG - Response for deleting network () 2025-10-30 11:11:50,921 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/f6361922-df0f-4fa3-a3d2-8370ff695f3a 2025-10-30 11:11:50,926 - DEBUG - Response Code: 404 2025-10-30 11:11:50,927 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:50,939 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:50,960 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:51,057 - INFO - Validated that VN ctest-left_vn-14495485 is not found in API Server 2025-10-30 11:11:51,070 - DEBUG - VN ctest-left_vn-14495485 is not present in Agent 10.0.0.41 2025-10-30 11:11:51,083 - DEBUG - VN ctest-left_vn-14495485 is not present in Agent 10.0.0.27 2025-10-30 11:11:51,083 - INFO - Validated that VN ctest-left_vn-14495485 is not in any agent 2025-10-30 11:11:51,120 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-14495485 info 2025-10-30 11:11:51,120 - INFO - Deleting VN ctest-mgmt_vn-34128463 2025-10-30 11:11:51,268 - DEBUG - Response for deleting network () 2025-10-30 11:11:51,269 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/350bcc07-75fd-4c1a-ab37-372bed576208 2025-10-30 11:11:51,276 - DEBUG - Response Code: 404 2025-10-30 11:11:51,276 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:51,282 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:51,294 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:51,391 - INFO - Validated that VN ctest-mgmt_vn-34128463 is not found in API Server 2025-10-30 11:11:51,405 - DEBUG - VN ctest-mgmt_vn-34128463 is not present in Agent 10.0.0.41 2025-10-30 11:11:51,416 - DEBUG - VN ctest-mgmt_vn-34128463 is not present in Agent 10.0.0.27 2025-10-30 11:11:51,416 - INFO - Validated that VN ctest-mgmt_vn-34128463 is not in any agent 2025-10-30 11:11:51,457 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-34128463 info 2025-10-30 11:11:52,817 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 11:11:52,817 - INFO - 2025-10-30 11:11:52,817 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16] 2025-10-30 11:11:52,817 - INFO - -------------------------------------------------------------------------------- 2025-10-30 11:11:52,821 - INFO - ================================================================================ 2025-10-30 11:11:52,821 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-30 11:11:54,114 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.131': '0', '10.20.0.128': '0'}, '10.0.0.27': {'10.20.0.145': '0', '10.20.0.128': '0'}} with 2025-10-30 11:11:54,114 - INFO - Initial checks done. Running the testcase now 2025-10-30 11:11:54,114 - INFO - 2025-10-30 11:11:54,396 - DEBUG - Response for create_network : {'network': {'id': 'cff855fe-377f-498a-929e-66d3f02bc3ba', 'name': 'ctest-mgmt_vn-66813694', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-mgmt_vn-66813694'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:54,679 - DEBUG - Response for create_subnet : {'subnet': {'id': '40680fd9-d020-41c5-ae98-14ab91bcb070', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': 'cff855fe-377f-498a-929e-66d3f02bc3ba', 'ip_version': 4, 'cidr': '142.129.236.192/26', 'allocation_pools': [{'start': '142.129.236.194', 'end': '142.129.236.254'}], 'gateway_ip': '142.129.236.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.129.236.194', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:54,717 - INFO - Created VN ctest-mgmt_vn-66813694 2025-10-30 11:11:54,784 - DEBUG - VN ctest-mgmt_vn-66813694 UUID is cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:54,899 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:54,906 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:54,918 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:55,020 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:55,036 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:55,048 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e6f8ba8e-06fc-40dd-919a-51dd959b68e3 2025-10-30 11:11:55,060 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e6f8ba8e-06fc-40dd-919a-51dd959b68e3 2025-10-30 11:11:55,069 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/38d90dec-89fe-4cc3-bc95-b8f5b78e6610 2025-10-30 11:11:55,077 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:55,077 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:55,087 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e6f8ba8e-06fc-40dd-919a-51dd959b68e3 2025-10-30 11:11:55,105 - INFO - Verified VN network id 15 for VN cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:55,105 - INFO - Verifications in API Server for VN ctest-mgmt_vn-66813694 passed 2025-10-30 11:11:55,105 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:55,115 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e6f8ba8e-06fc-40dd-919a-51dd959b68e3 2025-10-30 11:11:55,124 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e6f8ba8e-06fc-40dd-919a-51dd959b68e3 2025-10-30 11:11:55,134 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/38d90dec-89fe-4cc3-bc95-b8f5b78e6610 2025-10-30 11:11:55,147 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14985822310416468362', 'uuid-lslong': '10564994836311294906'}, 'enable': 'true', 'created': '2025-10-30T11:11:54', 'last-modified': '2025-10-30T11:11:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525425'} 2025-10-30 11:11:55,152 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:55,158 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14985822310416468362', 'uuid-lslong': '10564994836311294906'}, 'enable': 'true', 'created': '2025-10-30T11:11:54', 'last-modified': '2025-10-30T11:11:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.537098'} 2025-10-30 11:11:55,165 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:55,172 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14985822310416468362', 'uuid-lslong': '10564994836311294906'}, 'enable': 'true', 'created': '2025-10-30T11:11:54', 'last-modified': '2025-10-30T11:11:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.544464'} 2025-10-30 11:11:55,179 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:11:55,180 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-66813694 passed 2025-10-30 11:11:55,180 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-66813694 in API_Server ====== 2025-10-30 11:11:55,180 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:55,188 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:55,201 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:55,294 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cff855fe-377f-498a-929e-66d3f02bc3ba 2025-10-30 11:11:55,309 - DEBUG - =>VN ctest-mgmt_vn-66813694 has no policy to be verified 2025-10-30 11:11:55,309 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:55,309 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:55,309 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:55,323 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694?flat'} 2025-10-30 11:11:55,323 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:55,323 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:55,337 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694?flat'} 2025-10-30 11:11:55,337 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:55,337 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:55,351 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694?flat'} 2025-10-30 11:11:55,351 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-mgmt_vn-66813694 is found in opserver 2025-10-30 11:11:55,378 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:55,390 - DEBUG - VRF ids for VN ctest-mgmt_vn-66813694: {} 2025-10-30 11:11:55,659 - DEBUG - Response for create_network : {'network': {'id': 'db9abcda-941b-4f0f-8beb-3d8d33b21b7c', 'name': 'ctest-left_vn-77139656', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-left_vn-77139656'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:55,931 - DEBUG - Response for create_subnet : {'subnet': {'id': '8151024e-6fa9-4547-b48b-03ca51a69df5', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': 'db9abcda-941b-4f0f-8beb-3d8d33b21b7c', 'ip_version': 4, 'cidr': '198.13.195.64/26', 'allocation_pools': [{'start': '198.13.195.66', 'end': '198.13.195.126'}], 'gateway_ip': '198.13.195.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.13.195.66', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:55,958 - INFO - Created VN ctest-left_vn-77139656 2025-10-30 11:11:55,972 - DEBUG - VN ctest-left_vn-77139656 UUID is db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,077 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:56,088 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:56,110 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:56,218 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,235 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,249 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/3b96d12b-ff67-40b4-b144-300560d58bb7 2025-10-30 11:11:56,260 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/3b96d12b-ff67-40b4-b144-300560d58bb7 2025-10-30 11:11:56,270 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/91601880-fa2b-4d5b-949f-09e08e2efa98 2025-10-30 11:11:56,280 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:56,281 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,291 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/3b96d12b-ff67-40b4-b144-300560d58bb7 2025-10-30 11:11:56,310 - INFO - Verified VN network id 16 for VN db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,310 - INFO - Verifications in API Server for VN ctest-left_vn-77139656 passed 2025-10-30 11:11:56,310 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,321 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/3b96d12b-ff67-40b4-b144-300560d58bb7 2025-10-30 11:11:56,333 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/3b96d12b-ff67-40b4-b144-300560d58bb7 2025-10-30 11:11:56,342 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/91601880-fa2b-4d5b-949f-09e08e2efa98 2025-10-30 11:11:56,359 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15824167887693369103', 'uuid-lslong': '10082219867465980796'}, 'enable': 'true', 'created': '2025-10-30T11:11:55', 'last-modified': '2025-10-30T11:11:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.483951'} 2025-10-30 11:11:56,366 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:56,372 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15824167887693369103', 'uuid-lslong': '10082219867465980796'}, 'enable': 'true', 'created': '2025-10-30T11:11:55', 'last-modified': '2025-10-30T11:11:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.498708'} 2025-10-30 11:11:56,378 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:56,385 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15824167887693369103', 'uuid-lslong': '10082219867465980796'}, 'enable': 'true', 'created': '2025-10-30T11:11:55', 'last-modified': '2025-10-30T11:11:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.507057'} 2025-10-30 11:11:56,391 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:11:56,391 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-77139656 passed 2025-10-30 11:11:56,391 - DEBUG - ====Verifying policy data for ctest-left_vn-77139656 in API_Server ====== 2025-10-30 11:11:56,391 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:56,398 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:56,412 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:56,504 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/db9abcda-941b-4f0f-8beb-3d8d33b21b7c 2025-10-30 11:11:56,514 - DEBUG - =>VN ctest-left_vn-77139656 has no policy to be verified 2025-10-30 11:11:56,514 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:56,514 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:56,515 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:56,529 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656?flat'} 2025-10-30 11:11:56,529 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:56,529 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:56,543 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656?flat'} 2025-10-30 11:11:56,543 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:56,543 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:56,556 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656?flat'} 2025-10-30 11:11:56,556 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-left_vn-77139656 is found in opserver 2025-10-30 11:11:56,580 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:56,591 - DEBUG - VRF ids for VN ctest-left_vn-77139656: {} 2025-10-30 11:11:56,906 - DEBUG - Response for create_network : {'network': {'id': '4fb1bc82-b4ba-43d3-9c6d-203402e11df0', 'name': 'ctest-right_vn-22463433', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-right_vn-22463433'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:57,164 - DEBUG - Response for create_subnet : {'subnet': {'id': '4573289f-18a6-41be-bfda-9e54feefeb4c', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': '4fb1bc82-b4ba-43d3-9c6d-203402e11df0', 'ip_version': 4, 'cidr': '193.207.113.0/26', 'allocation_pools': [{'start': '193.207.113.2', 'end': '193.207.113.62'}], 'gateway_ip': '193.207.113.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '193.207.113.2', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:57,192 - INFO - Created VN ctest-right_vn-22463433 2025-10-30 11:11:57,207 - DEBUG - VN ctest-right_vn-22463433 UUID is 4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,288 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:57,296 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:57,310 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:57,408 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,422 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,432 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b5c209e6-c172-4d52-a18d-7e7133ac1c11 2025-10-30 11:11:57,441 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b5c209e6-c172-4d52-a18d-7e7133ac1c11 2025-10-30 11:11:57,450 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/92b31a9e-5bd2-43e0-96b9-e727694be61b 2025-10-30 11:11:57,459 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:57,459 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,469 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b5c209e6-c172-4d52-a18d-7e7133ac1c11 2025-10-30 11:11:57,488 - INFO - Verified VN network id 17 for VN 4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,488 - INFO - Verifications in API Server for VN ctest-right_vn-22463433 passed 2025-10-30 11:11:57,488 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,500 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b5c209e6-c172-4d52-a18d-7e7133ac1c11 2025-10-30 11:11:57,508 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b5c209e6-c172-4d52-a18d-7e7133ac1c11 2025-10-30 11:11:57,516 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/92b31a9e-5bd2-43e0-96b9-e727694be61b 2025-10-30 11:11:57,531 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5742578269437969363', 'uuid-lslong': '11271700850136915440'}, 'enable': 'true', 'created': '2025-10-30T11:11:56', 'last-modified': '2025-10-30T11:11:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421814'} 2025-10-30 11:11:57,538 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:57,544 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5742578269437969363', 'uuid-lslong': '11271700850136915440'}, 'enable': 'true', 'created': '2025-10-30T11:11:56', 'last-modified': '2025-10-30T11:11:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421660'} 2025-10-30 11:11:57,551 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:57,558 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5742578269437969363', 'uuid-lslong': '11271700850136915440'}, 'enable': 'true', 'created': '2025-10-30T11:11:56', 'last-modified': '2025-10-30T11:11:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448899'} 2025-10-30 11:11:57,565 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:11:57,565 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-22463433 passed 2025-10-30 11:11:57,565 - DEBUG - ====Verifying policy data for ctest-right_vn-22463433 in API_Server ====== 2025-10-30 11:11:57,565 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:57,571 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:57,584 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:57,683 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/4fb1bc82-b4ba-43d3-9c6d-203402e11df0 2025-10-30 11:11:57,693 - DEBUG - =>VN ctest-right_vn-22463433 has no policy to be verified 2025-10-30 11:11:57,693 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:57,693 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:57,693 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:57,707 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433?flat'} 2025-10-30 11:11:57,707 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:57,707 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:57,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433?flat'} 2025-10-30 11:11:57,722 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:57,723 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:57,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433?flat'} 2025-10-30 11:11:57,740 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-right_vn-22463433 is found in opserver 2025-10-30 11:11:57,763 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:57,775 - DEBUG - VRF ids for VN ctest-right_vn-22463433: {} 2025-10-30 11:11:58,073 - DEBUG - Response for create_network : {'network': {'id': '52831cee-1932-4ae9-bf58-0813ab47485b', 'name': 'ctest-trans_left_vn-62144933', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-trans_left_vn-62144933'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:58,336 - DEBUG - Response for create_subnet : {'subnet': {'id': '57c4c0c0-6895-4e7a-81d6-e50387e9444f', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': '52831cee-1932-4ae9-bf58-0813ab47485b', 'ip_version': 4, 'cidr': '135.13.17.64/26', 'allocation_pools': [{'start': '135.13.17.66', 'end': '135.13.17.126'}], 'gateway_ip': '135.13.17.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '135.13.17.66', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:58,366 - INFO - Created VN ctest-trans_left_vn-62144933 2025-10-30 11:11:58,380 - DEBUG - VN ctest-trans_left_vn-62144933 UUID is 52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,467 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:58,475 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:58,493 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:58,601 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,621 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,643 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b0d365a7-ee25-46c2-adb0-22e45eb214d9 2025-10-30 11:11:58,659 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b0d365a7-ee25-46c2-adb0-22e45eb214d9 2025-10-30 11:11:58,671 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d491af20-be49-450f-91e8-a008e329abc8 2025-10-30 11:11:58,682 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:11:58,682 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,695 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b0d365a7-ee25-46c2-adb0-22e45eb214d9 2025-10-30 11:11:58,714 - INFO - Verified VN network id 18 for VN 52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,714 - INFO - Verifications in API Server for VN ctest-trans_left_vn-62144933 passed 2025-10-30 11:11:58,715 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,727 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b0d365a7-ee25-46c2-adb0-22e45eb214d9 2025-10-30 11:11:58,736 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b0d365a7-ee25-46c2-adb0-22e45eb214d9 2025-10-30 11:11:58,744 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d491af20-be49-450f-91e8-a008e329abc8 2025-10-30 11:11:58,769 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5945627742009707241', 'uuid-lslong': '13787779139765749851'}, 'enable': 'true', 'created': '2025-10-30T11:11:58', 'last-modified': '2025-10-30T11:11:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481611'} 2025-10-30 11:11:58,780 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:11:58,788 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5945627742009707241', 'uuid-lslong': '13787779139765749851'}, 'enable': 'true', 'created': '2025-10-30T11:11:58', 'last-modified': '2025-10-30T11:11:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506043'} 2025-10-30 11:11:58,798 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:11:58,804 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5945627742009707241', 'uuid-lslong': '13787779139765749851'}, 'enable': 'true', 'created': '2025-10-30T11:11:58', 'last-modified': '2025-10-30T11:11:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532690'} 2025-10-30 11:11:58,812 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:11:58,812 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-62144933 passed 2025-10-30 11:11:58,812 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-62144933 in API_Server ====== 2025-10-30 11:11:58,812 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:58,820 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:58,837 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:58,944 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/52831cee-1932-4ae9-bf58-0813ab47485b 2025-10-30 11:11:58,965 - DEBUG - =>VN ctest-trans_left_vn-62144933 has no policy to be verified 2025-10-30 11:11:58,965 - DEBUG - Verifying the vn in opserver 2025-10-30 11:11:58,965 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933 virtual network link through opserver 10.0.0.249 2025-10-30 11:11:58,965 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:11:58,979 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933?flat'} 2025-10-30 11:11:58,980 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933 virtual network link through opserver 10.0.0.33 2025-10-30 11:11:58,980 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:11:58,994 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933?flat'} 2025-10-30 11:11:58,994 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933 virtual network link through opserver 10.0.0.19 2025-10-30 11:11:58,994 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:11:59,009 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933?flat'} 2025-10-30 11:11:59,009 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-trans_left_vn-62144933 is found in opserver 2025-10-30 11:11:59,036 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:11:59,051 - DEBUG - VRF ids for VN ctest-trans_left_vn-62144933: {} 2025-10-30 11:11:59,367 - DEBUG - Response for create_network : {'network': {'id': 'd631f8c2-db1b-40bc-b5bd-8d48952965ae', 'name': 'ctest-trans_right_vn-14324863', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'project_id': '087cc48c53564f84978430649f03dcca', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34212603', 'ctest-trans_right_vn-14324863'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:11:59,618 - DEBUG - Response for create_subnet : {'subnet': {'id': '0a81a7cc-d1c6-4285-8a63-f39030ada437', 'name': '', 'tenant_id': '087cc48c53564f84978430649f03dcca', 'network_id': 'd631f8c2-db1b-40bc-b5bd-8d48952965ae', 'ip_version': 4, 'cidr': '163.221.11.128/26', 'allocation_pools': [{'start': '163.221.11.130', 'end': '163.221.11.190'}], 'gateway_ip': '163.221.11.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '163.221.11.130', 'tags': [], 'project_id': '087cc48c53564f84978430649f03dcca'}} 2025-10-30 11:11:59,642 - INFO - Created VN ctest-trans_right_vn-14324863 2025-10-30 11:11:59,655 - DEBUG - VN ctest-trans_right_vn-14324863 UUID is d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:11:59,750 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:11:59,756 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:11:59,770 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:11:59,889 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:11:59,912 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:11:59,927 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/26b608f3-522c-426f-973d-1e87e2591dad 2025-10-30 11:11:59,950 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/26b608f3-522c-426f-973d-1e87e2591dad 2025-10-30 11:11:59,965 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/ea987b76-4a0e-44ca-9fb5-cf5fc59f5e78 2025-10-30 11:11:59,974 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:11:59,975 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:11:59,991 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/26b608f3-522c-426f-973d-1e87e2591dad 2025-10-30 11:12:00,048 - INFO - Verified VN network id 19 for VN d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:12:00,048 - INFO - Verifications in API Server for VN ctest-trans_right_vn-14324863 passed 2025-10-30 11:12:00,048 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:12:00,067 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/26b608f3-522c-426f-973d-1e87e2591dad 2025-10-30 11:12:00,077 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/26b608f3-522c-426f-973d-1e87e2591dad 2025-10-30 11:12:00,088 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/ea987b76-4a0e-44ca-9fb5-cf5fc59f5e78 2025-10-30 11:12:00,103 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15434390913758740668', 'uuid-lslong': '13095778634342950318'}, 'enable': 'true', 'created': '2025-10-30T11:11:59', 'last-modified': '2025-10-30T11:11:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.551115'} 2025-10-30 11:12:00,111 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:00,118 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15434390913758740668', 'uuid-lslong': '13095778634342950318'}, 'enable': 'true', 'created': '2025-10-30T11:11:59', 'last-modified': '2025-10-30T11:11:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.566535'} 2025-10-30 11:12:00,125 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:00,133 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34212603', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15434390913758740668', 'uuid-lslong': '13095778634342950318'}, 'enable': 'true', 'created': '2025-10-30T11:11:59', 'last-modified': '2025-10-30T11:11:59', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.575190'} 2025-10-30 11:12:00,141 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:00,141 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-14324863 passed 2025-10-30 11:12:00,141 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-14324863 in API_Server ====== 2025-10-30 11:12:00,141 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:00,149 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:00,166 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:12:00,274 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d631f8c2-db1b-40bc-b5bd-8d48952965ae 2025-10-30 11:12:00,287 - DEBUG - =>VN ctest-trans_right_vn-14324863 has no policy to be verified 2025-10-30 11:12:00,287 - DEBUG - Verifying the vn in opserver 2025-10-30 11:12:00,287 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863 virtual network link through opserver 10.0.0.249 2025-10-30 11:12:00,287 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:00,302 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863?flat'} 2025-10-30 11:12:00,302 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863 virtual network link through opserver 10.0.0.33 2025-10-30 11:12:00,302 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:00,319 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863?flat'} 2025-10-30 11:12:00,319 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863 virtual network link through opserver 10.0.0.19 2025-10-30 11:12:00,320 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:00,333 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863?flat'} 2025-10-30 11:12:00,333 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34212603:ctest-trans_right_vn-14324863 is found in opserver 2025-10-30 11:12:00,363 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:12:00,379 - DEBUG - VRF ids for VN ctest-trans_right_vn-14324863: {} 2025-10-30 11:12:01,586 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-2) 2025-10-30 11:12:03,062 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-1) 2025-10-30 11:12:03,062 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-82389065'] 2025-10-30 11:12:03,362 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-82389065'] created succesfully 2025-10-30 11:12:03,781 - DEBUG - Image by name tiny_trans_fw not found 2025-10-30 11:12:03,781 - DEBUG - Installing image tiny_trans_fw 2025-10-30 11:12:03,781 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-30 11:12:03,781 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-30 11:12:03,781 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-30 11:12:03,781 - DEBUG - Unzip image 2025-10-30 11:12:03,781 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-30 11:12:03,810 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-30 11:12:03,810 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-82389065'] 2025-10-30 11:12:03,940 - INFO - Service template: ['default-domain', 'ctest-service_template_1-82389065'] deleted successfully. 2025-10-30 11:12:03,941 - INFO - Skip interface_detach for VM ctest-right_vm-23943084 in state BUILD 2025-10-30 11:12:03,941 - INFO - Deleting VM ctest-right_vm-23943084 2025-10-30 11:12:03,941 - ERROR - VM ctest-right_vm-23943084 has failed to come up 2025-10-30 11:12:03,941 - ERROR - Nova failed to get host of the VM 2025-10-30 11:12:03,941 - ERROR - VM ctest-right_vm-23943084 has failed to come up 2025-10-30 11:12:03,941 - ERROR - Nova failed to get host of the VM 2025-10-30 11:12:04,155 - INFO - Skip interface_detach for VM ctest-left_vm-73773590 in state BUILD 2025-10-30 11:12:04,155 - INFO - Deleting VM ctest-left_vm-73773590 2025-10-30 11:12:04,155 - ERROR - VM ctest-left_vm-73773590 has failed to come up 2025-10-30 11:12:04,155 - ERROR - Nova failed to get host of the VM 2025-10-30 11:12:04,155 - ERROR - VM ctest-left_vm-73773590 has failed to come up 2025-10-30 11:12:04,155 - ERROR - Nova failed to get host of the VM 2025-10-30 11:12:04,357 - INFO - Deleting VN ctest-trans_right_vn-14324863 2025-10-30 11:12:04,585 - DEBUG - Response for deleting network () 2025-10-30 11:12:04,585 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/26b608f3-522c-426f-973d-1e87e2591dad 2025-10-30 11:12:04,598 - DEBUG - Response Code: 404 2025-10-30 11:12:04,598 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:04,610 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:04,634 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:12:04,764 - INFO - Validated that VN ctest-trans_right_vn-14324863 is not found in API Server 2025-10-30 11:12:04,779 - DEBUG - VN ctest-trans_right_vn-14324863 is not present in Agent 10.0.0.41 2025-10-30 11:12:04,801 - DEBUG - VN ctest-trans_right_vn-14324863 is not present in Agent 10.0.0.27 2025-10-30 11:12:04,801 - INFO - Validated that VN ctest-trans_right_vn-14324863 is not in any agent 2025-10-30 11:12:04,879 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-14324863 info 2025-10-30 11:12:04,879 - INFO - Deleting VN ctest-trans_left_vn-62144933 2025-10-30 11:12:05,138 - DEBUG - Response for deleting network () 2025-10-30 11:12:05,138 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b0d365a7-ee25-46c2-adb0-22e45eb214d9 2025-10-30 11:12:05,163 - DEBUG - Response Code: 404 2025-10-30 11:12:05,164 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:05,171 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:05,185 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:12:05,303 - INFO - Validated that VN ctest-trans_left_vn-62144933 is not found in API Server 2025-10-30 11:12:05,323 - DEBUG - VN ctest-trans_left_vn-62144933 is not present in Agent 10.0.0.41 2025-10-30 11:12:05,337 - DEBUG - VN ctest-trans_left_vn-62144933 is not present in Agent 10.0.0.27 2025-10-30 11:12:05,337 - INFO - Validated that VN ctest-trans_left_vn-62144933 is not in any agent 2025-10-30 11:12:05,397 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-62144933 info 2025-10-30 11:12:05,397 - INFO - Deleting VN ctest-right_vn-22463433 2025-10-30 11:12:05,441 - DEBUG - VN 4fb1bc82-b4ba-43d3-9c6d-203402e11df0 still in use: Unable to complete operation on network 4fb1bc82-b4ba-43d3-9c6d-203402e11df0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-35c82d71-cfc5-42c5-8667-f4f70ebbf41c'] 2025-10-30 11:12:05,441 - WARNING - Deleting VN ctest-right_vn-22463433 failed..Will retry 2025-10-30 11:12:07,636 - DEBUG - Response for deleting network () 2025-10-30 11:12:07,636 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b5c209e6-c172-4d52-a18d-7e7133ac1c11 2025-10-30 11:12:07,656 - DEBUG - Response Code: 404 2025-10-30 11:12:07,656 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:07,669 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:07,681 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:12:07,805 - INFO - Validated that VN ctest-right_vn-22463433 is not found in API Server 2025-10-30 11:12:07,818 - DEBUG - VN ctest-right_vn-22463433 is not present in Agent 10.0.0.41 2025-10-30 11:12:07,831 - DEBUG - VN ctest-right_vn-22463433 is not present in Agent 10.0.0.27 2025-10-30 11:12:07,832 - INFO - Validated that VN ctest-right_vn-22463433 is not in any agent 2025-10-30 11:12:07,870 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-22463433 info 2025-10-30 11:12:07,870 - INFO - Deleting VN ctest-left_vn-77139656 2025-10-30 11:12:08,050 - DEBUG - Response for deleting network () 2025-10-30 11:12:08,050 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/3b96d12b-ff67-40b4-b144-300560d58bb7 2025-10-30 11:12:08,064 - DEBUG - Response Code: 404 2025-10-30 11:12:08,064 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:08,073 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:08,086 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:12:08,194 - INFO - Validated that VN ctest-left_vn-77139656 is not found in API Server 2025-10-30 11:12:08,207 - DEBUG - VN ctest-left_vn-77139656 is not present in Agent 10.0.0.41 2025-10-30 11:12:08,220 - DEBUG - VN ctest-left_vn-77139656 is not present in Agent 10.0.0.27 2025-10-30 11:12:08,220 - INFO - Validated that VN ctest-left_vn-77139656 is not in any agent 2025-10-30 11:12:08,256 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-77139656 info 2025-10-30 11:12:08,257 - INFO - Deleting VN ctest-mgmt_vn-66813694 2025-10-30 11:12:08,400 - DEBUG - Response for deleting network () 2025-10-30 11:12:08,400 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e6f8ba8e-06fc-40dd-919a-51dd959b68e3 2025-10-30 11:12:08,406 - DEBUG - Response Code: 404 2025-10-30 11:12:08,406 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:08,413 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:08,431 - DEBUG - Requesting: http://10.0.0.249:8082/project/087cc48c-5356-4f84-9784-30649f03dcca 2025-10-30 11:12:08,564 - INFO - Validated that VN ctest-mgmt_vn-66813694 is not found in API Server 2025-10-30 11:12:08,577 - DEBUG - VN ctest-mgmt_vn-66813694 is not present in Agent 10.0.0.41 2025-10-30 11:12:08,592 - DEBUG - VN ctest-mgmt_vn-66813694 is not present in Agent 10.0.0.27 2025-10-30 11:12:08,592 - INFO - Validated that VN ctest-mgmt_vn-66813694 is not in any agent 2025-10-30 11:12:08,628 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-66813694 info 2025-10-30 11:12:09,956 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 11:12:09,956 - INFO - 2025-10-30 11:12:09,956 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17] 2025-10-30 11:12:09,956 - INFO - -------------------------------------------------------------------------------- 2025-10-30 11:12:10,844 - INFO - Deleted project: ctest-TestSvcHC-34212603, ID : 087cc48c-5356-4f84-9784-30649f03dcca