2025-08-14 03:01:58,175 - INFO - Domain Default found not creating 2025-08-14 03:01:58,317 - INFO - Project ctest-TestSvcHC-52549205 not found, creating it 2025-08-14 03:01:58,843 - INFO - Created Project:ctest-TestSvcHC-52549205, ID : f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:00,242 - INFO - ================================================================================ 2025-08-14 03:02:00,242 - INFO - STARTING TEST : test_svc_hc_basic 2025-08-14 03:02:01,507 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with 2025-08-14 03:02:01,508 - INFO - Initial checks done. Running the testcase now 2025-08-14 03:02:01,509 - INFO - 2025-08-14 03:02:02,189 - DEBUG - Response for create_network : {'network': {'id': '73dac27d-30fd-4338-b105-c21f59e15b45', 'name': 'ctest-mgmt_vn-18844590', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-mgmt_vn-18844590'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:02,494 - DEBUG - Response for create_subnet : {'subnet': {'id': '6c5c3e8e-a8d0-44d1-a713-9cd5bb7dc4ca', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': '73dac27d-30fd-4338-b105-c21f59e15b45', 'ip_version': 4, 'cidr': '175.108.105.0/26', 'allocation_pools': [{'start': '175.108.105.2', 'end': '175.108.105.62'}], 'gateway_ip': '175.108.105.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.108.105.2', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:02,517 - INFO - Created VN ctest-mgmt_vn-18844590 2025-08-14 03:02:02,534 - DEBUG - VN ctest-mgmt_vn-18844590 UUID is 73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:02,606 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:02,901 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:02,929 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:02,954 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:03,057 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:03,073 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:03,084 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3e244436-e7e7-4ffa-a5ec-6ef627f4268b 2025-08-14 03:02:03,093 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3e244436-e7e7-4ffa-a5ec-6ef627f4268b 2025-08-14 03:02:03,103 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/fc4c218d-d296-49cb-9091-40e65182aa00 2025-08-14 03:02:03,115 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:03,115 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:03,125 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3e244436-e7e7-4ffa-a5ec-6ef627f4268b 2025-08-14 03:02:03,141 - INFO - Verified VN network id 13 for VN 73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:03,142 - INFO - Verifications in API Server for VN ctest-mgmt_vn-18844590 passed 2025-08-14 03:02:03,142 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:03,152 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3e244436-e7e7-4ffa-a5ec-6ef627f4268b 2025-08-14 03:02:03,160 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3e244436-e7e7-4ffa-a5ec-6ef627f4268b 2025-08-14 03:02:03,168 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/fc4c218d-d296-49cb-9091-40e65182aa00 2025-08-14 03:02:03,182 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8348198702233240376', 'uuid-lslong': '12755814959504513861'}, 'enable': 'true', 'created': '2025-08-14T03:02:02', 'last-modified': '2025-08-14T03:02:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.744641'} 2025-08-14 03:02:03,189 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:03,195 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8348198702233240376', 'uuid-lslong': '12755814959504513861'}, 'enable': 'true', 'created': '2025-08-14T03:02:02', 'last-modified': '2025-08-14T03:02:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.756766'} 2025-08-14 03:02:03,202 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:03,208 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8348198702233240376', 'uuid-lslong': '12755814959504513861'}, 'enable': 'true', 'created': '2025-08-14T03:02:02', 'last-modified': '2025-08-14T03:02:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771299'} 2025-08-14 03:02:03,224 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:03,224 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-18844590 passed 2025-08-14 03:02:03,224 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-18844590 in API_Server ====== 2025-08-14 03:02:03,224 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:03,236 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:03,249 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:03,351 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/73dac27d-30fd-4338-b105-c21f59e15b45 2025-08-14 03:02:03,375 - DEBUG - =>VN ctest-mgmt_vn-18844590 has no policy to be verified 2025-08-14 03:02:03,375 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:03,375 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:03,375 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:03,692 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:03,750 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590?flat'} 2025-08-14 03:02:03,751 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:03,751 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:04,040 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:04,096 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590?flat'} 2025-08-14 03:02:04,096 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:04,096 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:04,388 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:04,448 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590?flat'} 2025-08-14 03:02:04,448 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-18844590 is found in opserver 2025-08-14 03:02:04,474 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:04,490 - DEBUG - VRF ids for VN ctest-mgmt_vn-18844590: {} 2025-08-14 03:02:04,715 - DEBUG - Response for create_network : {'network': {'id': '0d6b8efe-bfda-4c9c-b477-2b0d108f3649', 'name': 'ctest-left_vn-43633503', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-left_vn-43633503'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:04,974 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a2d5c90c-53c8-4805-b300-295b161d6080', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': '0d6b8efe-bfda-4c9c-b477-2b0d108f3649', 'ip_version': 4, 'cidr': '70.85.189.64/26', 'allocation_pools': [{'start': '70.85.189.66', 'end': '70.85.189.126'}], 'gateway_ip': '70.85.189.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '70.85.189.66', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:04,998 - INFO - Created VN ctest-left_vn-43633503 2025-08-14 03:02:05,010 - DEBUG - VN ctest-left_vn-43633503 UUID is 0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,083 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:05,089 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:05,101 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:05,193 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,206 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,215 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3c6d6bc-4d99-4633-bd05-19255213b7e7 2025-08-14 03:02:05,224 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3c6d6bc-4d99-4633-bd05-19255213b7e7 2025-08-14 03:02:05,233 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/09edd0f9-baed-4ba9-a7fd-a40bafc814c7 2025-08-14 03:02:05,240 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:05,240 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,250 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3c6d6bc-4d99-4633-bd05-19255213b7e7 2025-08-14 03:02:05,270 - INFO - Verified VN network id 14 for VN 0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,270 - INFO - Verifications in API Server for VN ctest-left_vn-43633503 passed 2025-08-14 03:02:05,270 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,281 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3c6d6bc-4d99-4633-bd05-19255213b7e7 2025-08-14 03:02:05,290 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3c6d6bc-4d99-4633-bd05-19255213b7e7 2025-08-14 03:02:05,299 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/09edd0f9-baed-4ba9-a7fd-a40bafc814c7 2025-08-14 03:02:05,314 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '967023769792695452', 'uuid-lslong': '13003909784167986761'}, 'enable': 'true', 'created': '2025-08-14T03:02:04', 'last-modified': '2025-08-14T03:02:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400730'} 2025-08-14 03:02:05,320 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:05,329 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '967023769792695452', 'uuid-lslong': '13003909784167986761'}, 'enable': 'true', 'created': '2025-08-14T03:02:04', 'last-modified': '2025-08-14T03:02:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423991'} 2025-08-14 03:02:05,338 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:05,344 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '967023769792695452', 'uuid-lslong': '13003909784167986761'}, 'enable': 'true', 'created': '2025-08-14T03:02:04', 'last-modified': '2025-08-14T03:02:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430636'} 2025-08-14 03:02:05,353 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:05,353 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-43633503 passed 2025-08-14 03:02:05,353 - DEBUG - ====Verifying policy data for ctest-left_vn-43633503 in API_Server ====== 2025-08-14 03:02:05,353 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:05,361 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:05,380 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:05,485 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/0d6b8efe-bfda-4c9c-b477-2b0d108f3649 2025-08-14 03:02:05,498 - DEBUG - =>VN ctest-left_vn-43633503 has no policy to be verified 2025-08-14 03:02:05,498 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:05,498 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:05,498 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:05,554 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503?flat'} 2025-08-14 03:02:05,554 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:05,554 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:05,610 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503?flat'} 2025-08-14 03:02:05,610 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:05,610 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:05,666 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503?flat'} 2025-08-14 03:02:05,666 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-43633503 is found in opserver 2025-08-14 03:02:05,689 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:05,700 - DEBUG - VRF ids for VN ctest-left_vn-43633503: {} 2025-08-14 03:02:05,977 - DEBUG - Response for create_network : {'network': {'id': '8238166c-1449-4a68-b3e2-996649f4e003', 'name': 'ctest-right_vn-15901147', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-right_vn-15901147'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:06,204 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bccae358-4c2a-4fc8-8b0f-bac305b116f4', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': '8238166c-1449-4a68-b3e2-996649f4e003', 'ip_version': 4, 'cidr': '197.178.187.128/26', 'allocation_pools': [{'start': '197.178.187.130', 'end': '197.178.187.190'}], 'gateway_ip': '197.178.187.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.178.187.130', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:06,224 - INFO - Created VN ctest-right_vn-15901147 2025-08-14 03:02:06,236 - DEBUG - VN ctest-right_vn-15901147 UUID is 8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,308 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:06,315 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:06,326 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:06,418 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,431 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,441 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/245b14aa-2e73-46d8-a932-d9ca3e910221 2025-08-14 03:02:06,451 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/245b14aa-2e73-46d8-a932-d9ca3e910221 2025-08-14 03:02:06,458 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/bb8c5e09-4161-4874-b11e-bfa184985bb2 2025-08-14 03:02:06,467 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:06,467 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,477 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/245b14aa-2e73-46d8-a932-d9ca3e910221 2025-08-14 03:02:06,494 - INFO - Verified VN network id 15 for VN 8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,494 - INFO - Verifications in API Server for VN ctest-right_vn-15901147 passed 2025-08-14 03:02:06,494 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,504 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/245b14aa-2e73-46d8-a932-d9ca3e910221 2025-08-14 03:02:06,514 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/245b14aa-2e73-46d8-a932-d9ca3e910221 2025-08-14 03:02:06,522 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/bb8c5e09-4161-4874-b11e-bfa184985bb2 2025-08-14 03:02:06,536 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9383274477079054952', 'uuid-lslong': '12962091342132207619'}, 'enable': 'true', 'created': '2025-08-14T03:02:05', 'last-modified': '2025-08-14T03:02:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392386'} 2025-08-14 03:02:06,542 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:06,548 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9383274477079054952', 'uuid-lslong': '12962091342132207619'}, 'enable': 'true', 'created': '2025-08-14T03:02:05', 'last-modified': '2025-08-14T03:02:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402069'} 2025-08-14 03:02:06,555 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:06,561 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9383274477079054952', 'uuid-lslong': '12962091342132207619'}, 'enable': 'true', 'created': '2025-08-14T03:02:05', 'last-modified': '2025-08-14T03:02:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417811'} 2025-08-14 03:02:06,567 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:06,567 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-15901147 passed 2025-08-14 03:02:06,567 - DEBUG - ====Verifying policy data for ctest-right_vn-15901147 in API_Server ====== 2025-08-14 03:02:06,567 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:06,577 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:06,591 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:06,692 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/8238166c-1449-4a68-b3e2-996649f4e003 2025-08-14 03:02:06,704 - DEBUG - =>VN ctest-right_vn-15901147 has no policy to be verified 2025-08-14 03:02:06,704 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:06,704 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:06,704 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:06,756 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147?flat'} 2025-08-14 03:02:06,756 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:06,756 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:06,814 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147?flat'} 2025-08-14 03:02:06,815 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:06,815 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:06,865 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147?flat'} 2025-08-14 03:02:06,866 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-15901147 is found in opserver 2025-08-14 03:02:06,894 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:06,906 - DEBUG - VRF ids for VN ctest-right_vn-15901147: {} 2025-08-14 03:02:06,957 - DEBUG - Services list from nova: [, , , ] 2025-08-14 03:02:08,429 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 03:02:09,727 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1) 2025-08-14 03:02:09,727 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-29168978'] 2025-08-14 03:02:10,027 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-29168978'] created succesfully 2025-08-14 03:02:10,371 - DEBUG - Image by name tiny_nat_fw not found 2025-08-14 03:02:10,371 - DEBUG - Installing image tiny_nat_fw 2025-08-14 03:02:10,371 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-14 03:02:10,372 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-14 03:02:10,372 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-14 03:02:10,372 - DEBUG - Unzip image 2025-08-14 03:02:10,372 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-14 03:02:10,390 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-08-14 03:02:10,392 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-29168978'] 2025-08-14 03:02:10,499 - INFO - Service template: ['default-domain', 'ctest-service_template_1-29168978'] deleted successfully. 2025-08-14 03:02:10,500 - INFO - Skip interface_detach for VM ctest-right_vm-48308983 in state BUILD 2025-08-14 03:02:10,502 - INFO - Deleting VM ctest-right_vm-48308983 2025-08-14 03:02:10,540 - ERROR - VM ctest-right_vm-48308983 has failed to come up 2025-08-14 03:02:10,540 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:10,540 - ERROR - VM ctest-right_vm-48308983 has failed to come up 2025-08-14 03:02:10,540 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:10,637 - INFO - Skip interface_detach for VM ctest-left_vm-32698878 in state BUILD 2025-08-14 03:02:10,637 - INFO - Deleting VM ctest-left_vm-32698878 2025-08-14 03:02:10,637 - ERROR - VM ctest-left_vm-32698878 has failed to come up 2025-08-14 03:02:10,637 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:10,637 - ERROR - VM ctest-left_vm-32698878 has failed to come up 2025-08-14 03:02:10,637 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:10,713 - INFO - Deleting VN ctest-right_vn-15901147 2025-08-14 03:02:10,756 - DEBUG - VN 8238166c-1449-4a68-b3e2-996649f4e003 still in use: Unable to complete operation on network 8238166c-1449-4a68-b3e2-996649f4e003. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ffa27ff8-54e9-4628-b7ad-706b198fbeaa'] 2025-08-14 03:02:10,757 - WARNING - Deleting VN ctest-right_vn-15901147 failed..Will retry 2025-08-14 03:02:12,917 - DEBUG - Response for deleting network () 2025-08-14 03:02:12,917 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/245b14aa-2e73-46d8-a932-d9ca3e910221 2025-08-14 03:02:12,923 - DEBUG - Response Code: 404 2025-08-14 03:02:12,923 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:12,930 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:12,973 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:13,080 - INFO - Validated that VN ctest-right_vn-15901147 is not found in API Server 2025-08-14 03:02:13,092 - DEBUG - VN ctest-right_vn-15901147 is not present in Agent 10.0.0.65 2025-08-14 03:02:13,103 - DEBUG - VN ctest-right_vn-15901147 is not present in Agent 10.0.0.130 2025-08-14 03:02:13,103 - INFO - Validated that VN ctest-right_vn-15901147 is not in any agent 2025-08-14 03:02:13,134 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-15901147 info 2025-08-14 03:02:13,135 - INFO - Deleting VN ctest-left_vn-43633503 2025-08-14 03:02:13,279 - DEBUG - Response for deleting network () 2025-08-14 03:02:13,279 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3c6d6bc-4d99-4633-bd05-19255213b7e7 2025-08-14 03:02:13,286 - DEBUG - Response Code: 404 2025-08-14 03:02:13,286 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:13,294 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:13,349 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:13,435 - INFO - Validated that VN ctest-left_vn-43633503 is not found in API Server 2025-08-14 03:02:13,449 - DEBUG - VN ctest-left_vn-43633503 is not present in Agent 10.0.0.65 2025-08-14 03:02:13,460 - DEBUG - VN ctest-left_vn-43633503 is not present in Agent 10.0.0.130 2025-08-14 03:02:13,460 - INFO - Validated that VN ctest-left_vn-43633503 is not in any agent 2025-08-14 03:02:13,498 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-43633503 info 2025-08-14 03:02:13,498 - INFO - Deleting VN ctest-mgmt_vn-18844590 2025-08-14 03:02:13,703 - DEBUG - Response for deleting network () 2025-08-14 03:02:13,704 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/3e244436-e7e7-4ffa-a5ec-6ef627f4268b 2025-08-14 03:02:13,710 - DEBUG - Response Code: 404 2025-08-14 03:02:13,710 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:13,716 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:13,728 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:13,822 - INFO - Validated that VN ctest-mgmt_vn-18844590 is not found in API Server 2025-08-14 03:02:13,834 - DEBUG - VN ctest-mgmt_vn-18844590 is not present in Agent 10.0.0.65 2025-08-14 03:02:13,846 - DEBUG - VN ctest-mgmt_vn-18844590 is not present in Agent 10.0.0.130 2025-08-14 03:02:13,846 - INFO - Validated that VN ctest-mgmt_vn-18844590 is not in any agent 2025-08-14 03:02:13,878 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-18844590 info 2025-08-14 03:02:15,131 - DEBUG - No XMPP flaps were noticed during the test 2025-08-14 03:02:15,132 - INFO - 2025-08-14 03:02:15,132 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-08-14 03:02:15,132 - INFO - -------------------------------------------------------------------------------- 2025-08-14 03:02:15,135 - INFO - ================================================================================ 2025-08-14 03:02:15,135 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-08-14 03:02:16,409 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.193': '0'}, '10.0.0.130': {'10.20.0.193': '0', '10.20.0.25': '0'}} with 2025-08-14 03:02:16,409 - INFO - Initial checks done. Running the testcase now 2025-08-14 03:02:16,409 - INFO - 2025-08-14 03:02:16,664 - DEBUG - Response for create_network : {'network': {'id': 'c2ce0bbf-f65c-4583-a26a-992e09c47660', 'name': 'ctest-mgmt_vn-01998099', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-mgmt_vn-01998099'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:16,868 - DEBUG - Response for create_subnet : {'subnet': {'id': '19421b7e-8757-4c70-b4fc-bf5f6eba4240', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': 'c2ce0bbf-f65c-4583-a26a-992e09c47660', 'ip_version': 4, 'cidr': '179.11.189.0/26', 'allocation_pools': [{'start': '179.11.189.2', 'end': '179.11.189.62'}], 'gateway_ip': '179.11.189.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '179.11.189.2', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:16,890 - INFO - Created VN ctest-mgmt_vn-01998099 2025-08-14 03:02:16,902 - DEBUG - VN ctest-mgmt_vn-01998099 UUID is c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:16,994 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:17,002 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:17,014 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:17,102 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:17,119 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:17,130 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f0cb7d88-488a-406f-9be2-8717397a0fd4 2025-08-14 03:02:17,139 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f0cb7d88-488a-406f-9be2-8717397a0fd4 2025-08-14 03:02:17,146 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/114a3493-cda6-4f14-accc-2cf5e6a39e27 2025-08-14 03:02:17,155 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:17,155 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:17,166 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f0cb7d88-488a-406f-9be2-8717397a0fd4 2025-08-14 03:02:17,183 - INFO - Verified VN network id 13 for VN c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:17,183 - INFO - Verifications in API Server for VN ctest-mgmt_vn-01998099 passed 2025-08-14 03:02:17,183 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:17,194 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f0cb7d88-488a-406f-9be2-8717397a0fd4 2025-08-14 03:02:17,203 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f0cb7d88-488a-406f-9be2-8717397a0fd4 2025-08-14 03:02:17,213 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/114a3493-cda6-4f14-accc-2cf5e6a39e27 2025-08-14 03:02:17,228 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14037170007660316035', 'uuid-lslong': '11703335004687070816'}, 'enable': 'true', 'created': '2025-08-14T03:02:16', 'last-modified': '2025-08-14T03:02:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414923'} 2025-08-14 03:02:17,236 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:17,243 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14037170007660316035', 'uuid-lslong': '11703335004687070816'}, 'enable': 'true', 'created': '2025-08-14T03:02:16', 'last-modified': '2025-08-14T03:02:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.433026'} 2025-08-14 03:02:17,250 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:17,257 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14037170007660316035', 'uuid-lslong': '11703335004687070816'}, 'enable': 'true', 'created': '2025-08-14T03:02:16', 'last-modified': '2025-08-14T03:02:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446262'} 2025-08-14 03:02:17,265 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-14 03:02:17,265 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-01998099 passed 2025-08-14 03:02:17,265 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-01998099 in API_Server ====== 2025-08-14 03:02:17,265 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:17,272 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:17,284 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:17,382 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/c2ce0bbf-f65c-4583-a26a-992e09c47660 2025-08-14 03:02:17,406 - DEBUG - =>VN ctest-mgmt_vn-01998099 has no policy to be verified 2025-08-14 03:02:17,406 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:17,406 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:17,406 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:17,425 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099?flat'} 2025-08-14 03:02:17,425 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:17,425 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:17,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099?flat'} 2025-08-14 03:02:17,439 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:17,439 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:17,455 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099?flat'} 2025-08-14 03:02:17,455 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-mgmt_vn-01998099 is found in opserver 2025-08-14 03:02:17,478 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:17,488 - DEBUG - VRF ids for VN ctest-mgmt_vn-01998099: {} 2025-08-14 03:02:17,743 - DEBUG - Response for create_network : {'network': {'id': 'f62467ca-0037-4f1b-bf91-ce1f41d1160d', 'name': 'ctest-left_vn-44628262', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-left_vn-44628262'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:17,952 - DEBUG - Response for create_subnet : {'subnet': {'id': 'eb42eac2-9085-4f37-ac03-071494f71bae', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': 'f62467ca-0037-4f1b-bf91-ce1f41d1160d', 'ip_version': 4, 'cidr': '110.154.76.0/26', 'allocation_pools': [{'start': '110.154.76.2', 'end': '110.154.76.62'}], 'gateway_ip': '110.154.76.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '110.154.76.2', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:17,979 - INFO - Created VN ctest-left_vn-44628262 2025-08-14 03:02:17,997 - DEBUG - VN ctest-left_vn-44628262 UUID is f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,075 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:18,082 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:18,094 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:18,176 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,194 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,204 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e8d7572f-cfa0-4700-8f95-2d78a7b3dfd8 2025-08-14 03:02:18,212 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e8d7572f-cfa0-4700-8f95-2d78a7b3dfd8 2025-08-14 03:02:18,221 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1456eec3-ebe9-4b69-8725-d24a74c1928b 2025-08-14 03:02:18,230 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:18,230 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,241 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e8d7572f-cfa0-4700-8f95-2d78a7b3dfd8 2025-08-14 03:02:18,259 - INFO - Verified VN network id 14 for VN f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,259 - INFO - Verifications in API Server for VN ctest-left_vn-44628262 passed 2025-08-14 03:02:18,259 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,270 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e8d7572f-cfa0-4700-8f95-2d78a7b3dfd8 2025-08-14 03:02:18,279 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e8d7572f-cfa0-4700-8f95-2d78a7b3dfd8 2025-08-14 03:02:18,286 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/1456eec3-ebe9-4b69-8725-d24a74c1928b 2025-08-14 03:02:18,302 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17736415349776535323', 'uuid-lslong': '13804040966510810637'}, 'enable': 'true', 'created': '2025-08-14T03:02:17', 'last-modified': '2025-08-14T03:02:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.389473'} 2025-08-14 03:02:18,308 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:18,315 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17736415349776535323', 'uuid-lslong': '13804040966510810637'}, 'enable': 'true', 'created': '2025-08-14T03:02:17', 'last-modified': '2025-08-14T03:02:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.411143'} 2025-08-14 03:02:18,322 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:18,328 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17736415349776535323', 'uuid-lslong': '13804040966510810637'}, 'enable': 'true', 'created': '2025-08-14T03:02:17', 'last-modified': '2025-08-14T03:02:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424003'} 2025-08-14 03:02:18,334 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-14 03:02:18,334 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-44628262 passed 2025-08-14 03:02:18,335 - DEBUG - ====Verifying policy data for ctest-left_vn-44628262 in API_Server ====== 2025-08-14 03:02:18,335 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:18,341 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:18,353 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:18,449 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/f62467ca-0037-4f1b-bf91-ce1f41d1160d 2025-08-14 03:02:18,461 - DEBUG - =>VN ctest-left_vn-44628262 has no policy to be verified 2025-08-14 03:02:18,461 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:18,461 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:18,461 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:18,478 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262?flat'} 2025-08-14 03:02:18,479 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:18,479 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:18,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262?flat'} 2025-08-14 03:02:18,497 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:18,497 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:18,515 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262?flat'} 2025-08-14 03:02:18,515 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-left_vn-44628262 is found in opserver 2025-08-14 03:02:18,539 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:18,551 - DEBUG - VRF ids for VN ctest-left_vn-44628262: {} 2025-08-14 03:02:18,868 - DEBUG - Response for create_network : {'network': {'id': 'a3440428-5453-4522-946d-56584d8095c8', 'name': 'ctest-right_vn-58309559', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-right_vn-58309559'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:19,140 - DEBUG - Response for create_subnet : {'subnet': {'id': '2084de33-2933-4bac-bdec-32bd4ea4b17d', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': 'a3440428-5453-4522-946d-56584d8095c8', 'ip_version': 4, 'cidr': '201.73.187.128/26', 'allocation_pools': [{'start': '201.73.187.130', 'end': '201.73.187.190'}], 'gateway_ip': '201.73.187.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '201.73.187.130', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:19,164 - INFO - Created VN ctest-right_vn-58309559 2025-08-14 03:02:19,177 - DEBUG - VN ctest-right_vn-58309559 UUID is a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,253 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:19,260 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:19,278 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:19,384 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,396 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,406 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c8f648a1-f0cb-4e0b-846a-ba35b76e944a 2025-08-14 03:02:19,416 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c8f648a1-f0cb-4e0b-846a-ba35b76e944a 2025-08-14 03:02:19,424 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/41053c64-f723-49cb-8284-6746deaa9bdd 2025-08-14 03:02:19,433 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:19,433 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,443 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c8f648a1-f0cb-4e0b-846a-ba35b76e944a 2025-08-14 03:02:19,458 - INFO - Verified VN network id 15 for VN a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,459 - INFO - Verifications in API Server for VN ctest-right_vn-58309559 passed 2025-08-14 03:02:19,459 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,470 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c8f648a1-f0cb-4e0b-846a-ba35b76e944a 2025-08-14 03:02:19,478 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c8f648a1-f0cb-4e0b-846a-ba35b76e944a 2025-08-14 03:02:19,485 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/41053c64-f723-49cb-8284-6746deaa9bdd 2025-08-14 03:02:19,498 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11764532697858524450', 'uuid-lslong': '10695299627332179400'}, 'enable': 'true', 'created': '2025-08-14T03:02:18', 'last-modified': '2025-08-14T03:02:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418437'} 2025-08-14 03:02:19,504 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:19,510 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11764532697858524450', 'uuid-lslong': '10695299627332179400'}, 'enable': 'true', 'created': '2025-08-14T03:02:18', 'last-modified': '2025-08-14T03:02:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434291'} 2025-08-14 03:02:19,516 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:19,522 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11764532697858524450', 'uuid-lslong': '10695299627332179400'}, 'enable': 'true', 'created': '2025-08-14T03:02:18', 'last-modified': '2025-08-14T03:02:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447199'} 2025-08-14 03:02:19,529 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-14 03:02:19,529 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-58309559 passed 2025-08-14 03:02:19,529 - DEBUG - ====Verifying policy data for ctest-right_vn-58309559 in API_Server ====== 2025-08-14 03:02:19,529 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:19,535 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:19,547 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:19,641 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/a3440428-5453-4522-946d-56584d8095c8 2025-08-14 03:02:19,651 - DEBUG - =>VN ctest-right_vn-58309559 has no policy to be verified 2025-08-14 03:02:19,651 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:19,651 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:19,651 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:19,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559?flat'} 2025-08-14 03:02:19,663 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:19,663 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:19,676 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559?flat'} 2025-08-14 03:02:19,676 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:19,676 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:19,689 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559?flat'} 2025-08-14 03:02:19,689 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-right_vn-58309559 is found in opserver 2025-08-14 03:02:19,714 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:19,725 - DEBUG - VRF ids for VN ctest-right_vn-58309559: {} 2025-08-14 03:02:19,991 - DEBUG - Response for create_network : {'network': {'id': '745fb906-8804-4c38-9c11-4c0870095228', 'name': 'ctest-trans_left_vn-40080249', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-trans_left_vn-40080249'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:20,183 - DEBUG - Response for create_subnet : {'subnet': {'id': '3fce6d3b-a056-4e32-9f3c-2720fd28661b', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': '745fb906-8804-4c38-9c11-4c0870095228', 'ip_version': 4, 'cidr': '111.192.184.128/26', 'allocation_pools': [{'start': '111.192.184.130', 'end': '111.192.184.190'}], 'gateway_ip': '111.192.184.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.192.184.130', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:20,203 - INFO - Created VN ctest-trans_left_vn-40080249 2025-08-14 03:02:20,216 - DEBUG - VN ctest-trans_left_vn-40080249 UUID is 745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,291 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:20,297 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:20,309 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:20,408 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,428 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,443 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/330e93a6-6034-4c01-a3c3-8fb521508194 2025-08-14 03:02:20,453 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/330e93a6-6034-4c01-a3c3-8fb521508194 2025-08-14 03:02:20,460 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/8ef799dc-b00a-4e7b-819f-115da30bcab8 2025-08-14 03:02:20,468 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-14 03:02:20,468 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,479 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/330e93a6-6034-4c01-a3c3-8fb521508194 2025-08-14 03:02:20,495 - INFO - Verified VN network id 16 for VN 745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,495 - INFO - Verifications in API Server for VN ctest-trans_left_vn-40080249 passed 2025-08-14 03:02:20,495 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,505 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/330e93a6-6034-4c01-a3c3-8fb521508194 2025-08-14 03:02:20,512 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/330e93a6-6034-4c01-a3c3-8fb521508194 2025-08-14 03:02:20,519 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/8ef799dc-b00a-4e7b-819f-115da30bcab8 2025-08-14 03:02:20,532 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8385624468890078264', 'uuid-lslong': '11245853343643947560'}, 'enable': 'true', 'created': '2025-08-14T03:02:19', 'last-modified': '2025-08-14T03:02:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402853'} 2025-08-14 03:02:20,538 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-14 03:02:20,546 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8385624468890078264', 'uuid-lslong': '11245853343643947560'}, 'enable': 'true', 'created': '2025-08-14T03:02:19', 'last-modified': '2025-08-14T03:02:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408186'} 2025-08-14 03:02:20,553 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-14 03:02:20,559 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8385624468890078264', 'uuid-lslong': '11245853343643947560'}, 'enable': 'true', 'created': '2025-08-14T03:02:19', 'last-modified': '2025-08-14T03:02:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422491'} 2025-08-14 03:02:20,566 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-14 03:02:20,566 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-40080249 passed 2025-08-14 03:02:20,566 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-40080249 in API_Server ====== 2025-08-14 03:02:20,566 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:20,572 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:20,583 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:20,667 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/745fb906-8804-4c38-9c11-4c0870095228 2025-08-14 03:02:20,680 - DEBUG - =>VN ctest-trans_left_vn-40080249 has no policy to be verified 2025-08-14 03:02:20,680 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:20,680 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:20,680 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:20,693 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249?flat'} 2025-08-14 03:02:20,693 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:20,693 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:20,706 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249?flat'} 2025-08-14 03:02:20,706 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:20,706 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:20,719 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249?flat'} 2025-08-14 03:02:20,719 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-trans_left_vn-40080249 is found in opserver 2025-08-14 03:02:20,743 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:20,755 - DEBUG - VRF ids for VN ctest-trans_left_vn-40080249: {} 2025-08-14 03:02:21,012 - DEBUG - Response for create_network : {'network': {'id': '53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d', 'name': 'ctest-trans_right_vn-01739584', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'project_id': 'f82aebc5297c44bbbadc64c912d03a23', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-52549205', 'ctest-trans_right_vn-01739584'], 'port_security_enabled': True, 'description': ''}} 2025-08-14 03:02:21,205 - DEBUG - Response for create_subnet : {'subnet': {'id': '3a27acdc-7de7-425d-8255-e96e31d3ee4b', 'name': '', 'tenant_id': 'f82aebc5297c44bbbadc64c912d03a23', 'network_id': '53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d', 'ip_version': 4, 'cidr': '146.108.114.0/26', 'allocation_pools': [{'start': '146.108.114.2', 'end': '146.108.114.62'}], 'gateway_ip': '146.108.114.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '146.108.114.2', 'tags': [], 'project_id': 'f82aebc5297c44bbbadc64c912d03a23'}} 2025-08-14 03:02:21,228 - INFO - Created VN ctest-trans_right_vn-01739584 2025-08-14 03:02:21,243 - DEBUG - VN ctest-trans_right_vn-01739584 UUID is 53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,313 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:21,319 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:21,331 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:21,425 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,440 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,451 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3b79af5-4f3a-4d77-8ccc-988f1f9b8644 2025-08-14 03:02:21,459 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3b79af5-4f3a-4d77-8ccc-988f1f9b8644 2025-08-14 03:02:21,466 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/98e8d3d1-fd78-462b-8a95-c8d9740c120d 2025-08-14 03:02:21,474 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-14 03:02:21,474 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,483 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3b79af5-4f3a-4d77-8ccc-988f1f9b8644 2025-08-14 03:02:21,499 - INFO - Verified VN network id 17 for VN 53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,499 - INFO - Verifications in API Server for VN ctest-trans_right_vn-01739584 passed 2025-08-14 03:02:21,499 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,510 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3b79af5-4f3a-4d77-8ccc-988f1f9b8644 2025-08-14 03:02:21,517 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3b79af5-4f3a-4d77-8ccc-988f1f9b8644 2025-08-14 03:02:21,524 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/98e8d3d1-fd78-462b-8a95-c8d9740c120d 2025-08-14 03:02:21,537 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5981479199803130102', 'uuid-lslong': '10163997323120516205'}, 'enable': 'true', 'created': '2025-08-14T03:02:20', 'last-modified': '2025-08-14T03:02:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.370770'} 2025-08-14 03:02:21,543 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-14 03:02:21,549 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5981479199803130102', 'uuid-lslong': '10163997323120516205'}, 'enable': 'true', 'created': '2025-08-14T03:02:20', 'last-modified': '2025-08-14T03:02:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385685'} 2025-08-14 03:02:21,556 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-14 03:02:21,563 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-52549205', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5981479199803130102', 'uuid-lslong': '10163997323120516205'}, 'enable': 'true', 'created': '2025-08-14T03:02:20', 'last-modified': '2025-08-14T03:02:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401713'} 2025-08-14 03:02:21,569 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-14 03:02:21,569 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-01739584 passed 2025-08-14 03:02:21,569 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-01739584 in API_Server ====== 2025-08-14 03:02:21,569 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:21,575 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:21,588 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:21,690 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/53027ba4-17a7-40f6-8d0d-c5b6d69e9c6d 2025-08-14 03:02:21,701 - DEBUG - =>VN ctest-trans_right_vn-01739584 has no policy to be verified 2025-08-14 03:02:21,701 - DEBUG - Verifying the vn in opserver 2025-08-14 03:02:21,701 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584 virtual network link through opserver 10.0.0.38 2025-08-14 03:02:21,701 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-14 03:02:21,716 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584?flat'} 2025-08-14 03:02:21,716 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584 virtual network link through opserver 10.0.0.27 2025-08-14 03:02:21,716 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-14 03:02:21,730 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584?flat'} 2025-08-14 03:02:21,730 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584 virtual network link through opserver 10.0.0.23 2025-08-14 03:02:21,730 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-08-14 03:02:21,744 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584?flat'} 2025-08-14 03:02:21,744 - INFO - Validated that VN default-domain:ctest-TestSvcHC-52549205:ctest-trans_right_vn-01739584 is found in opserver 2025-08-14 03:02:21,771 - DEBUG - Do not have enough data to verify VN in agent 2025-08-14 03:02:21,782 - DEBUG - VRF ids for VN ctest-trans_right_vn-01739584: {} 2025-08-14 03:02:22,752 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-1) 2025-08-14 03:02:23,998 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3851-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3851-2) 2025-08-14 03:02:23,999 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-16891365'] 2025-08-14 03:02:24,299 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-16891365'] created succesfully 2025-08-14 03:02:24,647 - DEBUG - Image by name tiny_trans_fw not found 2025-08-14 03:02:24,648 - DEBUG - Installing image tiny_trans_fw 2025-08-14 03:02:24,648 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-14 03:02:24,648 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-14 03:02:24,648 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-14 03:02:24,648 - DEBUG - Unzip image 2025-08-14 03:02:24,648 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-14 03:02:24,682 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-08-14 03:02:24,683 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-16891365'] 2025-08-14 03:02:24,784 - INFO - Service template: ['default-domain', 'ctest-service_template_1-16891365'] deleted successfully. 2025-08-14 03:02:24,784 - INFO - Skip interface_detach for VM ctest-right_vm-16379802 in state BUILD 2025-08-14 03:02:24,784 - INFO - Deleting VM ctest-right_vm-16379802 2025-08-14 03:02:24,784 - ERROR - VM ctest-right_vm-16379802 has failed to come up 2025-08-14 03:02:24,784 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:24,784 - ERROR - VM ctest-right_vm-16379802 has failed to come up 2025-08-14 03:02:24,784 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:24,860 - INFO - Skip interface_detach for VM ctest-left_vm-53099754 in state BUILD 2025-08-14 03:02:24,860 - INFO - Deleting VM ctest-left_vm-53099754 2025-08-14 03:02:24,860 - ERROR - VM ctest-left_vm-53099754 has failed to come up 2025-08-14 03:02:24,860 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:24,860 - ERROR - VM ctest-left_vm-53099754 has failed to come up 2025-08-14 03:02:24,860 - ERROR - Nova failed to get host of the VM 2025-08-14 03:02:24,936 - INFO - Deleting VN ctest-trans_right_vn-01739584 2025-08-14 03:02:25,140 - DEBUG - Response for deleting network () 2025-08-14 03:02:25,140 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e3b79af5-4f3a-4d77-8ccc-988f1f9b8644 2025-08-14 03:02:25,147 - DEBUG - Response Code: 404 2025-08-14 03:02:25,147 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:25,153 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:25,224 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:25,336 - INFO - Validated that VN ctest-trans_right_vn-01739584 is not found in API Server 2025-08-14 03:02:25,350 - DEBUG - VN ctest-trans_right_vn-01739584 is not present in Agent 10.0.0.65 2025-08-14 03:02:25,361 - DEBUG - VN ctest-trans_right_vn-01739584 is not present in Agent 10.0.0.130 2025-08-14 03:02:25,361 - INFO - Validated that VN ctest-trans_right_vn-01739584 is not in any agent 2025-08-14 03:02:25,398 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-01739584 info 2025-08-14 03:02:25,398 - INFO - Deleting VN ctest-trans_left_vn-40080249 2025-08-14 03:02:25,629 - DEBUG - Response for deleting network () 2025-08-14 03:02:25,629 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/330e93a6-6034-4c01-a3c3-8fb521508194 2025-08-14 03:02:25,636 - DEBUG - Response Code: 404 2025-08-14 03:02:25,636 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:25,648 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:25,689 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:25,780 - INFO - Validated that VN ctest-trans_left_vn-40080249 is not found in API Server 2025-08-14 03:02:25,795 - DEBUG - VN ctest-trans_left_vn-40080249 is not present in Agent 10.0.0.65 2025-08-14 03:02:25,818 - DEBUG - VN ctest-trans_left_vn-40080249 is not present in Agent 10.0.0.130 2025-08-14 03:02:25,818 - INFO - Validated that VN ctest-trans_left_vn-40080249 is not in any agent 2025-08-14 03:02:25,853 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-40080249 info 2025-08-14 03:02:25,854 - INFO - Deleting VN ctest-right_vn-58309559 2025-08-14 03:02:25,894 - DEBUG - VN a3440428-5453-4522-946d-56584d8095c8 still in use: Unable to complete operation on network a3440428-5453-4522-946d-56584d8095c8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1400b449-455a-4e6e-bab1-d0bdafa3484c'] 2025-08-14 03:02:25,894 - WARNING - Deleting VN ctest-right_vn-58309559 failed..Will retry 2025-08-14 03:02:28,062 - DEBUG - Response for deleting network () 2025-08-14 03:02:28,063 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/c8f648a1-f0cb-4e0b-846a-ba35b76e944a 2025-08-14 03:02:28,085 - DEBUG - Response Code: 404 2025-08-14 03:02:28,085 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:28,093 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:28,107 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:28,239 - INFO - Validated that VN ctest-right_vn-58309559 is not found in API Server 2025-08-14 03:02:28,251 - DEBUG - VN ctest-right_vn-58309559 is not present in Agent 10.0.0.65 2025-08-14 03:02:28,262 - DEBUG - VN ctest-right_vn-58309559 is not present in Agent 10.0.0.130 2025-08-14 03:02:28,262 - INFO - Validated that VN ctest-right_vn-58309559 is not in any agent 2025-08-14 03:02:28,299 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-58309559 info 2025-08-14 03:02:28,299 - INFO - Deleting VN ctest-left_vn-44628262 2025-08-14 03:02:28,451 - DEBUG - Response for deleting network () 2025-08-14 03:02:28,451 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e8d7572f-cfa0-4700-8f95-2d78a7b3dfd8 2025-08-14 03:02:28,465 - DEBUG - Response Code: 404 2025-08-14 03:02:28,465 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:28,477 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:28,495 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:28,596 - INFO - Validated that VN ctest-left_vn-44628262 is not found in API Server 2025-08-14 03:02:28,612 - DEBUG - VN ctest-left_vn-44628262 is not present in Agent 10.0.0.65 2025-08-14 03:02:28,624 - DEBUG - VN ctest-left_vn-44628262 is not present in Agent 10.0.0.130 2025-08-14 03:02:28,624 - INFO - Validated that VN ctest-left_vn-44628262 is not in any agent 2025-08-14 03:02:28,664 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-44628262 info 2025-08-14 03:02:28,664 - INFO - Deleting VN ctest-mgmt_vn-01998099 2025-08-14 03:02:28,856 - DEBUG - Response for deleting network () 2025-08-14 03:02:28,857 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/f0cb7d88-488a-406f-9be2-8717397a0fd4 2025-08-14 03:02:28,866 - DEBUG - Response Code: 404 2025-08-14 03:02:28,866 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2025-08-14 03:02:28,874 - DEBUG - Requesting: http://10.0.0.38:8082/domain/16362ee5-4ea2-4ad6-8a9c-e34af37c4ada 2025-08-14 03:02:28,894 - DEBUG - Requesting: http://10.0.0.38:8082/project/f82aebc5-297c-44bb-badc-64c912d03a23 2025-08-14 03:02:28,991 - INFO - Validated that VN ctest-mgmt_vn-01998099 is not found in API Server 2025-08-14 03:02:29,003 - DEBUG - VN ctest-mgmt_vn-01998099 is not present in Agent 10.0.0.65 2025-08-14 03:02:29,018 - DEBUG - VN ctest-mgmt_vn-01998099 is not present in Agent 10.0.0.130 2025-08-14 03:02:29,018 - INFO - Validated that VN ctest-mgmt_vn-01998099 is not in any agent 2025-08-14 03:02:29,054 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-01998099 info 2025-08-14 03:02:30,328 - DEBUG - No XMPP flaps were noticed during the test 2025-08-14 03:02:30,328 - INFO - 2025-08-14 03:02:30,328 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2025-08-14 03:02:30,329 - INFO - -------------------------------------------------------------------------------- 2025-08-14 03:02:31,060 - INFO - Deleted project: ctest-TestSvcHC-52549205, ID : f82aebc5-297c-44bb-badc-64c912d03a23