2025-12-04 03:28:14,829 - INFO - Domain Default found not creating 2025-12-04 03:28:15,027 - INFO - Project ctest-TestSvcHC-53694578 not found, creating it 2025-12-04 03:28:15,595 - INFO - Created Project:ctest-TestSvcHC-53694578, ID : 34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:17,289 - INFO - ================================================================================ 2025-12-04 03:28:17,289 - INFO - STARTING TEST : test_svc_hc_basic 2025-12-04 03:28:18,575 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.209': '0', '10.20.0.254': '0'}, '10.0.0.130': {'10.20.0.192': '0', '10.20.0.209': '0'}} with 2025-12-04 03:28:18,575 - INFO - Initial checks done. Running the testcase now 2025-12-04 03:28:18,575 - INFO - 2025-12-04 03:28:19,336 - DEBUG - Response for create_network : {'network': {'id': 'a7ebf19a-9c93-43d2-953e-84ddd440ba57', 'name': 'ctest-mgmt_vn-94244148', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-mgmt_vn-94244148'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:19,608 - DEBUG - Response for create_subnet : {'subnet': {'id': '989fb5ef-1abe-4ffe-beea-1f24e25898de', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': 'a7ebf19a-9c93-43d2-953e-84ddd440ba57', 'ip_version': 4, 'cidr': '67.204.56.192/26', 'allocation_pools': [{'start': '67.204.56.194', 'end': '67.204.56.254'}], 'gateway_ip': '67.204.56.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '67.204.56.194', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:19,637 - INFO - Created VN ctest-mgmt_vn-94244148 2025-12-04 03:28:19,652 - DEBUG - VN ctest-mgmt_vn-94244148 UUID is a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:19,732 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:20,040 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:20,073 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:20,091 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:20,187 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:20,204 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:20,215 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/15cd9184-06a2-4b3f-8f8c-dff82cc45452 2025-12-04 03:28:20,223 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/15cd9184-06a2-4b3f-8f8c-dff82cc45452 2025-12-04 03:28:20,231 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/8100f4e4-bc8f-40a6-9b6b-b824e775f8a3 2025-12-04 03:28:20,239 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:20,239 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:20,251 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/15cd9184-06a2-4b3f-8f8c-dff82cc45452 2025-12-04 03:28:20,268 - INFO - Verified VN network id 13 for VN a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:20,268 - INFO - Verifications in API Server for VN ctest-mgmt_vn-94244148 passed 2025-12-04 03:28:20,268 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:20,278 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/15cd9184-06a2-4b3f-8f8c-dff82cc45452 2025-12-04 03:28:20,286 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/15cd9184-06a2-4b3f-8f8c-dff82cc45452 2025-12-04 03:28:20,294 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/8100f4e4-bc8f-40a6-9b6b-b824e775f8a3 2025-12-04 03:28:20,306 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12100030470215123922', 'uuid-lslong': '10754179048490973783'}, 'enable': 'true', 'created': '2025-12-04T03:28:19', 'last-modified': '2025-12-04T03:28:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.756969'} 2025-12-04 03:28:20,313 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:20,319 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12100030470215123922', 'uuid-lslong': '10754179048490973783'}, 'enable': 'true', 'created': '2025-12-04T03:28:19', 'last-modified': '2025-12-04T03:28:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.768562'} 2025-12-04 03:28:20,325 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:20,331 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12100030470215123922', 'uuid-lslong': '10754179048490973783'}, 'enable': 'true', 'created': '2025-12-04T03:28:19', 'last-modified': '2025-12-04T03:28:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.778247'} 2025-12-04 03:28:20,336 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:20,337 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-94244148 passed 2025-12-04 03:28:20,337 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-94244148 in API_Server ====== 2025-12-04 03:28:20,337 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:20,343 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:20,354 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:20,472 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/a7ebf19a-9c93-43d2-953e-84ddd440ba57 2025-12-04 03:28:20,482 - DEBUG - =>VN ctest-mgmt_vn-94244148 has no policy to be verified 2025-12-04 03:28:20,482 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:20,482 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:20,482 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:20,796 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:20,881 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148?flat'} 2025-12-04 03:28:20,881 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:20,881 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:21,183 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:21,254 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148?flat'} 2025-12-04 03:28:21,254 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:21,254 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:21,561 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:21,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148?flat'} 2025-12-04 03:28:21,643 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-94244148 is found in opserver 2025-12-04 03:28:21,667 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:21,679 - DEBUG - VRF ids for VN ctest-mgmt_vn-94244148: {} 2025-12-04 03:28:21,975 - DEBUG - Response for create_network : {'network': {'id': '0c740e3b-60c3-4053-9da0-b3e7a7971455', 'name': 'ctest-left_vn-77220365', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-left_vn-77220365'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:22,212 - DEBUG - Response for create_subnet : {'subnet': {'id': '97f5e8b3-97cc-4dcc-9291-fa0963e9c412', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': '0c740e3b-60c3-4053-9da0-b3e7a7971455', 'ip_version': 4, 'cidr': '53.189.36.64/26', 'allocation_pools': [{'start': '53.189.36.66', 'end': '53.189.36.126'}], 'gateway_ip': '53.189.36.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.189.36.66', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:22,243 - INFO - Created VN ctest-left_vn-77220365 2025-12-04 03:28:22,266 - DEBUG - VN ctest-left_vn-77220365 UUID is 0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,351 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:22,357 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:22,373 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:22,488 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,501 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,512 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/77967dcb-5f5f-4de6-8f18-660cfe3d1b2c 2025-12-04 03:28:22,522 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/77967dcb-5f5f-4de6-8f18-660cfe3d1b2c 2025-12-04 03:28:22,530 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a9c19e35-738b-465e-a098-44797b106a04 2025-12-04 03:28:22,539 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:22,539 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,550 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/77967dcb-5f5f-4de6-8f18-660cfe3d1b2c 2025-12-04 03:28:22,570 - INFO - Verified VN network id 14 for VN 0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,570 - INFO - Verifications in API Server for VN ctest-left_vn-77220365 passed 2025-12-04 03:28:22,571 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,582 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/77967dcb-5f5f-4de6-8f18-660cfe3d1b2c 2025-12-04 03:28:22,592 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/77967dcb-5f5f-4de6-8f18-660cfe3d1b2c 2025-12-04 03:28:22,602 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a9c19e35-738b-465e-a098-44797b106a04 2025-12-04 03:28:22,617 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '897357873942839379', 'uuid-lslong': '11358276067758904405'}, 'enable': 'true', 'created': '2025-12-04T03:28:21', 'last-modified': '2025-12-04T03:28:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471407'} 2025-12-04 03:28:22,625 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:22,631 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '897357873942839379', 'uuid-lslong': '11358276067758904405'}, 'enable': 'true', 'created': '2025-12-04T03:28:21', 'last-modified': '2025-12-04T03:28:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.483820'} 2025-12-04 03:28:22,637 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:22,644 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '897357873942839379', 'uuid-lslong': '11358276067758904405'}, 'enable': 'true', 'created': '2025-12-04T03:28:21', 'last-modified': '2025-12-04T03:28:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491937'} 2025-12-04 03:28:22,651 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:22,651 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-77220365 passed 2025-12-04 03:28:22,651 - DEBUG - ====Verifying policy data for ctest-left_vn-77220365 in API_Server ====== 2025-12-04 03:28:22,651 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:22,658 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:22,670 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:22,773 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/0c740e3b-60c3-4053-9da0-b3e7a7971455 2025-12-04 03:28:22,788 - DEBUG - =>VN ctest-left_vn-77220365 has no policy to be verified 2025-12-04 03:28:22,788 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:22,788 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:22,788 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:22,874 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365?flat'} 2025-12-04 03:28:22,874 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:22,874 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:22,951 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365?flat'} 2025-12-04 03:28:22,951 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:22,951 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:23,028 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365?flat'} 2025-12-04 03:28:23,028 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-77220365 is found in opserver 2025-12-04 03:28:23,052 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:23,063 - DEBUG - VRF ids for VN ctest-left_vn-77220365: {} 2025-12-04 03:28:23,364 - DEBUG - Response for create_network : {'network': {'id': 'b5538346-d135-40e4-b62c-2c000b1da32d', 'name': 'ctest-right_vn-23701746', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-right_vn-23701746'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:23,614 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cda0c165-e279-4520-b9d0-8449be1dc739', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': 'b5538346-d135-40e4-b62c-2c000b1da32d', 'ip_version': 4, 'cidr': '75.48.128.64/26', 'allocation_pools': [{'start': '75.48.128.66', 'end': '75.48.128.126'}], 'gateway_ip': '75.48.128.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '75.48.128.66', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:23,635 - INFO - Created VN ctest-right_vn-23701746 2025-12-04 03:28:23,647 - DEBUG - VN ctest-right_vn-23701746 UUID is b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:23,728 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:23,735 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:23,747 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:23,844 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:23,857 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:23,867 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c0145143-6c41-49c9-bb2c-61dbe94a664b 2025-12-04 03:28:23,875 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c0145143-6c41-49c9-bb2c-61dbe94a664b 2025-12-04 03:28:23,883 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/912852aa-b01e-42e0-baae-86c83dcb1891 2025-12-04 03:28:23,890 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:23,890 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:23,901 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c0145143-6c41-49c9-bb2c-61dbe94a664b 2025-12-04 03:28:23,917 - INFO - Verified VN network id 15 for VN b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:23,917 - INFO - Verifications in API Server for VN ctest-right_vn-23701746 passed 2025-12-04 03:28:23,917 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:23,927 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c0145143-6c41-49c9-bb2c-61dbe94a664b 2025-12-04 03:28:23,935 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c0145143-6c41-49c9-bb2c-61dbe94a664b 2025-12-04 03:28:23,954 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/912852aa-b01e-42e0-baae-86c83dcb1891 2025-12-04 03:28:23,968 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13065931284112818404', 'uuid-lslong': '13126915392576267053'}, 'enable': 'true', 'created': '2025-12-04T03:28:23', 'last-modified': '2025-12-04T03:28:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418667'} 2025-12-04 03:28:23,974 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:23,982 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13065931284112818404', 'uuid-lslong': '13126915392576267053'}, 'enable': 'true', 'created': '2025-12-04T03:28:23', 'last-modified': '2025-12-04T03:28:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414673'} 2025-12-04 03:28:23,990 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:23,997 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13065931284112818404', 'uuid-lslong': '13126915392576267053'}, 'enable': 'true', 'created': '2025-12-04T03:28:23', 'last-modified': '2025-12-04T03:28:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.447848'} 2025-12-04 03:28:24,005 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:24,005 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-23701746 passed 2025-12-04 03:28:24,006 - DEBUG - ====Verifying policy data for ctest-right_vn-23701746 in API_Server ====== 2025-12-04 03:28:24,006 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:24,014 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:24,028 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:24,136 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b5538346-d135-40e4-b62c-2c000b1da32d 2025-12-04 03:28:24,148 - DEBUG - =>VN ctest-right_vn-23701746 has no policy to be verified 2025-12-04 03:28:24,148 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:24,148 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:24,148 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:24,233 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746?flat'} 2025-12-04 03:28:24,233 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:24,233 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:24,309 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746?flat'} 2025-12-04 03:28:24,309 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:24,309 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:24,392 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746?flat'} 2025-12-04 03:28:24,392 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-23701746 is found in opserver 2025-12-04 03:28:24,415 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:24,428 - DEBUG - VRF ids for VN ctest-right_vn-23701746: {} 2025-12-04 03:28:24,517 - DEBUG - Services list from nova: [, , , ] 2025-12-04 03:28:25,689 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-1) 2025-12-04 03:28:27,027 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-2) 2025-12-04 03:28:27,028 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-72576417'] 2025-12-04 03:28:27,361 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-72576417'] created succesfully 2025-12-04 03:28:27,736 - DEBUG - Image by name tiny_nat_fw not found 2025-12-04 03:28:27,736 - DEBUG - Installing image tiny_nat_fw 2025-12-04 03:28:27,736 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-12-04 03:28:27,736 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-12-04 03:28:27,736 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-12-04 03:28:27,736 - DEBUG - Unzip image 2025-12-04 03:28:27,736 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-12-04 03:28:27,757 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-12-04 03:28:27,759 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-72576417'] 2025-12-04 03:28:27,857 - INFO - Service template: ['default-domain', 'ctest-service_template_1-72576417'] deleted successfully. 2025-12-04 03:28:27,857 - INFO - Skip interface_detach for VM ctest-right_vm-33443065 in state BUILD 2025-12-04 03:28:27,858 - INFO - Deleting VM ctest-right_vm-33443065 2025-12-04 03:28:27,919 - ERROR - VM ctest-right_vm-33443065 has failed to come up 2025-12-04 03:28:27,919 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:27,919 - ERROR - VM ctest-right_vm-33443065 has failed to come up 2025-12-04 03:28:27,919 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:28,016 - INFO - Skip interface_detach for VM ctest-left_vm-38133600 in state BUILD 2025-12-04 03:28:28,017 - INFO - Deleting VM ctest-left_vm-38133600 2025-12-04 03:28:28,017 - ERROR - VM ctest-left_vm-38133600 has failed to come up 2025-12-04 03:28:28,017 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:28,017 - ERROR - VM ctest-left_vm-38133600 has failed to come up 2025-12-04 03:28:28,017 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:28,102 - INFO - Deleting VN ctest-right_vn-23701746 2025-12-04 03:28:28,145 - DEBUG - VN b5538346-d135-40e4-b62c-2c000b1da32d still in use: Unable to complete operation on network b5538346-d135-40e4-b62c-2c000b1da32d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7c25d5ee-e2d0-4b6f-bc10-52d632c0e0c1'] 2025-12-04 03:28:28,145 - WARNING - Deleting VN ctest-right_vn-23701746 failed..Will retry 2025-12-04 03:28:30,318 - DEBUG - Response for deleting network () 2025-12-04 03:28:30,318 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/c0145143-6c41-49c9-bb2c-61dbe94a664b 2025-12-04 03:28:30,325 - DEBUG - Response Code: 404 2025-12-04 03:28:30,325 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:30,346 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:30,366 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:30,462 - INFO - Validated that VN ctest-right_vn-23701746 is not found in API Server 2025-12-04 03:28:30,479 - DEBUG - VN ctest-right_vn-23701746 is not present in Agent 10.0.0.22 2025-12-04 03:28:30,491 - DEBUG - VN ctest-right_vn-23701746 is not present in Agent 10.0.0.130 2025-12-04 03:28:30,492 - INFO - Validated that VN ctest-right_vn-23701746 is not in any agent 2025-12-04 03:28:30,526 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-23701746 info 2025-12-04 03:28:30,526 - INFO - Deleting VN ctest-left_vn-77220365 2025-12-04 03:28:30,722 - DEBUG - Response for deleting network () 2025-12-04 03:28:30,722 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/77967dcb-5f5f-4de6-8f18-660cfe3d1b2c 2025-12-04 03:28:30,729 - DEBUG - Response Code: 404 2025-12-04 03:28:30,729 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:30,735 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:30,794 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:30,890 - INFO - Validated that VN ctest-left_vn-77220365 is not found in API Server 2025-12-04 03:28:30,901 - DEBUG - VN ctest-left_vn-77220365 is not present in Agent 10.0.0.22 2025-12-04 03:28:30,911 - DEBUG - VN ctest-left_vn-77220365 is not present in Agent 10.0.0.130 2025-12-04 03:28:30,911 - INFO - Validated that VN ctest-left_vn-77220365 is not in any agent 2025-12-04 03:28:30,944 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-77220365 info 2025-12-04 03:28:30,944 - INFO - Deleting VN ctest-mgmt_vn-94244148 2025-12-04 03:28:31,130 - DEBUG - Response for deleting network () 2025-12-04 03:28:31,130 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/15cd9184-06a2-4b3f-8f8c-dff82cc45452 2025-12-04 03:28:31,137 - DEBUG - Response Code: 404 2025-12-04 03:28:31,138 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:31,144 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:31,170 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:31,268 - INFO - Validated that VN ctest-mgmt_vn-94244148 is not found in API Server 2025-12-04 03:28:31,278 - DEBUG - VN ctest-mgmt_vn-94244148 is not present in Agent 10.0.0.22 2025-12-04 03:28:31,289 - DEBUG - VN ctest-mgmt_vn-94244148 is not present in Agent 10.0.0.130 2025-12-04 03:28:31,289 - INFO - Validated that VN ctest-mgmt_vn-94244148 is not in any agent 2025-12-04 03:28:31,321 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-94244148 info 2025-12-04 03:28:32,608 - DEBUG - No XMPP flaps were noticed during the test 2025-12-04 03:28:32,608 - INFO - 2025-12-04 03:28:32,608 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-12-04 03:28:32,608 - INFO - -------------------------------------------------------------------------------- 2025-12-04 03:28:32,612 - INFO - ================================================================================ 2025-12-04 03:28:32,612 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-12-04 03:28:33,923 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.209': '0', '10.20.0.254': '0'}, '10.0.0.130': {'10.20.0.192': '0', '10.20.0.209': '0'}} with 2025-12-04 03:28:33,923 - INFO - Initial checks done. Running the testcase now 2025-12-04 03:28:33,923 - INFO - 2025-12-04 03:28:34,210 - DEBUG - Response for create_network : {'network': {'id': '3a8485a1-1f97-4ad3-8eab-b05100ef2ab3', 'name': 'ctest-mgmt_vn-01746239', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-mgmt_vn-01746239'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:34,483 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a97a8eb6-38c2-408e-8f4e-a29998748356', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': '3a8485a1-1f97-4ad3-8eab-b05100ef2ab3', 'ip_version': 4, 'cidr': '220.53.112.64/26', 'allocation_pools': [{'start': '220.53.112.66', 'end': '220.53.112.126'}], 'gateway_ip': '220.53.112.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.53.112.66', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:34,507 - INFO - Created VN ctest-mgmt_vn-01746239 2025-12-04 03:28:34,521 - DEBUG - VN ctest-mgmt_vn-01746239 UUID is 3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:34,604 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:34,611 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:34,625 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:34,729 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:34,742 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:34,752 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b0d89ed2-3711-43e9-b229-b0960e3dad97 2025-12-04 03:28:34,761 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b0d89ed2-3711-43e9-b229-b0960e3dad97 2025-12-04 03:28:34,772 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/70596e3d-d6f9-45e5-8b68-e3861c096b33 2025-12-04 03:28:34,780 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:34,781 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:34,790 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b0d89ed2-3711-43e9-b229-b0960e3dad97 2025-12-04 03:28:34,808 - INFO - Verified VN network id 13 for VN 3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:34,809 - INFO - Verifications in API Server for VN ctest-mgmt_vn-01746239 passed 2025-12-04 03:28:34,809 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:34,823 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b0d89ed2-3711-43e9-b229-b0960e3dad97 2025-12-04 03:28:34,832 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b0d89ed2-3711-43e9-b229-b0960e3dad97 2025-12-04 03:28:34,841 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/70596e3d-d6f9-45e5-8b68-e3861c096b33 2025-12-04 03:28:34,854 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4216642078191864531', 'uuid-lslong': '10280504436357802675'}, 'enable': 'true', 'created': '2025-12-04T03:28:34', 'last-modified': '2025-12-04T03:28:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431970'} 2025-12-04 03:28:34,861 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:34,868 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4216642078191864531', 'uuid-lslong': '10280504436357802675'}, 'enable': 'true', 'created': '2025-12-04T03:28:34', 'last-modified': '2025-12-04T03:28:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.442274'} 2025-12-04 03:28:34,876 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:34,881 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4216642078191864531', 'uuid-lslong': '10280504436357802675'}, 'enable': 'true', 'created': '2025-12-04T03:28:34', 'last-modified': '2025-12-04T03:28:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459453'} 2025-12-04 03:28:34,889 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-04 03:28:34,889 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-01746239 passed 2025-12-04 03:28:34,889 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-01746239 in API_Server ====== 2025-12-04 03:28:34,889 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:34,896 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:34,910 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:35,003 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/3a8485a1-1f97-4ad3-8eab-b05100ef2ab3 2025-12-04 03:28:35,015 - DEBUG - =>VN ctest-mgmt_vn-01746239 has no policy to be verified 2025-12-04 03:28:35,015 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:35,015 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:35,015 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:35,035 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239?flat'} 2025-12-04 03:28:35,035 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:35,035 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:35,050 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239?flat'} 2025-12-04 03:28:35,050 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:35,050 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:35,062 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239?flat'} 2025-12-04 03:28:35,062 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-mgmt_vn-01746239 is found in opserver 2025-12-04 03:28:35,087 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:35,099 - DEBUG - VRF ids for VN ctest-mgmt_vn-01746239: {} 2025-12-04 03:28:35,373 - DEBUG - Response for create_network : {'network': {'id': '70bb3e06-22c0-40e7-9127-0934e3193f99', 'name': 'ctest-left_vn-05499692', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-left_vn-05499692'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:35,610 - DEBUG - Response for create_subnet : {'subnet': {'id': '331fe620-2ff3-4ea1-a85d-611e9e44c569', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': '70bb3e06-22c0-40e7-9127-0934e3193f99', 'ip_version': 4, 'cidr': '182.173.1.192/26', 'allocation_pools': [{'start': '182.173.1.194', 'end': '182.173.1.254'}], 'gateway_ip': '182.173.1.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '182.173.1.194', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:35,635 - INFO - Created VN ctest-left_vn-05499692 2025-12-04 03:28:35,650 - DEBUG - VN ctest-left_vn-05499692 UUID is 70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:35,723 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:35,730 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:35,742 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:35,841 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:35,854 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:35,866 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/cba1effa-043d-4a61-bc16-c4b0c62ffb10 2025-12-04 03:28:35,874 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/cba1effa-043d-4a61-bc16-c4b0c62ffb10 2025-12-04 03:28:35,881 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/8b15063a-20a2-4985-b0d7-bc3c5b3d9612 2025-12-04 03:28:35,890 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:35,890 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:35,902 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/cba1effa-043d-4a61-bc16-c4b0c62ffb10 2025-12-04 03:28:35,920 - INFO - Verified VN network id 14 for VN 70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:35,920 - INFO - Verifications in API Server for VN ctest-left_vn-05499692 passed 2025-12-04 03:28:35,920 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:35,931 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/cba1effa-043d-4a61-bc16-c4b0c62ffb10 2025-12-04 03:28:35,938 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/cba1effa-043d-4a61-bc16-c4b0c62ffb10 2025-12-04 03:28:35,947 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/8b15063a-20a2-4985-b0d7-bc3c5b3d9612 2025-12-04 03:28:35,962 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8123154548966572263', 'uuid-lslong': '10459338782344298393'}, 'enable': 'true', 'created': '2025-12-04T03:28:35', 'last-modified': '2025-12-04T03:28:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414007'} 2025-12-04 03:28:35,968 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:35,974 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8123154548966572263', 'uuid-lslong': '10459338782344298393'}, 'enable': 'true', 'created': '2025-12-04T03:28:35', 'last-modified': '2025-12-04T03:28:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423165'} 2025-12-04 03:28:35,982 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:35,988 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8123154548966572263', 'uuid-lslong': '10459338782344298393'}, 'enable': 'true', 'created': '2025-12-04T03:28:35', 'last-modified': '2025-12-04T03:28:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428780'} 2025-12-04 03:28:35,994 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-04 03:28:35,994 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-05499692 passed 2025-12-04 03:28:35,995 - DEBUG - ====Verifying policy data for ctest-left_vn-05499692 in API_Server ====== 2025-12-04 03:28:35,995 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:36,001 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:36,013 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:36,111 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/70bb3e06-22c0-40e7-9127-0934e3193f99 2025-12-04 03:28:36,125 - DEBUG - =>VN ctest-left_vn-05499692 has no policy to be verified 2025-12-04 03:28:36,125 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:36,125 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:36,125 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:36,138 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692?flat'} 2025-12-04 03:28:36,138 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:36,138 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:36,152 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692?flat'} 2025-12-04 03:28:36,152 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:36,152 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:36,165 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692?flat'} 2025-12-04 03:28:36,165 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-left_vn-05499692 is found in opserver 2025-12-04 03:28:36,188 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:36,200 - DEBUG - VRF ids for VN ctest-left_vn-05499692: {} 2025-12-04 03:28:36,475 - DEBUG - Response for create_network : {'network': {'id': 'cac19d48-d952-4dbf-ab4b-204712d1d1e6', 'name': 'ctest-right_vn-98250873', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-right_vn-98250873'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:36,750 - DEBUG - Response for create_subnet : {'subnet': {'id': '0842b21f-d870-40a5-b391-e35356b6bbcb', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': 'cac19d48-d952-4dbf-ab4b-204712d1d1e6', 'ip_version': 4, 'cidr': '25.32.242.128/26', 'allocation_pools': [{'start': '25.32.242.130', 'end': '25.32.242.190'}], 'gateway_ip': '25.32.242.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25.32.242.130', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:36,780 - INFO - Created VN ctest-right_vn-98250873 2025-12-04 03:28:36,793 - DEBUG - VN ctest-right_vn-98250873 UUID is cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:36,871 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:36,879 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:36,892 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:36,991 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:37,008 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:37,022 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b617009b-4087-4505-9a2f-1267c7bd50e5 2025-12-04 03:28:37,035 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b617009b-4087-4505-9a2f-1267c7bd50e5 2025-12-04 03:28:37,046 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/df7ce2fe-745c-41e8-8a20-96106e3bf312 2025-12-04 03:28:37,053 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:37,054 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:37,067 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b617009b-4087-4505-9a2f-1267c7bd50e5 2025-12-04 03:28:37,085 - INFO - Verified VN network id 15 for VN cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:37,085 - INFO - Verifications in API Server for VN ctest-right_vn-98250873 passed 2025-12-04 03:28:37,085 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:37,103 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b617009b-4087-4505-9a2f-1267c7bd50e5 2025-12-04 03:28:37,114 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b617009b-4087-4505-9a2f-1267c7bd50e5 2025-12-04 03:28:37,122 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/df7ce2fe-745c-41e8-8a20-96106e3bf312 2025-12-04 03:28:37,142 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14610131602375855551', 'uuid-lslong': '12342994693369483750'}, 'enable': 'true', 'created': '2025-12-04T03:28:36', 'last-modified': '2025-12-04T03:28:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448398'} 2025-12-04 03:28:37,158 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:37,168 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14610131602375855551', 'uuid-lslong': '12342994693369483750'}, 'enable': 'true', 'created': '2025-12-04T03:28:36', 'last-modified': '2025-12-04T03:28:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467552'} 2025-12-04 03:28:37,176 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:37,182 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14610131602375855551', 'uuid-lslong': '12342994693369483750'}, 'enable': 'true', 'created': '2025-12-04T03:28:36', 'last-modified': '2025-12-04T03:28:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486403'} 2025-12-04 03:28:37,190 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-04 03:28:37,190 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-98250873 passed 2025-12-04 03:28:37,190 - DEBUG - ====Verifying policy data for ctest-right_vn-98250873 in API_Server ====== 2025-12-04 03:28:37,190 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:37,198 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:37,214 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:37,317 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/cac19d48-d952-4dbf-ab4b-204712d1d1e6 2025-12-04 03:28:37,326 - DEBUG - =>VN ctest-right_vn-98250873 has no policy to be verified 2025-12-04 03:28:37,326 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:37,326 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:37,326 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:37,342 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873?flat'} 2025-12-04 03:28:37,342 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:37,342 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:37,357 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873?flat'} 2025-12-04 03:28:37,357 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:37,357 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:37,372 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873?flat'} 2025-12-04 03:28:37,372 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-right_vn-98250873 is found in opserver 2025-12-04 03:28:37,396 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:37,407 - DEBUG - VRF ids for VN ctest-right_vn-98250873: {} 2025-12-04 03:28:37,716 - DEBUG - Response for create_network : {'network': {'id': '9eaefc68-e282-4cad-9ce6-e7e3523359e7', 'name': 'ctest-trans_left_vn-34444780', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-trans_left_vn-34444780'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:37,963 - DEBUG - Response for create_subnet : {'subnet': {'id': '9596d883-549f-4671-82a6-ccd1e1097ae9', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': '9eaefc68-e282-4cad-9ce6-e7e3523359e7', 'ip_version': 4, 'cidr': '203.143.8.128/26', 'allocation_pools': [{'start': '203.143.8.130', 'end': '203.143.8.190'}], 'gateway_ip': '203.143.8.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '203.143.8.130', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:37,990 - INFO - Created VN ctest-trans_left_vn-34444780 2025-12-04 03:28:38,003 - DEBUG - VN ctest-trans_left_vn-34444780 UUID is 9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,082 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:38,089 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:38,102 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:38,202 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,214 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,224 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/209f54cd-8f5e-4e59-997e-8e3ba67a7c96 2025-12-04 03:28:38,233 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/209f54cd-8f5e-4e59-997e-8e3ba67a7c96 2025-12-04 03:28:38,241 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/570c36aa-63cf-4054-abda-4afee2949704 2025-12-04 03:28:38,249 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-04 03:28:38,249 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,260 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/209f54cd-8f5e-4e59-997e-8e3ba67a7c96 2025-12-04 03:28:38,279 - INFO - Verified VN network id 16 for VN 9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,279 - INFO - Verifications in API Server for VN ctest-trans_left_vn-34444780 passed 2025-12-04 03:28:38,279 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,291 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/209f54cd-8f5e-4e59-997e-8e3ba67a7c96 2025-12-04 03:28:38,300 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/209f54cd-8f5e-4e59-997e-8e3ba67a7c96 2025-12-04 03:28:38,307 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/570c36aa-63cf-4054-abda-4afee2949704 2025-12-04 03:28:38,320 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11434354031347256493', 'uuid-lslong': '11305978878082898407'}, 'enable': 'true', 'created': '2025-12-04T03:28:37', 'last-modified': '2025-12-04T03:28:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.432372'} 2025-12-04 03:28:38,328 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-04 03:28:38,336 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11434354031347256493', 'uuid-lslong': '11305978878082898407'}, 'enable': 'true', 'created': '2025-12-04T03:28:37', 'last-modified': '2025-12-04T03:28:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459050'} 2025-12-04 03:28:38,344 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-04 03:28:38,350 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11434354031347256493', 'uuid-lslong': '11305978878082898407'}, 'enable': 'true', 'created': '2025-12-04T03:28:37', 'last-modified': '2025-12-04T03:28:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476235'} 2025-12-04 03:28:38,356 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-04 03:28:38,356 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-34444780 passed 2025-12-04 03:28:38,357 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-34444780 in API_Server ====== 2025-12-04 03:28:38,357 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:38,364 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:38,376 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:38,473 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9eaefc68-e282-4cad-9ce6-e7e3523359e7 2025-12-04 03:28:38,484 - DEBUG - =>VN ctest-trans_left_vn-34444780 has no policy to be verified 2025-12-04 03:28:38,484 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:38,484 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:38,484 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:38,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780?flat'} 2025-12-04 03:28:38,497 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:38,497 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:38,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780?flat'} 2025-12-04 03:28:38,511 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:38,511 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:38,524 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780?flat'} 2025-12-04 03:28:38,524 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-trans_left_vn-34444780 is found in opserver 2025-12-04 03:28:38,546 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:38,557 - DEBUG - VRF ids for VN ctest-trans_left_vn-34444780: {} 2025-12-04 03:28:38,848 - DEBUG - Response for create_network : {'network': {'id': '7115389e-c62b-4dbd-b856-6406fcb4efe6', 'name': 'ctest-trans_right_vn-08359468', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'project_id': '34b2e0df14ea48c08759fa683a63b5ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-53694578', 'ctest-trans_right_vn-08359468'], 'port_security_enabled': True, 'description': ''}} 2025-12-04 03:28:39,087 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a4df500b-20bd-4ef3-91a3-97b774bb01f1', 'name': '', 'tenant_id': '34b2e0df14ea48c08759fa683a63b5ed', 'network_id': '7115389e-c62b-4dbd-b856-6406fcb4efe6', 'ip_version': 4, 'cidr': '136.254.52.0/26', 'allocation_pools': [{'start': '136.254.52.2', 'end': '136.254.52.62'}], 'gateway_ip': '136.254.52.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '136.254.52.2', 'tags': [], 'project_id': '34b2e0df14ea48c08759fa683a63b5ed'}} 2025-12-04 03:28:39,117 - INFO - Created VN ctest-trans_right_vn-08359468 2025-12-04 03:28:39,132 - DEBUG - VN ctest-trans_right_vn-08359468 UUID is 7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,207 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:39,213 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:39,226 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:39,319 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,331 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,341 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/2cbe9d65-b3ce-497a-acc6-9653a569d707 2025-12-04 03:28:39,348 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/2cbe9d65-b3ce-497a-acc6-9653a569d707 2025-12-04 03:28:39,355 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/2a2629bf-40c5-49f7-8e72-88f2bbe5d30b 2025-12-04 03:28:39,362 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-04 03:28:39,362 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,373 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/2cbe9d65-b3ce-497a-acc6-9653a569d707 2025-12-04 03:28:39,392 - INFO - Verified VN network id 17 for VN 7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,392 - INFO - Verifications in API Server for VN ctest-trans_right_vn-08359468 passed 2025-12-04 03:28:39,392 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,401 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/2cbe9d65-b3ce-497a-acc6-9653a569d707 2025-12-04 03:28:39,409 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/2cbe9d65-b3ce-497a-acc6-9653a569d707 2025-12-04 03:28:39,417 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/2a2629bf-40c5-49f7-8e72-88f2bbe5d30b 2025-12-04 03:28:39,432 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8148481355377495485', 'uuid-lslong': '13282914132148154342'}, 'enable': 'true', 'created': '2025-12-04T03:28:38', 'last-modified': '2025-12-04T03:28:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401973'} 2025-12-04 03:28:39,441 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-04 03:28:39,447 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8148481355377495485', 'uuid-lslong': '13282914132148154342'}, 'enable': 'true', 'created': '2025-12-04T03:28:38', 'last-modified': '2025-12-04T03:28:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418672'} 2025-12-04 03:28:39,454 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-04 03:28:39,460 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-53694578', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8148481355377495485', 'uuid-lslong': '13282914132148154342'}, 'enable': 'true', 'created': '2025-12-04T03:28:38', 'last-modified': '2025-12-04T03:28:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.427830'} 2025-12-04 03:28:39,466 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-04 03:28:39,466 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-08359468 passed 2025-12-04 03:28:39,466 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-08359468 in API_Server ====== 2025-12-04 03:28:39,466 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:39,473 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:39,486 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:39,582 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/7115389e-c62b-4dbd-b856-6406fcb4efe6 2025-12-04 03:28:39,592 - DEBUG - =>VN ctest-trans_right_vn-08359468 has no policy to be verified 2025-12-04 03:28:39,592 - DEBUG - Verifying the vn in opserver 2025-12-04 03:28:39,593 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468 virtual network link through opserver 10.0.0.27 2025-12-04 03:28:39,593 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-12-04 03:28:39,605 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468?flat'} 2025-12-04 03:28:39,605 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468 virtual network link through opserver 10.0.0.33 2025-12-04 03:28:39,605 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-12-04 03:28:39,619 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468?flat'} 2025-12-04 03:28:39,619 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468 virtual network link through opserver 10.0.0.23 2025-12-04 03:28:39,619 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-04 03:28:39,632 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468?flat'} 2025-12-04 03:28:39,632 - INFO - Validated that VN default-domain:ctest-TestSvcHC-53694578:ctest-trans_right_vn-08359468 is found in opserver 2025-12-04 03:28:39,654 - DEBUG - Do not have enough data to verify VN in agent 2025-12-04 03:28:39,665 - DEBUG - VRF ids for VN ctest-trans_right_vn-08359468: {} 2025-12-04 03:28:40,852 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-2) 2025-12-04 03:28:42,340 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4840-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4840-1) 2025-12-04 03:28:42,341 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-64524295'] 2025-12-04 03:28:42,645 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-64524295'] created succesfully 2025-12-04 03:28:43,037 - DEBUG - Image by name tiny_trans_fw not found 2025-12-04 03:28:43,037 - DEBUG - Installing image tiny_trans_fw 2025-12-04 03:28:43,037 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-12-04 03:28:43,037 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-12-04 03:28:43,038 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-12-04 03:28:43,038 - DEBUG - Unzip image 2025-12-04 03:28:43,038 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-12-04 03:28:43,062 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-12-04 03:28:43,063 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-64524295'] 2025-12-04 03:28:43,165 - INFO - Service template: ['default-domain', 'ctest-service_template_1-64524295'] deleted successfully. 2025-12-04 03:28:43,165 - INFO - Skip interface_detach for VM ctest-right_vm-99330502 in state BUILD 2025-12-04 03:28:43,165 - INFO - Deleting VM ctest-right_vm-99330502 2025-12-04 03:28:43,166 - ERROR - VM ctest-right_vm-99330502 has failed to come up 2025-12-04 03:28:43,166 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:43,166 - ERROR - VM ctest-right_vm-99330502 has failed to come up 2025-12-04 03:28:43,166 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:43,289 - INFO - Skip interface_detach for VM ctest-left_vm-18074272 in state BUILD 2025-12-04 03:28:43,289 - INFO - Deleting VM ctest-left_vm-18074272 2025-12-04 03:28:43,289 - ERROR - VM ctest-left_vm-18074272 has failed to come up 2025-12-04 03:28:43,289 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:43,289 - ERROR - VM ctest-left_vm-18074272 has failed to come up 2025-12-04 03:28:43,289 - ERROR - Nova failed to get host of the VM 2025-12-04 03:28:43,383 - INFO - Deleting VN ctest-trans_right_vn-08359468 2025-12-04 03:28:43,566 - DEBUG - Response for deleting network () 2025-12-04 03:28:43,567 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/2cbe9d65-b3ce-497a-acc6-9653a569d707 2025-12-04 03:28:43,575 - DEBUG - Response Code: 404 2025-12-04 03:28:43,575 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:43,594 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:43,614 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:43,725 - INFO - Validated that VN ctest-trans_right_vn-08359468 is not found in API Server 2025-12-04 03:28:43,747 - DEBUG - VN ctest-trans_right_vn-08359468 is not present in Agent 10.0.0.22 2025-12-04 03:28:43,759 - DEBUG - VN ctest-trans_right_vn-08359468 is not present in Agent 10.0.0.130 2025-12-04 03:28:43,759 - INFO - Validated that VN ctest-trans_right_vn-08359468 is not in any agent 2025-12-04 03:28:43,815 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-08359468 info 2025-12-04 03:28:43,815 - INFO - Deleting VN ctest-trans_left_vn-34444780 2025-12-04 03:28:43,991 - DEBUG - Response for deleting network () 2025-12-04 03:28:43,991 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/209f54cd-8f5e-4e59-997e-8e3ba67a7c96 2025-12-04 03:28:44,001 - DEBUG - Response Code: 404 2025-12-04 03:28:44,002 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:44,020 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:44,051 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:44,150 - INFO - Validated that VN ctest-trans_left_vn-34444780 is not found in API Server 2025-12-04 03:28:44,163 - DEBUG - VN ctest-trans_left_vn-34444780 is not present in Agent 10.0.0.22 2025-12-04 03:28:44,176 - DEBUG - VN ctest-trans_left_vn-34444780 is not present in Agent 10.0.0.130 2025-12-04 03:28:44,176 - INFO - Validated that VN ctest-trans_left_vn-34444780 is not in any agent 2025-12-04 03:28:44,230 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-34444780 info 2025-12-04 03:28:44,230 - INFO - Deleting VN ctest-right_vn-98250873 2025-12-04 03:28:44,276 - DEBUG - VN cac19d48-d952-4dbf-ab4b-204712d1d1e6 still in use: Unable to complete operation on network cac19d48-d952-4dbf-ab4b-204712d1d1e6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-69ed0144-5502-4cf8-86d1-6268d92a2114'] 2025-12-04 03:28:44,276 - WARNING - Deleting VN ctest-right_vn-98250873 failed..Will retry 2025-12-04 03:28:46,453 - DEBUG - Response for deleting network () 2025-12-04 03:28:46,453 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b617009b-4087-4505-9a2f-1267c7bd50e5 2025-12-04 03:28:46,468 - DEBUG - Response Code: 404 2025-12-04 03:28:46,469 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:46,488 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:46,509 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:46,631 - INFO - Validated that VN ctest-right_vn-98250873 is not found in API Server 2025-12-04 03:28:46,646 - DEBUG - VN ctest-right_vn-98250873 is not present in Agent 10.0.0.22 2025-12-04 03:28:46,656 - DEBUG - VN ctest-right_vn-98250873 is not present in Agent 10.0.0.130 2025-12-04 03:28:46,657 - INFO - Validated that VN ctest-right_vn-98250873 is not in any agent 2025-12-04 03:28:46,690 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-98250873 info 2025-12-04 03:28:46,690 - INFO - Deleting VN ctest-left_vn-05499692 2025-12-04 03:28:46,870 - DEBUG - Response for deleting network () 2025-12-04 03:28:46,870 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/cba1effa-043d-4a61-bc16-c4b0c62ffb10 2025-12-04 03:28:46,879 - DEBUG - Response Code: 404 2025-12-04 03:28:46,879 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:46,887 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:46,900 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:46,991 - INFO - Validated that VN ctest-left_vn-05499692 is not found in API Server 2025-12-04 03:28:47,005 - DEBUG - VN ctest-left_vn-05499692 is not present in Agent 10.0.0.22 2025-12-04 03:28:47,016 - DEBUG - VN ctest-left_vn-05499692 is not present in Agent 10.0.0.130 2025-12-04 03:28:47,016 - INFO - Validated that VN ctest-left_vn-05499692 is not in any agent 2025-12-04 03:28:47,052 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-05499692 info 2025-12-04 03:28:47,052 - INFO - Deleting VN ctest-mgmt_vn-01746239 2025-12-04 03:28:47,225 - DEBUG - Response for deleting network () 2025-12-04 03:28:47,225 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/b0d89ed2-3711-43e9-b229-b0960e3dad97 2025-12-04 03:28:47,241 - DEBUG - Response Code: 404 2025-12-04 03:28:47,241 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-12-04 03:28:47,251 - DEBUG - Requesting: http://10.0.0.27:8082/domain/77f3106b-db9e-49b5-893e-09cac574b890 2025-12-04 03:28:47,263 - DEBUG - Requesting: http://10.0.0.27:8082/project/34b2e0df-14ea-48c0-8759-fa683a63b5ed 2025-12-04 03:28:47,357 - INFO - Validated that VN ctest-mgmt_vn-01746239 is not found in API Server 2025-12-04 03:28:47,371 - DEBUG - VN ctest-mgmt_vn-01746239 is not present in Agent 10.0.0.22 2025-12-04 03:28:47,386 - DEBUG - VN ctest-mgmt_vn-01746239 is not present in Agent 10.0.0.130 2025-12-04 03:28:47,386 - INFO - Validated that VN ctest-mgmt_vn-01746239 is not in any agent 2025-12-04 03:28:47,420 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-01746239 info 2025-12-04 03:28:48,708 - DEBUG - No XMPP flaps were noticed during the test 2025-12-04 03:28:48,708 - INFO - 2025-12-04 03:28:48,708 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2025-12-04 03:28:48,708 - INFO - -------------------------------------------------------------------------------- 2025-12-04 03:28:49,459 - INFO - Deleted project: ctest-TestSvcHC-53694578, ID : 34b2e0df-14ea-48c0-8759-fa683a63b5ed