2025-11-17 03:13:03,994 - INFO - Domain Default found not creating 2025-11-17 03:13:04,166 - INFO - Project ctest-TestSvcHC-34087861 not found, creating it 2025-11-17 03:13:04,716 - INFO - Created Project:ctest-TestSvcHC-34087861, ID : 573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:06,606 - INFO - ================================================================================ 2025-11-17 03:13:06,606 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-17 03:13:07,903 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-11-17 03:13:07,903 - INFO - Initial checks done. Running the testcase now 2025-11-17 03:13:07,903 - INFO - 2025-11-17 03:13:08,702 - DEBUG - Response for create_network : {'network': {'id': '51b1b1e5-2f0f-44db-9e58-27df419eab13', 'name': 'ctest-mgmt_vn-48966737', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-mgmt_vn-48966737'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:08,989 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a5e8c614-7c8c-4310-ba86-16c58f2d1877', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '51b1b1e5-2f0f-44db-9e58-27df419eab13', 'ip_version': 4, 'cidr': '27.15.26.192/26', 'allocation_pools': [{'start': '27.15.26.194', 'end': '27.15.26.254'}], 'gateway_ip': '27.15.26.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '27.15.26.194', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:09,029 - INFO - Created VN ctest-mgmt_vn-48966737 2025-11-17 03:13:09,043 - DEBUG - VN ctest-mgmt_vn-48966737 UUID is 51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,131 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:09,486 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:09,526 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:09,547 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:09,665 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,683 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,698 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/364376e0-a502-4cbf-a4c9-cd33f56ff1e4 2025-11-17 03:13:09,708 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/364376e0-a502-4cbf-a4c9-cd33f56ff1e4 2025-11-17 03:13:09,718 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/6e185fcf-5093-454c-9850-c6796b007f27 2025-11-17 03:13:09,728 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:09,729 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,742 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/364376e0-a502-4cbf-a4c9-cd33f56ff1e4 2025-11-17 03:13:09,761 - INFO - Verified VN network id 14 for VN 51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,761 - INFO - Verifications in API Server for VN ctest-mgmt_vn-48966737 passed 2025-11-17 03:13:09,762 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,772 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/364376e0-a502-4cbf-a4c9-cd33f56ff1e4 2025-11-17 03:13:09,780 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/364376e0-a502-4cbf-a4c9-cd33f56ff1e4 2025-11-17 03:13:09,788 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/6e185fcf-5093-454c-9850-c6796b007f27 2025-11-17 03:13:09,801 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5886681785845105883', 'uuid-lslong': '11409913495775259411'}, 'enable': 'true', 'created': '2025-11-17T03:13:08', 'last-modified': '2025-11-17T03:13:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.878892'} 2025-11-17 03:13:09,810 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:09,816 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5886681785845105883', 'uuid-lslong': '11409913495775259411'}, 'enable': 'true', 'created': '2025-11-17T03:13:08', 'last-modified': '2025-11-17T03:13:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.891091'} 2025-11-17 03:13:09,822 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:09,828 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5886681785845105883', 'uuid-lslong': '11409913495775259411'}, 'enable': 'true', 'created': '2025-11-17T03:13:08', 'last-modified': '2025-11-17T03:13:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.905602'} 2025-11-17 03:13:09,834 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:09,834 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-48966737 passed 2025-11-17 03:13:09,834 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-48966737 in API_Server ====== 2025-11-17 03:13:09,834 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:09,850 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:09,864 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:09,963 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/51b1b1e5-2f0f-44db-9e58-27df419eab13 2025-11-17 03:13:09,974 - DEBUG - =>VN ctest-mgmt_vn-48966737 has no policy to be verified 2025-11-17 03:13:09,974 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:09,974 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:09,975 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:10,320 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:10,414 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737?flat'} 2025-11-17 03:13:10,414 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:10,414 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:10,763 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:10,843 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737?flat'} 2025-11-17 03:13:10,843 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:10,843 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:11,191 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:11,262 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737?flat'} 2025-11-17 03:13:11,262 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-48966737 is found in opserver 2025-11-17 03:13:11,283 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:11,293 - DEBUG - VRF ids for VN ctest-mgmt_vn-48966737: {} 2025-11-17 03:13:11,619 - DEBUG - Response for create_network : {'network': {'id': 'cd7594fb-485e-40aa-8105-409143be4e32', 'name': 'ctest-left_vn-52066950', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-left_vn-52066950'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:11,863 - DEBUG - Response for create_subnet : {'subnet': {'id': '3cd5fba7-101b-4006-9731-57f08255d734', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': 'cd7594fb-485e-40aa-8105-409143be4e32', 'ip_version': 4, 'cidr': '216.106.64.192/26', 'allocation_pools': [{'start': '216.106.64.194', 'end': '216.106.64.254'}], 'gateway_ip': '216.106.64.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '216.106.64.194', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:11,895 - INFO - Created VN ctest-left_vn-52066950 2025-11-17 03:13:11,911 - DEBUG - VN ctest-left_vn-52066950 UUID is cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,004 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:12,012 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:12,025 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:12,124 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,138 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,150 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cff4e345-e21d-4237-b142-403e2d93a64c 2025-11-17 03:13:12,162 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cff4e345-e21d-4237-b142-403e2d93a64c 2025-11-17 03:13:12,170 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/27575374-5af3-4188-aa2f-20420d1ca66e 2025-11-17 03:13:12,178 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:12,178 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,188 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cff4e345-e21d-4237-b142-403e2d93a64c 2025-11-17 03:13:12,210 - INFO - Verified VN network id 15 for VN cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,210 - INFO - Verifications in API Server for VN ctest-left_vn-52066950 passed 2025-11-17 03:13:12,210 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,221 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cff4e345-e21d-4237-b142-403e2d93a64c 2025-11-17 03:13:12,234 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cff4e345-e21d-4237-b142-403e2d93a64c 2025-11-17 03:13:12,257 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/27575374-5af3-4188-aa2f-20420d1ca66e 2025-11-17 03:13:12,274 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14804903157022212266', 'uuid-lslong': '9296907998427237938'}, 'enable': 'true', 'created': '2025-11-17T03:13:11', 'last-modified': '2025-11-17T03:13:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.472019'} 2025-11-17 03:13:12,284 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:12,290 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14804903157022212266', 'uuid-lslong': '9296907998427237938'}, 'enable': 'true', 'created': '2025-11-17T03:13:11', 'last-modified': '2025-11-17T03:13:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490323'} 2025-11-17 03:13:12,297 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:12,302 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14804903157022212266', 'uuid-lslong': '9296907998427237938'}, 'enable': 'true', 'created': '2025-11-17T03:13:11', 'last-modified': '2025-11-17T03:13:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501748'} 2025-11-17 03:13:12,308 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:12,308 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-52066950 passed 2025-11-17 03:13:12,309 - DEBUG - ====Verifying policy data for ctest-left_vn-52066950 in API_Server ====== 2025-11-17 03:13:12,309 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:12,317 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:12,332 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:12,467 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/cd7594fb-485e-40aa-8105-409143be4e32 2025-11-17 03:13:12,479 - DEBUG - =>VN ctest-left_vn-52066950 has no policy to be verified 2025-11-17 03:13:12,479 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:12,479 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:12,479 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:12,563 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950?flat'} 2025-11-17 03:13:12,563 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:12,563 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:12,649 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950?flat'} 2025-11-17 03:13:12,650 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:12,650 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:12,753 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950?flat'} 2025-11-17 03:13:12,753 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-52066950 is found in opserver 2025-11-17 03:13:12,774 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:12,787 - DEBUG - VRF ids for VN ctest-left_vn-52066950: {} 2025-11-17 03:13:13,106 - DEBUG - Response for create_network : {'network': {'id': '843eb073-ec2d-455b-a23c-1b7f1e3ad8ef', 'name': 'ctest-right_vn-70853557', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-right_vn-70853557'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:13,386 - DEBUG - Response for create_subnet : {'subnet': {'id': '01a980ab-3f2d-4adf-8d4f-261df4ca646a', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '843eb073-ec2d-455b-a23c-1b7f1e3ad8ef', 'ip_version': 4, 'cidr': '115.247.67.0/26', 'allocation_pools': [{'start': '115.247.67.2', 'end': '115.247.67.62'}], 'gateway_ip': '115.247.67.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '115.247.67.2', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:13,413 - INFO - Created VN ctest-right_vn-70853557 2025-11-17 03:13:13,426 - DEBUG - VN ctest-right_vn-70853557 UUID is 843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:13,535 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:13,543 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:13,562 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:13,677 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:13,698 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:13,720 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/036291fa-7f13-44ea-9688-ed4fe227ceec 2025-11-17 03:13:13,730 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/036291fa-7f13-44ea-9688-ed4fe227ceec 2025-11-17 03:13:13,739 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/8f799ac5-781e-43e9-856b-13eb24c7169f 2025-11-17 03:13:13,747 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:13,747 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:13,761 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/036291fa-7f13-44ea-9688-ed4fe227ceec 2025-11-17 03:13:13,780 - INFO - Verified VN network id 16 for VN 843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:13,781 - INFO - Verifications in API Server for VN ctest-right_vn-70853557 passed 2025-11-17 03:13:13,781 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:13,794 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/036291fa-7f13-44ea-9688-ed4fe227ceec 2025-11-17 03:13:13,804 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/036291fa-7f13-44ea-9688-ed4fe227ceec 2025-11-17 03:13:13,814 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/8f799ac5-781e-43e9-856b-13eb24c7169f 2025-11-17 03:13:13,827 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9529247873492665691', 'uuid-lslong': '11690248965528934639'}, 'enable': 'true', 'created': '2025-11-17T03:13:13', 'last-modified': '2025-11-17T03:13:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506041'} 2025-11-17 03:13:13,837 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:13,843 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9529247873492665691', 'uuid-lslong': '11690248965528934639'}, 'enable': 'true', 'created': '2025-11-17T03:13:13', 'last-modified': '2025-11-17T03:13:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.517019'} 2025-11-17 03:13:13,852 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:13,858 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9529247873492665691', 'uuid-lslong': '11690248965528934639'}, 'enable': 'true', 'created': '2025-11-17T03:13:13', 'last-modified': '2025-11-17T03:13:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.537198'} 2025-11-17 03:13:13,865 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:13,865 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-70853557 passed 2025-11-17 03:13:13,866 - DEBUG - ====Verifying policy data for ctest-right_vn-70853557 in API_Server ====== 2025-11-17 03:13:13,866 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:13,872 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:13,885 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:14,010 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/843eb073-ec2d-455b-a23c-1b7f1e3ad8ef 2025-11-17 03:13:14,021 - DEBUG - =>VN ctest-right_vn-70853557 has no policy to be verified 2025-11-17 03:13:14,021 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:14,021 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:14,022 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:14,092 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557?flat'} 2025-11-17 03:13:14,092 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:14,092 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:14,166 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557?flat'} 2025-11-17 03:13:14,166 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:14,166 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:14,252 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557?flat'} 2025-11-17 03:13:14,252 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-70853557 is found in opserver 2025-11-17 03:13:14,279 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:14,292 - DEBUG - VRF ids for VN ctest-right_vn-70853557: {} 2025-11-17 03:13:14,388 - DEBUG - Services list from nova: [, , , ] 2025-11-17 03:13:15,664 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-1) 2025-11-17 03:13:17,244 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-2) 2025-11-17 03:13:17,245 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-31357443'] 2025-11-17 03:13:17,545 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-31357443'] created succesfully 2025-11-17 03:13:18,068 - DEBUG - Image by name tiny_nat_fw not found 2025-11-17 03:13:18,068 - DEBUG - Installing image tiny_nat_fw 2025-11-17 03:13:18,068 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-17 03:13:18,068 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-17 03:13:18,069 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-17 03:13:18,069 - DEBUG - Unzip image 2025-11-17 03:13:18,069 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-17 03:13:18,107 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-17 03:13:18,108 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-31357443'] 2025-11-17 03:13:18,217 - INFO - Service template: ['default-domain', 'ctest-service_template_1-31357443'] deleted successfully. 2025-11-17 03:13:18,217 - INFO - Skip interface_detach for VM ctest-right_vm-97049043 in state BUILD 2025-11-17 03:13:18,217 - INFO - Deleting VM ctest-right_vm-97049043 2025-11-17 03:13:18,268 - ERROR - VM ctest-right_vm-97049043 has failed to come up 2025-11-17 03:13:18,269 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:18,270 - ERROR - VM ctest-right_vm-97049043 has failed to come up 2025-11-17 03:13:18,270 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:18,520 - INFO - Skip interface_detach for VM ctest-left_vm-29425186 in state BUILD 2025-11-17 03:13:18,520 - INFO - Deleting VM ctest-left_vm-29425186 2025-11-17 03:13:18,520 - ERROR - VM ctest-left_vm-29425186 has failed to come up 2025-11-17 03:13:18,520 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:18,520 - ERROR - VM ctest-left_vm-29425186 has failed to come up 2025-11-17 03:13:18,520 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:18,664 - INFO - Deleting VN ctest-right_vn-70853557 2025-11-17 03:13:18,745 - DEBUG - VN 843eb073-ec2d-455b-a23c-1b7f1e3ad8ef still in use: Unable to complete operation on network 843eb073-ec2d-455b-a23c-1b7f1e3ad8ef. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7982e636-72e6-40bf-9d2e-595ba9c12789'] 2025-11-17 03:13:18,745 - WARNING - Deleting VN ctest-right_vn-70853557 failed..Will retry 2025-11-17 03:13:20,932 - DEBUG - Response for deleting network () 2025-11-17 03:13:20,932 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/036291fa-7f13-44ea-9688-ed4fe227ceec 2025-11-17 03:13:20,945 - DEBUG - Response Code: 404 2025-11-17 03:13:20,945 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:20,960 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:20,977 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:21,095 - INFO - Validated that VN ctest-right_vn-70853557 is not found in API Server 2025-11-17 03:13:21,107 - DEBUG - VN ctest-right_vn-70853557 is not present in Agent 10.0.0.50 2025-11-17 03:13:21,122 - DEBUG - VN ctest-right_vn-70853557 is not present in Agent 10.0.0.73 2025-11-17 03:13:21,122 - INFO - Validated that VN ctest-right_vn-70853557 is not in any agent 2025-11-17 03:13:21,155 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-70853557 info 2025-11-17 03:13:21,155 - INFO - Deleting VN ctest-left_vn-52066950 2025-11-17 03:13:21,386 - DEBUG - Response for deleting network () 2025-11-17 03:13:21,386 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/cff4e345-e21d-4237-b142-403e2d93a64c 2025-11-17 03:13:21,393 - DEBUG - Response Code: 404 2025-11-17 03:13:21,393 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:21,401 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:21,457 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:21,569 - INFO - Validated that VN ctest-left_vn-52066950 is not found in API Server 2025-11-17 03:13:21,581 - DEBUG - VN ctest-left_vn-52066950 is not present in Agent 10.0.0.50 2025-11-17 03:13:21,593 - DEBUG - VN ctest-left_vn-52066950 is not present in Agent 10.0.0.73 2025-11-17 03:13:21,593 - INFO - Validated that VN ctest-left_vn-52066950 is not in any agent 2025-11-17 03:13:21,629 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-52066950 info 2025-11-17 03:13:21,630 - INFO - Deleting VN ctest-mgmt_vn-48966737 2025-11-17 03:13:21,803 - DEBUG - Response for deleting network () 2025-11-17 03:13:21,804 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/364376e0-a502-4cbf-a4c9-cd33f56ff1e4 2025-11-17 03:13:21,814 - DEBUG - Response Code: 404 2025-11-17 03:13:21,815 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:21,823 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:21,842 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:21,958 - INFO - Validated that VN ctest-mgmt_vn-48966737 is not found in API Server 2025-11-17 03:13:21,969 - DEBUG - VN ctest-mgmt_vn-48966737 is not present in Agent 10.0.0.50 2025-11-17 03:13:21,983 - DEBUG - VN ctest-mgmt_vn-48966737 is not present in Agent 10.0.0.73 2025-11-17 03:13:21,983 - INFO - Validated that VN ctest-mgmt_vn-48966737 is not in any agent 2025-11-17 03:13:22,026 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-48966737 info 2025-11-17 03:13:23,316 - DEBUG - No XMPP flaps were noticed during the test 2025-11-17 03:13:23,316 - INFO -

2025-11-17 03:13:23,316 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:17]

2025-11-17 03:13:23,316 - INFO - -------------------------------------------------------------------------------- 2025-11-17 03:13:23,320 - INFO - ================================================================================ 2025-11-17 03:13:23,320 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-17 03:13:24,592 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-11-17 03:13:24,593 - INFO - Initial checks done. Running the testcase now 2025-11-17 03:13:24,593 - INFO - 2025-11-17 03:13:24,872 - DEBUG - Response for create_network : {'network': {'id': '4355a986-40df-493d-8979-94ff38ff8b9a', 'name': 'ctest-mgmt_vn-98919422', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-mgmt_vn-98919422'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:25,109 - DEBUG - Response for create_subnet : {'subnet': {'id': '13a77665-6a04-43c7-8328-4450e3d1ceef', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '4355a986-40df-493d-8979-94ff38ff8b9a', 'ip_version': 4, 'cidr': '201.87.124.192/26', 'allocation_pools': [{'start': '201.87.124.194', 'end': '201.87.124.254'}], 'gateway_ip': '201.87.124.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '201.87.124.194', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:25,139 - INFO - Created VN ctest-mgmt_vn-98919422 2025-11-17 03:13:25,153 - DEBUG - VN ctest-mgmt_vn-98919422 UUID is 4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,239 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:25,246 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:25,259 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:25,346 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,369 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,380 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2d92ce80-6723-4f5c-93f3-a244f626f3af 2025-11-17 03:13:25,393 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2d92ce80-6723-4f5c-93f3-a244f626f3af 2025-11-17 03:13:25,403 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/b29db862-97bc-4d7d-bbcc-b5657eacbf07 2025-11-17 03:13:25,413 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:25,413 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,428 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2d92ce80-6723-4f5c-93f3-a244f626f3af 2025-11-17 03:13:25,448 - INFO - Verified VN network id 14 for VN 4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,448 - INFO - Verifications in API Server for VN ctest-mgmt_vn-98919422 passed 2025-11-17 03:13:25,449 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,464 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2d92ce80-6723-4f5c-93f3-a244f626f3af 2025-11-17 03:13:25,473 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2d92ce80-6723-4f5c-93f3-a244f626f3af 2025-11-17 03:13:25,483 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/b29db862-97bc-4d7d-bbcc-b5657eacbf07 2025-11-17 03:13:25,498 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4851970567640664381', 'uuid-lslong': '9906112679271959450'}, 'enable': 'true', 'created': '2025-11-17T03:13:24', 'last-modified': '2025-11-17T03:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.458098'} 2025-11-17 03:13:25,505 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:25,510 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4851970567640664381', 'uuid-lslong': '9906112679271959450'}, 'enable': 'true', 'created': '2025-11-17T03:13:24', 'last-modified': '2025-11-17T03:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471442'} 2025-11-17 03:13:25,517 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:25,522 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4851970567640664381', 'uuid-lslong': '9906112679271959450'}, 'enable': 'true', 'created': '2025-11-17T03:13:24', 'last-modified': '2025-11-17T03:13:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.483579'} 2025-11-17 03:13:25,528 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-17 03:13:25,528 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-98919422 passed 2025-11-17 03:13:25,529 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-98919422 in API_Server ====== 2025-11-17 03:13:25,529 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:25,535 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:25,549 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:25,664 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/4355a986-40df-493d-8979-94ff38ff8b9a 2025-11-17 03:13:25,679 - DEBUG - =>VN ctest-mgmt_vn-98919422 has no policy to be verified 2025-11-17 03:13:25,679 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:25,680 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:25,680 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:25,694 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422?flat'} 2025-11-17 03:13:25,694 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:25,694 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:25,707 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422?flat'} 2025-11-17 03:13:25,707 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:25,707 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:25,727 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422?flat'} 2025-11-17 03:13:25,727 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-mgmt_vn-98919422 is found in opserver 2025-11-17 03:13:25,750 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:25,761 - DEBUG - VRF ids for VN ctest-mgmt_vn-98919422: {} 2025-11-17 03:13:26,058 - DEBUG - Response for create_network : {'network': {'id': '36bcb3c0-b7e6-4b15-abfd-05bde293496a', 'name': 'ctest-left_vn-77206489', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-left_vn-77206489'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:26,298 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b8ff59c9-a368-47d0-8950-1de3d6e045b4', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '36bcb3c0-b7e6-4b15-abfd-05bde293496a', 'ip_version': 4, 'cidr': '195.226.216.192/26', 'allocation_pools': [{'start': '195.226.216.194', 'end': '195.226.216.254'}], 'gateway_ip': '195.226.216.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '195.226.216.194', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:26,323 - INFO - Created VN ctest-left_vn-77206489 2025-11-17 03:13:26,339 - DEBUG - VN ctest-left_vn-77206489 UUID is 36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,416 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:26,424 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:26,437 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:26,563 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,578 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,593 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/056194b9-0fe9-44ff-87ec-4766768607e0 2025-11-17 03:13:26,606 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/056194b9-0fe9-44ff-87ec-4766768607e0 2025-11-17 03:13:26,617 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f382ffda-8208-444a-90d3-4d5dc574f19c 2025-11-17 03:13:26,625 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:26,625 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,637 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/056194b9-0fe9-44ff-87ec-4766768607e0 2025-11-17 03:13:26,656 - INFO - Verified VN network id 15 for VN 36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,656 - INFO - Verifications in API Server for VN ctest-left_vn-77206489 passed 2025-11-17 03:13:26,656 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,669 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/056194b9-0fe9-44ff-87ec-4766768607e0 2025-11-17 03:13:26,680 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/056194b9-0fe9-44ff-87ec-4766768607e0 2025-11-17 03:13:26,688 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/f382ffda-8208-444a-90d3-4d5dc574f19c 2025-11-17 03:13:26,705 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3944225013970127637', 'uuid-lslong': '12393068062701734250'}, 'enable': 'true', 'created': '2025-11-17T03:13:25', 'last-modified': '2025-11-17T03:13:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486790'} 2025-11-17 03:13:26,712 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:26,718 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3944225013970127637', 'uuid-lslong': '12393068062701734250'}, 'enable': 'true', 'created': '2025-11-17T03:13:25', 'last-modified': '2025-11-17T03:13:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499241'} 2025-11-17 03:13:26,725 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:26,731 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3944225013970127637', 'uuid-lslong': '12393068062701734250'}, 'enable': 'true', 'created': '2025-11-17T03:13:25', 'last-modified': '2025-11-17T03:13:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.511872'} 2025-11-17 03:13:26,737 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-11-17 03:13:26,737 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-77206489 passed 2025-11-17 03:13:26,737 - DEBUG - ====Verifying policy data for ctest-left_vn-77206489 in API_Server ====== 2025-11-17 03:13:26,738 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:26,744 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:26,756 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:26,864 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/36bcb3c0-b7e6-4b15-abfd-05bde293496a 2025-11-17 03:13:26,876 - DEBUG - =>VN ctest-left_vn-77206489 has no policy to be verified 2025-11-17 03:13:26,876 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:26,876 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:26,876 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:26,890 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489?flat'} 2025-11-17 03:13:26,890 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:26,890 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:26,903 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489?flat'} 2025-11-17 03:13:26,903 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:26,903 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:26,917 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489?flat'} 2025-11-17 03:13:26,917 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-left_vn-77206489 is found in opserver 2025-11-17 03:13:26,937 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:26,947 - DEBUG - VRF ids for VN ctest-left_vn-77206489: {} 2025-11-17 03:13:27,218 - DEBUG - Response for create_network : {'network': {'id': '9ec019af-d034-413e-b880-f8da620392c7', 'name': 'ctest-right_vn-00178389', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-right_vn-00178389'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:27,445 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e1e5a66e-3e1f-4ca2-a47a-2fa310ffa8cc', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '9ec019af-d034-413e-b880-f8da620392c7', 'ip_version': 4, 'cidr': '172.92.149.128/26', 'allocation_pools': [{'start': '172.92.149.130', 'end': '172.92.149.190'}], 'gateway_ip': '172.92.149.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '172.92.149.130', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:27,473 - INFO - Created VN ctest-right_vn-00178389 2025-11-17 03:13:27,485 - DEBUG - VN ctest-right_vn-00178389 UUID is 9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:27,569 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:27,577 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:27,591 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:27,699 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:27,716 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:27,730 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/00dd418a-b36e-43bd-8b48-f7534afa1ea9 2025-11-17 03:13:27,740 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/00dd418a-b36e-43bd-8b48-f7534afa1ea9 2025-11-17 03:13:27,751 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/1bc05e0c-8851-4f4a-812d-cb653d949806 2025-11-17 03:13:27,762 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:27,762 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:27,774 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/00dd418a-b36e-43bd-8b48-f7534afa1ea9 2025-11-17 03:13:27,795 - INFO - Verified VN network id 16 for VN 9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:27,795 - INFO - Verifications in API Server for VN ctest-right_vn-00178389 passed 2025-11-17 03:13:27,795 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:27,807 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/00dd418a-b36e-43bd-8b48-f7534afa1ea9 2025-11-17 03:13:27,817 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/00dd418a-b36e-43bd-8b48-f7534afa1ea9 2025-11-17 03:13:27,825 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/1bc05e0c-8851-4f4a-812d-cb653d949806 2025-11-17 03:13:27,837 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11439171296424116542', 'uuid-lslong': '13294899716828664519'}, 'enable': 'true', 'created': '2025-11-17T03:13:27', 'last-modified': '2025-11-17T03:13:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446933'} 2025-11-17 03:13:27,847 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:27,854 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11439171296424116542', 'uuid-lslong': '13294899716828664519'}, 'enable': 'true', 'created': '2025-11-17T03:13:27', 'last-modified': '2025-11-17T03:13:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462106'} 2025-11-17 03:13:27,861 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:27,867 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11439171296424116542', 'uuid-lslong': '13294899716828664519'}, 'enable': 'true', 'created': '2025-11-17T03:13:27', 'last-modified': '2025-11-17T03:13:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467543'} 2025-11-17 03:13:27,874 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-17 03:13:27,875 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-00178389 passed 2025-11-17 03:13:27,875 - DEBUG - ====Verifying policy data for ctest-right_vn-00178389 in API_Server ====== 2025-11-17 03:13:27,875 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:27,882 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:27,899 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:28,004 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9ec019af-d034-413e-b880-f8da620392c7 2025-11-17 03:13:28,014 - DEBUG - =>VN ctest-right_vn-00178389 has no policy to be verified 2025-11-17 03:13:28,015 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:28,015 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:28,015 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:28,027 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389?flat'} 2025-11-17 03:13:28,027 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:28,027 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:28,041 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389?flat'} 2025-11-17 03:13:28,041 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:28,041 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:28,054 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389?flat'} 2025-11-17 03:13:28,054 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-right_vn-00178389 is found in opserver 2025-11-17 03:13:28,078 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:28,090 - DEBUG - VRF ids for VN ctest-right_vn-00178389: {} 2025-11-17 03:13:28,386 - DEBUG - Response for create_network : {'network': {'id': '987552fd-2f8a-4177-8565-84660c3143e2', 'name': 'ctest-trans_left_vn-07228575', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-trans_left_vn-07228575'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:28,677 - DEBUG - Response for create_subnet : {'subnet': {'id': '90c2f5bb-ce83-42b4-94db-edd27fa08e05', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '987552fd-2f8a-4177-8565-84660c3143e2', 'ip_version': 4, 'cidr': '108.133.159.64/26', 'allocation_pools': [{'start': '108.133.159.66', 'end': '108.133.159.126'}], 'gateway_ip': '108.133.159.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '108.133.159.66', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:28,700 - INFO - Created VN ctest-trans_left_vn-07228575 2025-11-17 03:13:28,713 - DEBUG - VN ctest-trans_left_vn-07228575 UUID is 987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:28,788 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:28,795 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:28,809 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:28,931 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:28,945 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:28,957 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/f7781ade-fac3-4699-8b86-a5afd934ea5e 2025-11-17 03:13:28,970 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/f7781ade-fac3-4699-8b86-a5afd934ea5e 2025-11-17 03:13:28,981 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/1a0577a1-5d32-48bd-b525-ce513fda411a 2025-11-17 03:13:28,989 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-17 03:13:28,989 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:29,000 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/f7781ade-fac3-4699-8b86-a5afd934ea5e 2025-11-17 03:13:29,017 - INFO - Verified VN network id 17 for VN 987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:29,017 - INFO - Verifications in API Server for VN ctest-trans_left_vn-07228575 passed 2025-11-17 03:13:29,017 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:29,031 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/f7781ade-fac3-4699-8b86-a5afd934ea5e 2025-11-17 03:13:29,041 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/f7781ade-fac3-4699-8b86-a5afd934ea5e 2025-11-17 03:13:29,050 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/1a0577a1-5d32-48bd-b525-ce513fda411a 2025-11-17 03:13:29,068 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10985778113417986423', 'uuid-lslong': '9612234553518277602'}, 'enable': 'true', 'created': '2025-11-17T03:13:28', 'last-modified': '2025-11-17T03:13:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452247'} 2025-11-17 03:13:29,077 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-17 03:13:29,083 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10985778113417986423', 'uuid-lslong': '9612234553518277602'}, 'enable': 'true', 'created': '2025-11-17T03:13:28', 'last-modified': '2025-11-17T03:13:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.470653'} 2025-11-17 03:13:29,088 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-17 03:13:29,094 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10985778113417986423', 'uuid-lslong': '9612234553518277602'}, 'enable': 'true', 'created': '2025-11-17T03:13:28', 'last-modified': '2025-11-17T03:13:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.470457'} 2025-11-17 03:13:29,100 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-17 03:13:29,100 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-07228575 passed 2025-11-17 03:13:29,101 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-07228575 in API_Server ====== 2025-11-17 03:13:29,101 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:29,108 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:29,120 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:29,220 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/987552fd-2f8a-4177-8565-84660c3143e2 2025-11-17 03:13:29,234 - DEBUG - =>VN ctest-trans_left_vn-07228575 has no policy to be verified 2025-11-17 03:13:29,234 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:29,234 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:29,235 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:29,247 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575?flat'} 2025-11-17 03:13:29,247 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:29,247 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:29,261 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575?flat'} 2025-11-17 03:13:29,261 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:29,261 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:29,273 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575?flat'} 2025-11-17 03:13:29,273 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-trans_left_vn-07228575 is found in opserver 2025-11-17 03:13:29,296 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:29,306 - DEBUG - VRF ids for VN ctest-trans_left_vn-07228575: {} 2025-11-17 03:13:29,613 - DEBUG - Response for create_network : {'network': {'id': '1cf9363e-09b1-4a3f-8401-0927671fe23a', 'name': 'ctest-trans_right_vn-44244586', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-34087861', 'ctest-trans_right_vn-44244586'], 'port_security_enabled': True, 'description': ''}} 2025-11-17 03:13:29,888 - DEBUG - Response for create_subnet : {'subnet': {'id': '4718178c-e483-4f59-82f6-ea939e345077', 'name': '', 'tenant_id': '573a8bca6d6141d7a2e04dd193dfcd82', 'network_id': '1cf9363e-09b1-4a3f-8401-0927671fe23a', 'ip_version': 4, 'cidr': '143.88.172.192/26', 'allocation_pools': [{'start': '143.88.172.194', 'end': '143.88.172.254'}], 'gateway_ip': '143.88.172.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '143.88.172.194', 'tags': [], 'project_id': '573a8bca6d6141d7a2e04dd193dfcd82'}} 2025-11-17 03:13:29,911 - INFO - Created VN ctest-trans_right_vn-44244586 2025-11-17 03:13:29,927 - DEBUG - VN ctest-trans_right_vn-44244586 UUID is 1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,000 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:30,007 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:30,019 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:30,128 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,143 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,154 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b999a48d-62a1-4cdf-bfb4-d1dda11126e2 2025-11-17 03:13:30,163 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b999a48d-62a1-4cdf-bfb4-d1dda11126e2 2025-11-17 03:13:30,171 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/c430005a-025c-456f-b3d6-6ff7c44244ff 2025-11-17 03:13:30,180 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-17 03:13:30,180 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,191 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b999a48d-62a1-4cdf-bfb4-d1dda11126e2 2025-11-17 03:13:30,208 - INFO - Verified VN network id 18 for VN 1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,208 - INFO - Verifications in API Server for VN ctest-trans_right_vn-44244586 passed 2025-11-17 03:13:30,208 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,219 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b999a48d-62a1-4cdf-bfb4-d1dda11126e2 2025-11-17 03:13:30,229 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b999a48d-62a1-4cdf-bfb4-d1dda11126e2 2025-11-17 03:13:30,237 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/c430005a-025c-456f-b3d6-6ff7c44244ff 2025-11-17 03:13:30,250 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2087759542341421631', 'uuid-lslong': '9511893952821715514'}, 'enable': 'true', 'created': '2025-11-17T03:13:29', 'last-modified': '2025-11-17T03:13:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417872'} 2025-11-17 03:13:30,257 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-17 03:13:30,263 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2087759542341421631', 'uuid-lslong': '9511893952821715514'}, 'enable': 'true', 'created': '2025-11-17T03:13:29', 'last-modified': '2025-11-17T03:13:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430010'} 2025-11-17 03:13:30,269 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-17 03:13:30,275 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-34087861', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2087759542341421631', 'uuid-lslong': '9511893952821715514'}, 'enable': 'true', 'created': '2025-11-17T03:13:29', 'last-modified': '2025-11-17T03:13:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444830'} 2025-11-17 03:13:30,281 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-17 03:13:30,281 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-44244586 passed 2025-11-17 03:13:30,281 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-44244586 in API_Server ====== 2025-11-17 03:13:30,282 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:30,288 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:30,300 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:30,406 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/1cf9363e-09b1-4a3f-8401-0927671fe23a 2025-11-17 03:13:30,425 - DEBUG - =>VN ctest-trans_right_vn-44244586 has no policy to be verified 2025-11-17 03:13:30,425 - DEBUG - Verifying the vn in opserver 2025-11-17 03:13:30,425 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586 virtual network link through opserver 10.0.0.22 2025-11-17 03:13:30,425 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-11-17 03:13:30,438 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586?flat'} 2025-11-17 03:13:30,438 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586 virtual network link through opserver 10.0.0.33 2025-11-17 03:13:30,438 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-17 03:13:30,452 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586?flat'} 2025-11-17 03:13:30,452 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586 virtual network link through opserver 10.0.0.23 2025-11-17 03:13:30,452 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-17 03:13:30,466 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586?flat'} 2025-11-17 03:13:30,466 - INFO - Validated that VN default-domain:ctest-TestSvcHC-34087861:ctest-trans_right_vn-44244586 is found in opserver 2025-11-17 03:13:30,488 - DEBUG - Do not have enough data to verify VN in agent 2025-11-17 03:13:30,499 - DEBUG - VRF ids for VN ctest-trans_right_vn-44244586: {} 2025-11-17 03:13:31,669 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-2) 2025-11-17 03:13:33,176 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4736-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4736-1) 2025-11-17 03:13:33,176 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-46993469'] 2025-11-17 03:13:33,468 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-46993469'] created succesfully 2025-11-17 03:13:33,874 - DEBUG - Image by name tiny_trans_fw not found 2025-11-17 03:13:33,874 - DEBUG - Installing image tiny_trans_fw 2025-11-17 03:13:33,874 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-17 03:13:33,874 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-17 03:13:33,874 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-17 03:13:33,874 - DEBUG - Unzip image 2025-11-17 03:13:33,874 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-17 03:13:33,898 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-17 03:13:33,898 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-46993469'] 2025-11-17 03:13:34,005 - INFO - Service template: ['default-domain', 'ctest-service_template_1-46993469'] deleted successfully. 2025-11-17 03:13:34,006 - INFO - Skip interface_detach for VM ctest-right_vm-92102625 in state BUILD 2025-11-17 03:13:34,006 - INFO - Deleting VM ctest-right_vm-92102625 2025-11-17 03:13:34,006 - ERROR - VM ctest-right_vm-92102625 has failed to come up 2025-11-17 03:13:34,006 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:34,006 - ERROR - VM ctest-right_vm-92102625 has failed to come up 2025-11-17 03:13:34,006 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:34,200 - INFO - Skip interface_detach for VM ctest-left_vm-35253037 in state BUILD 2025-11-17 03:13:34,200 - INFO - Deleting VM ctest-left_vm-35253037 2025-11-17 03:13:34,200 - ERROR - VM ctest-left_vm-35253037 has failed to come up 2025-11-17 03:13:34,200 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:34,200 - ERROR - VM ctest-left_vm-35253037 has failed to come up 2025-11-17 03:13:34,201 - ERROR - Nova failed to get host of the VM 2025-11-17 03:13:34,341 - INFO - Deleting VN ctest-trans_right_vn-44244586 2025-11-17 03:13:34,517 - DEBUG - Response for deleting network () 2025-11-17 03:13:34,517 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b999a48d-62a1-4cdf-bfb4-d1dda11126e2 2025-11-17 03:13:34,528 - DEBUG - Response Code: 404 2025-11-17 03:13:34,528 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:34,537 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:34,556 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:34,660 - INFO - Validated that VN ctest-trans_right_vn-44244586 is not found in API Server 2025-11-17 03:13:34,674 - DEBUG - VN ctest-trans_right_vn-44244586 is not present in Agent 10.0.0.50 2025-11-17 03:13:34,684 - DEBUG - VN ctest-trans_right_vn-44244586 is not present in Agent 10.0.0.73 2025-11-17 03:13:34,684 - INFO - Validated that VN ctest-trans_right_vn-44244586 is not in any agent 2025-11-17 03:13:34,734 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-44244586 info 2025-11-17 03:13:34,734 - INFO - Deleting VN ctest-trans_left_vn-07228575 2025-11-17 03:13:34,933 - DEBUG - Response for deleting network () 2025-11-17 03:13:34,934 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/f7781ade-fac3-4699-8b86-a5afd934ea5e 2025-11-17 03:13:34,941 - DEBUG - Response Code: 404 2025-11-17 03:13:34,941 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:34,948 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:34,962 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:35,096 - INFO - Validated that VN ctest-trans_left_vn-07228575 is not found in API Server 2025-11-17 03:13:35,113 - DEBUG - VN ctest-trans_left_vn-07228575 is not present in Agent 10.0.0.50 2025-11-17 03:13:35,139 - DEBUG - VN ctest-trans_left_vn-07228575 is not present in Agent 10.0.0.73 2025-11-17 03:13:35,139 - INFO - Validated that VN ctest-trans_left_vn-07228575 is not in any agent 2025-11-17 03:13:35,178 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-07228575 info 2025-11-17 03:13:35,178 - INFO - Deleting VN ctest-right_vn-00178389 2025-11-17 03:13:35,226 - DEBUG - VN 9ec019af-d034-413e-b880-f8da620392c7 still in use: Unable to complete operation on network 9ec019af-d034-413e-b880-f8da620392c7. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-92b040a7-cf0f-4bde-b085-11a675eb2d77'] 2025-11-17 03:13:35,226 - WARNING - Deleting VN ctest-right_vn-00178389 failed..Will retry 2025-11-17 03:13:37,414 - DEBUG - Response for deleting network () 2025-11-17 03:13:37,414 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/00dd418a-b36e-43bd-8b48-f7534afa1ea9 2025-11-17 03:13:37,424 - DEBUG - Response Code: 404 2025-11-17 03:13:37,424 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:37,432 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:37,487 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:37,585 - INFO - Validated that VN ctest-right_vn-00178389 is not found in API Server 2025-11-17 03:13:37,598 - DEBUG - VN ctest-right_vn-00178389 is not present in Agent 10.0.0.50 2025-11-17 03:13:37,608 - DEBUG - VN ctest-right_vn-00178389 is not present in Agent 10.0.0.73 2025-11-17 03:13:37,608 - INFO - Validated that VN ctest-right_vn-00178389 is not in any agent 2025-11-17 03:13:37,638 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-00178389 info 2025-11-17 03:13:37,638 - INFO - Deleting VN ctest-left_vn-77206489 2025-11-17 03:13:37,839 - DEBUG - Response for deleting network () 2025-11-17 03:13:37,839 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/056194b9-0fe9-44ff-87ec-4766768607e0 2025-11-17 03:13:37,845 - DEBUG - Response Code: 404 2025-11-17 03:13:37,845 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:37,851 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:37,884 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:37,998 - INFO - Validated that VN ctest-left_vn-77206489 is not found in API Server 2025-11-17 03:13:38,012 - DEBUG - VN ctest-left_vn-77206489 is not present in Agent 10.0.0.50 2025-11-17 03:13:38,027 - DEBUG - VN ctest-left_vn-77206489 is not present in Agent 10.0.0.73 2025-11-17 03:13:38,028 - INFO - Validated that VN ctest-left_vn-77206489 is not in any agent 2025-11-17 03:13:38,064 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-77206489 info 2025-11-17 03:13:38,064 - INFO - Deleting VN ctest-mgmt_vn-98919422 2025-11-17 03:13:38,226 - DEBUG - Response for deleting network () 2025-11-17 03:13:38,226 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/2d92ce80-6723-4f5c-93f3-a244f626f3af 2025-11-17 03:13:38,233 - DEBUG - Response Code: 404 2025-11-17 03:13:38,233 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-11-17 03:13:38,255 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03 2025-11-17 03:13:38,270 - DEBUG - Requesting: http://10.0.0.22:8082/project/573a8bca-6d61-41d7-a2e0-4dd193dfcd82 2025-11-17 03:13:38,382 - INFO - Validated that VN ctest-mgmt_vn-98919422 is not found in API Server 2025-11-17 03:13:38,394 - DEBUG - VN ctest-mgmt_vn-98919422 is not present in Agent 10.0.0.50 2025-11-17 03:13:38,408 - DEBUG - VN ctest-mgmt_vn-98919422 is not present in Agent 10.0.0.73 2025-11-17 03:13:38,408 - INFO - Validated that VN ctest-mgmt_vn-98919422 is not in any agent 2025-11-17 03:13:38,454 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-98919422 info 2025-11-17 03:13:39,751 - DEBUG - No XMPP flaps were noticed during the test 2025-11-17 03:13:39,751 - INFO -

2025-11-17 03:13:39,751 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16]

2025-11-17 03:13:39,751 - INFO - -------------------------------------------------------------------------------- 2025-11-17 03:13:40,548 - INFO - Deleted project: ctest-TestSvcHC-34087861, ID : 573a8bca-6d61-41d7-a2e0-4dd193dfcd82