2025-10-09 03:06:56,766 - INFO - Domain Default found not creating 2025-10-09 03:06:56,898 - INFO - Project ctest-TestSvcHC-22581552 not found, creating it 2025-10-09 03:06:57,411 - INFO - Created Project:ctest-TestSvcHC-22581552, ID : 7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:06:58,862 - INFO - ================================================================================ 2025-10-09 03:06:58,862 - INFO - STARTING TEST : test_svc_hc_basic 2025-10-09 03:07:00,144 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.27': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2025-10-09 03:07:00,145 - INFO - Initial checks done. Running the testcase now 2025-10-09 03:07:00,145 - INFO - 2025-10-09 03:07:00,835 - DEBUG - Response for create_network : {'network': {'id': 'ef9385cf-5af9-4847-8575-81dff62c2796', 'name': 'ctest-mgmt_vn-86189061', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-mgmt_vn-86189061'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:01,148 - DEBUG - Response for create_subnet : {'subnet': {'id': '07c204a4-577b-4e4e-99f0-60c8036c29d5', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': 'ef9385cf-5af9-4847-8575-81dff62c2796', 'ip_version': 4, 'cidr': '81.22.226.64/26', 'allocation_pools': [{'start': '81.22.226.66', 'end': '81.22.226.126'}], 'gateway_ip': '81.22.226.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '81.22.226.66', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:01,175 - INFO - Created VN ctest-mgmt_vn-86189061 2025-10-09 03:07:01,188 - DEBUG - VN ctest-mgmt_vn-86189061 UUID is ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,269 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:01,583 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:01,614 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:01,631 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:01,728 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,740 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,750 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0df1d65c-3825-4e19-8061-7a10663edc3b 2025-10-09 03:07:01,760 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0df1d65c-3825-4e19-8061-7a10663edc3b 2025-10-09 03:07:01,767 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/1d2dc7a2-a6b0-41c1-9bfc-2e3566bb5d12 2025-10-09 03:07:01,774 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:01,774 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,784 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0df1d65c-3825-4e19-8061-7a10663edc3b 2025-10-09 03:07:01,800 - INFO - Verified VN network id 14 for VN ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,801 - INFO - Verifications in API Server for VN ctest-mgmt_vn-86189061 passed 2025-10-09 03:07:01,801 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,812 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0df1d65c-3825-4e19-8061-7a10663edc3b 2025-10-09 03:07:01,819 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0df1d65c-3825-4e19-8061-7a10663edc3b 2025-10-09 03:07:01,827 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/1d2dc7a2-a6b0-41c1-9bfc-2e3566bb5d12 2025-10-09 03:07:01,843 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17263288922272254023', 'uuid-lslong': '9616735378227341206'}, 'enable': 'true', 'created': '2025-10-09T03:07:00', 'last-modified': '2025-10-09T03:07:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.741602'} 2025-10-09 03:07:01,851 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:01,858 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17263288922272254023', 'uuid-lslong': '9616735378227341206'}, 'enable': 'true', 'created': '2025-10-09T03:07:00', 'last-modified': '2025-10-09T03:07:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.759027'} 2025-10-09 03:07:01,864 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:01,870 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17263288922272254023', 'uuid-lslong': '9616735378227341206'}, 'enable': 'true', 'created': '2025-10-09T03:07:00', 'last-modified': '2025-10-09T03:07:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.773683'} 2025-10-09 03:07:01,876 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:01,876 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-86189061 passed 2025-10-09 03:07:01,876 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-86189061 in API_Server ====== 2025-10-09 03:07:01,876 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:01,884 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:01,897 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:01,990 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/ef9385cf-5af9-4847-8575-81dff62c2796 2025-10-09 03:07:01,999 - DEBUG - =>VN ctest-mgmt_vn-86189061 has no policy to be verified 2025-10-09 03:07:01,999 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:02,000 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:02,000 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:02,301 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:02,360 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061?flat'} 2025-10-09 03:07:02,360 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:02,360 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:02,659 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:02,715 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061?flat'} 2025-10-09 03:07:02,715 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:02,715 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:03,025 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:03,093 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061?flat'} 2025-10-09 03:07:03,093 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-86189061 is found in opserver 2025-10-09 03:07:03,112 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:03,123 - DEBUG - VRF ids for VN ctest-mgmt_vn-86189061: {} 2025-10-09 03:07:03,404 - DEBUG - Response for create_network : {'network': {'id': 'f1149be1-2287-4c99-8c34-a18d3a58aa89', 'name': 'ctest-left_vn-83843161', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-left_vn-83843161'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:03,670 - DEBUG - Response for create_subnet : {'subnet': {'id': '316c733a-5193-4973-9986-5b1772bd9777', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': 'f1149be1-2287-4c99-8c34-a18d3a58aa89', 'ip_version': 4, 'cidr': '51.120.191.192/26', 'allocation_pools': [{'start': '51.120.191.194', 'end': '51.120.191.254'}], 'gateway_ip': '51.120.191.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '51.120.191.194', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:03,694 - INFO - Created VN ctest-left_vn-83843161 2025-10-09 03:07:03,708 - DEBUG - VN ctest-left_vn-83843161 UUID is f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:03,787 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:03,794 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:03,805 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:03,903 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:03,925 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:03,935 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46720363-adc2-4970-a42d-aedb8e24a670 2025-10-09 03:07:03,943 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46720363-adc2-4970-a42d-aedb8e24a670 2025-10-09 03:07:03,951 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6f2adaa4-8e23-457e-bf1c-193e525beab7 2025-10-09 03:07:03,958 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:03,958 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:03,967 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46720363-adc2-4970-a42d-aedb8e24a670 2025-10-09 03:07:03,984 - INFO - Verified VN network id 15 for VN f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:03,985 - INFO - Verifications in API Server for VN ctest-left_vn-83843161 passed 2025-10-09 03:07:03,985 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:03,996 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46720363-adc2-4970-a42d-aedb8e24a670 2025-10-09 03:07:04,006 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46720363-adc2-4970-a42d-aedb8e24a670 2025-10-09 03:07:04,013 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6f2adaa4-8e23-457e-bf1c-193e525beab7 2025-10-09 03:07:04,026 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17371681053924084889', 'uuid-lslong': '10102877492040215177'}, 'enable': 'true', 'created': '2025-10-09T03:07:03', 'last-modified': '2025-10-09T03:07:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404679'} 2025-10-09 03:07:04,033 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:04,039 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17371681053924084889', 'uuid-lslong': '10102877492040215177'}, 'enable': 'true', 'created': '2025-10-09T03:07:03', 'last-modified': '2025-10-09T03:07:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.419393'} 2025-10-09 03:07:04,045 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:04,051 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17371681053924084889', 'uuid-lslong': '10102877492040215177'}, 'enable': 'true', 'created': '2025-10-09T03:07:03', 'last-modified': '2025-10-09T03:07:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426050'} 2025-10-09 03:07:04,057 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:04,057 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-83843161 passed 2025-10-09 03:07:04,058 - DEBUG - ====Verifying policy data for ctest-left_vn-83843161 in API_Server ====== 2025-10-09 03:07:04,058 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:04,064 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:04,078 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:04,172 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f1149be1-2287-4c99-8c34-a18d3a58aa89 2025-10-09 03:07:04,183 - DEBUG - =>VN ctest-left_vn-83843161 has no policy to be verified 2025-10-09 03:07:04,183 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:04,183 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:04,183 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:04,237 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161?flat'} 2025-10-09 03:07:04,237 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:04,237 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:04,290 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161?flat'} 2025-10-09 03:07:04,290 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:04,290 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:04,350 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161?flat'} 2025-10-09 03:07:04,350 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-83843161 is found in opserver 2025-10-09 03:07:04,372 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:04,384 - DEBUG - VRF ids for VN ctest-left_vn-83843161: {} 2025-10-09 03:07:04,667 - DEBUG - Response for create_network : {'network': {'id': '64b140b8-9581-41d7-bc2c-adb0b19dd4b6', 'name': 'ctest-right_vn-97678695', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-right_vn-97678695'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:04,912 - DEBUG - Response for create_subnet : {'subnet': {'id': '660f2a47-3291-4a8c-873e-20d7c849cbda', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': '64b140b8-9581-41d7-bc2c-adb0b19dd4b6', 'ip_version': 4, 'cidr': '149.237.43.192/26', 'allocation_pools': [{'start': '149.237.43.194', 'end': '149.237.43.254'}], 'gateway_ip': '149.237.43.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.237.43.194', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:04,936 - INFO - Created VN ctest-right_vn-97678695 2025-10-09 03:07:04,947 - DEBUG - VN ctest-right_vn-97678695 UUID is 64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,019 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:05,026 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:05,037 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:05,153 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,166 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,175 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bb90a11e-6064-40d1-a302-cbe8f175cb9b 2025-10-09 03:07:05,186 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bb90a11e-6064-40d1-a302-cbe8f175cb9b 2025-10-09 03:07:05,193 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/65426147-1a00-471e-a175-708f85dc9733 2025-10-09 03:07:05,205 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:05,206 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,214 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bb90a11e-6064-40d1-a302-cbe8f175cb9b 2025-10-09 03:07:05,231 - INFO - Verified VN network id 16 for VN 64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,231 - INFO - Verifications in API Server for VN ctest-right_vn-97678695 passed 2025-10-09 03:07:05,231 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,240 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bb90a11e-6064-40d1-a302-cbe8f175cb9b 2025-10-09 03:07:05,248 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bb90a11e-6064-40d1-a302-cbe8f175cb9b 2025-10-09 03:07:05,256 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/65426147-1a00-471e-a175-708f85dc9733 2025-10-09 03:07:05,271 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7255651636197016023', 'uuid-lslong': '13559403552511481014'}, 'enable': 'true', 'created': '2025-10-09T03:07:04', 'last-modified': '2025-10-09T03:07:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428104'} 2025-10-09 03:07:05,282 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:05,303 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7255651636197016023', 'uuid-lslong': '13559403552511481014'}, 'enable': 'true', 'created': '2025-10-09T03:07:04', 'last-modified': '2025-10-09T03:07:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448451'} 2025-10-09 03:07:05,315 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:05,322 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7255651636197016023', 'uuid-lslong': '13559403552511481014'}, 'enable': 'true', 'created': '2025-10-09T03:07:04', 'last-modified': '2025-10-09T03:07:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.478800'} 2025-10-09 03:07:05,329 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:05,329 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-97678695 passed 2025-10-09 03:07:05,330 - DEBUG - ====Verifying policy data for ctest-right_vn-97678695 in API_Server ====== 2025-10-09 03:07:05,330 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:05,337 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:05,352 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:05,448 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/64b140b8-9581-41d7-bc2c-adb0b19dd4b6 2025-10-09 03:07:05,464 - DEBUG - =>VN ctest-right_vn-97678695 has no policy to be verified 2025-10-09 03:07:05,464 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:05,464 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:05,464 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:05,527 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695?flat'} 2025-10-09 03:07:05,527 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:05,527 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:05,579 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695?flat'} 2025-10-09 03:07:05,579 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:05,579 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:05,630 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695?flat'} 2025-10-09 03:07:05,630 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-97678695 is found in opserver 2025-10-09 03:07:05,652 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:05,663 - DEBUG - VRF ids for VN ctest-right_vn-97678695: {} 2025-10-09 03:07:05,721 - DEBUG - Services list from nova: [, , , ] 2025-10-09 03:07:06,771 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4252-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4252-2) 2025-10-09 03:07:08,124 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4252-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4252-1) 2025-10-09 03:07:08,124 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-79329744'] 2025-10-09 03:07:08,433 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-79329744'] created succesfully 2025-10-09 03:07:08,891 - DEBUG - Image by name tiny_nat_fw not found 2025-10-09 03:07:08,891 - DEBUG - Installing image tiny_nat_fw 2025-10-09 03:07:08,891 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-10-09 03:07:08,891 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-09 03:07:08,891 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-09 03:07:08,891 - DEBUG - Unzip image 2025-10-09 03:07:08,891 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-10-09 03:07:08,911 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-10-09 03:07:08,911 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-79329744'] 2025-10-09 03:07:09,005 - INFO - Service template: ['default-domain', 'ctest-service_template_1-79329744'] deleted successfully. 2025-10-09 03:07:09,006 - INFO - Skip interface_detach for VM ctest-right_vm-61283896 in state BUILD 2025-10-09 03:07:09,006 - INFO - Deleting VM ctest-right_vm-61283896 2025-10-09 03:07:09,064 - ERROR - VM ctest-right_vm-61283896 has failed to come up 2025-10-09 03:07:09,064 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:09,064 - ERROR - VM ctest-right_vm-61283896 has failed to come up 2025-10-09 03:07:09,064 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:09,148 - INFO - Skip interface_detach for VM ctest-left_vm-67814003 in state BUILD 2025-10-09 03:07:09,148 - INFO - Deleting VM ctest-left_vm-67814003 2025-10-09 03:07:09,148 - ERROR - VM ctest-left_vm-67814003 has failed to come up 2025-10-09 03:07:09,148 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:09,148 - ERROR - VM ctest-left_vm-67814003 has failed to come up 2025-10-09 03:07:09,148 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:09,230 - INFO - Deleting VN ctest-right_vn-97678695 2025-10-09 03:07:09,287 - DEBUG - VN 64b140b8-9581-41d7-bc2c-adb0b19dd4b6 still in use: Unable to complete operation on network 64b140b8-9581-41d7-bc2c-adb0b19dd4b6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1028eec0-700d-4774-adb8-bda4c496e8af'] 2025-10-09 03:07:09,287 - WARNING - Deleting VN ctest-right_vn-97678695 failed..Will retry 2025-10-09 03:07:11,479 - DEBUG - Response for deleting network () 2025-10-09 03:07:11,479 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/bb90a11e-6064-40d1-a302-cbe8f175cb9b 2025-10-09 03:07:11,491 - DEBUG - Response Code: 404 2025-10-09 03:07:11,491 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:11,502 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:11,527 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:11,635 - INFO - Validated that VN ctest-right_vn-97678695 is not found in API Server 2025-10-09 03:07:11,647 - DEBUG - VN ctest-right_vn-97678695 is not present in Agent 10.0.0.22 2025-10-09 03:07:11,658 - DEBUG - VN ctest-right_vn-97678695 is not present in Agent 10.0.0.27 2025-10-09 03:07:11,658 - INFO - Validated that VN ctest-right_vn-97678695 is not in any agent 2025-10-09 03:07:11,698 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-97678695 info 2025-10-09 03:07:11,698 - INFO - Deleting VN ctest-left_vn-83843161 2025-10-09 03:07:11,850 - DEBUG - Response for deleting network () 2025-10-09 03:07:11,850 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/46720363-adc2-4970-a42d-aedb8e24a670 2025-10-09 03:07:11,862 - DEBUG - Response Code: 404 2025-10-09 03:07:11,862 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:11,869 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:11,883 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:11,978 - INFO - Validated that VN ctest-left_vn-83843161 is not found in API Server 2025-10-09 03:07:11,989 - DEBUG - VN ctest-left_vn-83843161 is not present in Agent 10.0.0.22 2025-10-09 03:07:12,000 - DEBUG - VN ctest-left_vn-83843161 is not present in Agent 10.0.0.27 2025-10-09 03:07:12,000 - INFO - Validated that VN ctest-left_vn-83843161 is not in any agent 2025-10-09 03:07:12,028 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-83843161 info 2025-10-09 03:07:12,028 - INFO - Deleting VN ctest-mgmt_vn-86189061 2025-10-09 03:07:12,162 - DEBUG - Response for deleting network () 2025-10-09 03:07:12,162 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/0df1d65c-3825-4e19-8061-7a10663edc3b 2025-10-09 03:07:12,167 - DEBUG - Response Code: 404 2025-10-09 03:07:12,167 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:12,172 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:12,187 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:12,276 - INFO - Validated that VN ctest-mgmt_vn-86189061 is not found in API Server 2025-10-09 03:07:12,289 - DEBUG - VN ctest-mgmt_vn-86189061 is not present in Agent 10.0.0.22 2025-10-09 03:07:12,304 - DEBUG - VN ctest-mgmt_vn-86189061 is not present in Agent 10.0.0.27 2025-10-09 03:07:12,304 - INFO - Validated that VN ctest-mgmt_vn-86189061 is not in any agent 2025-10-09 03:07:12,339 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-86189061 info 2025-10-09 03:07:13,619 - DEBUG - No XMPP flaps were noticed during the test 2025-10-09 03:07:13,619 - INFO -
2025-10-09 03:07:13,619 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15]
2025-10-09 03:07:13,619 - INFO - -------------------------------------------------------------------------------- 2025-10-09 03:07:13,622 - INFO - ================================================================================ 2025-10-09 03:07:13,623 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-10-09 03:07:14,900 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.20.0.25': '0', '10.20.0.14': '0'}, '10.0.0.27': {'10.20.0.25': '0', '10.20.0.14': '0'}} with 2025-10-09 03:07:14,900 - INFO - Initial checks done. Running the testcase now 2025-10-09 03:07:14,900 - INFO - 2025-10-09 03:07:15,217 - DEBUG - Response for create_network : {'network': {'id': 'f944cff0-6bc6-453a-aabb-08e3cf39f2d7', 'name': 'ctest-mgmt_vn-77969630', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-mgmt_vn-77969630'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:15,483 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c61d500a-08d1-4e6b-87bc-541f4ebb5a9b', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': 'f944cff0-6bc6-453a-aabb-08e3cf39f2d7', 'ip_version': 4, 'cidr': '51.30.66.64/26', 'allocation_pools': [{'start': '51.30.66.66', 'end': '51.30.66.126'}], 'gateway_ip': '51.30.66.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '51.30.66.66', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:15,509 - INFO - Created VN ctest-mgmt_vn-77969630 2025-10-09 03:07:15,519 - DEBUG - VN ctest-mgmt_vn-77969630 UUID is f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:15,603 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:15,609 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:15,620 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:15,705 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:15,727 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:15,739 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a3b11d0c-8684-4519-820a-de1577d0ee5e 2025-10-09 03:07:15,762 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a3b11d0c-8684-4519-820a-de1577d0ee5e 2025-10-09 03:07:15,770 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/904ebe2d-bdf1-4942-a7f3-69effee66af6 2025-10-09 03:07:15,778 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:15,778 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:15,787 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a3b11d0c-8684-4519-820a-de1577d0ee5e 2025-10-09 03:07:15,802 - INFO - Verified VN network id 14 for VN f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:15,803 - INFO - Verifications in API Server for VN ctest-mgmt_vn-77969630 passed 2025-10-09 03:07:15,803 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:15,818 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a3b11d0c-8684-4519-820a-de1577d0ee5e 2025-10-09 03:07:15,825 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a3b11d0c-8684-4519-820a-de1577d0ee5e 2025-10-09 03:07:15,835 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/904ebe2d-bdf1-4942-a7f3-69effee66af6 2025-10-09 03:07:15,848 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17961709845367637306', 'uuid-lslong': '12302436581619921623'}, 'enable': 'true', 'created': '2025-10-09T03:07:15', 'last-modified': '2025-10-09T03:07:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.418067'} 2025-10-09 03:07:15,862 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:15,868 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17961709845367637306', 'uuid-lslong': '12302436581619921623'}, 'enable': 'true', 'created': '2025-10-09T03:07:15', 'last-modified': '2025-10-09T03:07:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437634'} 2025-10-09 03:07:15,873 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:15,879 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17961709845367637306', 'uuid-lslong': '12302436581619921623'}, 'enable': 'true', 'created': '2025-10-09T03:07:15', 'last-modified': '2025-10-09T03:07:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449917'} 2025-10-09 03:07:15,885 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-09 03:07:15,885 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-77969630 passed 2025-10-09 03:07:15,885 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-77969630 in API_Server ====== 2025-10-09 03:07:15,886 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:15,894 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:15,907 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:15,999 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f944cff0-6bc6-453a-aabb-08e3cf39f2d7 2025-10-09 03:07:16,008 - DEBUG - =>VN ctest-mgmt_vn-77969630 has no policy to be verified 2025-10-09 03:07:16,009 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:16,009 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:16,009 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:16,021 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630?flat'} 2025-10-09 03:07:16,021 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:16,021 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:16,033 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630?flat'} 2025-10-09 03:07:16,033 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:16,033 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:16,045 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630?flat'} 2025-10-09 03:07:16,045 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-mgmt_vn-77969630 is found in opserver 2025-10-09 03:07:16,069 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:16,081 - DEBUG - VRF ids for VN ctest-mgmt_vn-77969630: {} 2025-10-09 03:07:16,360 - DEBUG - Response for create_network : {'network': {'id': '9b9c3e6a-032c-4359-b39c-956a260a259a', 'name': 'ctest-left_vn-48125920', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-left_vn-48125920'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:16,616 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a47ce46b-e15f-4e4b-8a51-ab656f57c2e4', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': '9b9c3e6a-032c-4359-b39c-956a260a259a', 'ip_version': 4, 'cidr': '51.38.125.128/26', 'allocation_pools': [{'start': '51.38.125.130', 'end': '51.38.125.190'}], 'gateway_ip': '51.38.125.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '51.38.125.130', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:16,640 - INFO - Created VN ctest-left_vn-48125920 2025-10-09 03:07:16,656 - DEBUG - VN ctest-left_vn-48125920 UUID is 9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:16,806 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:16,813 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:16,824 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:16,927 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:16,945 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:16,964 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f44fce69-e8a3-4198-8717-8f17f8cdfa0b 2025-10-09 03:07:16,976 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f44fce69-e8a3-4198-8717-8f17f8cdfa0b 2025-10-09 03:07:16,984 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/676e518e-fd9a-4c4d-b41e-7158e66d405c 2025-10-09 03:07:16,991 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:16,991 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:17,001 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f44fce69-e8a3-4198-8717-8f17f8cdfa0b 2025-10-09 03:07:17,021 - INFO - Verified VN network id 15 for VN 9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:17,021 - INFO - Verifications in API Server for VN ctest-left_vn-48125920 passed 2025-10-09 03:07:17,021 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:17,031 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f44fce69-e8a3-4198-8717-8f17f8cdfa0b 2025-10-09 03:07:17,039 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f44fce69-e8a3-4198-8717-8f17f8cdfa0b 2025-10-09 03:07:17,046 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/676e518e-fd9a-4c4d-b41e-7158e66d405c 2025-10-09 03:07:17,059 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11212905797286380377', 'uuid-lslong': '12942383712293234074'}, 'enable': 'true', 'created': '2025-10-09T03:07:16', 'last-modified': '2025-10-09T03:07:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496787'} 2025-10-09 03:07:17,065 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:17,071 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11212905797286380377', 'uuid-lslong': '12942383712293234074'}, 'enable': 'true', 'created': '2025-10-09T03:07:16', 'last-modified': '2025-10-09T03:07:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.518049'} 2025-10-09 03:07:17,077 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:17,082 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11212905797286380377', 'uuid-lslong': '12942383712293234074'}, 'enable': 'true', 'created': '2025-10-09T03:07:16', 'last-modified': '2025-10-09T03:07:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.530918'} 2025-10-09 03:07:17,088 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-09 03:07:17,088 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-48125920 passed 2025-10-09 03:07:17,089 - DEBUG - ====Verifying policy data for ctest-left_vn-48125920 in API_Server ====== 2025-10-09 03:07:17,089 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:17,095 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:17,109 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:17,210 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9b9c3e6a-032c-4359-b39c-956a260a259a 2025-10-09 03:07:17,221 - DEBUG - =>VN ctest-left_vn-48125920 has no policy to be verified 2025-10-09 03:07:17,221 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:17,221 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:17,221 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:17,234 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920?flat'} 2025-10-09 03:07:17,234 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:17,234 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:17,249 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920?flat'} 2025-10-09 03:07:17,249 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:17,249 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:17,261 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920?flat'} 2025-10-09 03:07:17,261 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-left_vn-48125920 is found in opserver 2025-10-09 03:07:17,282 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:17,292 - DEBUG - VRF ids for VN ctest-left_vn-48125920: {} 2025-10-09 03:07:17,560 - DEBUG - Response for create_network : {'network': {'id': 'f845c4b8-767c-40ef-b14a-da371ed52ca5', 'name': 'ctest-right_vn-94284904', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-right_vn-94284904'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:17,852 - DEBUG - Response for create_subnet : {'subnet': {'id': '15506ed3-247a-4f04-9f0f-fd44b31e4bc4', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': 'f845c4b8-767c-40ef-b14a-da371ed52ca5', 'ip_version': 4, 'cidr': '218.161.93.192/26', 'allocation_pools': [{'start': '218.161.93.194', 'end': '218.161.93.254'}], 'gateway_ip': '218.161.93.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.161.93.194', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:17,874 - INFO - Created VN ctest-right_vn-94284904 2025-10-09 03:07:17,888 - DEBUG - VN ctest-right_vn-94284904 UUID is f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:17,962 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:17,968 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:17,983 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:18,074 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:18,087 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:18,096 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a76f4a6e-27a1-4e75-869c-4536b27ec329 2025-10-09 03:07:18,103 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a76f4a6e-27a1-4e75-869c-4536b27ec329 2025-10-09 03:07:18,110 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/7ca40838-9f31-4147-814f-6e545f912f22 2025-10-09 03:07:18,115 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:18,115 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:18,123 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a76f4a6e-27a1-4e75-869c-4536b27ec329 2025-10-09 03:07:18,137 - INFO - Verified VN network id 16 for VN f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:18,138 - INFO - Verifications in API Server for VN ctest-right_vn-94284904 passed 2025-10-09 03:07:18,138 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:18,147 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a76f4a6e-27a1-4e75-869c-4536b27ec329 2025-10-09 03:07:18,154 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a76f4a6e-27a1-4e75-869c-4536b27ec329 2025-10-09 03:07:18,160 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/7ca40838-9f31-4147-814f-6e545f912f22 2025-10-09 03:07:18,173 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17889921391340044527', 'uuid-lslong': '12775263223265176741'}, 'enable': 'true', 'created': '2025-10-09T03:07:17', 'last-modified': '2025-10-09T03:07:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459320'} 2025-10-09 03:07:18,178 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:18,184 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17889921391340044527', 'uuid-lslong': '12775263223265176741'}, 'enable': 'true', 'created': '2025-10-09T03:07:17', 'last-modified': '2025-10-09T03:07:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471257'} 2025-10-09 03:07:18,190 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:18,196 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17889921391340044527', 'uuid-lslong': '12775263223265176741'}, 'enable': 'true', 'created': '2025-10-09T03:07:17', 'last-modified': '2025-10-09T03:07:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482515'} 2025-10-09 03:07:18,201 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-09 03:07:18,201 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-94284904 passed 2025-10-09 03:07:18,202 - DEBUG - ====Verifying policy data for ctest-right_vn-94284904 in API_Server ====== 2025-10-09 03:07:18,202 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:18,208 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:18,217 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:18,313 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f845c4b8-767c-40ef-b14a-da371ed52ca5 2025-10-09 03:07:18,323 - DEBUG - =>VN ctest-right_vn-94284904 has no policy to be verified 2025-10-09 03:07:18,323 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:18,323 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:18,323 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:18,334 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904?flat'} 2025-10-09 03:07:18,334 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:18,334 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:18,345 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904?flat'} 2025-10-09 03:07:18,345 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:18,345 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:18,358 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904?flat'} 2025-10-09 03:07:18,358 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-right_vn-94284904 is found in opserver 2025-10-09 03:07:18,378 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:18,387 - DEBUG - VRF ids for VN ctest-right_vn-94284904: {} 2025-10-09 03:07:18,666 - DEBUG - Response for create_network : {'network': {'id': '57af7ec6-5808-4ffc-84d7-6fea55042c47', 'name': 'ctest-trans_left_vn-85347159', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-trans_left_vn-85347159'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:18,894 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fbfff1cf-048d-4e56-b8bd-d9dd3c74df5e', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': '57af7ec6-5808-4ffc-84d7-6fea55042c47', 'ip_version': 4, 'cidr': '196.41.103.64/26', 'allocation_pools': [{'start': '196.41.103.66', 'end': '196.41.103.126'}], 'gateway_ip': '196.41.103.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '196.41.103.66', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:18,917 - INFO - Created VN ctest-trans_left_vn-85347159 2025-10-09 03:07:18,928 - DEBUG - VN ctest-trans_left_vn-85347159 UUID is 57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,005 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:19,013 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:19,025 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:19,112 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,129 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,139 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/4d4d70e0-b6ae-4dda-af3e-623fb98c1366 2025-10-09 03:07:19,148 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/4d4d70e0-b6ae-4dda-af3e-623fb98c1366 2025-10-09 03:07:19,156 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/bf04374c-4d1d-4b50-8463-959271d3cca7 2025-10-09 03:07:19,162 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-09 03:07:19,162 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,170 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/4d4d70e0-b6ae-4dda-af3e-623fb98c1366 2025-10-09 03:07:19,185 - INFO - Verified VN network id 17 for VN 57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,185 - INFO - Verifications in API Server for VN ctest-trans_left_vn-85347159 passed 2025-10-09 03:07:19,185 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,195 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/4d4d70e0-b6ae-4dda-af3e-623fb98c1366 2025-10-09 03:07:19,201 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/4d4d70e0-b6ae-4dda-af3e-623fb98c1366 2025-10-09 03:07:19,208 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/bf04374c-4d1d-4b50-8463-959271d3cca7 2025-10-09 03:07:19,222 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6318408192569659388', 'uuid-lslong': '9572242585238645831'}, 'enable': 'true', 'created': '2025-10-09T03:07:18', 'last-modified': '2025-10-09T03:07:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.371151'} 2025-10-09 03:07:19,227 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-09 03:07:19,233 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6318408192569659388', 'uuid-lslong': '9572242585238645831'}, 'enable': 'true', 'created': '2025-10-09T03:07:18', 'last-modified': '2025-10-09T03:07:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385073'} 2025-10-09 03:07:19,239 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-09 03:07:19,244 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6318408192569659388', 'uuid-lslong': '9572242585238645831'}, 'enable': 'true', 'created': '2025-10-09T03:07:18', 'last-modified': '2025-10-09T03:07:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396601'} 2025-10-09 03:07:19,249 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-09 03:07:19,250 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-85347159 passed 2025-10-09 03:07:19,250 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-85347159 in API_Server ====== 2025-10-09 03:07:19,250 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:19,255 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:19,267 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:19,376 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/57af7ec6-5808-4ffc-84d7-6fea55042c47 2025-10-09 03:07:19,386 - DEBUG - =>VN ctest-trans_left_vn-85347159 has no policy to be verified 2025-10-09 03:07:19,386 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:19,387 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:19,387 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:19,399 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159?flat'} 2025-10-09 03:07:19,399 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:19,399 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:19,411 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159?flat'} 2025-10-09 03:07:19,411 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:19,411 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:19,424 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159?flat'} 2025-10-09 03:07:19,424 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-trans_left_vn-85347159 is found in opserver 2025-10-09 03:07:19,446 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:19,455 - DEBUG - VRF ids for VN ctest-trans_left_vn-85347159: {} 2025-10-09 03:07:19,729 - DEBUG - Response for create_network : {'network': {'id': '5b8ba270-ddd8-4433-be7d-ea07bf8cba94', 'name': 'ctest-trans_right_vn-72021206', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'project_id': '7fe976149ebf4d3d9cd115e9d835638d', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-22581552', 'ctest-trans_right_vn-72021206'], 'port_security_enabled': True, 'description': ''}} 2025-10-09 03:07:19,950 - DEBUG - Response for create_subnet : {'subnet': {'id': '620e2fe3-36f7-475b-9bbe-91c4cd4b7d10', 'name': '', 'tenant_id': '7fe976149ebf4d3d9cd115e9d835638d', 'network_id': '5b8ba270-ddd8-4433-be7d-ea07bf8cba94', 'ip_version': 4, 'cidr': '91.38.99.64/26', 'allocation_pools': [{'start': '91.38.99.66', 'end': '91.38.99.126'}], 'gateway_ip': '91.38.99.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '91.38.99.66', 'tags': [], 'project_id': '7fe976149ebf4d3d9cd115e9d835638d'}} 2025-10-09 03:07:19,970 - INFO - Created VN ctest-trans_right_vn-72021206 2025-10-09 03:07:19,982 - DEBUG - VN ctest-trans_right_vn-72021206 UUID is 5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,067 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:20,073 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:20,085 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:20,185 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,197 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,206 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/acbb5e45-ae6f-4e4b-8aa4-b72a4fe917bb 2025-10-09 03:07:20,216 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/acbb5e45-ae6f-4e4b-8aa4-b72a4fe917bb 2025-10-09 03:07:20,224 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c236e49a-115c-4520-87de-3f0525d29bf9 2025-10-09 03:07:20,242 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-09 03:07:20,242 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,253 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/acbb5e45-ae6f-4e4b-8aa4-b72a4fe917bb 2025-10-09 03:07:20,272 - INFO - Verified VN network id 18 for VN 5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,272 - INFO - Verifications in API Server for VN ctest-trans_right_vn-72021206 passed 2025-10-09 03:07:20,272 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,283 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/acbb5e45-ae6f-4e4b-8aa4-b72a4fe917bb 2025-10-09 03:07:20,292 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/acbb5e45-ae6f-4e4b-8aa4-b72a4fe917bb 2025-10-09 03:07:20,299 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/c236e49a-115c-4520-87de-3f0525d29bf9 2025-10-09 03:07:20,315 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6596544684856198195', 'uuid-lslong': '13726384558294481556'}, 'enable': 'true', 'created': '2025-10-09T03:07:19', 'last-modified': '2025-10-09T03:07:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426238'} 2025-10-09 03:07:20,321 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-09 03:07:20,327 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6596544684856198195', 'uuid-lslong': '13726384558294481556'}, 'enable': 'true', 'created': '2025-10-09T03:07:19', 'last-modified': '2025-10-09T03:07:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.438570'} 2025-10-09 03:07:20,334 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-09 03:07:20,339 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-22581552', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6596544684856198195', 'uuid-lslong': '13726384558294481556'}, 'enable': 'true', 'created': '2025-10-09T03:07:19', 'last-modified': '2025-10-09T03:07:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.450390'} 2025-10-09 03:07:20,345 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-09 03:07:20,345 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-72021206 passed 2025-10-09 03:07:20,345 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-72021206 in API_Server ====== 2025-10-09 03:07:20,345 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:20,354 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:20,364 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:20,453 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/5b8ba270-ddd8-4433-be7d-ea07bf8cba94 2025-10-09 03:07:20,462 - DEBUG - =>VN ctest-trans_right_vn-72021206 has no policy to be verified 2025-10-09 03:07:20,462 - DEBUG - Verifying the vn in opserver 2025-10-09 03:07:20,462 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206 virtual network link through opserver 10.0.0.56 2025-10-09 03:07:20,462 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-10-09 03:07:20,487 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206?flat'} 2025-10-09 03:07:20,487 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206 virtual network link through opserver 10.0.0.19 2025-10-09 03:07:20,487 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-09 03:07:20,504 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206?flat'} 2025-10-09 03:07:20,504 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206 virtual network link through opserver 10.0.0.41 2025-10-09 03:07:20,504 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-09 03:07:20,517 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206?flat'} 2025-10-09 03:07:20,517 - INFO - Validated that VN default-domain:ctest-TestSvcHC-22581552:ctest-trans_right_vn-72021206 is found in opserver 2025-10-09 03:07:20,542 - DEBUG - Do not have enough data to verify VN in agent 2025-10-09 03:07:20,554 - DEBUG - VRF ids for VN ctest-trans_right_vn-72021206: {} 2025-10-09 03:07:21,620 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4252-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4252-1) 2025-10-09 03:07:22,882 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4252-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4252-2) 2025-10-09 03:07:22,884 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-14411528'] 2025-10-09 03:07:23,182 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-14411528'] created succesfully 2025-10-09 03:07:23,514 - DEBUG - Image by name tiny_trans_fw not found 2025-10-09 03:07:23,514 - DEBUG - Installing image tiny_trans_fw 2025-10-09 03:07:23,514 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-10-09 03:07:23,514 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-09 03:07:23,514 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-09 03:07:23,514 - DEBUG - Unzip image 2025-10-09 03:07:23,514 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-10-09 03:07:23,534 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-10-09 03:07:23,534 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-14411528'] 2025-10-09 03:07:23,629 - INFO - Service template: ['default-domain', 'ctest-service_template_1-14411528'] deleted successfully. 2025-10-09 03:07:23,630 - INFO - Skip interface_detach for VM ctest-right_vm-23327382 in state BUILD 2025-10-09 03:07:23,630 - INFO - Deleting VM ctest-right_vm-23327382 2025-10-09 03:07:23,630 - ERROR - VM ctest-right_vm-23327382 has failed to come up 2025-10-09 03:07:23,630 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:23,630 - ERROR - VM ctest-right_vm-23327382 has failed to come up 2025-10-09 03:07:23,630 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:23,734 - INFO - Skip interface_detach for VM ctest-left_vm-99410257 in state BUILD 2025-10-09 03:07:23,734 - INFO - Deleting VM ctest-left_vm-99410257 2025-10-09 03:07:23,734 - ERROR - VM ctest-left_vm-99410257 has failed to come up 2025-10-09 03:07:23,735 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:23,735 - ERROR - VM ctest-left_vm-99410257 has failed to come up 2025-10-09 03:07:23,735 - ERROR - Nova failed to get host of the VM 2025-10-09 03:07:23,826 - INFO - Deleting VN ctest-trans_right_vn-72021206 2025-10-09 03:07:23,983 - DEBUG - Response for deleting network () 2025-10-09 03:07:23,983 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/acbb5e45-ae6f-4e4b-8aa4-b72a4fe917bb 2025-10-09 03:07:23,989 - DEBUG - Response Code: 404 2025-10-09 03:07:23,989 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:23,997 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:24,026 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:24,101 - INFO - Validated that VN ctest-trans_right_vn-72021206 is not found in API Server 2025-10-09 03:07:24,115 - DEBUG - VN ctest-trans_right_vn-72021206 is not present in Agent 10.0.0.22 2025-10-09 03:07:24,130 - DEBUG - VN ctest-trans_right_vn-72021206 is not present in Agent 10.0.0.27 2025-10-09 03:07:24,130 - INFO - Validated that VN ctest-trans_right_vn-72021206 is not in any agent 2025-10-09 03:07:24,164 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-72021206 info 2025-10-09 03:07:24,164 - INFO - Deleting VN ctest-trans_left_vn-85347159 2025-10-09 03:07:24,333 - DEBUG - Response for deleting network () 2025-10-09 03:07:24,334 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/4d4d70e0-b6ae-4dda-af3e-623fb98c1366 2025-10-09 03:07:24,344 - DEBUG - Response Code: 404 2025-10-09 03:07:24,344 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:24,351 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:24,364 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:24,468 - INFO - Validated that VN ctest-trans_left_vn-85347159 is not found in API Server 2025-10-09 03:07:24,482 - DEBUG - VN ctest-trans_left_vn-85347159 is not present in Agent 10.0.0.22 2025-10-09 03:07:24,506 - DEBUG - VN ctest-trans_left_vn-85347159 is not present in Agent 10.0.0.27 2025-10-09 03:07:24,506 - INFO - Validated that VN ctest-trans_left_vn-85347159 is not in any agent 2025-10-09 03:07:24,543 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-85347159 info 2025-10-09 03:07:24,544 - INFO - Deleting VN ctest-right_vn-94284904 2025-10-09 03:07:24,615 - DEBUG - VN f845c4b8-767c-40ef-b14a-da371ed52ca5 still in use: Unable to complete operation on network f845c4b8-767c-40ef-b14a-da371ed52ca5. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ee0df4e8-cc42-48a2-8085-ca0ecaf186aa'] 2025-10-09 03:07:24,615 - WARNING - Deleting VN ctest-right_vn-94284904 failed..Will retry 2025-10-09 03:07:26,760 - DEBUG - Response for deleting network () 2025-10-09 03:07:26,760 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a76f4a6e-27a1-4e75-869c-4536b27ec329 2025-10-09 03:07:26,767 - DEBUG - Response Code: 404 2025-10-09 03:07:26,767 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:26,773 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:26,784 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:26,874 - INFO - Validated that VN ctest-right_vn-94284904 is not found in API Server 2025-10-09 03:07:26,886 - DEBUG - VN ctest-right_vn-94284904 is not present in Agent 10.0.0.22 2025-10-09 03:07:26,895 - DEBUG - VN ctest-right_vn-94284904 is not present in Agent 10.0.0.27 2025-10-09 03:07:26,895 - INFO - Validated that VN ctest-right_vn-94284904 is not in any agent 2025-10-09 03:07:26,926 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-94284904 info 2025-10-09 03:07:26,926 - INFO - Deleting VN ctest-left_vn-48125920 2025-10-09 03:07:27,095 - DEBUG - Response for deleting network () 2025-10-09 03:07:27,095 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/f44fce69-e8a3-4198-8717-8f17f8cdfa0b 2025-10-09 03:07:27,100 - DEBUG - Response Code: 404 2025-10-09 03:07:27,101 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:27,111 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:27,121 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:27,203 - INFO - Validated that VN ctest-left_vn-48125920 is not found in API Server 2025-10-09 03:07:27,219 - DEBUG - VN ctest-left_vn-48125920 is not present in Agent 10.0.0.22 2025-10-09 03:07:27,228 - DEBUG - VN ctest-left_vn-48125920 is not present in Agent 10.0.0.27 2025-10-09 03:07:27,229 - INFO - Validated that VN ctest-left_vn-48125920 is not in any agent 2025-10-09 03:07:27,265 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-48125920 info 2025-10-09 03:07:27,265 - INFO - Deleting VN ctest-mgmt_vn-77969630 2025-10-09 03:07:27,415 - DEBUG - Response for deleting network () 2025-10-09 03:07:27,415 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/a3b11d0c-8684-4519-820a-de1577d0ee5e 2025-10-09 03:07:27,434 - DEBUG - Response Code: 404 2025-10-09 03:07:27,434 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-10-09 03:07:27,448 - DEBUG - Requesting: http://10.0.0.56:8082/domain/7ed77c0b-e642-4c13-a404-7756503cf17d 2025-10-09 03:07:27,462 - DEBUG - Requesting: http://10.0.0.56:8082/project/7fe97614-9ebf-4d3d-9cd1-15e9d835638d 2025-10-09 03:07:27,560 - INFO - Validated that VN ctest-mgmt_vn-77969630 is not found in API Server 2025-10-09 03:07:27,570 - DEBUG - VN ctest-mgmt_vn-77969630 is not present in Agent 10.0.0.22 2025-10-09 03:07:27,579 - DEBUG - VN ctest-mgmt_vn-77969630 is not present in Agent 10.0.0.27 2025-10-09 03:07:27,579 - INFO - Validated that VN ctest-mgmt_vn-77969630 is not in any agent 2025-10-09 03:07:27,606 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-77969630 info 2025-10-09 03:07:28,898 - DEBUG - No XMPP flaps were noticed during the test 2025-10-09 03:07:28,898 - INFO -
2025-10-09 03:07:28,898 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]
2025-10-09 03:07:28,898 - INFO - -------------------------------------------------------------------------------- 2025-10-09 03:07:29,615 - INFO - Deleted project: ctest-TestSvcHC-22581552, ID : 7fe97614-9ebf-4d3d-9cd1-15e9d835638d