2025-11-27 03:04:46,402 - INFO - Domain Default found not creating 2025-11-27 03:04:46,563 - INFO - Project ctest-TestSvcHC-94102809 not found, creating it 2025-11-27 03:04:47,082 - INFO - Created Project:ctest-TestSvcHC-94102809, ID : f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:48,658 - INFO - ================================================================================ 2025-11-27 03:04:48,659 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-27 03:04:49,951 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.193': '0', '10.20.0.192': '0'}, '10.0.0.130': {'10.20.0.192': '0', '10.20.0.129': '0'}} with 2025-11-27 03:04:49,952 - INFO - Initial checks done. Running the testcase now 2025-11-27 03:04:49,952 - INFO - 2025-11-27 03:04:50,629 - DEBUG - Response for create_network : {'network': {'id': '1bde21c6-6a50-4f52-9ba6-046ab9917207', 'name': 'ctest-mgmt_vn-63219497', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-mgmt_vn-63219497'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:04:50,971 - DEBUG - Response for create_subnet : {'subnet': {'id': 'eedba304-af04-4206-aa42-984124ac8022', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': '1bde21c6-6a50-4f52-9ba6-046ab9917207', 'ip_version': 4, 'cidr': '62.167.195.128/26', 'allocation_pools': [{'start': '62.167.195.130', 'end': '62.167.195.190'}], 'gateway_ip': '62.167.195.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '62.167.195.130', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:04:50,992 - INFO - Created VN ctest-mgmt_vn-63219497 2025-11-27 03:04:51,004 - DEBUG - VN ctest-mgmt_vn-63219497 UUID is 1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,072 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:51,371 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:51,406 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:04:51,420 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:51,511 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,523 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,532 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/f406364a-ec10-4f93-9846-1336aba028d9 2025-11-27 03:04:51,539 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/f406364a-ec10-4f93-9846-1336aba028d9 2025-11-27 03:04:51,545 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/98b5c9a9-238a-4130-969f-f6a5c4717eea 2025-11-27 03:04:51,550 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:04:51,551 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,558 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/f406364a-ec10-4f93-9846-1336aba028d9 2025-11-27 03:04:51,571 - INFO - Verified VN network id 14 for VN 1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,572 - INFO - Verifications in API Server for VN ctest-mgmt_vn-63219497 passed 2025-11-27 03:04:51,572 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,583 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/f406364a-ec10-4f93-9846-1336aba028d9 2025-11-27 03:04:51,591 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/f406364a-ec10-4f93-9846-1336aba028d9 2025-11-27 03:04:51,600 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/98b5c9a9-238a-4130-969f-f6a5c4717eea 2025-11-27 03:04:51,617 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2008079619924709202', 'uuid-lslong': '11215656778439160327'}, 'enable': 'true', 'created': '2025-11-27T03:04:50', 'last-modified': '2025-11-27T03:04:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.701731'} 2025-11-27 03:04:51,623 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:04:51,629 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2008079619924709202', 'uuid-lslong': '11215656778439160327'}, 'enable': 'true', 'created': '2025-11-27T03:04:50', 'last-modified': '2025-11-27T03:04:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.715456'} 2025-11-27 03:04:51,636 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:04:51,641 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2008079619924709202', 'uuid-lslong': '11215656778439160327'}, 'enable': 'true', 'created': '2025-11-27T03:04:50', 'last-modified': '2025-11-27T03:04:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.726289'} 2025-11-27 03:04:51,646 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:04:51,646 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-63219497 passed 2025-11-27 03:04:51,646 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-63219497 in API_Server ====== 2025-11-27 03:04:51,646 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:51,653 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:04:51,666 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:51,763 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1bde21c6-6a50-4f52-9ba6-046ab9917207 2025-11-27 03:04:51,771 - DEBUG - =>VN ctest-mgmt_vn-63219497 has no policy to be verified 2025-11-27 03:04:51,771 - DEBUG - Verifying the vn in opserver 2025-11-27 03:04:51,771 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497 virtual network link through opserver 10.0.0.27 2025-11-27 03:04:51,771 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:04:52,078 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:04:52,140 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497?flat'} 2025-11-27 03:04:52,140 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497 virtual network link through opserver 10.0.0.33 2025-11-27 03:04:52,140 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:04:52,440 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:04:52,514 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497?flat'} 2025-11-27 03:04:52,515 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497 virtual network link through opserver 10.0.0.23 2025-11-27 03:04:52,515 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:04:52,834 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:04:52,904 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497?flat'} 2025-11-27 03:04:52,904 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-63219497 is found in opserver 2025-11-27 03:04:52,925 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:04:52,933 - DEBUG - VRF ids for VN ctest-mgmt_vn-63219497: {} 2025-11-27 03:04:53,175 - DEBUG - Response for create_network : {'network': {'id': '79182cad-9d10-437b-a273-d36986733e7d', 'name': 'ctest-left_vn-50732988', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-left_vn-50732988'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:04:53,427 - DEBUG - Response for create_subnet : {'subnet': {'id': '193945d8-14a8-43cb-b006-b5d48d9cddc8', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': '79182cad-9d10-437b-a273-d36986733e7d', 'ip_version': 4, 'cidr': '73.113.115.192/26', 'allocation_pools': [{'start': '73.113.115.194', 'end': '73.113.115.254'}], 'gateway_ip': '73.113.115.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.113.115.194', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:04:53,452 - INFO - Created VN ctest-left_vn-50732988 2025-11-27 03:04:53,468 - DEBUG - VN ctest-left_vn-50732988 UUID is 79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,550 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:53,557 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:04:53,568 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:53,652 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,665 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,674 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3701eb96-6098-42f0-a3e5-f24b5d83f353 2025-11-27 03:04:53,681 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3701eb96-6098-42f0-a3e5-f24b5d83f353 2025-11-27 03:04:53,688 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f7374f74-84b2-452f-ac1b-16ce88c09528 2025-11-27 03:04:53,695 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:04:53,695 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,705 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3701eb96-6098-42f0-a3e5-f24b5d83f353 2025-11-27 03:04:53,720 - INFO - Verified VN network id 15 for VN 79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,720 - INFO - Verifications in API Server for VN ctest-left_vn-50732988 passed 2025-11-27 03:04:53,720 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,734 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3701eb96-6098-42f0-a3e5-f24b5d83f353 2025-11-27 03:04:53,741 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3701eb96-6098-42f0-a3e5-f24b5d83f353 2025-11-27 03:04:53,748 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f7374f74-84b2-452f-ac1b-16ce88c09528 2025-11-27 03:04:53,761 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8725773402206389115', 'uuid-lslong': '11705932306646777469'}, 'enable': 'true', 'created': '2025-11-27T03:04:53', 'last-modified': '2025-11-27T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387923'} 2025-11-27 03:04:53,768 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:04:53,775 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8725773402206389115', 'uuid-lslong': '11705932306646777469'}, 'enable': 'true', 'created': '2025-11-27T03:04:53', 'last-modified': '2025-11-27T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396081'} 2025-11-27 03:04:53,782 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:04:53,787 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8725773402206389115', 'uuid-lslong': '11705932306646777469'}, 'enable': 'true', 'created': '2025-11-27T03:04:53', 'last-modified': '2025-11-27T03:04:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415467'} 2025-11-27 03:04:53,793 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:04:53,793 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-50732988 passed 2025-11-27 03:04:53,793 - DEBUG - ====Verifying policy data for ctest-left_vn-50732988 in API_Server ====== 2025-11-27 03:04:53,794 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:53,800 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:04:53,811 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:53,909 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/79182cad-9d10-437b-a273-d36986733e7d 2025-11-27 03:04:53,920 - DEBUG - =>VN ctest-left_vn-50732988 has no policy to be verified 2025-11-27 03:04:53,920 - DEBUG - Verifying the vn in opserver 2025-11-27 03:04:53,920 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988 virtual network link through opserver 10.0.0.27 2025-11-27 03:04:53,920 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:04:53,983 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988?flat'} 2025-11-27 03:04:53,983 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988 virtual network link through opserver 10.0.0.33 2025-11-27 03:04:53,983 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:04:54,039 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988?flat'} 2025-11-27 03:04:54,039 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988 virtual network link through opserver 10.0.0.23 2025-11-27 03:04:54,039 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:04:54,112 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988?flat'} 2025-11-27 03:04:54,112 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-50732988 is found in opserver 2025-11-27 03:04:54,137 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:04:54,153 - DEBUG - VRF ids for VN ctest-left_vn-50732988: {} 2025-11-27 03:04:54,419 - DEBUG - Response for create_network : {'network': {'id': '19b0f5e5-f7aa-4706-ae58-d629ec85a3bc', 'name': 'ctest-right_vn-32116203', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-right_vn-32116203'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:04:54,611 - DEBUG - Response for create_subnet : {'subnet': {'id': '889955c6-7487-42ab-9ff3-418be3477932', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': '19b0f5e5-f7aa-4706-ae58-d629ec85a3bc', 'ip_version': 4, 'cidr': '158.46.71.128/26', 'allocation_pools': [{'start': '158.46.71.130', 'end': '158.46.71.190'}], 'gateway_ip': '158.46.71.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '158.46.71.130', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:04:54,630 - INFO - Created VN ctest-right_vn-32116203 2025-11-27 03:04:54,640 - DEBUG - VN ctest-right_vn-32116203 UUID is 19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:54,715 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:54,721 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:04:54,732 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:54,825 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:54,836 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:54,845 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8efd593d-5dfe-4c33-9e86-e8201f377580 2025-11-27 03:04:54,852 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8efd593d-5dfe-4c33-9e86-e8201f377580 2025-11-27 03:04:54,858 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/e5a3bf03-a6fc-4e44-a571-6f3c2628a596 2025-11-27 03:04:54,866 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:04:54,866 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:54,874 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8efd593d-5dfe-4c33-9e86-e8201f377580 2025-11-27 03:04:54,888 - INFO - Verified VN network id 16 for VN 19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:54,888 - INFO - Verifications in API Server for VN ctest-right_vn-32116203 passed 2025-11-27 03:04:54,889 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:54,897 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8efd593d-5dfe-4c33-9e86-e8201f377580 2025-11-27 03:04:54,904 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8efd593d-5dfe-4c33-9e86-e8201f377580 2025-11-27 03:04:54,911 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/e5a3bf03-a6fc-4e44-a571-6f3c2628a596 2025-11-27 03:04:54,922 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1851249814900721414', 'uuid-lslong': '12563026636100182972'}, 'enable': 'true', 'created': '2025-11-27T03:04:54', 'last-modified': '2025-11-27T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362900'} 2025-11-27 03:04:54,927 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:04:54,933 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1851249814900721414', 'uuid-lslong': '12563026636100182972'}, 'enable': 'true', 'created': '2025-11-27T03:04:54', 'last-modified': '2025-11-27T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376764'} 2025-11-27 03:04:54,938 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:04:54,943 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1851249814900721414', 'uuid-lslong': '12563026636100182972'}, 'enable': 'true', 'created': '2025-11-27T03:04:54', 'last-modified': '2025-11-27T03:04:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.385623'} 2025-11-27 03:04:54,949 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:04:54,949 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-32116203 passed 2025-11-27 03:04:54,949 - DEBUG - ====Verifying policy data for ctest-right_vn-32116203 in API_Server ====== 2025-11-27 03:04:54,950 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:04:54,956 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:04:54,967 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:04:55,050 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/19b0f5e5-f7aa-4706-ae58-d629ec85a3bc 2025-11-27 03:04:55,060 - DEBUG - =>VN ctest-right_vn-32116203 has no policy to be verified 2025-11-27 03:04:55,060 - DEBUG - Verifying the vn in opserver 2025-11-27 03:04:55,060 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203 virtual network link through opserver 10.0.0.27 2025-11-27 03:04:55,060 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:04:55,119 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203?flat'} 2025-11-27 03:04:55,119 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203 virtual network link through opserver 10.0.0.33 2025-11-27 03:04:55,119 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:04:55,176 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203?flat'} 2025-11-27 03:04:55,176 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203 virtual network link through opserver 10.0.0.23 2025-11-27 03:04:55,176 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:04:55,228 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203?flat'} 2025-11-27 03:04:55,228 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-32116203 is found in opserver 2025-11-27 03:04:55,250 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:04:55,259 - DEBUG - VRF ids for VN ctest-right_vn-32116203: {} 2025-11-27 03:04:55,332 - DEBUG - Services list from nova: [, , , ] 2025-11-27 03:04:56,407 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-2) 2025-11-27 03:04:57,744 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-1) 2025-11-27 03:04:57,744 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-16093738'] 2025-11-27 03:04:58,040 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-16093738'] created succesfully 2025-11-27 03:04:58,472 - DEBUG - Image by name tiny_nat_fw not found 2025-11-27 03:04:58,472 - DEBUG - Installing image tiny_nat_fw 2025-11-27 03:04:58,472 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-27 03:04:58,473 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-27 03:04:58,473 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-27 03:04:58,473 - DEBUG - Unzip image 2025-11-27 03:04:58,473 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-27 03:04:58,499 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-27 03:04:58,500 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-16093738'] 2025-11-27 03:04:58,592 - INFO - Service template: ['default-domain', 'ctest-service_template_1-16093738'] deleted successfully. 2025-11-27 03:04:58,592 - INFO - Skip interface_detach for VM ctest-right_vm-10022799 in state BUILD 2025-11-27 03:04:58,592 - INFO - Deleting VM ctest-right_vm-10022799 2025-11-27 03:04:58,655 - ERROR - VM ctest-right_vm-10022799 has failed to come up 2025-11-27 03:04:58,655 - ERROR - Nova failed to get host of the VM 2025-11-27 03:04:58,655 - ERROR - VM ctest-right_vm-10022799 has failed to come up 2025-11-27 03:04:58,655 - ERROR - Nova failed to get host of the VM 2025-11-27 03:04:58,742 - INFO - Skip interface_detach for VM ctest-left_vm-09175743 in state BUILD 2025-11-27 03:04:58,743 - INFO - Deleting VM ctest-left_vm-09175743 2025-11-27 03:04:58,743 - ERROR - VM ctest-left_vm-09175743 has failed to come up 2025-11-27 03:04:58,744 - ERROR - Nova failed to get host of the VM 2025-11-27 03:04:58,745 - ERROR - VM ctest-left_vm-09175743 has failed to come up 2025-11-27 03:04:58,745 - ERROR - Nova failed to get host of the VM 2025-11-27 03:04:58,823 - INFO - Deleting VN ctest-right_vn-32116203 2025-11-27 03:04:58,864 - DEBUG - VN 19b0f5e5-f7aa-4706-ae58-d629ec85a3bc still in use: Unable to complete operation on network 19b0f5e5-f7aa-4706-ae58-d629ec85a3bc. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a0ab5555-aad3-4835-9dd9-032c3aecd512'] 2025-11-27 03:04:58,864 - WARNING - Deleting VN ctest-right_vn-32116203 failed..Will retry 2025-11-27 03:05:01,055 - DEBUG - Response for deleting network () 2025-11-27 03:05:01,055 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8efd593d-5dfe-4c33-9e86-e8201f377580 2025-11-27 03:05:01,061 - DEBUG - Response Code: 404 2025-11-27 03:05:01,062 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:01,069 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:01,149 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:01,254 - INFO - Validated that VN ctest-right_vn-32116203 is not found in API Server 2025-11-27 03:05:01,267 - DEBUG - VN ctest-right_vn-32116203 is not present in Agent 10.0.0.19 2025-11-27 03:05:01,277 - DEBUG - VN ctest-right_vn-32116203 is not present in Agent 10.0.0.130 2025-11-27 03:05:01,277 - INFO - Validated that VN ctest-right_vn-32116203 is not in any agent 2025-11-27 03:05:01,312 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-32116203 info 2025-11-27 03:05:01,312 - INFO - Deleting VN ctest-left_vn-50732988 2025-11-27 03:05:01,485 - DEBUG - Response for deleting network () 2025-11-27 03:05:01,485 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/3701eb96-6098-42f0-a3e5-f24b5d83f353 2025-11-27 03:05:01,492 - DEBUG - Response Code: 404 2025-11-27 03:05:01,492 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:01,499 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:01,527 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:01,655 - INFO - Validated that VN ctest-left_vn-50732988 is not found in API Server 2025-11-27 03:05:01,667 - DEBUG - VN ctest-left_vn-50732988 is not present in Agent 10.0.0.19 2025-11-27 03:05:01,678 - DEBUG - VN ctest-left_vn-50732988 is not present in Agent 10.0.0.130 2025-11-27 03:05:01,678 - INFO - Validated that VN ctest-left_vn-50732988 is not in any agent 2025-11-27 03:05:01,711 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-50732988 info 2025-11-27 03:05:01,712 - INFO - Deleting VN ctest-mgmt_vn-63219497 2025-11-27 03:05:01,877 - DEBUG - Response for deleting network () 2025-11-27 03:05:01,877 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/f406364a-ec10-4f93-9846-1336aba028d9 2025-11-27 03:05:01,884 - DEBUG - Response Code: 404 2025-11-27 03:05:01,885 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:01,892 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:01,919 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:02,013 - INFO - Validated that VN ctest-mgmt_vn-63219497 is not found in API Server 2025-11-27 03:05:02,024 - DEBUG - VN ctest-mgmt_vn-63219497 is not present in Agent 10.0.0.19 2025-11-27 03:05:02,035 - DEBUG - VN ctest-mgmt_vn-63219497 is not present in Agent 10.0.0.130 2025-11-27 03:05:02,035 - INFO - Validated that VN ctest-mgmt_vn-63219497 is not in any agent 2025-11-27 03:05:02,071 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-63219497 info 2025-11-27 03:05:03,368 - DEBUG - No XMPP flaps were noticed during the test 2025-11-27 03:05:03,369 - INFO - 2025-11-27 03:05:03,369 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-11-27 03:05:03,369 - INFO - -------------------------------------------------------------------------------- 2025-11-27 03:05:03,373 - INFO - ================================================================================ 2025-11-27 03:05:03,373 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-27 03:05:04,660 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.193': '0', '10.20.0.192': '0'}, '10.0.0.130': {'10.20.0.192': '0', '10.20.0.129': '0'}} with 2025-11-27 03:05:04,661 - INFO - Initial checks done. Running the testcase now 2025-11-27 03:05:04,661 - INFO - 2025-11-27 03:05:04,935 - DEBUG - Response for create_network : {'network': {'id': 'c07a6899-8d5f-4a5d-bf32-0f15e23aab9c', 'name': 'ctest-mgmt_vn-59577512', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-mgmt_vn-59577512'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:05:05,193 - DEBUG - Response for create_subnet : {'subnet': {'id': '8e8834af-d918-46bd-98bf-2cb5e03dc581', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': 'c07a6899-8d5f-4a5d-bf32-0f15e23aab9c', 'ip_version': 4, 'cidr': '140.241.161.0/26', 'allocation_pools': [{'start': '140.241.161.2', 'end': '140.241.161.62'}], 'gateway_ip': '140.241.161.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '140.241.161.2', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:05:05,216 - INFO - Created VN ctest-mgmt_vn-59577512 2025-11-27 03:05:05,226 - DEBUG - VN ctest-mgmt_vn-59577512 UUID is c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,297 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:05,305 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:05,316 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:05,405 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,417 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,426 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/dd6503b9-f658-45fc-b853-0630f50035ed 2025-11-27 03:05:05,435 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/dd6503b9-f658-45fc-b853-0630f50035ed 2025-11-27 03:05:05,442 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/1192aa3c-b69c-4c44-b19c-07b5b65c1792 2025-11-27 03:05:05,448 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:05:05,448 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,457 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/dd6503b9-f658-45fc-b853-0630f50035ed 2025-11-27 03:05:05,473 - INFO - Verified VN network id 14 for VN c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,474 - INFO - Verifications in API Server for VN ctest-mgmt_vn-59577512 passed 2025-11-27 03:05:05,474 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,485 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/dd6503b9-f658-45fc-b853-0630f50035ed 2025-11-27 03:05:05,493 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/dd6503b9-f658-45fc-b853-0630f50035ed 2025-11-27 03:05:05,501 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/1192aa3c-b69c-4c44-b19c-07b5b65c1792 2025-11-27 03:05:05,515 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13869513011151981149', 'uuid-lslong': '13777090796743994268'}, 'enable': 'true', 'created': '2025-11-27T03:05:04', 'last-modified': '2025-11-27T03:05:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.363086'} 2025-11-27 03:05:05,521 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:05:05,527 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13869513011151981149', 'uuid-lslong': '13777090796743994268'}, 'enable': 'true', 'created': '2025-11-27T03:05:04', 'last-modified': '2025-11-27T03:05:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.379343'} 2025-11-27 03:05:05,534 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:05:05,540 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13869513011151981149', 'uuid-lslong': '13777090796743994268'}, 'enable': 'true', 'created': '2025-11-27T03:05:04', 'last-modified': '2025-11-27T03:05:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396071'} 2025-11-27 03:05:05,545 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-27 03:05:05,545 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-59577512 passed 2025-11-27 03:05:05,545 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-59577512 in API_Server ====== 2025-11-27 03:05:05,545 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:05,551 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:05,562 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:05,650 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/c07a6899-8d5f-4a5d-bf32-0f15e23aab9c 2025-11-27 03:05:05,660 - DEBUG - =>VN ctest-mgmt_vn-59577512 has no policy to be verified 2025-11-27 03:05:05,660 - DEBUG - Verifying the vn in opserver 2025-11-27 03:05:05,660 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512 virtual network link through opserver 10.0.0.27 2025-11-27 03:05:05,660 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:05:05,671 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512?flat'} 2025-11-27 03:05:05,671 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512 virtual network link through opserver 10.0.0.33 2025-11-27 03:05:05,671 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:05:05,683 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512?flat'} 2025-11-27 03:05:05,683 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512 virtual network link through opserver 10.0.0.23 2025-11-27 03:05:05,684 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:05:05,695 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512?flat'} 2025-11-27 03:05:05,695 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-mgmt_vn-59577512 is found in opserver 2025-11-27 03:05:05,715 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:05:05,724 - DEBUG - VRF ids for VN ctest-mgmt_vn-59577512: {} 2025-11-27 03:05:06,032 - DEBUG - Response for create_network : {'network': {'id': '6151948e-2525-4f43-a86d-727034e6df10', 'name': 'ctest-left_vn-44345819', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-left_vn-44345819'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:05:06,246 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b148b9da-44ca-4d3a-9f19-56a0b0826039', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': '6151948e-2525-4f43-a86d-727034e6df10', 'ip_version': 4, 'cidr': '87.34.181.0/26', 'allocation_pools': [{'start': '87.34.181.2', 'end': '87.34.181.62'}], 'gateway_ip': '87.34.181.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '87.34.181.2', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:05:06,285 - INFO - Created VN ctest-left_vn-44345819 2025-11-27 03:05:06,294 - DEBUG - VN ctest-left_vn-44345819 UUID is 6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,371 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:06,377 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:06,386 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:06,473 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,484 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,493 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8733e216-1f8d-42e0-8db3-5f8608befa85 2025-11-27 03:05:06,500 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8733e216-1f8d-42e0-8db3-5f8608befa85 2025-11-27 03:05:06,506 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/4b02818e-fc90-41c8-9859-90e3e647e6be 2025-11-27 03:05:06,512 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:05:06,512 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,520 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8733e216-1f8d-42e0-8db3-5f8608befa85 2025-11-27 03:05:06,533 - INFO - Verified VN network id 15 for VN 6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,534 - INFO - Verifications in API Server for VN ctest-left_vn-44345819 passed 2025-11-27 03:05:06,534 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,542 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8733e216-1f8d-42e0-8db3-5f8608befa85 2025-11-27 03:05:06,549 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8733e216-1f8d-42e0-8db3-5f8608befa85 2025-11-27 03:05:06,555 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/4b02818e-fc90-41c8-9859-90e3e647e6be 2025-11-27 03:05:06,565 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7012549433022041923', 'uuid-lslong': '12136482397082803984'}, 'enable': 'true', 'created': '2025-11-27T03:05:05', 'last-modified': '2025-11-27T03:05:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.358851'} 2025-11-27 03:05:06,571 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:05:06,577 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7012549433022041923', 'uuid-lslong': '12136482397082803984'}, 'enable': 'true', 'created': '2025-11-27T03:05:05', 'last-modified': '2025-11-27T03:05:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364376'} 2025-11-27 03:05:06,583 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:05:06,589 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7012549433022041923', 'uuid-lslong': '12136482397082803984'}, 'enable': 'true', 'created': '2025-11-27T03:05:05', 'last-modified': '2025-11-27T03:05:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.381511'} 2025-11-27 03:05:06,596 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-27 03:05:06,596 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-44345819 passed 2025-11-27 03:05:06,597 - DEBUG - ====Verifying policy data for ctest-left_vn-44345819 in API_Server ====== 2025-11-27 03:05:06,597 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:06,604 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:06,615 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:06,715 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/6151948e-2525-4f43-a86d-727034e6df10 2025-11-27 03:05:06,733 - DEBUG - =>VN ctest-left_vn-44345819 has no policy to be verified 2025-11-27 03:05:06,733 - DEBUG - Verifying the vn in opserver 2025-11-27 03:05:06,733 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819 virtual network link through opserver 10.0.0.27 2025-11-27 03:05:06,733 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:05:06,747 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819?flat'} 2025-11-27 03:05:06,747 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819 virtual network link through opserver 10.0.0.33 2025-11-27 03:05:06,747 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:05:06,760 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819?flat'} 2025-11-27 03:05:06,760 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819 virtual network link through opserver 10.0.0.23 2025-11-27 03:05:06,760 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:05:06,778 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819?flat'} 2025-11-27 03:05:06,778 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-left_vn-44345819 is found in opserver 2025-11-27 03:05:06,804 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:05:06,818 - DEBUG - VRF ids for VN ctest-left_vn-44345819: {} 2025-11-27 03:05:07,060 - DEBUG - Response for create_network : {'network': {'id': 'ae258dd9-216e-4971-8dfc-cf5b6409af2b', 'name': 'ctest-right_vn-97834396', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-right_vn-97834396'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:05:07,283 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b3e52698-8022-4c97-91e0-435ead6ca166', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': 'ae258dd9-216e-4971-8dfc-cf5b6409af2b', 'ip_version': 4, 'cidr': '111.2.176.192/26', 'allocation_pools': [{'start': '111.2.176.194', 'end': '111.2.176.254'}], 'gateway_ip': '111.2.176.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '111.2.176.194', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:05:07,307 - INFO - Created VN ctest-right_vn-97834396 2025-11-27 03:05:07,331 - DEBUG - VN ctest-right_vn-97834396 UUID is ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,401 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:07,407 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:07,418 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:07,509 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,520 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,532 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/68fbf8c4-8efc-4d87-bf16-a75d88ce9390 2025-11-27 03:05:07,542 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/68fbf8c4-8efc-4d87-bf16-a75d88ce9390 2025-11-27 03:05:07,552 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/58dabc72-7d62-4069-a2e2-fc0635467f5b 2025-11-27 03:05:07,560 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:05:07,560 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,569 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/68fbf8c4-8efc-4d87-bf16-a75d88ce9390 2025-11-27 03:05:07,583 - INFO - Verified VN network id 16 for VN ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,584 - INFO - Verifications in API Server for VN ctest-right_vn-97834396 passed 2025-11-27 03:05:07,584 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,593 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/68fbf8c4-8efc-4d87-bf16-a75d88ce9390 2025-11-27 03:05:07,600 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/68fbf8c4-8efc-4d87-bf16-a75d88ce9390 2025-11-27 03:05:07,607 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/58dabc72-7d62-4069-a2e2-fc0635467f5b 2025-11-27 03:05:07,619 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12548591900446050673', 'uuid-lslong': '10231280444906254123'}, 'enable': 'true', 'created': '2025-11-27T03:05:07', 'last-modified': '2025-11-27T03:05:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393472'} 2025-11-27 03:05:07,625 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:05:07,630 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12548591900446050673', 'uuid-lslong': '10231280444906254123'}, 'enable': 'true', 'created': '2025-11-27T03:05:07', 'last-modified': '2025-11-27T03:05:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403360'} 2025-11-27 03:05:07,637 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:05:07,642 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12548591900446050673', 'uuid-lslong': '10231280444906254123'}, 'enable': 'true', 'created': '2025-11-27T03:05:07', 'last-modified': '2025-11-27T03:05:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.413249'} 2025-11-27 03:05:07,647 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-27 03:05:07,647 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-97834396 passed 2025-11-27 03:05:07,648 - DEBUG - ====Verifying policy data for ctest-right_vn-97834396 in API_Server ====== 2025-11-27 03:05:07,648 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:07,655 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:07,668 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:07,762 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/ae258dd9-216e-4971-8dfc-cf5b6409af2b 2025-11-27 03:05:07,778 - DEBUG - =>VN ctest-right_vn-97834396 has no policy to be verified 2025-11-27 03:05:07,778 - DEBUG - Verifying the vn in opserver 2025-11-27 03:05:07,778 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396 virtual network link through opserver 10.0.0.27 2025-11-27 03:05:07,779 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:05:07,791 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396?flat'} 2025-11-27 03:05:07,791 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396 virtual network link through opserver 10.0.0.33 2025-11-27 03:05:07,791 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:05:07,803 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396?flat'} 2025-11-27 03:05:07,803 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396 virtual network link through opserver 10.0.0.23 2025-11-27 03:05:07,804 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:05:07,819 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396?flat'} 2025-11-27 03:05:07,819 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-right_vn-97834396 is found in opserver 2025-11-27 03:05:07,841 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:05:07,851 - DEBUG - VRF ids for VN ctest-right_vn-97834396: {} 2025-11-27 03:05:08,113 - DEBUG - Response for create_network : {'network': {'id': '040f151f-a15e-4c82-8c2d-63e3c7614922', 'name': 'ctest-trans_left_vn-18818427', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-trans_left_vn-18818427'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:05:08,378 - DEBUG - Response for create_subnet : {'subnet': {'id': '0b316b39-69b4-4c8e-80ea-9069551d6b2a', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': '040f151f-a15e-4c82-8c2d-63e3c7614922', 'ip_version': 4, 'cidr': '51.104.127.0/26', 'allocation_pools': [{'start': '51.104.127.2', 'end': '51.104.127.62'}], 'gateway_ip': '51.104.127.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '51.104.127.2', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:05:08,398 - INFO - Created VN ctest-trans_left_vn-18818427 2025-11-27 03:05:08,408 - DEBUG - VN ctest-trans_left_vn-18818427 UUID is 040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,488 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:08,495 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:08,506 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:08,591 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,602 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,613 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d35e6647-9955-4791-b1d4-eb9864b8a558 2025-11-27 03:05:08,623 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d35e6647-9955-4791-b1d4-eb9864b8a558 2025-11-27 03:05:08,646 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a252280c-5cda-4ca7-b987-ddd764dc7e08 2025-11-27 03:05:08,653 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-27 03:05:08,653 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,663 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d35e6647-9955-4791-b1d4-eb9864b8a558 2025-11-27 03:05:08,676 - INFO - Verified VN network id 17 for VN 040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,676 - INFO - Verifications in API Server for VN ctest-trans_left_vn-18818427 passed 2025-11-27 03:05:08,676 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,686 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d35e6647-9955-4791-b1d4-eb9864b8a558 2025-11-27 03:05:08,693 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d35e6647-9955-4791-b1d4-eb9864b8a558 2025-11-27 03:05:08,701 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/a252280c-5cda-4ca7-b987-ddd764dc7e08 2025-11-27 03:05:08,713 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '292475726397852802', 'uuid-lslong': '10100839369215658274'}, 'enable': 'true', 'created': '2025-11-27T03:05:08', 'last-modified': '2025-11-27T03:05:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.397667'} 2025-11-27 03:05:08,718 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-27 03:05:08,724 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '292475726397852802', 'uuid-lslong': '10100839369215658274'}, 'enable': 'true', 'created': '2025-11-27T03:05:08', 'last-modified': '2025-11-27T03:05:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405810'} 2025-11-27 03:05:08,731 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-27 03:05:08,737 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '292475726397852802', 'uuid-lslong': '10100839369215658274'}, 'enable': 'true', 'created': '2025-11-27T03:05:08', 'last-modified': '2025-11-27T03:05:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420538'} 2025-11-27 03:05:08,743 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-27 03:05:08,743 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-18818427 passed 2025-11-27 03:05:08,743 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-18818427 in API_Server ====== 2025-11-27 03:05:08,743 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:08,749 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:08,759 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:08,843 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/040f151f-a15e-4c82-8c2d-63e3c7614922 2025-11-27 03:05:08,855 - DEBUG - =>VN ctest-trans_left_vn-18818427 has no policy to be verified 2025-11-27 03:05:08,855 - DEBUG - Verifying the vn in opserver 2025-11-27 03:05:08,855 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427 virtual network link through opserver 10.0.0.27 2025-11-27 03:05:08,855 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:05:08,866 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427?flat'} 2025-11-27 03:05:08,866 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427 virtual network link through opserver 10.0.0.33 2025-11-27 03:05:08,866 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:05:08,878 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427?flat'} 2025-11-27 03:05:08,878 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427 virtual network link through opserver 10.0.0.23 2025-11-27 03:05:08,878 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:05:08,888 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427?flat'} 2025-11-27 03:05:08,888 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-trans_left_vn-18818427 is found in opserver 2025-11-27 03:05:08,909 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:05:08,920 - DEBUG - VRF ids for VN ctest-trans_left_vn-18818427: {} 2025-11-27 03:05:09,187 - DEBUG - Response for create_network : {'network': {'id': 'bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed', 'name': 'ctest-trans_right_vn-59291464', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'project_id': 'f0f0c725d02341358426983bd0d3e682', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-94102809', 'ctest-trans_right_vn-59291464'], 'port_security_enabled': True, 'description': ''}} 2025-11-27 03:05:09,372 - DEBUG - Response for create_subnet : {'subnet': {'id': '9cef9e9d-c82a-4212-81aa-f184cfbbc8f0', 'name': '', 'tenant_id': 'f0f0c725d02341358426983bd0d3e682', 'network_id': 'bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed', 'ip_version': 4, 'cidr': '106.87.194.128/26', 'allocation_pools': [{'start': '106.87.194.130', 'end': '106.87.194.190'}], 'gateway_ip': '106.87.194.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '106.87.194.130', 'tags': [], 'project_id': 'f0f0c725d02341358426983bd0d3e682'}} 2025-11-27 03:05:09,391 - INFO - Created VN ctest-trans_right_vn-59291464 2025-11-27 03:05:09,402 - DEBUG - VN ctest-trans_right_vn-59291464 UUID is bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,467 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:09,473 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:09,484 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:09,580 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,592 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,601 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/da6c456d-ba5c-45ab-b094-bd30deb1da70 2025-11-27 03:05:09,609 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/da6c456d-ba5c-45ab-b094-bd30deb1da70 2025-11-27 03:05:09,615 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/b8806086-1f41-44fd-9a85-2bb8be6184df 2025-11-27 03:05:09,623 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-27 03:05:09,623 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,633 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/da6c456d-ba5c-45ab-b094-bd30deb1da70 2025-11-27 03:05:09,653 - INFO - Verified VN network id 18 for VN bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,653 - INFO - Verifications in API Server for VN ctest-trans_right_vn-59291464 passed 2025-11-27 03:05:09,653 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,662 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/da6c456d-ba5c-45ab-b094-bd30deb1da70 2025-11-27 03:05:09,669 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/da6c456d-ba5c-45ab-b094-bd30deb1da70 2025-11-27 03:05:09,676 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/b8806086-1f41-44fd-9a85-2bb8be6184df 2025-11-27 03:05:09,687 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13679797603113845208', 'uuid-lslong': '13552204494120366829'}, 'enable': 'true', 'created': '2025-11-27T03:05:09', 'last-modified': '2025-11-27T03:05:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364185'} 2025-11-27 03:05:09,691 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-27 03:05:09,697 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13679797603113845208', 'uuid-lslong': '13552204494120366829'}, 'enable': 'true', 'created': '2025-11-27T03:05:09', 'last-modified': '2025-11-27T03:05:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374952'} 2025-11-27 03:05:09,703 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-27 03:05:09,714 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-94102809', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13679797603113845208', 'uuid-lslong': '13552204494120366829'}, 'enable': 'true', 'created': '2025-11-27T03:05:09', 'last-modified': '2025-11-27T03:05:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.393535'} 2025-11-27 03:05:09,720 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-27 03:05:09,720 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-59291464 passed 2025-11-27 03:05:09,721 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-59291464 in API_Server ====== 2025-11-27 03:05:09,721 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:09,728 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:09,743 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:09,839 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/bdd86770-fcd7-41d8-bc13-1a2f4b7f32ed 2025-11-27 03:05:09,847 - DEBUG - =>VN ctest-trans_right_vn-59291464 has no policy to be verified 2025-11-27 03:05:09,847 - DEBUG - Verifying the vn in opserver 2025-11-27 03:05:09,847 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464 virtual network link through opserver 10.0.0.27 2025-11-27 03:05:09,847 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-11-27 03:05:09,859 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464?flat'} 2025-11-27 03:05:09,859 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464 virtual network link through opserver 10.0.0.33 2025-11-27 03:05:09,860 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-11-27 03:05:09,872 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464?flat'} 2025-11-27 03:05:09,872 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464 virtual network link through opserver 10.0.0.23 2025-11-27 03:05:09,872 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-27 03:05:09,884 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464?flat'} 2025-11-27 03:05:09,884 - INFO - Validated that VN default-domain:ctest-TestSvcHC-94102809:ctest-trans_right_vn-59291464 is found in opserver 2025-11-27 03:05:09,904 - DEBUG - Do not have enough data to verify VN in agent 2025-11-27 03:05:09,914 - DEBUG - VRF ids for VN ctest-trans_right_vn-59291464: {} 2025-11-27 03:05:10,922 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-1) 2025-11-27 03:05:12,242 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4820-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4820-2) 2025-11-27 03:05:12,242 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-60445435'] 2025-11-27 03:05:12,539 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-60445435'] created succesfully 2025-11-27 03:05:12,877 - DEBUG - Image by name tiny_trans_fw not found 2025-11-27 03:05:12,877 - DEBUG - Installing image tiny_trans_fw 2025-11-27 03:05:12,877 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-27 03:05:12,877 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-27 03:05:12,877 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-27 03:05:12,877 - DEBUG - Unzip image 2025-11-27 03:05:12,877 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-27 03:05:12,899 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-27 03:05:12,899 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-60445435'] 2025-11-27 03:05:13,034 - INFO - Service template: ['default-domain', 'ctest-service_template_1-60445435'] deleted successfully. 2025-11-27 03:05:13,034 - INFO - Skip interface_detach for VM ctest-right_vm-95186361 in state BUILD 2025-11-27 03:05:13,035 - INFO - Deleting VM ctest-right_vm-95186361 2025-11-27 03:05:13,035 - ERROR - VM ctest-right_vm-95186361 has failed to come up 2025-11-27 03:05:13,035 - ERROR - Nova failed to get host of the VM 2025-11-27 03:05:13,036 - ERROR - VM ctest-right_vm-95186361 has failed to come up 2025-11-27 03:05:13,036 - ERROR - Nova failed to get host of the VM 2025-11-27 03:05:13,164 - INFO - Skip interface_detach for VM ctest-left_vm-71363711 in state BUILD 2025-11-27 03:05:13,164 - INFO - Deleting VM ctest-left_vm-71363711 2025-11-27 03:05:13,164 - ERROR - VM ctest-left_vm-71363711 has failed to come up 2025-11-27 03:05:13,164 - ERROR - Nova failed to get host of the VM 2025-11-27 03:05:13,164 - ERROR - VM ctest-left_vm-71363711 has failed to come up 2025-11-27 03:05:13,164 - ERROR - Nova failed to get host of the VM 2025-11-27 03:05:13,231 - INFO - Deleting VN ctest-trans_right_vn-59291464 2025-11-27 03:05:13,385 - DEBUG - Response for deleting network () 2025-11-27 03:05:13,385 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/da6c456d-ba5c-45ab-b094-bd30deb1da70 2025-11-27 03:05:13,390 - DEBUG - Response Code: 404 2025-11-27 03:05:13,391 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:13,398 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:13,423 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:13,529 - INFO - Validated that VN ctest-trans_right_vn-59291464 is not found in API Server 2025-11-27 03:05:13,540 - DEBUG - VN ctest-trans_right_vn-59291464 is not present in Agent 10.0.0.19 2025-11-27 03:05:13,590 - DEBUG - VN ctest-trans_right_vn-59291464 is not present in Agent 10.0.0.130 2025-11-27 03:05:13,590 - INFO - Validated that VN ctest-trans_right_vn-59291464 is not in any agent 2025-11-27 03:05:13,621 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-59291464 info 2025-11-27 03:05:13,621 - INFO - Deleting VN ctest-trans_left_vn-18818427 2025-11-27 03:05:13,801 - DEBUG - Response for deleting network () 2025-11-27 03:05:13,801 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/d35e6647-9955-4791-b1d4-eb9864b8a558 2025-11-27 03:05:13,813 - DEBUG - Response Code: 404 2025-11-27 03:05:13,813 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:13,822 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:13,873 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:13,989 - INFO - Validated that VN ctest-trans_left_vn-18818427 is not found in API Server 2025-11-27 03:05:14,003 - DEBUG - VN ctest-trans_left_vn-18818427 is not present in Agent 10.0.0.19 2025-11-27 03:05:14,020 - DEBUG - VN ctest-trans_left_vn-18818427 is not present in Agent 10.0.0.130 2025-11-27 03:05:14,020 - INFO - Validated that VN ctest-trans_left_vn-18818427 is not in any agent 2025-11-27 03:05:14,056 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-18818427 info 2025-11-27 03:05:14,057 - INFO - Deleting VN ctest-right_vn-97834396 2025-11-27 03:05:14,118 - DEBUG - VN ae258dd9-216e-4971-8dfc-cf5b6409af2b still in use: Unable to complete operation on network ae258dd9-216e-4971-8dfc-cf5b6409af2b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a5c9c911-bc57-43df-846c-3cbcf79a6fed'] 2025-11-27 03:05:14,118 - WARNING - Deleting VN ctest-right_vn-97834396 failed..Will retry 2025-11-27 03:05:16,272 - DEBUG - Response for deleting network () 2025-11-27 03:05:16,272 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/68fbf8c4-8efc-4d87-bf16-a75d88ce9390 2025-11-27 03:05:16,278 - DEBUG - Response Code: 404 2025-11-27 03:05:16,278 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:16,283 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:16,295 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:16,382 - INFO - Validated that VN ctest-right_vn-97834396 is not found in API Server 2025-11-27 03:05:16,393 - DEBUG - VN ctest-right_vn-97834396 is not present in Agent 10.0.0.19 2025-11-27 03:05:16,408 - DEBUG - VN ctest-right_vn-97834396 is not present in Agent 10.0.0.130 2025-11-27 03:05:16,409 - INFO - Validated that VN ctest-right_vn-97834396 is not in any agent 2025-11-27 03:05:16,437 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-97834396 info 2025-11-27 03:05:16,437 - INFO - Deleting VN ctest-left_vn-44345819 2025-11-27 03:05:16,610 - DEBUG - Response for deleting network () 2025-11-27 03:05:16,610 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/8733e216-1f8d-42e0-8db3-5f8608befa85 2025-11-27 03:05:16,617 - DEBUG - Response Code: 404 2025-11-27 03:05:16,617 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:16,628 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:16,639 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:16,738 - INFO - Validated that VN ctest-left_vn-44345819 is not found in API Server 2025-11-27 03:05:16,750 - DEBUG - VN ctest-left_vn-44345819 is not present in Agent 10.0.0.19 2025-11-27 03:05:16,761 - DEBUG - VN ctest-left_vn-44345819 is not present in Agent 10.0.0.130 2025-11-27 03:05:16,761 - INFO - Validated that VN ctest-left_vn-44345819 is not in any agent 2025-11-27 03:05:16,796 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-44345819 info 2025-11-27 03:05:16,796 - INFO - Deleting VN ctest-mgmt_vn-59577512 2025-11-27 03:05:16,946 - DEBUG - Response for deleting network () 2025-11-27 03:05:16,946 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/dd6503b9-f658-45fc-b853-0630f50035ed 2025-11-27 03:05:16,961 - DEBUG - Response Code: 404 2025-11-27 03:05:16,961 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-11-27 03:05:16,969 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ea95f9c6-3b7f-4f10-9ecb-80826711f59a 2025-11-27 03:05:17,021 - DEBUG - Requesting: http://10.0.0.27:8082/project/f0f0c725-d023-4135-8426-983bd0d3e682 2025-11-27 03:05:17,109 - INFO - Validated that VN ctest-mgmt_vn-59577512 is not found in API Server 2025-11-27 03:05:17,120 - DEBUG - VN ctest-mgmt_vn-59577512 is not present in Agent 10.0.0.19 2025-11-27 03:05:17,129 - DEBUG - VN ctest-mgmt_vn-59577512 is not present in Agent 10.0.0.130 2025-11-27 03:05:17,129 - INFO - Validated that VN ctest-mgmt_vn-59577512 is not in any agent 2025-11-27 03:05:17,160 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-59577512 info 2025-11-27 03:05:18,424 - DEBUG - No XMPP flaps were noticed during the test 2025-11-27 03:05:18,424 - INFO - 2025-11-27 03:05:18,424 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15] 2025-11-27 03:05:18,424 - INFO - -------------------------------------------------------------------------------- 2025-11-27 03:05:19,146 - INFO - Deleted project: ctest-TestSvcHC-94102809, ID : f0f0c725-d023-4135-8426-983bd0d3e682