2025-11-03 03:12:56,196 - INFO - Domain Default found not creating 2025-11-03 03:12:56,360 - INFO - Project ctest-TestSvcHC-21059794 not found, creating it 2025-11-03 03:12:56,992 - INFO - Created Project:ctest-TestSvcHC-21059794, ID : 92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:12:58,476 - INFO - ================================================================================ 2025-11-03 03:12:58,477 - INFO - STARTING TEST : test_svc_hc_basic 2025-11-03 03:12:59,789 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with 2025-11-03 03:12:59,789 - INFO - Initial checks done. Running the testcase now 2025-11-03 03:12:59,789 - INFO - 2025-11-03 03:13:00,497 - DEBUG - Response for create_network : {'network': {'id': 'a70e5187-9561-4cfe-9014-a3cb85a58b10', 'name': 'ctest-mgmt_vn-64328988', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-mgmt_vn-64328988'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:00,832 - DEBUG - Response for create_subnet : {'subnet': {'id': '656f4503-1eb9-4ecf-9bb8-47017c22314e', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': 'a70e5187-9561-4cfe-9014-a3cb85a58b10', 'ip_version': 4, 'cidr': '31.224.23.128/26', 'allocation_pools': [{'start': '31.224.23.130', 'end': '31.224.23.190'}], 'gateway_ip': '31.224.23.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '31.224.23.130', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:00,875 - INFO - Created VN ctest-mgmt_vn-64328988 2025-11-03 03:13:00,889 - DEBUG - VN ctest-mgmt_vn-64328988 UUID is a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:00,973 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:01,298 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:01,329 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:01,348 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:01,485 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:01,496 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:01,507 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/af3eaa99-f902-4cbe-a031-432ff516dd88 2025-11-03 03:13:01,516 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/af3eaa99-f902-4cbe-a031-432ff516dd88 2025-11-03 03:13:01,524 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/4ba21947-91cb-4350-afc8-c77e618b0235 2025-11-03 03:13:01,530 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:01,530 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:01,542 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/af3eaa99-f902-4cbe-a031-432ff516dd88 2025-11-03 03:13:01,558 - INFO - Verified VN network id 16 for VN a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:01,558 - INFO - Verifications in API Server for VN ctest-mgmt_vn-64328988 passed 2025-11-03 03:13:01,558 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:01,567 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/af3eaa99-f902-4cbe-a031-432ff516dd88 2025-11-03 03:13:01,574 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/af3eaa99-f902-4cbe-a031-432ff516dd88 2025-11-03 03:13:01,584 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/4ba21947-91cb-4350-afc8-c77e618b0235 2025-11-03 03:13:01,596 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12037648496776531198', 'uuid-lslong': '10382103135511743248'}, 'enable': 'true', 'created': '2025-11-03T03:13:00', 'last-modified': '2025-11-03T03:13:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.837949'} 2025-11-03 03:13:01,603 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:01,611 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12037648496776531198', 'uuid-lslong': '10382103135511743248'}, 'enable': 'true', 'created': '2025-11-03T03:13:00', 'last-modified': '2025-11-03T03:13:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.850710'} 2025-11-03 03:13:01,621 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:01,629 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12037648496776531198', 'uuid-lslong': '10382103135511743248'}, 'enable': 'true', 'created': '2025-11-03T03:13:00', 'last-modified': '2025-11-03T03:13:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.866132'} 2025-11-03 03:13:01,637 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:01,637 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-64328988 passed 2025-11-03 03:13:01,637 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-64328988 in API_Server ====== 2025-11-03 03:13:01,637 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:01,644 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:01,655 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:01,763 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/a70e5187-9561-4cfe-9014-a3cb85a58b10 2025-11-03 03:13:01,775 - DEBUG - =>VN ctest-mgmt_vn-64328988 has no policy to be verified 2025-11-03 03:13:01,775 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:01,775 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:01,775 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:02,087 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:02,167 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988?flat'} 2025-11-03 03:13:02,167 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:02,167 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:02,470 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:02,528 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988?flat'} 2025-11-03 03:13:02,528 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:02,529 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:02,826 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:02,884 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988?flat'} 2025-11-03 03:13:02,884 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-64328988 is found in opserver 2025-11-03 03:13:02,904 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:02,914 - DEBUG - VRF ids for VN ctest-mgmt_vn-64328988: {} 2025-11-03 03:13:03,195 - DEBUG - Response for create_network : {'network': {'id': '1bfa63d6-aafd-42da-bf82-58d381a8eb44', 'name': 'ctest-left_vn-42821130', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-left_vn-42821130'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:03,472 - DEBUG - Response for create_subnet : {'subnet': {'id': '2cf4b81f-dc34-4082-8110-bc32772fc2d1', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': '1bfa63d6-aafd-42da-bf82-58d381a8eb44', 'ip_version': 4, 'cidr': '144.189.41.64/26', 'allocation_pools': [{'start': '144.189.41.66', 'end': '144.189.41.126'}], 'gateway_ip': '144.189.41.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '144.189.41.66', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:03,493 - INFO - Created VN ctest-left_vn-42821130 2025-11-03 03:13:03,505 - DEBUG - VN ctest-left_vn-42821130 UUID is 1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,581 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:03,588 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:03,600 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:03,702 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,714 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,722 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2c1ae6ee-581c-42cf-a2dc-2f1a9d44a8fb 2025-11-03 03:13:03,731 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2c1ae6ee-581c-42cf-a2dc-2f1a9d44a8fb 2025-11-03 03:13:03,738 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/35333f44-54a8-4f16-9dc5-f0e1d2e95676 2025-11-03 03:13:03,744 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:03,745 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,753 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2c1ae6ee-581c-42cf-a2dc-2f1a9d44a8fb 2025-11-03 03:13:03,770 - INFO - Verified VN network id 17 for VN 1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,770 - INFO - Verifications in API Server for VN ctest-left_vn-42821130 passed 2025-11-03 03:13:03,770 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,779 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2c1ae6ee-581c-42cf-a2dc-2f1a9d44a8fb 2025-11-03 03:13:03,787 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2c1ae6ee-581c-42cf-a2dc-2f1a9d44a8fb 2025-11-03 03:13:03,795 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/35333f44-54a8-4f16-9dc5-f0e1d2e95676 2025-11-03 03:13:03,807 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2016033556844593882', 'uuid-lslong': '13799689873653295940'}, 'enable': 'true', 'created': '2025-11-03T03:13:03', 'last-modified': '2025-11-03T03:13:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408098'} 2025-11-03 03:13:03,813 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:03,819 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2016033556844593882', 'uuid-lslong': '13799689873653295940'}, 'enable': 'true', 'created': '2025-11-03T03:13:03', 'last-modified': '2025-11-03T03:13:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422476'} 2025-11-03 03:13:03,825 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:03,833 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2016033556844593882', 'uuid-lslong': '13799689873653295940'}, 'enable': 'true', 'created': '2025-11-03T03:13:03', 'last-modified': '2025-11-03T03:13:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431250'} 2025-11-03 03:13:03,843 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:03,843 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-42821130 passed 2025-11-03 03:13:03,844 - DEBUG - ====Verifying policy data for ctest-left_vn-42821130 in API_Server ====== 2025-11-03 03:13:03,844 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:03,851 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:03,863 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:03,984 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1bfa63d6-aafd-42da-bf82-58d381a8eb44 2025-11-03 03:13:03,995 - DEBUG - =>VN ctest-left_vn-42821130 has no policy to be verified 2025-11-03 03:13:03,995 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:03,995 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:03,995 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:04,052 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130?flat'} 2025-11-03 03:13:04,052 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:04,052 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:04,110 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130?flat'} 2025-11-03 03:13:04,111 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:04,111 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:04,164 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130?flat'} 2025-11-03 03:13:04,164 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-42821130 is found in opserver 2025-11-03 03:13:04,186 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:04,197 - DEBUG - VRF ids for VN ctest-left_vn-42821130: {} 2025-11-03 03:13:04,488 - DEBUG - Response for create_network : {'network': {'id': '997ae3e2-1bf1-4f27-852e-8e3d2a9949f3', 'name': 'ctest-right_vn-76648299', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-right_vn-76648299'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:04,775 - DEBUG - Response for create_subnet : {'subnet': {'id': '957f588a-1ba9-4d99-b9ab-76bdad8d2f57', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': '997ae3e2-1bf1-4f27-852e-8e3d2a9949f3', 'ip_version': 4, 'cidr': '191.105.84.0/26', 'allocation_pools': [{'start': '191.105.84.2', 'end': '191.105.84.62'}], 'gateway_ip': '191.105.84.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '191.105.84.2', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:04,800 - INFO - Created VN ctest-right_vn-76648299 2025-11-03 03:13:04,815 - DEBUG - VN ctest-right_vn-76648299 UUID is 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:04,891 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:04,898 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:04,910 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:04,999 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:05,014 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:05,023 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/992f7204-b308-4c46-92e3-47010bc9bd4c 2025-11-03 03:13:05,030 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/992f7204-b308-4c46-92e3-47010bc9bd4c 2025-11-03 03:13:05,038 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/b025544c-ef34-465e-b40e-f52450184581 2025-11-03 03:13:05,044 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:05,044 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:05,052 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/992f7204-b308-4c46-92e3-47010bc9bd4c 2025-11-03 03:13:05,068 - INFO - Verified VN network id 18 for VN 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:05,069 - INFO - Verifications in API Server for VN ctest-right_vn-76648299 passed 2025-11-03 03:13:05,069 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:05,080 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/992f7204-b308-4c46-92e3-47010bc9bd4c 2025-11-03 03:13:05,089 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/992f7204-b308-4c46-92e3-47010bc9bd4c 2025-11-03 03:13:05,095 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/b025544c-ef34-465e-b40e-f52450184581 2025-11-03 03:13:05,106 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11059402395232587559', 'uuid-lslong': '9596764249331943923'}, 'enable': 'true', 'created': '2025-11-03T03:13:04', 'last-modified': '2025-11-03T03:13:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390968'} 2025-11-03 03:13:05,111 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:05,119 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11059402395232587559', 'uuid-lslong': '9596764249331943923'}, 'enable': 'true', 'created': '2025-11-03T03:13:04', 'last-modified': '2025-11-03T03:13:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404466'} 2025-11-03 03:13:05,127 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:05,133 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11059402395232587559', 'uuid-lslong': '9596764249331943923'}, 'enable': 'true', 'created': '2025-11-03T03:13:04', 'last-modified': '2025-11-03T03:13:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.415592'} 2025-11-03 03:13:05,139 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:05,139 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-76648299 passed 2025-11-03 03:13:05,139 - DEBUG - ====Verifying policy data for ctest-right_vn-76648299 in API_Server ====== 2025-11-03 03:13:05,139 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:05,146 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:05,157 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:05,260 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 2025-11-03 03:13:05,271 - DEBUG - =>VN ctest-right_vn-76648299 has no policy to be verified 2025-11-03 03:13:05,271 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:05,271 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:05,271 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:05,329 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299?flat'} 2025-11-03 03:13:05,329 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:05,329 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:05,392 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299?flat'} 2025-11-03 03:13:05,392 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:05,392 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:05,449 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299?flat'} 2025-11-03 03:13:05,449 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-76648299 is found in opserver 2025-11-03 03:13:05,471 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:05,485 - DEBUG - VRF ids for VN ctest-right_vn-76648299: {} 2025-11-03 03:13:05,549 - DEBUG - Services list from nova: [, , , ] 2025-11-03 03:13:06,559 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 03:13:07,970 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 03:13:07,970 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-98959939'] 2025-11-03 03:13:08,281 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-98959939'] created succesfully 2025-11-03 03:13:08,701 - DEBUG - Image by name tiny_nat_fw not found 2025-11-03 03:13:08,701 - DEBUG - Installing image tiny_nat_fw 2025-11-03 03:13:08,701 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-11-03 03:13:08,701 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-03 03:13:08,701 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-03 03:13:08,701 - DEBUG - Unzip image 2025-11-03 03:13:08,701 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-11-03 03:13:08,719 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-11-03 03:13:08,720 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-98959939'] 2025-11-03 03:13:08,813 - INFO - Service template: ['default-domain', 'ctest-service_template_1-98959939'] deleted successfully. 2025-11-03 03:13:08,814 - INFO - Skip interface_detach for VM ctest-right_vm-86314613 in state BUILD 2025-11-03 03:13:08,815 - INFO - Deleting VM ctest-right_vm-86314613 2025-11-03 03:13:08,869 - ERROR - VM ctest-right_vm-86314613 has failed to come up 2025-11-03 03:13:08,869 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:08,869 - ERROR - VM ctest-right_vm-86314613 has failed to come up 2025-11-03 03:13:08,869 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:08,971 - INFO - Skip interface_detach for VM ctest-left_vm-10938870 in state BUILD 2025-11-03 03:13:08,971 - INFO - Deleting VM ctest-left_vm-10938870 2025-11-03 03:13:08,971 - ERROR - VM ctest-left_vm-10938870 has failed to come up 2025-11-03 03:13:08,971 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:08,971 - ERROR - VM ctest-left_vm-10938870 has failed to come up 2025-11-03 03:13:08,971 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:09,063 - INFO - Deleting VN ctest-right_vn-76648299 2025-11-03 03:13:09,108 - DEBUG - VN 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 still in use: Unable to complete operation on network 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b4a6d2b1-0732-418f-a809-ec5059484470'] 2025-11-03 03:13:09,108 - WARNING - Deleting VN ctest-right_vn-76648299 failed..Will retry 2025-11-03 03:13:11,155 - DEBUG - VN 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 still in use: Unable to complete operation on network 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-22e6adc1-3143-4710-bf45-909e5afca3fb'] 2025-11-03 03:13:11,155 - WARNING - Deleting VN ctest-right_vn-76648299 failed..Will retry 2025-11-03 03:13:13,194 - DEBUG - VN 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 still in use: Unable to complete operation on network 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-cfbb622c-5c73-4d79-aaab-905b79a66d7e'] 2025-11-03 03:13:13,194 - WARNING - Deleting VN ctest-right_vn-76648299 failed..Will retry 2025-11-03 03:13:15,240 - DEBUG - VN 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 still in use: Unable to complete operation on network 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-50246429-eaf6-47e4-b3a1-f040f24d8ec4'] 2025-11-03 03:13:15,240 - WARNING - Deleting VN ctest-right_vn-76648299 failed..Will retry 2025-11-03 03:13:17,291 - DEBUG - VN 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3 still in use: Unable to complete operation on network 997ae3e2-1bf1-4f27-852e-8e3d2a9949f3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-77d5b516-df9f-4635-a61f-9c8633e85ce5'] 2025-11-03 03:13:17,291 - WARNING - Deleting VN ctest-right_vn-76648299 failed..Will retry 2025-11-03 03:13:19,453 - DEBUG - Response for deleting network () 2025-11-03 03:13:19,453 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/992f7204-b308-4c46-92e3-47010bc9bd4c 2025-11-03 03:13:19,459 - DEBUG - Response Code: 404 2025-11-03 03:13:19,459 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:19,465 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:19,482 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:19,574 - INFO - Validated that VN ctest-right_vn-76648299 is not found in API Server 2025-11-03 03:13:19,585 - DEBUG - VN ctest-right_vn-76648299 is not present in Agent 10.0.0.73 2025-11-03 03:13:19,608 - DEBUG - VN ctest-right_vn-76648299 is not present in Agent 10.0.0.33 2025-11-03 03:13:19,608 - INFO - Validated that VN ctest-right_vn-76648299 is not in any agent 2025-11-03 03:13:19,652 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-76648299 info 2025-11-03 03:13:19,652 - INFO - Deleting VN ctest-left_vn-42821130 2025-11-03 03:13:19,813 - DEBUG - Response for deleting network () 2025-11-03 03:13:19,813 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/2c1ae6ee-581c-42cf-a2dc-2f1a9d44a8fb 2025-11-03 03:13:19,820 - DEBUG - Response Code: 404 2025-11-03 03:13:19,820 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:19,830 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:19,844 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:19,946 - INFO - Validated that VN ctest-left_vn-42821130 is not found in API Server 2025-11-03 03:13:19,958 - DEBUG - VN ctest-left_vn-42821130 is not present in Agent 10.0.0.73 2025-11-03 03:13:19,968 - DEBUG - VN ctest-left_vn-42821130 is not present in Agent 10.0.0.33 2025-11-03 03:13:19,968 - INFO - Validated that VN ctest-left_vn-42821130 is not in any agent 2025-11-03 03:13:20,001 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-42821130 info 2025-11-03 03:13:20,001 - INFO - Deleting VN ctest-mgmt_vn-64328988 2025-11-03 03:13:20,152 - DEBUG - Response for deleting network () 2025-11-03 03:13:20,153 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/af3eaa99-f902-4cbe-a031-432ff516dd88 2025-11-03 03:13:20,159 - DEBUG - Response Code: 404 2025-11-03 03:13:20,159 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:20,164 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:20,175 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:20,295 - INFO - Validated that VN ctest-mgmt_vn-64328988 is not found in API Server 2025-11-03 03:13:20,304 - DEBUG - VN ctest-mgmt_vn-64328988 is not present in Agent 10.0.0.73 2025-11-03 03:13:20,316 - DEBUG - VN ctest-mgmt_vn-64328988 is not present in Agent 10.0.0.33 2025-11-03 03:13:20,316 - INFO - Validated that VN ctest-mgmt_vn-64328988 is not in any agent 2025-11-03 03:13:20,350 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-64328988 info 2025-11-03 03:13:21,623 - DEBUG - No XMPP flaps were noticed during the test 2025-11-03 03:13:21,623 - INFO -

2025-11-03 03:13:21,623 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:23]

2025-11-03 03:13:21,623 - INFO - -------------------------------------------------------------------------------- 2025-11-03 03:13:21,628 - INFO - ================================================================================ 2025-11-03 03:13:21,628 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-11-03 03:13:22,906 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.33': {'10.20.0.17': '0', '10.20.0.193': '0'}} with 2025-11-03 03:13:22,906 - INFO - Initial checks done. Running the testcase now 2025-11-03 03:13:22,906 - INFO - 2025-11-03 03:13:23,174 - DEBUG - Response for create_network : {'network': {'id': 'bafbe122-dd9d-45fa-840b-3f97462c6da0', 'name': 'ctest-mgmt_vn-77319746', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-mgmt_vn-77319746'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:23,403 - DEBUG - Response for create_subnet : {'subnet': {'id': '11000ba4-cbd0-4dfa-bcb0-3bd87ac42feb', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': 'bafbe122-dd9d-45fa-840b-3f97462c6da0', 'ip_version': 4, 'cidr': '155.16.250.128/26', 'allocation_pools': [{'start': '155.16.250.130', 'end': '155.16.250.190'}], 'gateway_ip': '155.16.250.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '155.16.250.130', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:23,424 - INFO - Created VN ctest-mgmt_vn-77319746 2025-11-03 03:13:23,436 - DEBUG - VN ctest-mgmt_vn-77319746 UUID is bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:23,510 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:23,516 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:23,527 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:23,621 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:23,632 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:23,642 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:23,652 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:23,662 - DEBUG - Route Targets: [] 2025-11-03 03:13:23,662 - DEBUG - RT names not yet present for VN ctest-mgmt_vn-77319746 2025-11-03 03:13:28,663 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:28,670 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:28,682 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:28,775 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:28,786 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:28,797 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:28,809 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:28,818 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/dcb679e5-2448-4385-9cc5-e44cc325c919 2025-11-03 03:13:28,826 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:28,826 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:28,835 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:28,854 - INFO - Verified VN network id 16 for VN bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:28,854 - INFO - Verifications in API Server for VN ctest-mgmt_vn-77319746 passed 2025-11-03 03:13:28,855 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:28,865 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:28,872 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:28,879 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/dcb679e5-2448-4385-9cc5-e44cc325c919 2025-11-03 03:13:28,891 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13473610250072180218', 'uuid-lslong': '9514768556700233120'}, 'enable': 'true', 'created': '2025-11-03T03:13:23', 'last-modified': '2025-11-03T03:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.531511'} 2025-11-03 03:13:28,896 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:28,903 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13473610250072180218', 'uuid-lslong': '9514768556700233120'}, 'enable': 'true', 'created': '2025-11-03T03:13:23', 'last-modified': '2025-11-03T03:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.547594'} 2025-11-03 03:13:28,911 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:28,920 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13473610250072180218', 'uuid-lslong': '9514768556700233120'}, 'enable': 'true', 'created': '2025-11-03T03:13:23', 'last-modified': '2025-11-03T03:13:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.561858'} 2025-11-03 03:13:28,927 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-11-03 03:13:28,927 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-77319746 passed 2025-11-03 03:13:28,928 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-77319746 in API_Server ====== 2025-11-03 03:13:28,928 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:28,934 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:28,945 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:29,034 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/bafbe122-dd9d-45fa-840b-3f97462c6da0 2025-11-03 03:13:29,051 - DEBUG - =>VN ctest-mgmt_vn-77319746 has no policy to be verified 2025-11-03 03:13:29,051 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:29,052 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:29,052 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:29,066 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746?flat'} 2025-11-03 03:13:29,066 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:29,066 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:29,080 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746?flat'} 2025-11-03 03:13:29,080 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:29,080 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:29,092 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746?flat'} 2025-11-03 03:13:29,092 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-mgmt_vn-77319746 is found in opserver 2025-11-03 03:13:29,112 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:29,121 - DEBUG - VRF ids for VN ctest-mgmt_vn-77319746: {} 2025-11-03 03:13:29,396 - DEBUG - Response for create_network : {'network': {'id': '513ec79c-386d-4e50-b770-307f7b758e76', 'name': 'ctest-left_vn-57816900', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-left_vn-57816900'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:29,634 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cd184c1a-039d-49c7-90e9-a9c377a0c12e', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': '513ec79c-386d-4e50-b770-307f7b758e76', 'ip_version': 4, 'cidr': '141.96.20.128/26', 'allocation_pools': [{'start': '141.96.20.130', 'end': '141.96.20.190'}], 'gateway_ip': '141.96.20.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '141.96.20.130', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:29,658 - INFO - Created VN ctest-left_vn-57816900 2025-11-03 03:13:29,671 - DEBUG - VN ctest-left_vn-57816900 UUID is 513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:29,742 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:29,748 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:29,758 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:29,857 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:29,869 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:29,878 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1cc750f8-9e23-48b3-b91e-62c6e2f4ee2f 2025-11-03 03:13:29,887 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1cc750f8-9e23-48b3-b91e-62c6e2f4ee2f 2025-11-03 03:13:29,893 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/61f7e001-d14b-4199-9c14-85abda9cd862 2025-11-03 03:13:29,899 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:29,899 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:29,908 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1cc750f8-9e23-48b3-b91e-62c6e2f4ee2f 2025-11-03 03:13:29,927 - INFO - Verified VN network id 17 for VN 513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:29,927 - INFO - Verifications in API Server for VN ctest-left_vn-57816900 passed 2025-11-03 03:13:29,927 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:29,936 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1cc750f8-9e23-48b3-b91e-62c6e2f4ee2f 2025-11-03 03:13:29,945 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1cc750f8-9e23-48b3-b91e-62c6e2f4ee2f 2025-11-03 03:13:29,952 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/61f7e001-d14b-4199-9c14-85abda9cd862 2025-11-03 03:13:29,962 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5854336039403736656', 'uuid-lslong': '13218118230422687350'}, 'enable': 'true', 'created': '2025-11-03T03:13:29', 'last-modified': '2025-11-03T03:13:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403716'} 2025-11-03 03:13:29,967 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:29,973 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5854336039403736656', 'uuid-lslong': '13218118230422687350'}, 'enable': 'true', 'created': '2025-11-03T03:13:29', 'last-modified': '2025-11-03T03:13:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416862'} 2025-11-03 03:13:29,978 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:29,985 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5854336039403736656', 'uuid-lslong': '13218118230422687350'}, 'enable': 'true', 'created': '2025-11-03T03:13:29', 'last-modified': '2025-11-03T03:13:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.428153'} 2025-11-03 03:13:29,990 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-11-03 03:13:29,990 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-57816900 passed 2025-11-03 03:13:29,990 - DEBUG - ====Verifying policy data for ctest-left_vn-57816900 in API_Server ====== 2025-11-03 03:13:29,990 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:29,996 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:30,006 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:30,097 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/513ec79c-386d-4e50-b770-307f7b758e76 2025-11-03 03:13:30,115 - DEBUG - =>VN ctest-left_vn-57816900 has no policy to be verified 2025-11-03 03:13:30,115 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:30,115 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:30,115 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:30,128 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900?flat'} 2025-11-03 03:13:30,128 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:30,128 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:30,143 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900?flat'} 2025-11-03 03:13:30,143 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:30,143 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:30,154 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900?flat'} 2025-11-03 03:13:30,154 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-left_vn-57816900 is found in opserver 2025-11-03 03:13:30,173 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:30,183 - DEBUG - VRF ids for VN ctest-left_vn-57816900: {} 2025-11-03 03:13:30,491 - DEBUG - Response for create_network : {'network': {'id': 'cb648905-0f88-4e39-899c-0d557a79122b', 'name': 'ctest-right_vn-49799696', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-right_vn-49799696'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:30,765 - DEBUG - Response for create_subnet : {'subnet': {'id': '51851f9e-9248-4d47-9eca-dfe449362842', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': 'cb648905-0f88-4e39-899c-0d557a79122b', 'ip_version': 4, 'cidr': '200.129.64.192/26', 'allocation_pools': [{'start': '200.129.64.194', 'end': '200.129.64.254'}], 'gateway_ip': '200.129.64.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '200.129.64.194', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:30,790 - INFO - Created VN ctest-right_vn-49799696 2025-11-03 03:13:30,801 - DEBUG - VN ctest-right_vn-49799696 UUID is cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:30,887 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:30,893 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:30,907 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:31,014 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:31,034 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:31,053 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7033edff-d9c7-4265-b2f4-f8a16457e8ea 2025-11-03 03:13:31,062 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7033edff-d9c7-4265-b2f4-f8a16457e8ea 2025-11-03 03:13:31,072 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ec7f0d8-1160-44a0-962f-aefb85f920a8 2025-11-03 03:13:31,081 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:31,081 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:31,090 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7033edff-d9c7-4265-b2f4-f8a16457e8ea 2025-11-03 03:13:31,111 - INFO - Verified VN network id 18 for VN cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:31,111 - INFO - Verifications in API Server for VN ctest-right_vn-49799696 passed 2025-11-03 03:13:31,111 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:31,128 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7033edff-d9c7-4265-b2f4-f8a16457e8ea 2025-11-03 03:13:31,139 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7033edff-d9c7-4265-b2f4-f8a16457e8ea 2025-11-03 03:13:31,150 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6ec7f0d8-1160-44a0-962f-aefb85f920a8 2025-11-03 03:13:31,166 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14655989742198869561', 'uuid-lslong': '9915815140341125675'}, 'enable': 'true', 'created': '2025-11-03T03:13:30', 'last-modified': '2025-11-03T03:13:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466139'} 2025-11-03 03:13:31,172 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:31,180 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14655989742198869561', 'uuid-lslong': '9915815140341125675'}, 'enable': 'true', 'created': '2025-11-03T03:13:30', 'last-modified': '2025-11-03T03:13:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479792'} 2025-11-03 03:13:31,188 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:31,195 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14655989742198869561', 'uuid-lslong': '9915815140341125675'}, 'enable': 'true', 'created': '2025-11-03T03:13:30', 'last-modified': '2025-11-03T03:13:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501582'} 2025-11-03 03:13:31,202 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-11-03 03:13:31,202 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-49799696 passed 2025-11-03 03:13:31,202 - DEBUG - ====Verifying policy data for ctest-right_vn-49799696 in API_Server ====== 2025-11-03 03:13:31,202 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:31,210 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:31,223 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:31,323 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/cb648905-0f88-4e39-899c-0d557a79122b 2025-11-03 03:13:31,335 - DEBUG - =>VN ctest-right_vn-49799696 has no policy to be verified 2025-11-03 03:13:31,335 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:31,335 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:31,335 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:31,358 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696?flat'} 2025-11-03 03:13:31,358 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:31,358 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:31,377 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696?flat'} 2025-11-03 03:13:31,377 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:31,377 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:31,390 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696?flat'} 2025-11-03 03:13:31,390 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-right_vn-49799696 is found in opserver 2025-11-03 03:13:31,413 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:31,426 - DEBUG - VRF ids for VN ctest-right_vn-49799696: {} 2025-11-03 03:13:31,701 - DEBUG - Response for create_network : {'network': {'id': 'e858af8e-c36f-4199-b34e-9774bec45a27', 'name': 'ctest-trans_left_vn-96601351', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-trans_left_vn-96601351'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:31,939 - DEBUG - Response for create_subnet : {'subnet': {'id': '7d1fe7a1-aff8-4fa3-8796-8e9dbcb45f77', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': 'e858af8e-c36f-4199-b34e-9774bec45a27', 'ip_version': 4, 'cidr': '120.128.225.192/26', 'allocation_pools': [{'start': '120.128.225.194', 'end': '120.128.225.254'}], 'gateway_ip': '120.128.225.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '120.128.225.194', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:31,963 - INFO - Created VN ctest-trans_left_vn-96601351 2025-11-03 03:13:31,975 - DEBUG - VN ctest-trans_left_vn-96601351 UUID is e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,076 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:32,081 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:32,092 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:32,202 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,216 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,237 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/360d5fdb-72e4-4659-884a-04097009bdc5 2025-11-03 03:13:32,281 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/360d5fdb-72e4-4659-884a-04097009bdc5 2025-11-03 03:13:32,298 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/3d225db9-3e7b-47ac-9f88-cd8522e3153b 2025-11-03 03:13:32,312 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-03 03:13:32,312 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,331 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/360d5fdb-72e4-4659-884a-04097009bdc5 2025-11-03 03:13:32,366 - INFO - Verified VN network id 19 for VN e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,366 - INFO - Verifications in API Server for VN ctest-trans_left_vn-96601351 passed 2025-11-03 03:13:32,366 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,396 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/360d5fdb-72e4-4659-884a-04097009bdc5 2025-11-03 03:13:32,477 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/360d5fdb-72e4-4659-884a-04097009bdc5 2025-11-03 03:13:32,526 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/3d225db9-3e7b-47ac-9f88-cd8522e3153b 2025-11-03 03:13:32,541 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16742324642448884121', 'uuid-lslong': '12920430908645071399'}, 'enable': 'true', 'created': '2025-11-03T03:13:31', 'last-modified': '2025-11-03T03:13:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.663076'} 2025-11-03 03:13:32,550 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-03 03:13:32,568 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16742324642448884121', 'uuid-lslong': '12920430908645071399'}, 'enable': 'true', 'created': '2025-11-03T03:13:31', 'last-modified': '2025-11-03T03:13:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.688862'} 2025-11-03 03:13:32,576 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-03 03:13:32,584 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16742324642448884121', 'uuid-lslong': '12920430908645071399'}, 'enable': 'true', 'created': '2025-11-03T03:13:31', 'last-modified': '2025-11-03T03:13:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.705830'} 2025-11-03 03:13:32,594 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-11-03 03:13:32,594 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-96601351 passed 2025-11-03 03:13:32,595 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-96601351 in API_Server ====== 2025-11-03 03:13:32,595 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:32,602 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:32,619 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:32,717 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/e858af8e-c36f-4199-b34e-9774bec45a27 2025-11-03 03:13:32,730 - DEBUG - =>VN ctest-trans_left_vn-96601351 has no policy to be verified 2025-11-03 03:13:32,730 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:32,730 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:32,730 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:32,746 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351?flat'} 2025-11-03 03:13:32,746 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:32,746 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:32,761 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351?flat'} 2025-11-03 03:13:32,761 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:32,761 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:32,773 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351?flat'} 2025-11-03 03:13:32,773 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-trans_left_vn-96601351 is found in opserver 2025-11-03 03:13:32,796 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:32,808 - DEBUG - VRF ids for VN ctest-trans_left_vn-96601351: {} 2025-11-03 03:13:33,120 - DEBUG - Response for create_network : {'network': {'id': 'c83e834e-f686-4d7e-8b16-f5df1b8ffa03', 'name': 'ctest-trans_right_vn-66914751', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'project_id': '92fa87eaa96240f291f1b7990a02d2ee', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-21059794', 'ctest-trans_right_vn-66914751'], 'port_security_enabled': True, 'description': ''}} 2025-11-03 03:13:33,365 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b30fe4d2-cd81-4bf9-8c43-65523bd63abf', 'name': '', 'tenant_id': '92fa87eaa96240f291f1b7990a02d2ee', 'network_id': 'c83e834e-f686-4d7e-8b16-f5df1b8ffa03', 'ip_version': 4, 'cidr': '131.40.240.192/26', 'allocation_pools': [{'start': '131.40.240.194', 'end': '131.40.240.254'}], 'gateway_ip': '131.40.240.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '131.40.240.194', 'tags': [], 'project_id': '92fa87eaa96240f291f1b7990a02d2ee'}} 2025-11-03 03:13:33,388 - INFO - Created VN ctest-trans_right_vn-66914751 2025-11-03 03:13:33,405 - DEBUG - VN ctest-trans_right_vn-66914751 UUID is c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,489 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:33,497 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:33,510 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:33,608 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,620 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,630 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5c052780-2ced-46be-ba87-0a4ec633ee32 2025-11-03 03:13:33,638 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5c052780-2ced-46be-ba87-0a4ec633ee32 2025-11-03 03:13:33,646 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7d18248d-7711-4d81-b5a8-bfa8f0fe32db 2025-11-03 03:13:33,655 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-03 03:13:33,655 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,664 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5c052780-2ced-46be-ba87-0a4ec633ee32 2025-11-03 03:13:33,681 - INFO - Verified VN network id 20 for VN c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,682 - INFO - Verifications in API Server for VN ctest-trans_right_vn-66914751 passed 2025-11-03 03:13:33,682 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,699 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5c052780-2ced-46be-ba87-0a4ec633ee32 2025-11-03 03:13:33,708 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5c052780-2ced-46be-ba87-0a4ec633ee32 2025-11-03 03:13:33,717 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/7d18248d-7711-4d81-b5a8-bfa8f0fe32db 2025-11-03 03:13:33,731 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14429114631308332414', 'uuid-lslong': '10022468359348550147'}, 'enable': 'true', 'created': '2025-11-03T03:13:33', 'last-modified': '2025-11-03T03:13:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434042'} 2025-11-03 03:13:33,738 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-03 03:13:33,745 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14429114631308332414', 'uuid-lslong': '10022468359348550147'}, 'enable': 'true', 'created': '2025-11-03T03:13:33', 'last-modified': '2025-11-03T03:13:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445997'} 2025-11-03 03:13:33,751 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-03 03:13:33,757 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-21059794', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14429114631308332414', 'uuid-lslong': '10022468359348550147'}, 'enable': 'true', 'created': '2025-11-03T03:13:33', 'last-modified': '2025-11-03T03:13:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460364'} 2025-11-03 03:13:33,763 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-11-03 03:13:33,763 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-66914751 passed 2025-11-03 03:13:33,763 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-66914751 in API_Server ====== 2025-11-03 03:13:33,764 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:33,769 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:33,781 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:33,880 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/c83e834e-f686-4d7e-8b16-f5df1b8ffa03 2025-11-03 03:13:33,889 - DEBUG - =>VN ctest-trans_right_vn-66914751 has no policy to be verified 2025-11-03 03:13:33,889 - DEBUG - Verifying the vn in opserver 2025-11-03 03:13:33,889 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751 virtual network link through opserver 10.0.0.249 2025-11-03 03:13:33,889 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-11-03 03:13:33,901 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751?flat'} 2025-11-03 03:13:33,901 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751 virtual network link through opserver 10.0.0.61 2025-11-03 03:13:33,901 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-11-03 03:13:33,917 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751?flat'} 2025-11-03 03:13:33,917 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751 virtual network link through opserver 10.0.0.23 2025-11-03 03:13:33,917 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-11-03 03:13:33,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751?flat'} 2025-11-03 03:13:33,932 - INFO - Validated that VN default-domain:ctest-TestSvcHC-21059794:ctest-trans_right_vn-66914751 is found in opserver 2025-11-03 03:13:33,956 - DEBUG - Do not have enough data to verify VN in agent 2025-11-03 03:13:33,967 - DEBUG - VRF ids for VN ctest-trans_right_vn-66914751: {} 2025-11-03 03:13:35,079 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-2) 2025-11-03 03:13:36,503 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4597-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4597-1) 2025-11-03 03:13:36,503 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-04579767'] 2025-11-03 03:13:36,793 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-04579767'] created succesfully 2025-11-03 03:13:37,168 - DEBUG - Image by name tiny_trans_fw not found 2025-11-03 03:13:37,169 - DEBUG - Installing image tiny_trans_fw 2025-11-03 03:13:37,169 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-11-03 03:13:37,169 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-03 03:13:37,169 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-03 03:13:37,169 - DEBUG - Unzip image 2025-11-03 03:13:37,169 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-11-03 03:13:37,187 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-11-03 03:13:37,188 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-04579767'] 2025-11-03 03:13:37,299 - INFO - Service template: ['default-domain', 'ctest-service_template_1-04579767'] deleted successfully. 2025-11-03 03:13:37,299 - INFO - Skip interface_detach for VM ctest-right_vm-61516687 in state BUILD 2025-11-03 03:13:37,299 - INFO - Deleting VM ctest-right_vm-61516687 2025-11-03 03:13:37,299 - ERROR - VM ctest-right_vm-61516687 has failed to come up 2025-11-03 03:13:37,299 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:37,299 - ERROR - VM ctest-right_vm-61516687 has failed to come up 2025-11-03 03:13:37,299 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:37,382 - INFO - Skip interface_detach for VM ctest-left_vm-65475468 in state BUILD 2025-11-03 03:13:37,383 - INFO - Deleting VM ctest-left_vm-65475468 2025-11-03 03:13:37,383 - ERROR - VM ctest-left_vm-65475468 has failed to come up 2025-11-03 03:13:37,383 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:37,383 - ERROR - VM ctest-left_vm-65475468 has failed to come up 2025-11-03 03:13:37,383 - ERROR - Nova failed to get host of the VM 2025-11-03 03:13:37,452 - INFO - Deleting VN ctest-trans_right_vn-66914751 2025-11-03 03:13:37,655 - DEBUG - Response for deleting network () 2025-11-03 03:13:37,655 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/5c052780-2ced-46be-ba87-0a4ec633ee32 2025-11-03 03:13:37,672 - DEBUG - Response Code: 404 2025-11-03 03:13:37,673 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:37,680 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:37,739 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:37,840 - INFO - Validated that VN ctest-trans_right_vn-66914751 is not found in API Server 2025-11-03 03:13:37,925 - DEBUG - VN ctest-trans_right_vn-66914751 is not present in Agent 10.0.0.73 2025-11-03 03:13:37,935 - DEBUG - VN ctest-trans_right_vn-66914751 is not present in Agent 10.0.0.33 2025-11-03 03:13:37,935 - INFO - Validated that VN ctest-trans_right_vn-66914751 is not in any agent 2025-11-03 03:13:38,015 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-66914751 info 2025-11-03 03:13:38,015 - INFO - Deleting VN ctest-trans_left_vn-96601351 2025-11-03 03:13:38,196 - DEBUG - Response for deleting network () 2025-11-03 03:13:38,196 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/360d5fdb-72e4-4659-884a-04097009bdc5 2025-11-03 03:13:38,204 - DEBUG - Response Code: 404 2025-11-03 03:13:38,204 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:38,209 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:38,223 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:38,312 - INFO - Validated that VN ctest-trans_left_vn-96601351 is not found in API Server 2025-11-03 03:13:38,339 - DEBUG - VN ctest-trans_left_vn-96601351 is not present in Agent 10.0.0.73 2025-11-03 03:13:38,365 - DEBUG - VN ctest-trans_left_vn-96601351 is not present in Agent 10.0.0.33 2025-11-03 03:13:38,365 - INFO - Validated that VN ctest-trans_left_vn-96601351 is not in any agent 2025-11-03 03:13:38,401 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-96601351 info 2025-11-03 03:13:38,402 - INFO - Deleting VN ctest-right_vn-49799696 2025-11-03 03:13:38,446 - DEBUG - VN cb648905-0f88-4e39-899c-0d557a79122b still in use: Unable to complete operation on network cb648905-0f88-4e39-899c-0d557a79122b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a021a10e-34e6-4da5-990f-665563795ac4'] 2025-11-03 03:13:38,447 - WARNING - Deleting VN ctest-right_vn-49799696 failed..Will retry 2025-11-03 03:13:40,602 - DEBUG - Response for deleting network () 2025-11-03 03:13:40,603 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/7033edff-d9c7-4265-b2f4-f8a16457e8ea 2025-11-03 03:13:40,608 - DEBUG - Response Code: 404 2025-11-03 03:13:40,608 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:40,616 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:40,674 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:40,777 - INFO - Validated that VN ctest-right_vn-49799696 is not found in API Server 2025-11-03 03:13:40,790 - DEBUG - VN ctest-right_vn-49799696 is not present in Agent 10.0.0.73 2025-11-03 03:13:40,801 - DEBUG - VN ctest-right_vn-49799696 is not present in Agent 10.0.0.33 2025-11-03 03:13:40,801 - INFO - Validated that VN ctest-right_vn-49799696 is not in any agent 2025-11-03 03:13:40,833 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-49799696 info 2025-11-03 03:13:40,833 - INFO - Deleting VN ctest-left_vn-57816900 2025-11-03 03:13:40,875 - DEBUG - VN 513ec79c-386d-4e50-b770-307f7b758e76 still in use: Unable to complete operation on network 513ec79c-386d-4e50-b770-307f7b758e76. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-cc76feca-ed9a-49db-ae6d-301a04fad94f'] 2025-11-03 03:13:40,877 - WARNING - Deleting VN ctest-left_vn-57816900 failed..Will retry 2025-11-03 03:13:42,920 - DEBUG - VN 513ec79c-386d-4e50-b770-307f7b758e76 still in use: Unable to complete operation on network 513ec79c-386d-4e50-b770-307f7b758e76. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-75c25f74-f9a9-4d22-813a-a22b5cf46ea8'] 2025-11-03 03:13:42,920 - WARNING - Deleting VN ctest-left_vn-57816900 failed..Will retry 2025-11-03 03:13:44,959 - DEBUG - VN 513ec79c-386d-4e50-b770-307f7b758e76 still in use: Unable to complete operation on network 513ec79c-386d-4e50-b770-307f7b758e76. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-6b71a6ba-61b5-461d-bbd5-fc74b6c5d6a5'] 2025-11-03 03:13:44,959 - WARNING - Deleting VN ctest-left_vn-57816900 failed..Will retry 2025-11-03 03:13:47,110 - DEBUG - Response for deleting network () 2025-11-03 03:13:47,110 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/1cc750f8-9e23-48b3-b91e-62c6e2f4ee2f 2025-11-03 03:13:47,116 - DEBUG - Response Code: 404 2025-11-03 03:13:47,116 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:47,128 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:47,140 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:47,232 - INFO - Validated that VN ctest-left_vn-57816900 is not found in API Server 2025-11-03 03:13:47,243 - DEBUG - VN ctest-left_vn-57816900 is not present in Agent 10.0.0.73 2025-11-03 03:13:47,256 - DEBUG - VN ctest-left_vn-57816900 is not present in Agent 10.0.0.33 2025-11-03 03:13:47,256 - INFO - Validated that VN ctest-left_vn-57816900 is not in any agent 2025-11-03 03:13:47,288 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-57816900 info 2025-11-03 03:13:47,289 - INFO - Deleting VN ctest-mgmt_vn-77319746 2025-11-03 03:13:47,426 - DEBUG - Response for deleting network () 2025-11-03 03:13:47,426 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/6c8295ac-2af0-4814-9c85-94fdb0ba7aeb 2025-11-03 03:13:47,434 - DEBUG - Response Code: 404 2025-11-03 03:13:47,434 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-11-03 03:13:47,440 - DEBUG - Requesting: http://10.0.0.249:8082/domain/08e054d4-7d42-4fbe-9f71-53fe1c9730a1 2025-11-03 03:13:47,451 - DEBUG - Requesting: http://10.0.0.249:8082/project/92fa87ea-a962-40f2-91f1-b7990a02d2ee 2025-11-03 03:13:47,549 - INFO - Validated that VN ctest-mgmt_vn-77319746 is not found in API Server 2025-11-03 03:13:47,559 - DEBUG - VN ctest-mgmt_vn-77319746 is not present in Agent 10.0.0.73 2025-11-03 03:13:47,575 - DEBUG - VN ctest-mgmt_vn-77319746 is not present in Agent 10.0.0.33 2025-11-03 03:13:47,575 - INFO - Validated that VN ctest-mgmt_vn-77319746 is not in any agent 2025-11-03 03:13:47,612 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-77319746 info 2025-11-03 03:13:48,897 - DEBUG - No XMPP flaps were noticed during the test 2025-11-03 03:13:48,897 - INFO -

2025-11-03 03:13:48,897 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:27]

2025-11-03 03:13:48,897 - INFO - -------------------------------------------------------------------------------- 2025-11-03 03:13:49,639 - INFO - Deleted project: ctest-TestSvcHC-21059794, ID : 92fa87ea-a962-40f2-91f1-b7990a02d2ee