2025-09-08 03:18:43,197 - INFO - Domain Default found not creating 2025-09-08 03:18:43,363 - INFO - Project ctest-TestSvcHC-59289858 not found, creating it 2025-09-08 03:18:43,960 - INFO - Created Project:ctest-TestSvcHC-59289858, ID : 45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:45,599 - INFO - ================================================================================ 2025-09-08 03:18:45,599 - INFO - STARTING TEST : test_svc_hc_basic 2025-09-08 03:18:46,971 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.14': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2025-09-08 03:18:46,971 - INFO - Initial checks done. Running the testcase now 2025-09-08 03:18:46,971 - INFO - 2025-09-08 03:18:47,727 - DEBUG - Response for create_network : {'network': {'id': 'c963cfd6-3add-47b6-96da-ca6c1c465d43', 'name': 'ctest-mgmt_vn-38810532', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-mgmt_vn-38810532'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:18:48,104 - DEBUG - Response for create_subnet : {'subnet': {'id': '8995fef5-44d7-4854-9fc7-650f4759b035', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': 'c963cfd6-3add-47b6-96da-ca6c1c465d43', 'ip_version': 4, 'cidr': '214.94.176.192/26', 'allocation_pools': [{'start': '214.94.176.194', 'end': '214.94.176.254'}], 'gateway_ip': '214.94.176.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '214.94.176.194', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:18:48,128 - INFO - Created VN ctest-mgmt_vn-38810532 2025-09-08 03:18:48,141 - DEBUG - VN ctest-mgmt_vn-38810532 UUID is c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:48,238 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:48,580 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:48,617 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:48,636 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:48,743 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:48,758 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:48,768 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/04485587-329c-4956-a63e-52068b017ae4 2025-09-08 03:18:48,778 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/04485587-329c-4956-a63e-52068b017ae4 2025-09-08 03:18:48,787 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/efac088c-cd9e-4a80-be58-befdb9ffff50 2025-09-08 03:18:48,795 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:18:48,795 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:48,805 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/04485587-329c-4956-a63e-52068b017ae4 2025-09-08 03:18:48,824 - INFO - Verified VN network id 14 for VN c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:48,824 - INFO - Verifications in API Server for VN ctest-mgmt_vn-38810532 passed 2025-09-08 03:18:48,824 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:48,834 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/04485587-329c-4956-a63e-52068b017ae4 2025-09-08 03:18:48,843 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/04485587-329c-4956-a63e-52068b017ae4 2025-09-08 03:18:48,852 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/efac088c-cd9e-4a80-be58-befdb9ffff50 2025-09-08 03:18:48,866 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14511670943335401398', 'uuid-lslong': '10870223216291765571'}, 'enable': 'true', 'created': '2025-09-08T03:18:47', 'last-modified': '2025-09-08T03:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.847543'} 2025-09-08 03:18:48,873 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:18:48,889 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14511670943335401398', 'uuid-lslong': '10870223216291765571'}, 'enable': 'true', 'created': '2025-09-08T03:18:47', 'last-modified': '2025-09-08T03:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.862707'} 2025-09-08 03:18:48,899 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:18:48,905 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14511670943335401398', 'uuid-lslong': '10870223216291765571'}, 'enable': 'true', 'created': '2025-09-08T03:18:47', 'last-modified': '2025-09-08T03:18:47', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.884354'} 2025-09-08 03:18:48,912 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:18:48,912 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-38810532 passed 2025-09-08 03:18:48,913 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-38810532 in API_Server ====== 2025-09-08 03:18:48,913 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:48,921 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:48,939 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:49,059 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/c963cfd6-3add-47b6-96da-ca6c1c465d43 2025-09-08 03:18:49,073 - DEBUG - =>VN ctest-mgmt_vn-38810532 has no policy to be verified 2025-09-08 03:18:49,074 - DEBUG - Verifying the vn in opserver 2025-09-08 03:18:49,074 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532 virtual network link through opserver 10.0.0.41 2025-09-08 03:18:49,074 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:18:49,469 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:18:49,545 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532?flat'} 2025-09-08 03:18:49,545 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532 virtual network link through opserver 10.0.0.27 2025-09-08 03:18:49,545 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:18:49,897 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:18:49,970 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532?flat'} 2025-09-08 03:18:49,970 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532 virtual network link through opserver 10.0.0.38 2025-09-08 03:18:49,970 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:18:50,325 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:18:50,383 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532?flat'} 2025-09-08 03:18:50,383 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-38810532 is found in opserver 2025-09-08 03:18:50,430 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:18:50,451 - DEBUG - VRF ids for VN ctest-mgmt_vn-38810532: {} 2025-09-08 03:18:50,707 - DEBUG - Response for create_network : {'network': {'id': 'dcca3815-6ebf-4d1b-9038-e056f2533f0b', 'name': 'ctest-left_vn-28863168', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-left_vn-28863168'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:18:51,019 - DEBUG - Response for create_subnet : {'subnet': {'id': '74f22813-d30d-421b-aeff-b76afb82c4ea', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': 'dcca3815-6ebf-4d1b-9038-e056f2533f0b', 'ip_version': 4, 'cidr': '206.247.7.192/26', 'allocation_pools': [{'start': '206.247.7.194', 'end': '206.247.7.254'}], 'gateway_ip': '206.247.7.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.247.7.194', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:18:51,092 - INFO - Created VN ctest-left_vn-28863168 2025-09-08 03:18:51,109 - DEBUG - VN ctest-left_vn-28863168 UUID is dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,277 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:51,300 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:51,331 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:51,516 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,546 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,575 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/7f27a7c8-ff27-4d82-abc3-81d653fb4e1d 2025-09-08 03:18:51,595 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/7f27a7c8-ff27-4d82-abc3-81d653fb4e1d 2025-09-08 03:18:51,608 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ede6976f-bc1a-49e1-bd07-f817917d88bd 2025-09-08 03:18:51,622 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:18:51,622 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,636 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/7f27a7c8-ff27-4d82-abc3-81d653fb4e1d 2025-09-08 03:18:51,661 - INFO - Verified VN network id 15 for VN dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,661 - INFO - Verifications in API Server for VN ctest-left_vn-28863168 passed 2025-09-08 03:18:51,661 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,674 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/7f27a7c8-ff27-4d82-abc3-81d653fb4e1d 2025-09-08 03:18:51,686 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/7f27a7c8-ff27-4d82-abc3-81d653fb4e1d 2025-09-08 03:18:51,694 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ede6976f-bc1a-49e1-bd07-f817917d88bd 2025-09-08 03:18:51,709 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15909590298343197979', 'uuid-lslong': '10392302804194770699'}, 'enable': 'true', 'created': '2025-09-08T03:18:50', 'last-modified': '2025-09-08T03:18:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.781277'} 2025-09-08 03:18:51,716 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:18:51,724 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15909590298343197979', 'uuid-lslong': '10392302804194770699'}, 'enable': 'true', 'created': '2025-09-08T03:18:50', 'last-modified': '2025-09-08T03:18:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.806512'} 2025-09-08 03:18:51,732 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:18:51,739 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15909590298343197979', 'uuid-lslong': '10392302804194770699'}, 'enable': 'true', 'created': '2025-09-08T03:18:50', 'last-modified': '2025-09-08T03:18:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.815088'} 2025-09-08 03:18:51,746 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:18:51,746 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-28863168 passed 2025-09-08 03:18:51,746 - DEBUG - ====Verifying policy data for ctest-left_vn-28863168 in API_Server ====== 2025-09-08 03:18:51,748 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:51,755 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:51,769 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:51,859 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dcca3815-6ebf-4d1b-9038-e056f2533f0b 2025-09-08 03:18:51,876 - DEBUG - =>VN ctest-left_vn-28863168 has no policy to be verified 2025-09-08 03:18:51,876 - DEBUG - Verifying the vn in opserver 2025-09-08 03:18:51,876 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168 virtual network link through opserver 10.0.0.41 2025-09-08 03:18:51,876 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:18:51,947 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168?flat'} 2025-09-08 03:18:51,947 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168 virtual network link through opserver 10.0.0.27 2025-09-08 03:18:51,947 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:18:52,007 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168?flat'} 2025-09-08 03:18:52,007 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168 virtual network link through opserver 10.0.0.38 2025-09-08 03:18:52,007 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:18:52,082 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168?flat'} 2025-09-08 03:18:52,082 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-28863168 is found in opserver 2025-09-08 03:18:52,121 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:18:52,143 - DEBUG - VRF ids for VN ctest-left_vn-28863168: {} 2025-09-08 03:18:52,431 - DEBUG - Response for create_network : {'network': {'id': '99f96e84-1dc8-4783-9b54-ef684aa7e8e8', 'name': 'ctest-right_vn-58175644', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-right_vn-58175644'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:18:52,713 - DEBUG - Response for create_subnet : {'subnet': {'id': '14841b8f-4955-4c75-938b-eb5448b22a77', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': '99f96e84-1dc8-4783-9b54-ef684aa7e8e8', 'ip_version': 4, 'cidr': '162.242.87.192/26', 'allocation_pools': [{'start': '162.242.87.194', 'end': '162.242.87.254'}], 'gateway_ip': '162.242.87.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '162.242.87.194', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:18:52,740 - INFO - Created VN ctest-right_vn-58175644 2025-09-08 03:18:52,755 - DEBUG - VN ctest-right_vn-58175644 UUID is 99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:52,828 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:52,834 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:52,845 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:52,954 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:52,969 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:52,978 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9d73d9d0-a2a7-4756-bc0f-46df50825d31 2025-09-08 03:18:52,985 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9d73d9d0-a2a7-4756-bc0f-46df50825d31 2025-09-08 03:18:52,992 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/50609bc1-cbc2-4456-9bf8-d72bcc1a14da 2025-09-08 03:18:53,000 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:18:53,000 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:53,011 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9d73d9d0-a2a7-4756-bc0f-46df50825d31 2025-09-08 03:18:53,028 - INFO - Verified VN network id 16 for VN 99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:53,029 - INFO - Verifications in API Server for VN ctest-right_vn-58175644 passed 2025-09-08 03:18:53,029 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:53,038 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9d73d9d0-a2a7-4756-bc0f-46df50825d31 2025-09-08 03:18:53,046 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9d73d9d0-a2a7-4756-bc0f-46df50825d31 2025-09-08 03:18:53,056 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/50609bc1-cbc2-4456-9bf8-d72bcc1a14da 2025-09-08 03:18:53,068 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11095020670718330755', 'uuid-lslong': '11192834205130680552'}, 'enable': 'true', 'created': '2025-09-08T03:18:52', 'last-modified': '2025-09-08T03:18:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443509'} 2025-09-08 03:18:53,074 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:18:53,080 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11095020670718330755', 'uuid-lslong': '11192834205130680552'}, 'enable': 'true', 'created': '2025-09-08T03:18:52', 'last-modified': '2025-09-08T03:18:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449372'} 2025-09-08 03:18:53,087 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:18:53,093 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11095020670718330755', 'uuid-lslong': '11192834205130680552'}, 'enable': 'true', 'created': '2025-09-08T03:18:52', 'last-modified': '2025-09-08T03:18:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457147'} 2025-09-08 03:18:53,100 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:18:53,100 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-58175644 passed 2025-09-08 03:18:53,100 - DEBUG - ====Verifying policy data for ctest-right_vn-58175644 in API_Server ====== 2025-09-08 03:18:53,100 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:53,108 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:53,121 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:53,233 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/99f96e84-1dc8-4783-9b54-ef684aa7e8e8 2025-09-08 03:18:53,243 - DEBUG - =>VN ctest-right_vn-58175644 has no policy to be verified 2025-09-08 03:18:53,243 - DEBUG - Verifying the vn in opserver 2025-09-08 03:18:53,243 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644 virtual network link through opserver 10.0.0.41 2025-09-08 03:18:53,243 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:18:53,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644?flat'} 2025-09-08 03:18:53,308 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644 virtual network link through opserver 10.0.0.27 2025-09-08 03:18:53,308 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:18:53,373 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644?flat'} 2025-09-08 03:18:53,373 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644 virtual network link through opserver 10.0.0.38 2025-09-08 03:18:53,373 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:18:53,434 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644?flat'} 2025-09-08 03:18:53,434 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-58175644 is found in opserver 2025-09-08 03:18:53,475 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:18:53,495 - DEBUG - VRF ids for VN ctest-right_vn-58175644: {} 2025-09-08 03:18:53,563 - DEBUG - Services list from nova: [, , , ] 2025-09-08 03:18:55,007 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4041-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4041-1) 2025-09-08 03:18:56,424 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4041-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4041-2) 2025-09-08 03:18:56,425 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-66736289'] 2025-09-08 03:18:56,730 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-66736289'] created succesfully 2025-09-08 03:18:57,165 - DEBUG - Image by name tiny_nat_fw not found 2025-09-08 03:18:57,165 - DEBUG - Installing image tiny_nat_fw 2025-09-08 03:18:57,165 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-09-08 03:18:57,165 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-08 03:18:57,165 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-08 03:18:57,165 - DEBUG - Unzip image 2025-09-08 03:18:57,165 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-09-08 03:18:57,189 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-09-08 03:18:57,190 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-66736289'] 2025-09-08 03:18:57,295 - INFO - Service template: ['default-domain', 'ctest-service_template_1-66736289'] deleted successfully. 2025-09-08 03:18:57,295 - INFO - Skip interface_detach for VM ctest-right_vm-90182900 in state BUILD 2025-09-08 03:18:57,295 - INFO - Deleting VM ctest-right_vm-90182900 2025-09-08 03:18:57,348 - ERROR - VM ctest-right_vm-90182900 has failed to come up 2025-09-08 03:18:57,348 - ERROR - Nova failed to get host of the VM 2025-09-08 03:18:57,348 - ERROR - VM ctest-right_vm-90182900 has failed to come up 2025-09-08 03:18:57,348 - ERROR - Nova failed to get host of the VM 2025-09-08 03:18:57,461 - INFO - Skip interface_detach for VM ctest-left_vm-13420684 in state BUILD 2025-09-08 03:18:57,461 - INFO - Deleting VM ctest-left_vm-13420684 2025-09-08 03:18:57,461 - ERROR - VM ctest-left_vm-13420684 has failed to come up 2025-09-08 03:18:57,461 - ERROR - Nova failed to get host of the VM 2025-09-08 03:18:57,461 - ERROR - VM ctest-left_vm-13420684 has failed to come up 2025-09-08 03:18:57,462 - ERROR - Nova failed to get host of the VM 2025-09-08 03:18:57,554 - INFO - Deleting VN ctest-right_vn-58175644 2025-09-08 03:18:57,611 - DEBUG - VN 99f96e84-1dc8-4783-9b54-ef684aa7e8e8 still in use: Unable to complete operation on network 99f96e84-1dc8-4783-9b54-ef684aa7e8e8. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-644f919b-e78b-4ce9-8587-98953f637d76'] 2025-09-08 03:18:57,611 - WARNING - Deleting VN ctest-right_vn-58175644 failed..Will retry 2025-09-08 03:18:59,784 - DEBUG - Response for deleting network () 2025-09-08 03:18:59,784 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9d73d9d0-a2a7-4756-bc0f-46df50825d31 2025-09-08 03:18:59,800 - DEBUG - Response Code: 404 2025-09-08 03:18:59,800 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:18:59,811 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:18:59,829 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:18:59,942 - INFO - Validated that VN ctest-right_vn-58175644 is not found in API Server 2025-09-08 03:18:59,962 - DEBUG - VN ctest-right_vn-58175644 is not present in Agent 10.0.0.65 2025-09-08 03:19:00,008 - DEBUG - VN ctest-right_vn-58175644 is not present in Agent 10.0.0.23 2025-09-08 03:19:00,009 - INFO - Validated that VN ctest-right_vn-58175644 is not in any agent 2025-09-08 03:19:00,059 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-58175644 info 2025-09-08 03:19:00,059 - INFO - Deleting VN ctest-left_vn-28863168 2025-09-08 03:19:00,236 - DEBUG - Response for deleting network () 2025-09-08 03:19:00,236 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/7f27a7c8-ff27-4d82-abc3-81d653fb4e1d 2025-09-08 03:19:00,244 - DEBUG - Response Code: 404 2025-09-08 03:19:00,244 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:00,250 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:00,262 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:00,347 - INFO - Validated that VN ctest-left_vn-28863168 is not found in API Server 2025-09-08 03:19:00,369 - DEBUG - VN ctest-left_vn-28863168 is not present in Agent 10.0.0.65 2025-09-08 03:19:00,394 - DEBUG - VN ctest-left_vn-28863168 is not present in Agent 10.0.0.23 2025-09-08 03:19:00,394 - INFO - Validated that VN ctest-left_vn-28863168 is not in any agent 2025-09-08 03:19:00,439 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-28863168 info 2025-09-08 03:19:00,439 - INFO - Deleting VN ctest-mgmt_vn-38810532 2025-09-08 03:19:00,581 - DEBUG - Response for deleting network () 2025-09-08 03:19:00,581 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/04485587-329c-4956-a63e-52068b017ae4 2025-09-08 03:19:00,587 - DEBUG - Response Code: 404 2025-09-08 03:19:00,587 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:00,593 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:00,615 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:00,714 - INFO - Validated that VN ctest-mgmt_vn-38810532 is not found in API Server 2025-09-08 03:19:00,738 - DEBUG - VN ctest-mgmt_vn-38810532 is not present in Agent 10.0.0.65 2025-09-08 03:19:00,761 - DEBUG - VN ctest-mgmt_vn-38810532 is not present in Agent 10.0.0.23 2025-09-08 03:19:00,761 - INFO - Validated that VN ctest-mgmt_vn-38810532 is not in any agent 2025-09-08 03:19:00,804 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-38810532 info 2025-09-08 03:19:02,169 - DEBUG - No XMPP flaps were noticed during the test 2025-09-08 03:19:02,169 - INFO - 2025-09-08 03:19:02,169 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:17] 2025-09-08 03:19:02,169 - INFO - -------------------------------------------------------------------------------- 2025-09-08 03:19:02,172 - INFO - ================================================================================ 2025-09-08 03:19:02,172 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-09-08 03:19:03,560 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.14': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.25': '0', '10.20.0.129': '0'}} with 2025-09-08 03:19:03,560 - INFO - Initial checks done. Running the testcase now 2025-09-08 03:19:03,560 - INFO - 2025-09-08 03:19:03,871 - DEBUG - Response for create_network : {'network': {'id': 'be716c83-38ad-4451-8a76-f4822529c89b', 'name': 'ctest-mgmt_vn-47116869', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-mgmt_vn-47116869'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:19:04,137 - DEBUG - Response for create_subnet : {'subnet': {'id': '05c7a14e-1e4d-439c-a194-5aeb56359c6e', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': 'be716c83-38ad-4451-8a76-f4822529c89b', 'ip_version': 4, 'cidr': '4.179.220.64/26', 'allocation_pools': [{'start': '4.179.220.66', 'end': '4.179.220.126'}], 'gateway_ip': '4.179.220.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '4.179.220.66', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:19:04,162 - INFO - Created VN ctest-mgmt_vn-47116869 2025-09-08 03:19:04,173 - DEBUG - VN ctest-mgmt_vn-47116869 UUID is be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,257 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:04,265 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:04,277 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:04,377 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,394 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,407 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/54c7a395-4de2-4a38-b750-27cd12e9dedb 2025-09-08 03:19:04,418 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/54c7a395-4de2-4a38-b750-27cd12e9dedb 2025-09-08 03:19:04,428 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/70eedd99-42ff-4615-9321-41a87318fb66 2025-09-08 03:19:04,437 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:19:04,437 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,449 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/54c7a395-4de2-4a38-b750-27cd12e9dedb 2025-09-08 03:19:04,469 - INFO - Verified VN network id 14 for VN be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,469 - INFO - Verifications in API Server for VN ctest-mgmt_vn-47116869 passed 2025-09-08 03:19:04,469 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,480 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/54c7a395-4de2-4a38-b750-27cd12e9dedb 2025-09-08 03:19:04,490 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/54c7a395-4de2-4a38-b750-27cd12e9dedb 2025-09-08 03:19:04,499 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/70eedd99-42ff-4615-9321-41a87318fb66 2025-09-08 03:19:04,525 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13722868850422006865', 'uuid-lslong': '9977430864292333723'}, 'enable': 'true', 'created': '2025-09-08T03:19:03', 'last-modified': '2025-09-08T03:19:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467564'} 2025-09-08 03:19:04,539 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:19:04,548 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13722868850422006865', 'uuid-lslong': '9977430864292333723'}, 'enable': 'true', 'created': '2025-09-08T03:19:03', 'last-modified': '2025-09-08T03:19:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491502'} 2025-09-08 03:19:04,556 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:19:04,562 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13722868850422006865', 'uuid-lslong': '9977430864292333723'}, 'enable': 'true', 'created': '2025-09-08T03:19:03', 'last-modified': '2025-09-08T03:19:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506190'} 2025-09-08 03:19:04,568 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-08 03:19:04,568 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-47116869 passed 2025-09-08 03:19:04,569 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-47116869 in API_Server ====== 2025-09-08 03:19:04,569 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:04,576 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:04,588 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:04,695 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/be716c83-38ad-4451-8a76-f4822529c89b 2025-09-08 03:19:04,706 - DEBUG - =>VN ctest-mgmt_vn-47116869 has no policy to be verified 2025-09-08 03:19:04,706 - DEBUG - Verifying the vn in opserver 2025-09-08 03:19:04,706 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869 virtual network link through opserver 10.0.0.41 2025-09-08 03:19:04,706 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:19:04,724 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869?flat'} 2025-09-08 03:19:04,724 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869 virtual network link through opserver 10.0.0.27 2025-09-08 03:19:04,724 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:19:04,739 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869?flat'} 2025-09-08 03:19:04,739 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869 virtual network link through opserver 10.0.0.38 2025-09-08 03:19:04,739 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:19:04,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869?flat'} 2025-09-08 03:19:04,755 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-mgmt_vn-47116869 is found in opserver 2025-09-08 03:19:04,793 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:19:04,812 - DEBUG - VRF ids for VN ctest-mgmt_vn-47116869: {} 2025-09-08 03:19:05,090 - DEBUG - Response for create_network : {'network': {'id': '2406e0e7-9ed7-4c13-b733-dd67b5341d68', 'name': 'ctest-left_vn-80551921', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-left_vn-80551921'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:19:05,379 - DEBUG - Response for create_subnet : {'subnet': {'id': '23ea7edd-b1e8-415c-9270-9133413fbeee', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': '2406e0e7-9ed7-4c13-b733-dd67b5341d68', 'ip_version': 4, 'cidr': '206.219.122.192/26', 'allocation_pools': [{'start': '206.219.122.194', 'end': '206.219.122.254'}], 'gateway_ip': '206.219.122.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '206.219.122.194', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:19:05,405 - INFO - Created VN ctest-left_vn-80551921 2025-09-08 03:19:05,418 - DEBUG - VN ctest-left_vn-80551921 UUID is 2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,496 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:05,504 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:05,517 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:05,615 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,632 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,643 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1de25db-4144-4f95-943b-6b64b1905dd0 2025-09-08 03:19:05,651 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1de25db-4144-4f95-943b-6b64b1905dd0 2025-09-08 03:19:05,659 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5e472fa4-6b0a-42af-876c-31e6b9838ca6 2025-09-08 03:19:05,666 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:19:05,667 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,676 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1de25db-4144-4f95-943b-6b64b1905dd0 2025-09-08 03:19:05,692 - INFO - Verified VN network id 15 for VN 2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,693 - INFO - Verifications in API Server for VN ctest-left_vn-80551921 passed 2025-09-08 03:19:05,693 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,702 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1de25db-4144-4f95-943b-6b64b1905dd0 2025-09-08 03:19:05,711 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1de25db-4144-4f95-943b-6b64b1905dd0 2025-09-08 03:19:05,719 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5e472fa4-6b0a-42af-876c-31e6b9838ca6 2025-09-08 03:19:05,731 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2596009520632646675', 'uuid-lslong': '13201138370244517224'}, 'enable': 'true', 'created': '2025-09-08T03:19:05', 'last-modified': '2025-09-08T03:19:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405069'} 2025-09-08 03:19:05,737 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:19:05,742 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2596009520632646675', 'uuid-lslong': '13201138370244517224'}, 'enable': 'true', 'created': '2025-09-08T03:19:05', 'last-modified': '2025-09-08T03:19:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.416021'} 2025-09-08 03:19:05,749 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:19:05,755 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2596009520632646675', 'uuid-lslong': '13201138370244517224'}, 'enable': 'true', 'created': '2025-09-08T03:19:05', 'last-modified': '2025-09-08T03:19:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.426681'} 2025-09-08 03:19:05,761 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-09-08 03:19:05,761 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-80551921 passed 2025-09-08 03:19:05,761 - DEBUG - ====Verifying policy data for ctest-left_vn-80551921 in API_Server ====== 2025-09-08 03:19:05,761 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:05,768 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:05,780 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:05,884 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/2406e0e7-9ed7-4c13-b733-dd67b5341d68 2025-09-08 03:19:05,903 - DEBUG - =>VN ctest-left_vn-80551921 has no policy to be verified 2025-09-08 03:19:05,903 - DEBUG - Verifying the vn in opserver 2025-09-08 03:19:05,903 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921 virtual network link through opserver 10.0.0.41 2025-09-08 03:19:05,903 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:19:05,923 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921?flat'} 2025-09-08 03:19:05,923 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921 virtual network link through opserver 10.0.0.27 2025-09-08 03:19:05,923 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:19:05,936 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921?flat'} 2025-09-08 03:19:05,936 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921 virtual network link through opserver 10.0.0.38 2025-09-08 03:19:05,936 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:19:05,950 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921?flat'} 2025-09-08 03:19:05,950 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-left_vn-80551921 is found in opserver 2025-09-08 03:19:05,994 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:19:06,012 - DEBUG - VRF ids for VN ctest-left_vn-80551921: {} 2025-09-08 03:19:06,282 - DEBUG - Response for create_network : {'network': {'id': '20e70a29-5585-45d5-ac63-d2386fca0728', 'name': 'ctest-right_vn-01645833', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-right_vn-01645833'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:19:06,540 - DEBUG - Response for create_subnet : {'subnet': {'id': '3b923d61-0143-4d05-bfbf-6340c7dbaa67', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': '20e70a29-5585-45d5-ac63-d2386fca0728', 'ip_version': 4, 'cidr': '89.210.212.64/26', 'allocation_pools': [{'start': '89.210.212.66', 'end': '89.210.212.126'}], 'gateway_ip': '89.210.212.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '89.210.212.66', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:19:06,565 - INFO - Created VN ctest-right_vn-01645833 2025-09-08 03:19:06,580 - DEBUG - VN ctest-right_vn-01645833 UUID is 20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:06,664 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:06,672 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:06,686 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:06,781 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:06,794 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:06,805 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/56491478-fbd3-4f92-a468-902b1e98cb02 2025-09-08 03:19:06,812 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/56491478-fbd3-4f92-a468-902b1e98cb02 2025-09-08 03:19:06,819 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d3a35c74-6002-4948-9aae-73d8c4a980f3 2025-09-08 03:19:06,826 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:19:06,826 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:06,835 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/56491478-fbd3-4f92-a468-902b1e98cb02 2025-09-08 03:19:06,851 - INFO - Verified VN network id 16 for VN 20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:06,851 - INFO - Verifications in API Server for VN ctest-right_vn-01645833 passed 2025-09-08 03:19:06,851 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:06,860 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/56491478-fbd3-4f92-a468-902b1e98cb02 2025-09-08 03:19:06,868 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/56491478-fbd3-4f92-a468-902b1e98cb02 2025-09-08 03:19:06,876 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d3a35c74-6002-4948-9aae-73d8c4a980f3 2025-09-08 03:19:06,889 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2370874901478589909', 'uuid-lslong': '12422003337053472552'}, 'enable': 'true', 'created': '2025-09-08T03:19:06', 'last-modified': '2025-09-08T03:19:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435807'} 2025-09-08 03:19:06,898 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:19:06,905 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2370874901478589909', 'uuid-lslong': '12422003337053472552'}, 'enable': 'true', 'created': '2025-09-08T03:19:06', 'last-modified': '2025-09-08T03:19:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451191'} 2025-09-08 03:19:06,913 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:19:06,919 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2370874901478589909', 'uuid-lslong': '12422003337053472552'}, 'enable': 'true', 'created': '2025-09-08T03:19:06', 'last-modified': '2025-09-08T03:19:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462733'} 2025-09-08 03:19:06,926 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-08 03:19:06,926 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-01645833 passed 2025-09-08 03:19:06,926 - DEBUG - ====Verifying policy data for ctest-right_vn-01645833 in API_Server ====== 2025-09-08 03:19:06,926 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:06,939 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:06,952 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:07,061 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/20e70a29-5585-45d5-ac63-d2386fca0728 2025-09-08 03:19:07,081 - DEBUG - =>VN ctest-right_vn-01645833 has no policy to be verified 2025-09-08 03:19:07,081 - DEBUG - Verifying the vn in opserver 2025-09-08 03:19:07,082 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833 virtual network link through opserver 10.0.0.41 2025-09-08 03:19:07,082 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:19:07,104 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833?flat'} 2025-09-08 03:19:07,104 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833 virtual network link through opserver 10.0.0.27 2025-09-08 03:19:07,104 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:19:07,119 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833?flat'} 2025-09-08 03:19:07,119 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833 virtual network link through opserver 10.0.0.38 2025-09-08 03:19:07,119 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:19:07,139 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833?flat'} 2025-09-08 03:19:07,139 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-right_vn-01645833 is found in opserver 2025-09-08 03:19:07,175 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:19:07,205 - DEBUG - VRF ids for VN ctest-right_vn-01645833: {} 2025-09-08 03:19:07,656 - DEBUG - Response for create_network : {'network': {'id': 'b97b7ba9-e604-447c-976d-d0f022d49a89', 'name': 'ctest-trans_left_vn-58633292', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-trans_left_vn-58633292'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:19:07,895 - DEBUG - Response for create_subnet : {'subnet': {'id': '6decc59d-1387-4c95-9da5-67b419ed80ee', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': 'b97b7ba9-e604-447c-976d-d0f022d49a89', 'ip_version': 4, 'cidr': '198.74.187.192/26', 'allocation_pools': [{'start': '198.74.187.194', 'end': '198.74.187.254'}], 'gateway_ip': '198.74.187.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.74.187.194', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:19:07,917 - INFO - Created VN ctest-trans_left_vn-58633292 2025-09-08 03:19:07,930 - DEBUG - VN ctest-trans_left_vn-58633292 UUID is b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,010 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:08,017 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:08,031 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:08,123 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,137 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,147 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1a9d809-45b6-4ee3-963d-8d783be3e8c7 2025-09-08 03:19:08,155 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1a9d809-45b6-4ee3-963d-8d783be3e8c7 2025-09-08 03:19:08,162 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/8a0c4fcc-076d-479a-b8bb-76c49f040716 2025-09-08 03:19:08,170 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-08 03:19:08,170 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,180 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1a9d809-45b6-4ee3-963d-8d783be3e8c7 2025-09-08 03:19:08,197 - INFO - Verified VN network id 17 for VN b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,197 - INFO - Verifications in API Server for VN ctest-trans_left_vn-58633292 passed 2025-09-08 03:19:08,197 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,207 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1a9d809-45b6-4ee3-963d-8d783be3e8c7 2025-09-08 03:19:08,214 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1a9d809-45b6-4ee3-963d-8d783be3e8c7 2025-09-08 03:19:08,222 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/8a0c4fcc-076d-479a-b8bb-76c49f040716 2025-09-08 03:19:08,236 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13365412288790807676', 'uuid-lslong': '10911607201983666825'}, 'enable': 'true', 'created': '2025-09-08T03:19:07', 'last-modified': '2025-09-08T03:19:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394709'} 2025-09-08 03:19:08,243 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-08 03:19:08,248 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13365412288790807676', 'uuid-lslong': '10911607201983666825'}, 'enable': 'true', 'created': '2025-09-08T03:19:07', 'last-modified': '2025-09-08T03:19:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405751'} 2025-09-08 03:19:08,254 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-08 03:19:08,259 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13365412288790807676', 'uuid-lslong': '10911607201983666825'}, 'enable': 'true', 'created': '2025-09-08T03:19:07', 'last-modified': '2025-09-08T03:19:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417211'} 2025-09-08 03:19:08,264 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-09-08 03:19:08,264 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-58633292 passed 2025-09-08 03:19:08,265 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-58633292 in API_Server ====== 2025-09-08 03:19:08,265 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:08,276 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:08,290 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:08,382 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b97b7ba9-e604-447c-976d-d0f022d49a89 2025-09-08 03:19:08,408 - DEBUG - =>VN ctest-trans_left_vn-58633292 has no policy to be verified 2025-09-08 03:19:08,408 - DEBUG - Verifying the vn in opserver 2025-09-08 03:19:08,408 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292 virtual network link through opserver 10.0.0.41 2025-09-08 03:19:08,408 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:19:08,425 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292?flat'} 2025-09-08 03:19:08,425 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292 virtual network link through opserver 10.0.0.27 2025-09-08 03:19:08,425 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:19:08,442 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292?flat'} 2025-09-08 03:19:08,442 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292 virtual network link through opserver 10.0.0.38 2025-09-08 03:19:08,442 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:19:08,454 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292?flat'} 2025-09-08 03:19:08,454 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-trans_left_vn-58633292 is found in opserver 2025-09-08 03:19:08,483 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:19:08,494 - DEBUG - VRF ids for VN ctest-trans_left_vn-58633292: {} 2025-09-08 03:19:08,797 - DEBUG - Response for create_network : {'network': {'id': '5a11f758-0c13-4af7-8fee-0fa9128758ae', 'name': 'ctest-trans_right_vn-98944227', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'project_id': '45d6ccc161454cf192c57783fab77b1c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-59289858', 'ctest-trans_right_vn-98944227'], 'port_security_enabled': True, 'description': ''}} 2025-09-08 03:19:09,062 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e91bc1b7-0034-4ae2-a141-a7e64dbd78f6', 'name': '', 'tenant_id': '45d6ccc161454cf192c57783fab77b1c', 'network_id': '5a11f758-0c13-4af7-8fee-0fa9128758ae', 'ip_version': 4, 'cidr': '66.147.16.192/26', 'allocation_pools': [{'start': '66.147.16.194', 'end': '66.147.16.254'}], 'gateway_ip': '66.147.16.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '66.147.16.194', 'tags': [], 'project_id': '45d6ccc161454cf192c57783fab77b1c'}} 2025-09-08 03:19:09,095 - INFO - Created VN ctest-trans_right_vn-98944227 2025-09-08 03:19:09,107 - DEBUG - VN ctest-trans_right_vn-98944227 UUID is 5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,181 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:09,189 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:09,208 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:09,300 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,314 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,327 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cadc391a-1471-4ddb-9279-698b5a7023f5 2025-09-08 03:19:09,337 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cadc391a-1471-4ddb-9279-698b5a7023f5 2025-09-08 03:19:09,347 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/94a4945f-c2b0-47bb-a46d-47d39aa6f8cc 2025-09-08 03:19:09,357 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-08 03:19:09,357 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,370 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cadc391a-1471-4ddb-9279-698b5a7023f5 2025-09-08 03:19:09,391 - INFO - Verified VN network id 18 for VN 5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,391 - INFO - Verifications in API Server for VN ctest-trans_right_vn-98944227 passed 2025-09-08 03:19:09,392 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,402 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cadc391a-1471-4ddb-9279-698b5a7023f5 2025-09-08 03:19:09,410 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cadc391a-1471-4ddb-9279-698b5a7023f5 2025-09-08 03:19:09,419 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/94a4945f-c2b0-47bb-a46d-47d39aa6f8cc 2025-09-08 03:19:09,433 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6490240495549369079', 'uuid-lslong': '10371244210715580590'}, 'enable': 'true', 'created': '2025-09-08T03:19:08', 'last-modified': '2025-09-08T03:19:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.421839'} 2025-09-08 03:19:09,440 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-08 03:19:09,445 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6490240495549369079', 'uuid-lslong': '10371244210715580590'}, 'enable': 'true', 'created': '2025-09-08T03:19:08', 'last-modified': '2025-09-08T03:19:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430549'} 2025-09-08 03:19:09,451 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-08 03:19:09,457 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-59289858', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6490240495549369079', 'uuid-lslong': '10371244210715580590'}, 'enable': 'true', 'created': '2025-09-08T03:19:08', 'last-modified': '2025-09-08T03:19:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436426'} 2025-09-08 03:19:09,464 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-09-08 03:19:09,464 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-98944227 passed 2025-09-08 03:19:09,464 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-98944227 in API_Server ====== 2025-09-08 03:19:09,464 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:09,471 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:09,485 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:09,595 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/5a11f758-0c13-4af7-8fee-0fa9128758ae 2025-09-08 03:19:09,607 - DEBUG - =>VN ctest-trans_right_vn-98944227 has no policy to be verified 2025-09-08 03:19:09,607 - DEBUG - Verifying the vn in opserver 2025-09-08 03:19:09,607 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227 virtual network link through opserver 10.0.0.41 2025-09-08 03:19:09,607 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-08 03:19:09,622 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227?flat'} 2025-09-08 03:19:09,622 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227 virtual network link through opserver 10.0.0.27 2025-09-08 03:19:09,622 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-09-08 03:19:09,639 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227?flat'} 2025-09-08 03:19:09,639 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227 virtual network link through opserver 10.0.0.38 2025-09-08 03:19:09,639 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-09-08 03:19:09,652 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227?flat'} 2025-09-08 03:19:09,653 - INFO - Validated that VN default-domain:ctest-TestSvcHC-59289858:ctest-trans_right_vn-98944227 is found in opserver 2025-09-08 03:19:09,691 - DEBUG - Do not have enough data to verify VN in agent 2025-09-08 03:19:09,709 - DEBUG - VRF ids for VN ctest-trans_right_vn-98944227: {} 2025-09-08 03:19:10,900 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4041-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4041-2) 2025-09-08 03:19:12,371 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4041-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4041-1) 2025-09-08 03:19:12,372 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-99991944'] 2025-09-08 03:19:12,663 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-99991944'] created succesfully 2025-09-08 03:19:13,020 - DEBUG - Image by name tiny_trans_fw not found 2025-09-08 03:19:13,020 - DEBUG - Installing image tiny_trans_fw 2025-09-08 03:19:13,020 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-09-08 03:19:13,021 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-08 03:19:13,021 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-08 03:19:13,021 - DEBUG - Unzip image 2025-09-08 03:19:13,021 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-09-08 03:19:13,060 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-09-08 03:19:13,061 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-99991944'] 2025-09-08 03:19:13,203 - INFO - Service template: ['default-domain', 'ctest-service_template_1-99991944'] deleted successfully. 2025-09-08 03:19:13,203 - INFO - Skip interface_detach for VM ctest-right_vm-98501236 in state BUILD 2025-09-08 03:19:13,203 - INFO - Deleting VM ctest-right_vm-98501236 2025-09-08 03:19:13,204 - ERROR - VM ctest-right_vm-98501236 has failed to come up 2025-09-08 03:19:13,204 - ERROR - Nova failed to get host of the VM 2025-09-08 03:19:13,205 - ERROR - VM ctest-right_vm-98501236 has failed to come up 2025-09-08 03:19:13,205 - ERROR - Nova failed to get host of the VM 2025-09-08 03:19:13,314 - INFO - Skip interface_detach for VM ctest-left_vm-13585987 in state BUILD 2025-09-08 03:19:13,314 - INFO - Deleting VM ctest-left_vm-13585987 2025-09-08 03:19:13,315 - ERROR - VM ctest-left_vm-13585987 has failed to come up 2025-09-08 03:19:13,315 - ERROR - Nova failed to get host of the VM 2025-09-08 03:19:13,315 - ERROR - VM ctest-left_vm-13585987 has failed to come up 2025-09-08 03:19:13,315 - ERROR - Nova failed to get host of the VM 2025-09-08 03:19:13,430 - INFO - Deleting VN ctest-trans_right_vn-98944227 2025-09-08 03:19:13,634 - DEBUG - Response for deleting network () 2025-09-08 03:19:13,635 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cadc391a-1471-4ddb-9279-698b5a7023f5 2025-09-08 03:19:13,644 - DEBUG - Response Code: 404 2025-09-08 03:19:13,644 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:13,660 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:13,681 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:13,781 - INFO - Validated that VN ctest-trans_right_vn-98944227 is not found in API Server 2025-09-08 03:19:13,799 - DEBUG - VN ctest-trans_right_vn-98944227 is not present in Agent 10.0.0.65 2025-09-08 03:19:13,820 - DEBUG - VN ctest-trans_right_vn-98944227 is not present in Agent 10.0.0.23 2025-09-08 03:19:13,820 - INFO - Validated that VN ctest-trans_right_vn-98944227 is not in any agent 2025-09-08 03:19:13,862 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-98944227 info 2025-09-08 03:19:13,862 - INFO - Deleting VN ctest-trans_left_vn-58633292 2025-09-08 03:19:14,085 - DEBUG - Response for deleting network () 2025-09-08 03:19:14,085 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1a9d809-45b6-4ee3-963d-8d783be3e8c7 2025-09-08 03:19:14,097 - DEBUG - Response Code: 404 2025-09-08 03:19:14,097 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:14,109 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:14,169 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:14,270 - INFO - Validated that VN ctest-trans_left_vn-58633292 is not found in API Server 2025-09-08 03:19:14,287 - DEBUG - VN ctest-trans_left_vn-58633292 is not present in Agent 10.0.0.65 2025-09-08 03:19:14,307 - DEBUG - VN ctest-trans_left_vn-58633292 is not present in Agent 10.0.0.23 2025-09-08 03:19:14,307 - INFO - Validated that VN ctest-trans_left_vn-58633292 is not in any agent 2025-09-08 03:19:14,342 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-58633292 info 2025-09-08 03:19:14,342 - INFO - Deleting VN ctest-right_vn-01645833 2025-09-08 03:19:14,385 - DEBUG - VN 20e70a29-5585-45d5-ac63-d2386fca0728 still in use: Unable to complete operation on network 20e70a29-5585-45d5-ac63-d2386fca0728. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-44cf1a21-403e-4844-a007-ad517f1d7c05'] 2025-09-08 03:19:14,385 - WARNING - Deleting VN ctest-right_vn-01645833 failed..Will retry 2025-09-08 03:19:16,566 - DEBUG - Response for deleting network () 2025-09-08 03:19:16,566 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/56491478-fbd3-4f92-a468-902b1e98cb02 2025-09-08 03:19:16,578 - DEBUG - Response Code: 404 2025-09-08 03:19:16,578 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:16,588 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:16,643 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:16,736 - INFO - Validated that VN ctest-right_vn-01645833 is not found in API Server 2025-09-08 03:19:16,754 - DEBUG - VN ctest-right_vn-01645833 is not present in Agent 10.0.0.65 2025-09-08 03:19:16,773 - DEBUG - VN ctest-right_vn-01645833 is not present in Agent 10.0.0.23 2025-09-08 03:19:16,773 - INFO - Validated that VN ctest-right_vn-01645833 is not in any agent 2025-09-08 03:19:16,811 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-01645833 info 2025-09-08 03:19:16,811 - INFO - Deleting VN ctest-left_vn-80551921 2025-09-08 03:19:16,981 - DEBUG - Response for deleting network () 2025-09-08 03:19:16,981 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d1de25db-4144-4f95-943b-6b64b1905dd0 2025-09-08 03:19:16,988 - DEBUG - Response Code: 404 2025-09-08 03:19:16,988 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:16,995 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:17,014 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:17,116 - INFO - Validated that VN ctest-left_vn-80551921 is not found in API Server 2025-09-08 03:19:17,139 - DEBUG - VN ctest-left_vn-80551921 is not present in Agent 10.0.0.65 2025-09-08 03:19:17,159 - DEBUG - VN ctest-left_vn-80551921 is not present in Agent 10.0.0.23 2025-09-08 03:19:17,159 - INFO - Validated that VN ctest-left_vn-80551921 is not in any agent 2025-09-08 03:19:17,200 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-80551921 info 2025-09-08 03:19:17,201 - INFO - Deleting VN ctest-mgmt_vn-47116869 2025-09-08 03:19:17,373 - DEBUG - Response for deleting network () 2025-09-08 03:19:17,373 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/54c7a395-4de2-4a38-b750-27cd12e9dedb 2025-09-08 03:19:17,379 - DEBUG - Response Code: 404 2025-09-08 03:19:17,380 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-09-08 03:19:17,389 - DEBUG - Requesting: http://10.0.0.41:8082/domain/729830a9-0e71-496c-9bfd-570f28a4effe 2025-09-08 03:19:17,412 - DEBUG - Requesting: http://10.0.0.41:8082/project/45d6ccc1-6145-4cf1-92c5-7783fab77b1c 2025-09-08 03:19:17,513 - INFO - Validated that VN ctest-mgmt_vn-47116869 is not found in API Server 2025-09-08 03:19:17,540 - DEBUG - VN ctest-mgmt_vn-47116869 is not present in Agent 10.0.0.65 2025-09-08 03:19:17,563 - DEBUG - VN ctest-mgmt_vn-47116869 is not present in Agent 10.0.0.23 2025-09-08 03:19:17,564 - INFO - Validated that VN ctest-mgmt_vn-47116869 is not in any agent 2025-09-08 03:19:17,606 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-47116869 info 2025-09-08 03:19:19,047 - DEBUG - No XMPP flaps were noticed during the test 2025-09-08 03:19:19,047 - INFO - 2025-09-08 03:19:19,047 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:17] 2025-09-08 03:19:19,047 - INFO - -------------------------------------------------------------------------------- 2025-09-08 03:19:19,910 - INFO - Deleted project: ctest-TestSvcHC-59289858, ID : 45d6ccc1-6145-4cf1-92c5-7783fab77b1c