2025-08-07 03:14:28,714 - INFO - Domain Default found not creating 2025-08-07 03:14:28,891 - INFO - Project ctest-TestSvcHC-35985049 not found, creating it 2025-08-07 03:14:29,504 - INFO - Created Project:ctest-TestSvcHC-35985049, ID : 81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:31,056 - INFO - ================================================================================ 2025-08-07 03:14:31,056 - INFO - STARTING TEST : test_svc_hc_basic 2025-08-07 03:14:32,337 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 03:14:32,337 - INFO - Initial checks done. Running the testcase now 2025-08-07 03:14:32,337 - INFO - 2025-08-07 03:14:33,076 - DEBUG - Response for create_network : {'network': {'id': '536ed6e7-6300-40ae-bb97-99ac768d423b', 'name': 'ctest-mgmt_vn-44767698', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-mgmt_vn-44767698'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:33,402 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd29b94d1-5550-4530-8ef5-cfd11940f518', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': '536ed6e7-6300-40ae-bb97-99ac768d423b', 'ip_version': 4, 'cidr': '154.197.36.128/26', 'allocation_pools': [{'start': '154.197.36.130', 'end': '154.197.36.190'}], 'gateway_ip': '154.197.36.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '154.197.36.130', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:33,427 - INFO - Created VN ctest-mgmt_vn-44767698 2025-08-07 03:14:33,442 - DEBUG - VN ctest-mgmt_vn-44767698 UUID is 536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:33,524 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:33,831 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:33,864 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:33,884 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:33,993 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:34,008 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:34,019 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/588ae168-b174-4f2f-9b40-8cd682ab5323 2025-08-07 03:14:34,028 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/588ae168-b174-4f2f-9b40-8cd682ab5323 2025-08-07 03:14:34,038 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/82fb7977-9eba-4eea-a7da-3aee821b8896 2025-08-07 03:14:34,046 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:34,046 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:34,061 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/588ae168-b174-4f2f-9b40-8cd682ab5323 2025-08-07 03:14:34,082 - INFO - Verified VN network id 12 for VN 536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:34,083 - INFO - Verifications in API Server for VN ctest-mgmt_vn-44767698 passed 2025-08-07 03:14:34,083 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:34,095 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/588ae168-b174-4f2f-9b40-8cd682ab5323 2025-08-07 03:14:34,105 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/588ae168-b174-4f2f-9b40-8cd682ab5323 2025-08-07 03:14:34,114 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/82fb7977-9eba-4eea-a7da-3aee821b8896 2025-08-07 03:14:34,127 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6011978841872941230', 'uuid-lslong': '13517441772578226747'}, 'enable': 'true', 'created': '2025-08-07T03:14:32', 'last-modified': '2025-08-07T03:14:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.795644'} 2025-08-07 03:14:34,135 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:34,143 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6011978841872941230', 'uuid-lslong': '13517441772578226747'}, 'enable': 'true', 'created': '2025-08-07T03:14:32', 'last-modified': '2025-08-07T03:14:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.813277'} 2025-08-07 03:14:34,150 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:34,157 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6011978841872941230', 'uuid-lslong': '13517441772578226747'}, 'enable': 'true', 'created': '2025-08-07T03:14:32', 'last-modified': '2025-08-07T03:14:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.828656'} 2025-08-07 03:14:34,165 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:34,165 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-44767698 passed 2025-08-07 03:14:34,166 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-44767698 in API_Server ====== 2025-08-07 03:14:34,166 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:34,174 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:34,188 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:34,294 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/536ed6e7-6300-40ae-bb97-99ac768d423b 2025-08-07 03:14:34,305 - DEBUG - =>VN ctest-mgmt_vn-44767698 has no policy to be verified 2025-08-07 03:14:34,306 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:34,306 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:34,306 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:34,617 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:34,685 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698?flat'} 2025-08-07 03:14:34,685 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:34,685 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:34,996 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:35,068 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698?flat'} 2025-08-07 03:14:35,068 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:35,068 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:35,391 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:35,454 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698?flat'} 2025-08-07 03:14:35,454 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-44767698 is found in opserver 2025-08-07 03:14:35,483 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:35,495 - DEBUG - VRF ids for VN ctest-mgmt_vn-44767698: {} 2025-08-07 03:14:35,831 - DEBUG - Response for create_network : {'network': {'id': 'f2cc20d3-55b6-432c-b1ea-f29c05d72c9f', 'name': 'ctest-left_vn-25537319', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-left_vn-25537319'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:36,094 - DEBUG - Response for create_subnet : {'subnet': {'id': '55bae183-c9b0-4461-845d-913fec657bc1', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': 'f2cc20d3-55b6-432c-b1ea-f29c05d72c9f', 'ip_version': 4, 'cidr': '22.138.140.128/26', 'allocation_pools': [{'start': '22.138.140.130', 'end': '22.138.140.190'}], 'gateway_ip': '22.138.140.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '22.138.140.130', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:36,121 - INFO - Created VN ctest-left_vn-25537319 2025-08-07 03:14:36,142 - DEBUG - VN ctest-left_vn-25537319 UUID is f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,229 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:36,236 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:36,251 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:36,364 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,382 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,396 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/94fe3ca4-8cf5-4400-afff-d5a49419f7c2 2025-08-07 03:14:36,407 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/94fe3ca4-8cf5-4400-afff-d5a49419f7c2 2025-08-07 03:14:36,419 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/981b393b-0742-480e-8d93-5d30e07764ef 2025-08-07 03:14:36,430 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:36,430 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,444 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/94fe3ca4-8cf5-4400-afff-d5a49419f7c2 2025-08-07 03:14:36,466 - INFO - Verified VN network id 13 for VN f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,466 - INFO - Verifications in API Server for VN ctest-left_vn-25537319 passed 2025-08-07 03:14:36,466 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,480 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/94fe3ca4-8cf5-4400-afff-d5a49419f7c2 2025-08-07 03:14:36,492 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/94fe3ca4-8cf5-4400-afff-d5a49419f7c2 2025-08-07 03:14:36,504 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/981b393b-0742-480e-8d93-5d30e07764ef 2025-08-07 03:14:36,527 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17495394744475730732', 'uuid-lslong': '12820326041190345887'}, 'enable': 'true', 'created': '2025-08-07T03:14:35', 'last-modified': '2025-08-07T03:14:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493153'} 2025-08-07 03:14:36,536 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:36,544 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17495394744475730732', 'uuid-lslong': '12820326041190345887'}, 'enable': 'true', 'created': '2025-08-07T03:14:35', 'last-modified': '2025-08-07T03:14:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.515781'} 2025-08-07 03:14:36,553 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:36,561 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17495394744475730732', 'uuid-lslong': '12820326041190345887'}, 'enable': 'true', 'created': '2025-08-07T03:14:35', 'last-modified': '2025-08-07T03:14:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.531731'} 2025-08-07 03:14:36,570 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:36,570 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-25537319 passed 2025-08-07 03:14:36,570 - DEBUG - ====Verifying policy data for ctest-left_vn-25537319 in API_Server ====== 2025-08-07 03:14:36,570 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:36,578 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:36,595 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:36,698 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/f2cc20d3-55b6-432c-b1ea-f29c05d72c9f 2025-08-07 03:14:36,718 - DEBUG - =>VN ctest-left_vn-25537319 has no policy to be verified 2025-08-07 03:14:36,718 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:36,718 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:36,719 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:36,783 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319?flat'} 2025-08-07 03:14:36,783 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:36,783 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:36,862 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319?flat'} 2025-08-07 03:14:36,862 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:36,862 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:36,941 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319?flat'} 2025-08-07 03:14:36,941 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-25537319 is found in opserver 2025-08-07 03:14:36,971 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:36,984 - DEBUG - VRF ids for VN ctest-left_vn-25537319: {} 2025-08-07 03:14:37,305 - DEBUG - Response for create_network : {'network': {'id': '328a40db-aaf9-4c5e-8a32-d65d1664af5e', 'name': 'ctest-right_vn-65392594', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-right_vn-65392594'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:37,604 - DEBUG - Response for create_subnet : {'subnet': {'id': '7bb0411b-e87e-43ee-a68a-39dcbfdc364e', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': '328a40db-aaf9-4c5e-8a32-d65d1664af5e', 'ip_version': 4, 'cidr': '195.89.164.0/26', 'allocation_pools': [{'start': '195.89.164.2', 'end': '195.89.164.62'}], 'gateway_ip': '195.89.164.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '195.89.164.2', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:37,629 - INFO - Created VN ctest-right_vn-65392594 2025-08-07 03:14:37,644 - DEBUG - VN ctest-right_vn-65392594 UUID is 328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:37,733 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:37,742 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:37,759 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:37,875 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:37,890 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:37,904 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/5281feb2-08f0-437a-9b09-4ed33d397203 2025-08-07 03:14:37,917 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/5281feb2-08f0-437a-9b09-4ed33d397203 2025-08-07 03:14:37,929 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/ad868fb1-3ec7-4fe0-9138-01f9dbebb8c6 2025-08-07 03:14:37,939 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:37,939 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:37,958 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/5281feb2-08f0-437a-9b09-4ed33d397203 2025-08-07 03:14:37,977 - INFO - Verified VN network id 14 for VN 328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:37,977 - INFO - Verifications in API Server for VN ctest-right_vn-65392594 passed 2025-08-07 03:14:37,978 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:37,991 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/5281feb2-08f0-437a-9b09-4ed33d397203 2025-08-07 03:14:38,000 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/5281feb2-08f0-437a-9b09-4ed33d397203 2025-08-07 03:14:38,011 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/ad868fb1-3ec7-4fe0-9138-01f9dbebb8c6 2025-08-07 03:14:38,026 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3641794560892947550', 'uuid-lslong': '9958257421365587806'}, 'enable': 'true', 'created': '2025-08-07T03:14:37', 'last-modified': '2025-08-07T03:14:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.488897'} 2025-08-07 03:14:38,034 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:38,042 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3641794560892947550', 'uuid-lslong': '9958257421365587806'}, 'enable': 'true', 'created': '2025-08-07T03:14:37', 'last-modified': '2025-08-07T03:14:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.504597'} 2025-08-07 03:14:38,051 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:38,059 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3641794560892947550', 'uuid-lslong': '9958257421365587806'}, 'enable': 'true', 'created': '2025-08-07T03:14:37', 'last-modified': '2025-08-07T03:14:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.527106'} 2025-08-07 03:14:38,067 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:38,067 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-65392594 passed 2025-08-07 03:14:38,067 - DEBUG - ====Verifying policy data for ctest-right_vn-65392594 in API_Server ====== 2025-08-07 03:14:38,067 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:38,076 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:38,092 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:38,207 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/328a40db-aaf9-4c5e-8a32-d65d1664af5e 2025-08-07 03:14:38,223 - DEBUG - =>VN ctest-right_vn-65392594 has no policy to be verified 2025-08-07 03:14:38,223 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:38,223 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:38,223 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:38,293 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594?flat'} 2025-08-07 03:14:38,293 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:38,293 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:38,367 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594?flat'} 2025-08-07 03:14:38,367 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:38,367 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:38,438 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594?flat'} 2025-08-07 03:14:38,439 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-65392594 is found in opserver 2025-08-07 03:14:38,467 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:38,481 - DEBUG - VRF ids for VN ctest-right_vn-65392594: {} 2025-08-07 03:14:38,544 - DEBUG - Services list from nova: [, , , ] 2025-08-07 03:14:39,702 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3767-2) 2025-08-07 03:14:41,070 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3767-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3767-1) 2025-08-07 03:14:41,070 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-30156679'] 2025-08-07 03:14:41,399 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-30156679'] created succesfully 2025-08-07 03:14:41,825 - DEBUG - Image by name tiny_nat_fw not found 2025-08-07 03:14:41,825 - DEBUG - Installing image tiny_nat_fw 2025-08-07 03:14:41,825 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-08-07 03:14:41,826 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-07 03:14:41,826 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-07 03:14:41,826 - DEBUG - Unzip image 2025-08-07 03:14:41,826 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-08-07 03:14:41,867 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-08-07 03:14:41,868 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-30156679'] 2025-08-07 03:14:41,982 - INFO - Service template: ['default-domain', 'ctest-service_template_1-30156679'] deleted successfully. 2025-08-07 03:14:41,982 - INFO - Skip interface_detach for VM ctest-right_vm-36291311 in state BUILD 2025-08-07 03:14:41,982 - INFO - Deleting VM ctest-right_vm-36291311 2025-08-07 03:14:42,053 - ERROR - VM ctest-right_vm-36291311 has failed to come up 2025-08-07 03:14:42,053 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:42,053 - ERROR - VM ctest-right_vm-36291311 has failed to come up 2025-08-07 03:14:42,053 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:42,142 - INFO - Skip interface_detach for VM ctest-left_vm-49087479 in state BUILD 2025-08-07 03:14:42,143 - INFO - Deleting VM ctest-left_vm-49087479 2025-08-07 03:14:42,143 - ERROR - VM ctest-left_vm-49087479 has failed to come up 2025-08-07 03:14:42,143 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:42,143 - ERROR - VM ctest-left_vm-49087479 has failed to come up 2025-08-07 03:14:42,143 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:42,226 - INFO - Deleting VN ctest-right_vn-65392594 2025-08-07 03:14:42,283 - DEBUG - VN 328a40db-aaf9-4c5e-8a32-d65d1664af5e still in use: Unable to complete operation on network 328a40db-aaf9-4c5e-8a32-d65d1664af5e. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-20a7bc18-a429-4d7b-a32c-afacde589ded'] 2025-08-07 03:14:42,283 - WARNING - Deleting VN ctest-right_vn-65392594 failed..Will retry 2025-08-07 03:14:44,476 - DEBUG - Response for deleting network () 2025-08-07 03:14:44,477 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/5281feb2-08f0-437a-9b09-4ed33d397203 2025-08-07 03:14:44,488 - DEBUG - Response Code: 404 2025-08-07 03:14:44,489 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:44,500 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:44,548 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:44,627 - INFO - Validated that VN ctest-right_vn-65392594 is not found in API Server 2025-08-07 03:14:44,646 - DEBUG - VN ctest-right_vn-65392594 is not present in Agent 10.0.0.41 2025-08-07 03:14:44,658 - DEBUG - VN ctest-right_vn-65392594 is not present in Agent 10.0.0.61 2025-08-07 03:14:44,659 - INFO - Validated that VN ctest-right_vn-65392594 is not in any agent 2025-08-07 03:14:44,699 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-65392594 info 2025-08-07 03:14:44,700 - INFO - Deleting VN ctest-left_vn-25537319 2025-08-07 03:14:44,895 - DEBUG - Response for deleting network () 2025-08-07 03:14:44,896 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/94fe3ca4-8cf5-4400-afff-d5a49419f7c2 2025-08-07 03:14:44,904 - DEBUG - Response Code: 404 2025-08-07 03:14:44,904 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:44,926 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:44,955 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:45,090 - INFO - Validated that VN ctest-left_vn-25537319 is not found in API Server 2025-08-07 03:14:45,108 - DEBUG - VN ctest-left_vn-25537319 is not present in Agent 10.0.0.41 2025-08-07 03:14:45,124 - DEBUG - VN ctest-left_vn-25537319 is not present in Agent 10.0.0.61 2025-08-07 03:14:45,124 - INFO - Validated that VN ctest-left_vn-25537319 is not in any agent 2025-08-07 03:14:45,166 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-25537319 info 2025-08-07 03:14:45,166 - INFO - Deleting VN ctest-mgmt_vn-44767698 2025-08-07 03:14:45,355 - DEBUG - Response for deleting network () 2025-08-07 03:14:45,355 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/588ae168-b174-4f2f-9b40-8cd682ab5323 2025-08-07 03:14:45,362 - DEBUG - Response Code: 404 2025-08-07 03:14:45,363 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:45,371 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:45,401 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:45,522 - INFO - Validated that VN ctest-mgmt_vn-44767698 is not found in API Server 2025-08-07 03:14:45,542 - DEBUG - VN ctest-mgmt_vn-44767698 is not present in Agent 10.0.0.41 2025-08-07 03:14:45,555 - DEBUG - VN ctest-mgmt_vn-44767698 is not present in Agent 10.0.0.61 2025-08-07 03:14:45,555 - INFO - Validated that VN ctest-mgmt_vn-44767698 is not in any agent 2025-08-07 03:14:45,603 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-44767698 info 2025-08-07 03:14:46,915 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 03:14:46,915 - INFO - 2025-08-07 03:14:46,915 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:15] 2025-08-07 03:14:46,916 - INFO - -------------------------------------------------------------------------------- 2025-08-07 03:14:46,924 - INFO - ================================================================================ 2025-08-07 03:14:46,924 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-08-07 03:14:48,219 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 03:14:48,219 - INFO - Initial checks done. Running the testcase now 2025-08-07 03:14:48,219 - INFO - 2025-08-07 03:14:48,543 - DEBUG - Response for create_network : {'network': {'id': '35e6b366-d387-40ac-aa0d-c57fa162cd74', 'name': 'ctest-mgmt_vn-06000014', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-mgmt_vn-06000014'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:48,782 - DEBUG - Response for create_subnet : {'subnet': {'id': '67e7144f-287d-4640-a099-c3108419796c', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': '35e6b366-d387-40ac-aa0d-c57fa162cd74', 'ip_version': 4, 'cidr': '81.213.45.128/26', 'allocation_pools': [{'start': '81.213.45.130', 'end': '81.213.45.190'}], 'gateway_ip': '81.213.45.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '81.213.45.130', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:48,809 - INFO - Created VN ctest-mgmt_vn-06000014 2025-08-07 03:14:48,824 - DEBUG - VN ctest-mgmt_vn-06000014 UUID is 35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:48,912 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:48,919 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:48,935 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:49,034 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:49,058 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:49,071 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/da83d037-1fb1-403e-ac55-f821000ac0eb 2025-08-07 03:14:49,081 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/da83d037-1fb1-403e-ac55-f821000ac0eb 2025-08-07 03:14:49,090 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/49af147a-f32a-4645-8b76-11949dc3e31b 2025-08-07 03:14:49,098 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:49,098 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:49,110 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/da83d037-1fb1-403e-ac55-f821000ac0eb 2025-08-07 03:14:49,131 - INFO - Verified VN network id 12 for VN 35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:49,131 - INFO - Verifications in API Server for VN ctest-mgmt_vn-06000014 passed 2025-08-07 03:14:49,131 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:49,145 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/da83d037-1fb1-403e-ac55-f821000ac0eb 2025-08-07 03:14:49,155 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/da83d037-1fb1-403e-ac55-f821000ac0eb 2025-08-07 03:14:49,165 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/49af147a-f32a-4645-8b76-11949dc3e31b 2025-08-07 03:14:49,186 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3883988982870524076', 'uuid-lslong': '12253667313104113012'}, 'enable': 'true', 'created': '2025-08-07T03:14:48', 'last-modified': '2025-08-07T03:14:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463583'} 2025-08-07 03:14:49,196 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:49,202 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3883988982870524076', 'uuid-lslong': '12253667313104113012'}, 'enable': 'true', 'created': '2025-08-07T03:14:48', 'last-modified': '2025-08-07T03:14:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.472013'} 2025-08-07 03:14:49,212 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:49,219 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3883988982870524076', 'uuid-lslong': '12253667313104113012'}, 'enable': 'true', 'created': '2025-08-07T03:14:48', 'last-modified': '2025-08-07T03:14:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.498565'} 2025-08-07 03:14:49,227 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-07 03:14:49,227 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-06000014 passed 2025-08-07 03:14:49,227 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-06000014 in API_Server ====== 2025-08-07 03:14:49,227 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:49,236 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:49,252 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:49,356 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/35e6b366-d387-40ac-aa0d-c57fa162cd74 2025-08-07 03:14:49,370 - DEBUG - =>VN ctest-mgmt_vn-06000014 has no policy to be verified 2025-08-07 03:14:49,370 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:49,370 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:49,370 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:49,387 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014?flat'} 2025-08-07 03:14:49,387 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:49,387 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:49,404 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014?flat'} 2025-08-07 03:14:49,404 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:49,405 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:49,420 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014?flat'} 2025-08-07 03:14:49,420 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-mgmt_vn-06000014 is found in opserver 2025-08-07 03:14:49,448 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:49,464 - DEBUG - VRF ids for VN ctest-mgmt_vn-06000014: {} 2025-08-07 03:14:49,786 - DEBUG - Response for create_network : {'network': {'id': 'c9531848-1acf-43d8-9a8e-33270618cf6f', 'name': 'ctest-left_vn-88028456', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-left_vn-88028456'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:50,074 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e55cc34f-b851-45bb-8e47-ecfd3cb00d38', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': 'c9531848-1acf-43d8-9a8e-33270618cf6f', 'ip_version': 4, 'cidr': '73.76.5.0/26', 'allocation_pools': [{'start': '73.76.5.2', 'end': '73.76.5.62'}], 'gateway_ip': '73.76.5.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.76.5.2', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:50,096 - INFO - Created VN ctest-left_vn-88028456 2025-08-07 03:14:50,111 - DEBUG - VN ctest-left_vn-88028456 UUID is c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,191 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:50,199 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:50,213 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:50,318 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,338 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,351 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/ae5ba36a-55c5-4fe8-8415-4cdb6d073745 2025-08-07 03:14:50,362 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/ae5ba36a-55c5-4fe8-8415-4cdb6d073745 2025-08-07 03:14:50,370 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/abf703ca-001e-49e2-83a0-509d5a06cb4a 2025-08-07 03:14:50,379 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:50,381 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,395 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/ae5ba36a-55c5-4fe8-8415-4cdb6d073745 2025-08-07 03:14:50,416 - INFO - Verified VN network id 13 for VN c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,416 - INFO - Verifications in API Server for VN ctest-left_vn-88028456 passed 2025-08-07 03:14:50,417 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,431 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/ae5ba36a-55c5-4fe8-8415-4cdb6d073745 2025-08-07 03:14:50,441 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/ae5ba36a-55c5-4fe8-8415-4cdb6d073745 2025-08-07 03:14:50,453 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/abf703ca-001e-49e2-83a0-509d5a06cb4a 2025-08-07 03:14:50,469 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14506965522657002456', 'uuid-lslong': '11136895171232845679'}, 'enable': 'true', 'created': '2025-08-07T03:14:49', 'last-modified': '2025-08-07T03:14:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.472792'} 2025-08-07 03:14:50,478 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:50,486 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14506965522657002456', 'uuid-lslong': '11136895171232845679'}, 'enable': 'true', 'created': '2025-08-07T03:14:49', 'last-modified': '2025-08-07T03:14:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486479'} 2025-08-07 03:14:50,495 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:50,502 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14506965522657002456', 'uuid-lslong': '11136895171232845679'}, 'enable': 'true', 'created': '2025-08-07T03:14:49', 'last-modified': '2025-08-07T03:14:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493300'} 2025-08-07 03:14:50,511 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-08-07 03:14:50,511 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-88028456 passed 2025-08-07 03:14:50,512 - DEBUG - ====Verifying policy data for ctest-left_vn-88028456 in API_Server ====== 2025-08-07 03:14:50,512 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:50,520 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:50,543 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:50,669 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/c9531848-1acf-43d8-9a8e-33270618cf6f 2025-08-07 03:14:50,683 - DEBUG - =>VN ctest-left_vn-88028456 has no policy to be verified 2025-08-07 03:14:50,683 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:50,683 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:50,683 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:50,700 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456?flat'} 2025-08-07 03:14:50,701 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:50,701 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:50,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456?flat'} 2025-08-07 03:14:50,722 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:50,722 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:50,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456?flat'} 2025-08-07 03:14:50,741 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-left_vn-88028456 is found in opserver 2025-08-07 03:14:50,769 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:50,784 - DEBUG - VRF ids for VN ctest-left_vn-88028456: {} 2025-08-07 03:14:51,134 - DEBUG - Response for create_network : {'network': {'id': '6d35e714-a153-4d55-b134-cd94b859fb0d', 'name': 'ctest-right_vn-22758869', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-right_vn-22758869'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:51,427 - DEBUG - Response for create_subnet : {'subnet': {'id': '5e6cb5ee-31e5-4f7c-bf42-2a0200e88e31', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': '6d35e714-a153-4d55-b134-cd94b859fb0d', 'ip_version': 4, 'cidr': '24.105.177.192/26', 'allocation_pools': [{'start': '24.105.177.194', 'end': '24.105.177.254'}], 'gateway_ip': '24.105.177.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '24.105.177.194', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:51,456 - INFO - Created VN ctest-right_vn-22758869 2025-08-07 03:14:51,477 - DEBUG - VN ctest-right_vn-22758869 UUID is 6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:51,570 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:51,588 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:51,611 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:51,794 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:51,840 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:51,867 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/dfe633b8-2aae-4a43-b46b-389cd9941135 2025-08-07 03:14:51,888 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/dfe633b8-2aae-4a43-b46b-389cd9941135 2025-08-07 03:14:51,904 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/7c28e3b7-f154-4f33-8859-16445400bda1 2025-08-07 03:14:51,918 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:51,918 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:51,966 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/dfe633b8-2aae-4a43-b46b-389cd9941135 2025-08-07 03:14:52,021 - INFO - Verified VN network id 14 for VN 6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:52,021 - INFO - Verifications in API Server for VN ctest-right_vn-22758869 passed 2025-08-07 03:14:52,021 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:52,047 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/dfe633b8-2aae-4a43-b46b-389cd9941135 2025-08-07 03:14:52,075 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/dfe633b8-2aae-4a43-b46b-389cd9941135 2025-08-07 03:14:52,101 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/7c28e3b7-f154-4f33-8859-16445400bda1 2025-08-07 03:14:52,134 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7869449999691763029', 'uuid-lslong': '12769056882133957389'}, 'enable': 'true', 'created': '2025-08-07T03:14:51', 'last-modified': '2025-08-07T03:14:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.791295'} 2025-08-07 03:14:52,143 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:52,150 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7869449999691763029', 'uuid-lslong': '12769056882133957389'}, 'enable': 'true', 'created': '2025-08-07T03:14:51', 'last-modified': '2025-08-07T03:14:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.808636'} 2025-08-07 03:14:52,169 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:52,180 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7869449999691763029', 'uuid-lslong': '12769056882133957389'}, 'enable': 'true', 'created': '2025-08-07T03:14:51', 'last-modified': '2025-08-07T03:14:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.838609'} 2025-08-07 03:14:52,191 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-08-07 03:14:52,191 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-22758869 passed 2025-08-07 03:14:52,192 - DEBUG - ====Verifying policy data for ctest-right_vn-22758869 in API_Server ====== 2025-08-07 03:14:52,192 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:52,203 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:52,250 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:52,358 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/6d35e714-a153-4d55-b134-cd94b859fb0d 2025-08-07 03:14:52,382 - DEBUG - =>VN ctest-right_vn-22758869 has no policy to be verified 2025-08-07 03:14:52,382 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:52,382 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:52,382 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:52,401 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869?flat'} 2025-08-07 03:14:52,401 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:52,401 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:52,417 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869?flat'} 2025-08-07 03:14:52,417 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:52,418 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:52,435 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869?flat'} 2025-08-07 03:14:52,435 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-right_vn-22758869 is found in opserver 2025-08-07 03:14:52,469 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:52,484 - DEBUG - VRF ids for VN ctest-right_vn-22758869: {} 2025-08-07 03:14:52,854 - DEBUG - Response for create_network : {'network': {'id': '40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5', 'name': 'ctest-trans_left_vn-87859091', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-trans_left_vn-87859091'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:53,124 - DEBUG - Response for create_subnet : {'subnet': {'id': '50a4e1d1-d7ae-4d24-8240-125bfd4a868a', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': '40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5', 'ip_version': 4, 'cidr': '66.235.199.128/26', 'allocation_pools': [{'start': '66.235.199.130', 'end': '66.235.199.190'}], 'gateway_ip': '66.235.199.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '66.235.199.130', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:53,150 - INFO - Created VN ctest-trans_left_vn-87859091 2025-08-07 03:14:53,163 - DEBUG - VN ctest-trans_left_vn-87859091 UUID is 40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,255 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:53,263 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:53,279 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:53,388 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,408 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,424 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/15b05971-9bf5-4313-bba1-faeef6e5b402 2025-08-07 03:14:53,442 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/15b05971-9bf5-4313-bba1-faeef6e5b402 2025-08-07 03:14:53,452 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/23c1e145-8f4d-41d4-a4a8-c8b516b63592 2025-08-07 03:14:53,461 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-07 03:14:53,461 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,476 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/15b05971-9bf5-4313-bba1-faeef6e5b402 2025-08-07 03:14:53,498 - INFO - Verified VN network id 15 for VN 40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,498 - INFO - Verifications in API Server for VN ctest-trans_left_vn-87859091 passed 2025-08-07 03:14:53,498 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,511 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/15b05971-9bf5-4313-bba1-faeef6e5b402 2025-08-07 03:14:53,522 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/15b05971-9bf5-4313-bba1-faeef6e5b402 2025-08-07 03:14:53,531 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/23c1e145-8f4d-41d4-a4a8-c8b516b63592 2025-08-07 03:14:53,545 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4666358255235125211', 'uuid-lslong': '13327463476143789285'}, 'enable': 'true', 'created': '2025-08-07T03:14:52', 'last-modified': '2025-08-07T03:14:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492596'} 2025-08-07 03:14:53,552 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-07 03:14:53,560 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4666358255235125211', 'uuid-lslong': '13327463476143789285'}, 'enable': 'true', 'created': '2025-08-07T03:14:52', 'last-modified': '2025-08-07T03:14:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.505985'} 2025-08-07 03:14:53,568 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-07 03:14:53,574 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4666358255235125211', 'uuid-lslong': '13327463476143789285'}, 'enable': 'true', 'created': '2025-08-07T03:14:52', 'last-modified': '2025-08-07T03:14:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.512984'} 2025-08-07 03:14:53,581 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-08-07 03:14:53,582 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-87859091 passed 2025-08-07 03:14:53,582 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-87859091 in API_Server ====== 2025-08-07 03:14:53,582 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:53,589 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:53,602 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:53,714 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/40c23c1c-1600-4fdb-b8f4-a96b6c8b14e5 2025-08-07 03:14:53,727 - DEBUG - =>VN ctest-trans_left_vn-87859091 has no policy to be verified 2025-08-07 03:14:53,727 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:53,727 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:53,727 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:53,744 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091?flat'} 2025-08-07 03:14:53,744 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:53,744 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:53,761 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091?flat'} 2025-08-07 03:14:53,761 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:53,761 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:53,779 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091?flat'} 2025-08-07 03:14:53,779 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-trans_left_vn-87859091 is found in opserver 2025-08-07 03:14:53,810 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:53,826 - DEBUG - VRF ids for VN ctest-trans_left_vn-87859091: {} 2025-08-07 03:14:54,133 - DEBUG - Response for create_network : {'network': {'id': '90165a4e-ef85-4b1c-926c-8d229c19819b', 'name': 'ctest-trans_right_vn-76062212', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'project_id': '81a2f1043342403b87c8c90de09cb21e', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-35985049', 'ctest-trans_right_vn-76062212'], 'port_security_enabled': True, 'description': ''}} 2025-08-07 03:14:54,379 - DEBUG - Response for create_subnet : {'subnet': {'id': '1d767ad7-0324-4f10-a682-78f9209354c9', 'name': '', 'tenant_id': '81a2f1043342403b87c8c90de09cb21e', 'network_id': '90165a4e-ef85-4b1c-926c-8d229c19819b', 'ip_version': 4, 'cidr': '41.163.210.192/26', 'allocation_pools': [{'start': '41.163.210.194', 'end': '41.163.210.254'}], 'gateway_ip': '41.163.210.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.163.210.194', 'tags': [], 'project_id': '81a2f1043342403b87c8c90de09cb21e'}} 2025-08-07 03:14:54,407 - INFO - Created VN ctest-trans_right_vn-76062212 2025-08-07 03:14:54,422 - DEBUG - VN ctest-trans_right_vn-76062212 UUID is 90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,512 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:54,519 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:54,533 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:54,629 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,644 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,657 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/78136a71-2338-4a9d-b68c-415d6d0797e2 2025-08-07 03:14:54,668 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/78136a71-2338-4a9d-b68c-415d6d0797e2 2025-08-07 03:14:54,677 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e0c56e38-dab5-4b29-930f-418571b74c17 2025-08-07 03:14:54,686 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-07 03:14:54,686 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,697 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/78136a71-2338-4a9d-b68c-415d6d0797e2 2025-08-07 03:14:54,717 - INFO - Verified VN network id 16 for VN 90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,717 - INFO - Verifications in API Server for VN ctest-trans_right_vn-76062212 passed 2025-08-07 03:14:54,717 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,731 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/78136a71-2338-4a9d-b68c-415d6d0797e2 2025-08-07 03:14:54,742 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/78136a71-2338-4a9d-b68c-415d6d0797e2 2025-08-07 03:14:54,751 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/e0c56e38-dab5-4b29-930f-418571b74c17 2025-08-07 03:14:54,768 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10382585286021696284', 'uuid-lslong': '10550963206809551259'}, 'enable': 'true', 'created': '2025-08-07T03:14:54', 'last-modified': '2025-08-07T03:14:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449979'} 2025-08-07 03:14:54,779 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-07 03:14:54,786 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10382585286021696284', 'uuid-lslong': '10550963206809551259'}, 'enable': 'true', 'created': '2025-08-07T03:14:54', 'last-modified': '2025-08-07T03:14:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.471057'} 2025-08-07 03:14:54,795 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-07 03:14:54,802 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-35985049', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10382585286021696284', 'uuid-lslong': '10550963206809551259'}, 'enable': 'true', 'created': '2025-08-07T03:14:54', 'last-modified': '2025-08-07T03:14:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486328'} 2025-08-07 03:14:54,810 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-08-07 03:14:54,810 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-76062212 passed 2025-08-07 03:14:54,810 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-76062212 in API_Server ====== 2025-08-07 03:14:54,810 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:54,817 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:54,836 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:54,938 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/90165a4e-ef85-4b1c-926c-8d229c19819b 2025-08-07 03:14:54,956 - DEBUG - =>VN ctest-trans_right_vn-76062212 has no policy to be verified 2025-08-07 03:14:54,956 - DEBUG - Verifying the vn in opserver 2025-08-07 03:14:54,956 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212 virtual network link through opserver 10.0.0.56 2025-08-07 03:14:54,956 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-08-07 03:14:54,970 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212?flat'} 2025-08-07 03:14:54,971 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212 virtual network link through opserver 10.0.0.130 2025-08-07 03:14:54,971 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-08-07 03:14:54,986 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212?flat'} 2025-08-07 03:14:54,986 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212 virtual network link through opserver 10.0.0.249 2025-08-07 03:14:54,986 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-08-07 03:14:55,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212?flat'} 2025-08-07 03:14:55,001 - INFO - Validated that VN default-domain:ctest-TestSvcHC-35985049:ctest-trans_right_vn-76062212 is found in opserver 2025-08-07 03:14:55,029 - DEBUG - Do not have enough data to verify VN in agent 2025-08-07 03:14:55,043 - DEBUG - VRF ids for VN ctest-trans_right_vn-76062212: {} 2025-08-07 03:14:56,132 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3767-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3767-1) 2025-08-07 03:14:57,546 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3767-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3767-2) 2025-08-07 03:14:57,546 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-89650512'] 2025-08-07 03:14:57,861 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-89650512'] created succesfully 2025-08-07 03:14:58,274 - DEBUG - Image by name tiny_trans_fw not found 2025-08-07 03:14:58,274 - DEBUG - Installing image tiny_trans_fw 2025-08-07 03:14:58,274 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-07 03:14:58,274 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-07 03:14:58,274 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-07 03:14:58,274 - DEBUG - Unzip image 2025-08-07 03:14:58,275 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-08-07 03:14:58,297 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-08-07 03:14:58,298 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-89650512'] 2025-08-07 03:14:58,421 - INFO - Service template: ['default-domain', 'ctest-service_template_1-89650512'] deleted successfully. 2025-08-07 03:14:58,421 - INFO - Skip interface_detach for VM ctest-right_vm-76645005 in state BUILD 2025-08-07 03:14:58,421 - INFO - Deleting VM ctest-right_vm-76645005 2025-08-07 03:14:58,422 - ERROR - VM ctest-right_vm-76645005 has failed to come up 2025-08-07 03:14:58,422 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:58,422 - ERROR - VM ctest-right_vm-76645005 has failed to come up 2025-08-07 03:14:58,422 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:58,571 - INFO - Skip interface_detach for VM ctest-left_vm-40458781 in state BUILD 2025-08-07 03:14:58,571 - INFO - Deleting VM ctest-left_vm-40458781 2025-08-07 03:14:58,571 - ERROR - VM ctest-left_vm-40458781 has failed to come up 2025-08-07 03:14:58,571 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:58,571 - ERROR - VM ctest-left_vm-40458781 has failed to come up 2025-08-07 03:14:58,571 - ERROR - Nova failed to get host of the VM 2025-08-07 03:14:58,662 - INFO - Deleting VN ctest-trans_right_vn-76062212 2025-08-07 03:14:58,854 - DEBUG - Response for deleting network () 2025-08-07 03:14:58,854 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/78136a71-2338-4a9d-b68c-415d6d0797e2 2025-08-07 03:14:58,863 - DEBUG - Response Code: 404 2025-08-07 03:14:58,863 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:58,871 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:58,905 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:59,021 - INFO - Validated that VN ctest-trans_right_vn-76062212 is not found in API Server 2025-08-07 03:14:59,038 - DEBUG - VN ctest-trans_right_vn-76062212 is not present in Agent 10.0.0.41 2025-08-07 03:14:59,053 - DEBUG - VN ctest-trans_right_vn-76062212 is not present in Agent 10.0.0.61 2025-08-07 03:14:59,053 - INFO - Validated that VN ctest-trans_right_vn-76062212 is not in any agent 2025-08-07 03:14:59,110 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-76062212 info 2025-08-07 03:14:59,110 - INFO - Deleting VN ctest-trans_left_vn-87859091 2025-08-07 03:14:59,310 - DEBUG - Response for deleting network () 2025-08-07 03:14:59,310 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/15b05971-9bf5-4313-bba1-faeef6e5b402 2025-08-07 03:14:59,318 - DEBUG - Response Code: 404 2025-08-07 03:14:59,318 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:14:59,342 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:14:59,360 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:14:59,480 - INFO - Validated that VN ctest-trans_left_vn-87859091 is not found in API Server 2025-08-07 03:14:59,497 - DEBUG - VN ctest-trans_left_vn-87859091 is not present in Agent 10.0.0.41 2025-08-07 03:14:59,542 - DEBUG - VN ctest-trans_left_vn-87859091 is not present in Agent 10.0.0.61 2025-08-07 03:14:59,542 - INFO - Validated that VN ctest-trans_left_vn-87859091 is not in any agent 2025-08-07 03:14:59,610 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-87859091 info 2025-08-07 03:14:59,610 - INFO - Deleting VN ctest-right_vn-22758869 2025-08-07 03:14:59,670 - DEBUG - VN 6d35e714-a153-4d55-b134-cd94b859fb0d still in use: Unable to complete operation on network 6d35e714-a153-4d55-b134-cd94b859fb0d. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b07f10a1-9d72-4f73-a1dc-78e1d2b48133'] 2025-08-07 03:14:59,670 - WARNING - Deleting VN ctest-right_vn-22758869 failed..Will retry 2025-08-07 03:15:01,900 - DEBUG - Response for deleting network () 2025-08-07 03:15:01,901 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/dfe633b8-2aae-4a43-b46b-389cd9941135 2025-08-07 03:15:01,917 - DEBUG - Response Code: 404 2025-08-07 03:15:01,917 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:15:01,927 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:15:01,944 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:15:02,048 - INFO - Validated that VN ctest-right_vn-22758869 is not found in API Server 2025-08-07 03:15:02,069 - DEBUG - VN ctest-right_vn-22758869 is not present in Agent 10.0.0.41 2025-08-07 03:15:02,082 - DEBUG - VN ctest-right_vn-22758869 is not present in Agent 10.0.0.61 2025-08-07 03:15:02,082 - INFO - Validated that VN ctest-right_vn-22758869 is not in any agent 2025-08-07 03:15:02,130 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-22758869 info 2025-08-07 03:15:02,130 - INFO - Deleting VN ctest-left_vn-88028456 2025-08-07 03:15:02,319 - DEBUG - Response for deleting network () 2025-08-07 03:15:02,319 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/ae5ba36a-55c5-4fe8-8415-4cdb6d073745 2025-08-07 03:15:02,328 - DEBUG - Response Code: 404 2025-08-07 03:15:02,328 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:15:02,335 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:15:02,358 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:15:02,490 - INFO - Validated that VN ctest-left_vn-88028456 is not found in API Server 2025-08-07 03:15:02,509 - DEBUG - VN ctest-left_vn-88028456 is not present in Agent 10.0.0.41 2025-08-07 03:15:02,524 - DEBUG - VN ctest-left_vn-88028456 is not present in Agent 10.0.0.61 2025-08-07 03:15:02,524 - INFO - Validated that VN ctest-left_vn-88028456 is not in any agent 2025-08-07 03:15:02,575 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-88028456 info 2025-08-07 03:15:02,575 - INFO - Deleting VN ctest-mgmt_vn-06000014 2025-08-07 03:15:02,758 - DEBUG - Response for deleting network () 2025-08-07 03:15:02,758 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/da83d037-1fb1-403e-ac55-f821000ac0eb 2025-08-07 03:15:02,767 - DEBUG - Response Code: 404 2025-08-07 03:15:02,767 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-08-07 03:15:02,784 - DEBUG - Requesting: http://10.0.0.56:8082/domain/fb2d80da-9971-40dc-80ca-c5bb54e98569 2025-08-07 03:15:02,846 - DEBUG - Requesting: http://10.0.0.56:8082/project/81a2f104-3342-403b-87c8-c90de09cb21e 2025-08-07 03:15:02,959 - INFO - Validated that VN ctest-mgmt_vn-06000014 is not found in API Server 2025-08-07 03:15:02,976 - DEBUG - VN ctest-mgmt_vn-06000014 is not present in Agent 10.0.0.41 2025-08-07 03:15:02,989 - DEBUG - VN ctest-mgmt_vn-06000014 is not present in Agent 10.0.0.61 2025-08-07 03:15:02,990 - INFO - Validated that VN ctest-mgmt_vn-06000014 is not in any agent 2025-08-07 03:15:03,035 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-06000014 info 2025-08-07 03:15:04,324 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 03:15:04,324 - INFO - 2025-08-07 03:15:04,324 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:18] 2025-08-07 03:15:04,324 - INFO - -------------------------------------------------------------------------------- 2025-08-07 03:15:05,112 - INFO - Deleted project: ctest-TestSvcHC-35985049, ID : 81a2f104-3342-403b-87c8-c90de09cb21e