2025-12-08 03:11:47,386 - INFO - Domain Default found not creating 2025-12-08 03:11:47,544 - INFO - Project ctest-TestSvcHC-73892990 not found, creating it 2025-12-08 03:11:47,998 - INFO - Created Project:ctest-TestSvcHC-73892990, ID : c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:49,833 - INFO - ================================================================================ 2025-12-08 03:11:49,833 - INFO - STARTING TEST : test_svc_hc_basic 2025-12-08 03:11:51,129 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.145': '0', '10.20.0.18': '0'}, '10.0.0.129': {'10.20.0.145': '0', '10.20.0.14': '0'}} with 2025-12-08 03:11:51,129 - INFO - Initial checks done. Running the testcase now 2025-12-08 03:11:51,129 - INFO - 2025-12-08 03:11:51,856 - DEBUG - Response for create_network : {'network': {'id': 'dda25dba-3c6a-44d2-8fa0-62b86f1d4228', 'name': 'ctest-mgmt_vn-83951965', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-mgmt_vn-83951965'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:11:52,164 - DEBUG - Response for create_subnet : {'subnet': {'id': '20fac238-cffc-4a8b-a79e-555c998468de', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': 'dda25dba-3c6a-44d2-8fa0-62b86f1d4228', 'ip_version': 4, 'cidr': '35.68.219.64/26', 'allocation_pools': [{'start': '35.68.219.66', 'end': '35.68.219.126'}], 'gateway_ip': '35.68.219.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.68.219.66', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:11:52,185 - INFO - Created VN ctest-mgmt_vn-83951965 2025-12-08 03:11:52,197 - DEBUG - VN ctest-mgmt_vn-83951965 UUID is dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:52,264 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:52,601 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:52,634 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:11:52,650 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:52,744 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:52,761 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:52,772 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ee9e23fd-e4b6-4577-a7f3-eafaac338e80 2025-12-08 03:11:52,785 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ee9e23fd-e4b6-4577-a7f3-eafaac338e80 2025-12-08 03:11:52,795 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/375cc655-1872-4c5c-8cb8-e448f0c3c230 2025-12-08 03:11:52,803 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:11:52,803 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:52,813 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ee9e23fd-e4b6-4577-a7f3-eafaac338e80 2025-12-08 03:11:52,831 - INFO - Verified VN network id 14 for VN dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:52,831 - INFO - Verifications in API Server for VN ctest-mgmt_vn-83951965 passed 2025-12-08 03:11:52,831 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:52,845 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ee9e23fd-e4b6-4577-a7f3-eafaac338e80 2025-12-08 03:11:52,854 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ee9e23fd-e4b6-4577-a7f3-eafaac338e80 2025-12-08 03:11:52,863 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/375cc655-1872-4c5c-8cb8-e448f0c3c230 2025-12-08 03:11:52,875 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15970430283068097746', 'uuid-lslong': '10349380487975092776'}, 'enable': 'true', 'created': '2025-12-08T03:11:51', 'last-modified': '2025-12-08T03:11:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.767766'} 2025-12-08 03:11:52,881 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:11:52,886 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15970430283068097746', 'uuid-lslong': '10349380487975092776'}, 'enable': 'true', 'created': '2025-12-08T03:11:51', 'last-modified': '2025-12-08T03:11:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771578'} 2025-12-08 03:11:52,891 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:11:52,896 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15970430283068097746', 'uuid-lslong': '10349380487975092776'}, 'enable': 'true', 'created': '2025-12-08T03:11:51', 'last-modified': '2025-12-08T03:11:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.781240'} 2025-12-08 03:11:52,902 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:11:52,902 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-83951965 passed 2025-12-08 03:11:52,902 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-83951965 in API_Server ====== 2025-12-08 03:11:52,902 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:52,908 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:11:52,921 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:53,022 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/dda25dba-3c6a-44d2-8fa0-62b86f1d4228 2025-12-08 03:11:53,033 - DEBUG - =>VN ctest-mgmt_vn-83951965 has no policy to be verified 2025-12-08 03:11:53,033 - DEBUG - Verifying the vn in opserver 2025-12-08 03:11:53,033 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965 virtual network link through opserver 10.0.0.23 2025-12-08 03:11:53,033 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:11:53,373 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:11:53,444 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965?flat'} 2025-12-08 03:11:53,444 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965 virtual network link through opserver 10.0.0.22 2025-12-08 03:11:53,444 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:11:53,779 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:11:53,841 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965?flat'} 2025-12-08 03:11:53,841 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965 virtual network link through opserver 10.0.0.65 2025-12-08 03:11:53,842 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:11:54,177 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:11:54,254 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965?flat'} 2025-12-08 03:11:54,254 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-83951965 is found in opserver 2025-12-08 03:11:54,275 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:11:54,285 - DEBUG - VRF ids for VN ctest-mgmt_vn-83951965: {} 2025-12-08 03:11:54,547 - DEBUG - Response for create_network : {'network': {'id': 'f5b7ee3e-a39d-4595-9794-191d1ac79891', 'name': 'ctest-left_vn-47302548', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-left_vn-47302548'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:11:54,829 - DEBUG - Response for create_subnet : {'subnet': {'id': '9dc4434a-bf20-4951-9706-3abd720fe7ae', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': 'f5b7ee3e-a39d-4595-9794-191d1ac79891', 'ip_version': 4, 'cidr': '8.81.159.192/26', 'allocation_pools': [{'start': '8.81.159.194', 'end': '8.81.159.254'}], 'gateway_ip': '8.81.159.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '8.81.159.194', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:11:54,852 - INFO - Created VN ctest-left_vn-47302548 2025-12-08 03:11:54,866 - DEBUG - VN ctest-left_vn-47302548 UUID is f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:54,934 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:54,941 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:11:54,953 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:55,048 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:55,063 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:55,076 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fdb674a5-a835-46fd-9fd1-0484bf2b5b0f 2025-12-08 03:11:55,084 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fdb674a5-a835-46fd-9fd1-0484bf2b5b0f 2025-12-08 03:11:55,093 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/cd24c6a0-0c13-497b-80e8-5a37fcf7c28b 2025-12-08 03:11:55,099 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:11:55,099 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:55,108 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fdb674a5-a835-46fd-9fd1-0484bf2b5b0f 2025-12-08 03:11:55,123 - INFO - Verified VN network id 15 for VN f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:55,124 - INFO - Verifications in API Server for VN ctest-left_vn-47302548 passed 2025-12-08 03:11:55,124 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:55,132 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fdb674a5-a835-46fd-9fd1-0484bf2b5b0f 2025-12-08 03:11:55,139 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fdb674a5-a835-46fd-9fd1-0484bf2b5b0f 2025-12-08 03:11:55,145 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/cd24c6a0-0c13-497b-80e8-5a37fcf7c28b 2025-12-08 03:11:55,157 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17705882412830770581', 'uuid-lslong': '10922382609074329745'}, 'enable': 'true', 'created': '2025-12-08T03:11:54', 'last-modified': '2025-12-08T03:11:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.394897'} 2025-12-08 03:11:55,162 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:11:55,167 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17705882412830770581', 'uuid-lslong': '10922382609074329745'}, 'enable': 'true', 'created': '2025-12-08T03:11:54', 'last-modified': '2025-12-08T03:11:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.404354'} 2025-12-08 03:11:55,172 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:11:55,178 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17705882412830770581', 'uuid-lslong': '10922382609074329745'}, 'enable': 'true', 'created': '2025-12-08T03:11:54', 'last-modified': '2025-12-08T03:11:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417835'} 2025-12-08 03:11:55,183 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:11:55,183 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-47302548 passed 2025-12-08 03:11:55,183 - DEBUG - ====Verifying policy data for ctest-left_vn-47302548 in API_Server ====== 2025-12-08 03:11:55,183 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:55,190 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:11:55,200 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:55,300 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f5b7ee3e-a39d-4595-9794-191d1ac79891 2025-12-08 03:11:55,309 - DEBUG - =>VN ctest-left_vn-47302548 has no policy to be verified 2025-12-08 03:11:55,309 - DEBUG - Verifying the vn in opserver 2025-12-08 03:11:55,309 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548 virtual network link through opserver 10.0.0.23 2025-12-08 03:11:55,310 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:11:55,371 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548?flat'} 2025-12-08 03:11:55,371 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548 virtual network link through opserver 10.0.0.22 2025-12-08 03:11:55,371 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:11:55,433 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548?flat'} 2025-12-08 03:11:55,433 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548 virtual network link through opserver 10.0.0.65 2025-12-08 03:11:55,433 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:11:55,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548?flat'} 2025-12-08 03:11:55,497 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-47302548 is found in opserver 2025-12-08 03:11:55,518 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:11:55,528 - DEBUG - VRF ids for VN ctest-left_vn-47302548: {} 2025-12-08 03:11:55,819 - DEBUG - Response for create_network : {'network': {'id': '0f61f55b-e57f-429d-9981-8d1205c15c27', 'name': 'ctest-right_vn-24458152', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-right_vn-24458152'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:11:56,063 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a54766be-ab28-4567-93c6-bf1d4409b881', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': '0f61f55b-e57f-429d-9981-8d1205c15c27', 'ip_version': 4, 'cidr': '161.53.144.64/26', 'allocation_pools': [{'start': '161.53.144.66', 'end': '161.53.144.126'}], 'gateway_ip': '161.53.144.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '161.53.144.66', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:11:56,087 - INFO - Created VN ctest-right_vn-24458152 2025-12-08 03:11:56,099 - DEBUG - VN ctest-right_vn-24458152 UUID is 0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,171 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:56,177 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:11:56,188 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:56,282 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,293 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,302 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e2661ee5-beab-4779-a0e0-f3a0fa0beedd 2025-12-08 03:11:56,318 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e2661ee5-beab-4779-a0e0-f3a0fa0beedd 2025-12-08 03:11:56,327 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/2c1ea585-b499-4d68-8f03-790afb447c5e 2025-12-08 03:11:56,333 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:11:56,334 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,343 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e2661ee5-beab-4779-a0e0-f3a0fa0beedd 2025-12-08 03:11:56,360 - INFO - Verified VN network id 16 for VN 0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,360 - INFO - Verifications in API Server for VN ctest-right_vn-24458152 passed 2025-12-08 03:11:56,360 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,370 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e2661ee5-beab-4779-a0e0-f3a0fa0beedd 2025-12-08 03:11:56,377 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e2661ee5-beab-4779-a0e0-f3a0fa0beedd 2025-12-08 03:11:56,383 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/2c1ea585-b499-4d68-8f03-790afb447c5e 2025-12-08 03:11:56,395 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1108436758351004317', 'uuid-lslong': '11061277268344134695'}, 'enable': 'true', 'created': '2025-12-08T03:11:55', 'last-modified': '2025-12-08T03:11:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.408080'} 2025-12-08 03:11:56,400 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:11:56,405 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1108436758351004317', 'uuid-lslong': '11061277268344134695'}, 'enable': 'true', 'created': '2025-12-08T03:11:55', 'last-modified': '2025-12-08T03:11:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424963'} 2025-12-08 03:11:56,411 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:11:56,417 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1108436758351004317', 'uuid-lslong': '11061277268344134695'}, 'enable': 'true', 'created': '2025-12-08T03:11:55', 'last-modified': '2025-12-08T03:11:55', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.436461'} 2025-12-08 03:11:56,423 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:11:56,423 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-24458152 passed 2025-12-08 03:11:56,423 - DEBUG - ====Verifying policy data for ctest-right_vn-24458152 in API_Server ====== 2025-12-08 03:11:56,423 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:11:56,429 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:11:56,439 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:11:56,528 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/0f61f55b-e57f-429d-9981-8d1205c15c27 2025-12-08 03:11:56,544 - DEBUG - =>VN ctest-right_vn-24458152 has no policy to be verified 2025-12-08 03:11:56,545 - DEBUG - Verifying the vn in opserver 2025-12-08 03:11:56,545 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152 virtual network link through opserver 10.0.0.23 2025-12-08 03:11:56,545 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:11:56,609 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152?flat'} 2025-12-08 03:11:56,609 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152 virtual network link through opserver 10.0.0.22 2025-12-08 03:11:56,609 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:11:56,673 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152?flat'} 2025-12-08 03:11:56,673 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152 virtual network link through opserver 10.0.0.65 2025-12-08 03:11:56,673 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:11:56,734 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152?flat'} 2025-12-08 03:11:56,734 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-24458152 is found in opserver 2025-12-08 03:11:56,755 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:11:56,765 - DEBUG - VRF ids for VN ctest-right_vn-24458152: {} 2025-12-08 03:11:56,822 - DEBUG - Services list from nova: [, , , ] 2025-12-08 03:11:57,933 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-2) 2025-12-08 03:11:59,406 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-1) 2025-12-08 03:11:59,406 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-05508628'] 2025-12-08 03:11:59,738 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-05508628'] created succesfully 2025-12-08 03:12:00,119 - DEBUG - Image by name tiny_nat_fw not found 2025-12-08 03:12:00,119 - DEBUG - Installing image tiny_nat_fw 2025-12-08 03:12:00,119 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-12-08 03:12:00,119 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-12-08 03:12:00,119 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-12-08 03:12:00,120 - DEBUG - Unzip image 2025-12-08 03:12:00,120 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-12-08 03:12:00,140 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2025-12-08 03:12:00,140 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-05508628'] 2025-12-08 03:12:00,273 - INFO - Service template: ['default-domain', 'ctest-service_template_1-05508628'] deleted successfully. 2025-12-08 03:12:00,273 - INFO - Skip interface_detach for VM ctest-right_vm-51849845 in state BUILD 2025-12-08 03:12:00,274 - INFO - Deleting VM ctest-right_vm-51849845 2025-12-08 03:12:00,362 - ERROR - VM ctest-right_vm-51849845 has failed to come up 2025-12-08 03:12:00,363 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:00,363 - ERROR - VM ctest-right_vm-51849845 has failed to come up 2025-12-08 03:12:00,363 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:00,455 - INFO - Skip interface_detach for VM ctest-left_vm-32820848 in state BUILD 2025-12-08 03:12:00,455 - INFO - Deleting VM ctest-left_vm-32820848 2025-12-08 03:12:00,455 - ERROR - VM ctest-left_vm-32820848 has failed to come up 2025-12-08 03:12:00,456 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:00,456 - ERROR - VM ctest-left_vm-32820848 has failed to come up 2025-12-08 03:12:00,456 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:00,530 - INFO - Deleting VN ctest-right_vn-24458152 2025-12-08 03:12:00,573 - DEBUG - VN 0f61f55b-e57f-429d-9981-8d1205c15c27 still in use: Unable to complete operation on network 0f61f55b-e57f-429d-9981-8d1205c15c27. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-df943b6d-7027-4e6e-b073-d064383ce34b'] 2025-12-08 03:12:00,573 - WARNING - Deleting VN ctest-right_vn-24458152 failed..Will retry 2025-12-08 03:12:02,779 - DEBUG - Response for deleting network () 2025-12-08 03:12:02,780 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e2661ee5-beab-4779-a0e0-f3a0fa0beedd 2025-12-08 03:12:02,804 - DEBUG - Response Code: 404 2025-12-08 03:12:02,804 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:02,816 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:02,837 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:02,945 - INFO - Validated that VN ctest-right_vn-24458152 is not found in API Server 2025-12-08 03:12:02,959 - DEBUG - VN ctest-right_vn-24458152 is not present in Agent 10.0.0.41 2025-12-08 03:12:02,974 - DEBUG - VN ctest-right_vn-24458152 is not present in Agent 10.0.0.129 2025-12-08 03:12:02,974 - INFO - Validated that VN ctest-right_vn-24458152 is not in any agent 2025-12-08 03:12:03,016 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-24458152 info 2025-12-08 03:12:03,016 - INFO - Deleting VN ctest-left_vn-47302548 2025-12-08 03:12:03,193 - DEBUG - Response for deleting network () 2025-12-08 03:12:03,193 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fdb674a5-a835-46fd-9fd1-0484bf2b5b0f 2025-12-08 03:12:03,208 - DEBUG - Response Code: 404 2025-12-08 03:12:03,209 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:03,229 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:03,241 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:03,369 - INFO - Validated that VN ctest-left_vn-47302548 is not found in API Server 2025-12-08 03:12:03,381 - DEBUG - VN ctest-left_vn-47302548 is not present in Agent 10.0.0.41 2025-12-08 03:12:03,393 - DEBUG - VN ctest-left_vn-47302548 is not present in Agent 10.0.0.129 2025-12-08 03:12:03,393 - INFO - Validated that VN ctest-left_vn-47302548 is not in any agent 2025-12-08 03:12:03,425 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-47302548 info 2025-12-08 03:12:03,425 - INFO - Deleting VN ctest-mgmt_vn-83951965 2025-12-08 03:12:03,575 - DEBUG - Response for deleting network () 2025-12-08 03:12:03,575 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/ee9e23fd-e4b6-4577-a7f3-eafaac338e80 2025-12-08 03:12:03,581 - DEBUG - Response Code: 404 2025-12-08 03:12:03,581 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:03,594 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:03,607 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:03,707 - INFO - Validated that VN ctest-mgmt_vn-83951965 is not found in API Server 2025-12-08 03:12:03,718 - DEBUG - VN ctest-mgmt_vn-83951965 is not present in Agent 10.0.0.41 2025-12-08 03:12:03,732 - DEBUG - VN ctest-mgmt_vn-83951965 is not present in Agent 10.0.0.129 2025-12-08 03:12:03,732 - INFO - Validated that VN ctest-mgmt_vn-83951965 is not in any agent 2025-12-08 03:12:03,776 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-83951965 info 2025-12-08 03:12:05,069 - DEBUG - No XMPP flaps were noticed during the test 2025-12-08 03:12:05,069 - INFO -
2025-12-08 03:12:05,069 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:16]
2025-12-08 03:12:05,070 - INFO - -------------------------------------------------------------------------------- 2025-12-08 03:12:05,089 - INFO - ================================================================================ 2025-12-08 03:12:05,090 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2025-12-08 03:12:06,380 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.145': '0', '10.20.0.18': '0'}, '10.0.0.129': {'10.20.0.145': '0', '10.20.0.14': '0'}} with 2025-12-08 03:12:06,380 - INFO - Initial checks done. Running the testcase now 2025-12-08 03:12:06,380 - INFO - 2025-12-08 03:12:06,710 - DEBUG - Response for create_network : {'network': {'id': 'fc52214b-d67f-4f2e-a76a-a4bc4d643827', 'name': 'ctest-mgmt_vn-51885993', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-mgmt_vn-51885993'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:12:06,950 - DEBUG - Response for create_subnet : {'subnet': {'id': 'fb23c722-c06a-48ed-b324-b8e9e6cb0df4', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': 'fc52214b-d67f-4f2e-a76a-a4bc4d643827', 'ip_version': 4, 'cidr': '86.144.160.64/26', 'allocation_pools': [{'start': '86.144.160.66', 'end': '86.144.160.126'}], 'gateway_ip': '86.144.160.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '86.144.160.66', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:12:06,974 - INFO - Created VN ctest-mgmt_vn-51885993 2025-12-08 03:12:06,985 - DEBUG - VN ctest-mgmt_vn-51885993 UUID is fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,066 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:07,073 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:07,086 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:07,193 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,212 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,224 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e30f9bf7-62b2-4159-afff-e431205a4fd4 2025-12-08 03:12:07,234 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e30f9bf7-62b2-4159-afff-e431205a4fd4 2025-12-08 03:12:07,242 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/32c62298-ba30-4cf5-b65a-76d34f5a259a 2025-12-08 03:12:07,250 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:12:07,250 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,259 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e30f9bf7-62b2-4159-afff-e431205a4fd4 2025-12-08 03:12:07,276 - INFO - Verified VN network id 14 for VN fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,277 - INFO - Verifications in API Server for VN ctest-mgmt_vn-51885993 passed 2025-12-08 03:12:07,277 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,287 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e30f9bf7-62b2-4159-afff-e431205a4fd4 2025-12-08 03:12:07,296 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e30f9bf7-62b2-4159-afff-e431205a4fd4 2025-12-08 03:12:07,302 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/32c62298-ba30-4cf5-b65a-76d34f5a259a 2025-12-08 03:12:07,314 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18181631255253045038', 'uuid-lslong': '12063635680524515367'}, 'enable': 'true', 'created': '2025-12-08T03:12:06', 'last-modified': '2025-12-08T03:12:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.414528'} 2025-12-08 03:12:07,320 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:12:07,325 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18181631255253045038', 'uuid-lslong': '12063635680524515367'}, 'enable': 'true', 'created': '2025-12-08T03:12:06', 'last-modified': '2025-12-08T03:12:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423352'} 2025-12-08 03:12:07,334 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:12:07,340 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18181631255253045038', 'uuid-lslong': '12063635680524515367'}, 'enable': 'true', 'created': '2025-12-08T03:12:06', 'last-modified': '2025-12-08T03:12:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437670'} 2025-12-08 03:12:07,347 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-12-08 03:12:07,347 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-51885993 passed 2025-12-08 03:12:07,347 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-51885993 in API_Server ====== 2025-12-08 03:12:07,347 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:07,354 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:07,369 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:07,462 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/fc52214b-d67f-4f2e-a76a-a4bc4d643827 2025-12-08 03:12:07,474 - DEBUG - =>VN ctest-mgmt_vn-51885993 has no policy to be verified 2025-12-08 03:12:07,474 - DEBUG - Verifying the vn in opserver 2025-12-08 03:12:07,474 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993 virtual network link through opserver 10.0.0.23 2025-12-08 03:12:07,474 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:12:07,485 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993?flat'} 2025-12-08 03:12:07,486 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993 virtual network link through opserver 10.0.0.22 2025-12-08 03:12:07,486 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:12:07,499 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993?flat'} 2025-12-08 03:12:07,499 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993 virtual network link through opserver 10.0.0.65 2025-12-08 03:12:07,499 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:12:07,513 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993?flat'} 2025-12-08 03:12:07,513 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-mgmt_vn-51885993 is found in opserver 2025-12-08 03:12:07,539 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:12:07,551 - DEBUG - VRF ids for VN ctest-mgmt_vn-51885993: {} 2025-12-08 03:12:07,834 - DEBUG - Response for create_network : {'network': {'id': 'bced3b76-a695-4c81-a51e-8cd26ce4557d', 'name': 'ctest-left_vn-29875997', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-left_vn-29875997'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:12:08,127 - DEBUG - Response for create_subnet : {'subnet': {'id': '99bb1276-49b2-4882-a2c4-d852e8afbe5d', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': 'bced3b76-a695-4c81-a51e-8cd26ce4557d', 'ip_version': 4, 'cidr': '186.37.172.0/26', 'allocation_pools': [{'start': '186.37.172.2', 'end': '186.37.172.62'}], 'gateway_ip': '186.37.172.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.37.172.2', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:12:08,151 - INFO - Created VN ctest-left_vn-29875997 2025-12-08 03:12:08,162 - DEBUG - VN ctest-left_vn-29875997 UUID is bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,247 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:08,254 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:08,265 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:08,362 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,374 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,388 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/95f82519-8a2b-4e76-8509-1e26b6504e94 2025-12-08 03:12:08,397 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/95f82519-8a2b-4e76-8509-1e26b6504e94 2025-12-08 03:12:08,405 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6072b7cd-e2fa-4a56-afa6-1a0e9e1cca54 2025-12-08 03:12:08,412 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:12:08,413 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,423 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/95f82519-8a2b-4e76-8509-1e26b6504e94 2025-12-08 03:12:08,440 - INFO - Verified VN network id 15 for VN bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,440 - INFO - Verifications in API Server for VN ctest-left_vn-29875997 passed 2025-12-08 03:12:08,440 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,454 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/95f82519-8a2b-4e76-8509-1e26b6504e94 2025-12-08 03:12:08,463 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/95f82519-8a2b-4e76-8509-1e26b6504e94 2025-12-08 03:12:08,474 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6072b7cd-e2fa-4a56-afa6-1a0e9e1cca54 2025-12-08 03:12:08,490 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13613602629397859457', 'uuid-lslong': '11898102100957353341'}, 'enable': 'true', 'created': '2025-12-08T03:12:07', 'last-modified': '2025-12-08T03:12:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425090'} 2025-12-08 03:12:08,496 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:12:08,502 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13613602629397859457', 'uuid-lslong': '11898102100957353341'}, 'enable': 'true', 'created': '2025-12-08T03:12:07', 'last-modified': '2025-12-08T03:12:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425374'} 2025-12-08 03:12:08,508 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:12:08,514 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13613602629397859457', 'uuid-lslong': '11898102100957353341'}, 'enable': 'true', 'created': '2025-12-08T03:12:07', 'last-modified': '2025-12-08T03:12:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443140'} 2025-12-08 03:12:08,520 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-12-08 03:12:08,520 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-29875997 passed 2025-12-08 03:12:08,520 - DEBUG - ====Verifying policy data for ctest-left_vn-29875997 in API_Server ====== 2025-12-08 03:12:08,520 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:08,530 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:08,543 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:08,640 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/bced3b76-a695-4c81-a51e-8cd26ce4557d 2025-12-08 03:12:08,654 - DEBUG - =>VN ctest-left_vn-29875997 has no policy to be verified 2025-12-08 03:12:08,654 - DEBUG - Verifying the vn in opserver 2025-12-08 03:12:08,654 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997 virtual network link through opserver 10.0.0.23 2025-12-08 03:12:08,654 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:12:08,667 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997?flat'} 2025-12-08 03:12:08,667 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997 virtual network link through opserver 10.0.0.22 2025-12-08 03:12:08,667 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:12:08,683 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997?flat'} 2025-12-08 03:12:08,683 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997 virtual network link through opserver 10.0.0.65 2025-12-08 03:12:08,683 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:12:08,696 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997?flat'} 2025-12-08 03:12:08,696 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-left_vn-29875997 is found in opserver 2025-12-08 03:12:08,716 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:12:08,728 - DEBUG - VRF ids for VN ctest-left_vn-29875997: {} 2025-12-08 03:12:08,991 - DEBUG - Response for create_network : {'network': {'id': '452ba28f-91ae-4a14-9530-5eafb610f194', 'name': 'ctest-right_vn-95574729', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-right_vn-95574729'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:12:09,207 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e6f9ccc3-1e51-4f5c-a66e-82ba54443447', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': '452ba28f-91ae-4a14-9530-5eafb610f194', 'ip_version': 4, 'cidr': '101.202.124.64/26', 'allocation_pools': [{'start': '101.202.124.66', 'end': '101.202.124.126'}], 'gateway_ip': '101.202.124.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '101.202.124.66', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:12:09,233 - INFO - Created VN ctest-right_vn-95574729 2025-12-08 03:12:09,246 - DEBUG - VN ctest-right_vn-95574729 UUID is 452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,313 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:09,319 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:09,330 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:09,425 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,438 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,447 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4739fa90-d752-4ce1-a49c-3e1ab67658fa 2025-12-08 03:12:09,455 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4739fa90-d752-4ce1-a49c-3e1ab67658fa 2025-12-08 03:12:09,463 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/b79bb97a-8d4d-4f54-b0f3-3d0f79b31bfe 2025-12-08 03:12:09,470 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:12:09,470 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,481 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4739fa90-d752-4ce1-a49c-3e1ab67658fa 2025-12-08 03:12:09,500 - INFO - Verified VN network id 16 for VN 452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,500 - INFO - Verifications in API Server for VN ctest-right_vn-95574729 passed 2025-12-08 03:12:09,500 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,511 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4739fa90-d752-4ce1-a49c-3e1ab67658fa 2025-12-08 03:12:09,520 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4739fa90-d752-4ce1-a49c-3e1ab67658fa 2025-12-08 03:12:09,527 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/b79bb97a-8d4d-4f54-b0f3-3d0f79b31bfe 2025-12-08 03:12:09,542 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4984256150123727380', 'uuid-lslong': '10750196419300225428'}, 'enable': 'true', 'created': '2025-12-08T03:12:08', 'last-modified': '2025-12-08T03:12:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.378478'} 2025-12-08 03:12:09,552 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:12:09,558 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4984256150123727380', 'uuid-lslong': '10750196419300225428'}, 'enable': 'true', 'created': '2025-12-08T03:12:08', 'last-modified': '2025-12-08T03:12:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399851'} 2025-12-08 03:12:09,564 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:12:09,570 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4984256150123727380', 'uuid-lslong': '10750196419300225428'}, 'enable': 'true', 'created': '2025-12-08T03:12:08', 'last-modified': '2025-12-08T03:12:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.399782'} 2025-12-08 03:12:09,576 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-12-08 03:12:09,576 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-95574729 passed 2025-12-08 03:12:09,576 - DEBUG - ====Verifying policy data for ctest-right_vn-95574729 in API_Server ====== 2025-12-08 03:12:09,576 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:09,583 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:09,597 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:09,688 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/452ba28f-91ae-4a14-9530-5eafb610f194 2025-12-08 03:12:09,703 - DEBUG - =>VN ctest-right_vn-95574729 has no policy to be verified 2025-12-08 03:12:09,703 - DEBUG - Verifying the vn in opserver 2025-12-08 03:12:09,703 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729 virtual network link through opserver 10.0.0.23 2025-12-08 03:12:09,703 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:12:09,716 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729?flat'} 2025-12-08 03:12:09,716 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729 virtual network link through opserver 10.0.0.22 2025-12-08 03:12:09,716 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:12:09,728 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729?flat'} 2025-12-08 03:12:09,728 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729 virtual network link through opserver 10.0.0.65 2025-12-08 03:12:09,728 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:12:09,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729?flat'} 2025-12-08 03:12:09,740 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-right_vn-95574729 is found in opserver 2025-12-08 03:12:09,765 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:12:09,778 - DEBUG - VRF ids for VN ctest-right_vn-95574729: {} 2025-12-08 03:12:10,071 - DEBUG - Response for create_network : {'network': {'id': 'f341587e-8e9c-412e-bab4-7d1b40dc9bd4', 'name': 'ctest-trans_left_vn-20301764', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-trans_left_vn-20301764'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:12:10,259 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd9a5ff03-166e-4511-9564-6f63465c7c56', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': 'f341587e-8e9c-412e-bab4-7d1b40dc9bd4', 'ip_version': 4, 'cidr': '12.81.66.64/26', 'allocation_pools': [{'start': '12.81.66.66', 'end': '12.81.66.126'}], 'gateway_ip': '12.81.66.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.81.66.66', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:12:10,281 - INFO - Created VN ctest-trans_left_vn-20301764 2025-12-08 03:12:10,291 - DEBUG - VN ctest-trans_left_vn-20301764 UUID is f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,363 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:10,373 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:10,387 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:10,493 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,509 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,520 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/127ad526-d910-4f7d-aa51-e996c7194b2a 2025-12-08 03:12:10,532 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/127ad526-d910-4f7d-aa51-e996c7194b2a 2025-12-08 03:12:10,542 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/579b0fa1-d11f-4be8-9326-a1f5b5c7fc11 2025-12-08 03:12:10,553 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-08 03:12:10,553 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,569 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/127ad526-d910-4f7d-aa51-e996c7194b2a 2025-12-08 03:12:10,590 - INFO - Verified VN network id 17 for VN f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,590 - INFO - Verifications in API Server for VN ctest-trans_left_vn-20301764 passed 2025-12-08 03:12:10,590 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,601 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/127ad526-d910-4f7d-aa51-e996c7194b2a 2025-12-08 03:12:10,609 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/127ad526-d910-4f7d-aa51-e996c7194b2a 2025-12-08 03:12:10,618 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/579b0fa1-d11f-4be8-9326-a1f5b5c7fc11 2025-12-08 03:12:10,633 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17528388525284409646', 'uuid-lslong': '13453515542868302804'}, 'enable': 'true', 'created': '2025-12-08T03:12:10', 'last-modified': '2025-12-08T03:12:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.429086'} 2025-12-08 03:12:10,642 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-08 03:12:10,649 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17528388525284409646', 'uuid-lslong': '13453515542868302804'}, 'enable': 'true', 'created': '2025-12-08T03:12:10', 'last-modified': '2025-12-08T03:12:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.439274'} 2025-12-08 03:12:10,655 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-08 03:12:10,660 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17528388525284409646', 'uuid-lslong': '13453515542868302804'}, 'enable': 'true', 'created': '2025-12-08T03:12:10', 'last-modified': '2025-12-08T03:12:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453031'} 2025-12-08 03:12:10,666 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-12-08 03:12:10,666 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-20301764 passed 2025-12-08 03:12:10,666 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-20301764 in API_Server ====== 2025-12-08 03:12:10,666 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:10,672 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:10,683 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:10,771 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f341587e-8e9c-412e-bab4-7d1b40dc9bd4 2025-12-08 03:12:10,785 - DEBUG - =>VN ctest-trans_left_vn-20301764 has no policy to be verified 2025-12-08 03:12:10,785 - DEBUG - Verifying the vn in opserver 2025-12-08 03:12:10,785 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764 virtual network link through opserver 10.0.0.23 2025-12-08 03:12:10,785 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:12:10,799 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764?flat'} 2025-12-08 03:12:10,799 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764 virtual network link through opserver 10.0.0.22 2025-12-08 03:12:10,799 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:12:10,815 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764?flat'} 2025-12-08 03:12:10,815 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764 virtual network link through opserver 10.0.0.65 2025-12-08 03:12:10,815 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:12:10,828 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764?flat'} 2025-12-08 03:12:10,828 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-trans_left_vn-20301764 is found in opserver 2025-12-08 03:12:10,851 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:12:10,862 - DEBUG - VRF ids for VN ctest-trans_left_vn-20301764: {} 2025-12-08 03:12:11,126 - DEBUG - Response for create_network : {'network': {'id': '3f722b9d-9d3f-45fd-84a2-5f59748ea512', 'name': 'ctest-trans_right_vn-90069759', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'project_id': 'c90ea5384e854dde84f6f3037d80b932', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-73892990', 'ctest-trans_right_vn-90069759'], 'port_security_enabled': True, 'description': ''}} 2025-12-08 03:12:11,350 - DEBUG - Response for create_subnet : {'subnet': {'id': '6e53ca2e-69e2-498c-a759-9dadc76be55f', 'name': '', 'tenant_id': 'c90ea5384e854dde84f6f3037d80b932', 'network_id': '3f722b9d-9d3f-45fd-84a2-5f59748ea512', 'ip_version': 4, 'cidr': '35.231.239.0/26', 'allocation_pools': [{'start': '35.231.239.2', 'end': '35.231.239.62'}], 'gateway_ip': '35.231.239.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.231.239.2', 'tags': [], 'project_id': 'c90ea5384e854dde84f6f3037d80b932'}} 2025-12-08 03:12:11,374 - INFO - Created VN ctest-trans_right_vn-90069759 2025-12-08 03:12:11,386 - DEBUG - VN ctest-trans_right_vn-90069759 UUID is 3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,460 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:11,465 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:11,480 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:11,582 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,596 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,611 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c70ac585-7641-469f-b0da-c2815e83ff13 2025-12-08 03:12:11,622 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c70ac585-7641-469f-b0da-c2815e83ff13 2025-12-08 03:12:11,636 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e4cd1afc-c235-4aaa-9a14-09816650428f 2025-12-08 03:12:11,650 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-08 03:12:11,650 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,665 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c70ac585-7641-469f-b0da-c2815e83ff13 2025-12-08 03:12:11,685 - INFO - Verified VN network id 18 for VN 3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,685 - INFO - Verifications in API Server for VN ctest-trans_right_vn-90069759 passed 2025-12-08 03:12:11,685 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,696 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c70ac585-7641-469f-b0da-c2815e83ff13 2025-12-08 03:12:11,704 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c70ac585-7641-469f-b0da-c2815e83ff13 2025-12-08 03:12:11,711 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e4cd1afc-c235-4aaa-9a14-09816650428f 2025-12-08 03:12:11,724 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4571764527682504189', 'uuid-lslong': '9557306197045847314'}, 'enable': 'true', 'created': '2025-12-08T03:12:11', 'last-modified': '2025-12-08T03:12:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431248'} 2025-12-08 03:12:11,731 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-08 03:12:11,736 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4571764527682504189', 'uuid-lslong': '9557306197045847314'}, 'enable': 'true', 'created': '2025-12-08T03:12:11', 'last-modified': '2025-12-08T03:12:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446769'} 2025-12-08 03:12:11,743 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-08 03:12:11,749 - DEBUG - Control-node 10.0.0.65 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-73892990', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4571764527682504189', 'uuid-lslong': '9557306197045847314'}, 'enable': 'true', 'created': '2025-12-08T03:12:11', 'last-modified': '2025-12-08T03:12:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459099'} 2025-12-08 03:12:11,755 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-12-08 03:12:11,755 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-90069759 passed 2025-12-08 03:12:11,755 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-90069759 in API_Server ====== 2025-12-08 03:12:11,756 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:11,763 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:11,777 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:11,881 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/3f722b9d-9d3f-45fd-84a2-5f59748ea512 2025-12-08 03:12:11,891 - DEBUG - =>VN ctest-trans_right_vn-90069759 has no policy to be verified 2025-12-08 03:12:11,891 - DEBUG - Verifying the vn in opserver 2025-12-08 03:12:11,891 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759 virtual network link through opserver 10.0.0.23 2025-12-08 03:12:11,891 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-12-08 03:12:11,903 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759?flat'} 2025-12-08 03:12:11,903 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759 virtual network link through opserver 10.0.0.22 2025-12-08 03:12:11,904 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-12-08 03:12:11,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759?flat'} 2025-12-08 03:12:11,916 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759 virtual network link through opserver 10.0.0.65 2025-12-08 03:12:11,916 - DEBUG - Requesting: http://10.0.0.65:8081/analytics/uves/virtual-networks 2025-12-08 03:12:11,931 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759', 'href': 'http://10.0.0.65:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759?flat'} 2025-12-08 03:12:11,931 - INFO - Validated that VN default-domain:ctest-TestSvcHC-73892990:ctest-trans_right_vn-90069759 is found in opserver 2025-12-08 03:12:11,959 - DEBUG - Do not have enough data to verify VN in agent 2025-12-08 03:12:11,973 - DEBUG - VRF ids for VN ctest-trans_right_vn-90069759: {} 2025-12-08 03:12:13,180 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-1) 2025-12-08 03:12:14,641 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4854-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4854-2) 2025-12-08 03:12:14,642 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-48573649'] 2025-12-08 03:12:14,932 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-48573649'] created succesfully 2025-12-08 03:12:15,321 - DEBUG - Image by name tiny_trans_fw not found 2025-12-08 03:12:15,321 - DEBUG - Installing image tiny_trans_fw 2025-12-08 03:12:15,321 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-12-08 03:12:15,321 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-12-08 03:12:15,321 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-12-08 03:12:15,321 - DEBUG - Unzip image 2025-12-08 03:12:15,322 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-12-08 03:12:15,344 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2025-12-08 03:12:15,344 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-48573649'] 2025-12-08 03:12:15,457 - INFO - Service template: ['default-domain', 'ctest-service_template_1-48573649'] deleted successfully. 2025-12-08 03:12:15,457 - INFO - Skip interface_detach for VM ctest-right_vm-91080496 in state BUILD 2025-12-08 03:12:15,457 - INFO - Deleting VM ctest-right_vm-91080496 2025-12-08 03:12:15,457 - ERROR - VM ctest-right_vm-91080496 has failed to come up 2025-12-08 03:12:15,457 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:15,457 - ERROR - VM ctest-right_vm-91080496 has failed to come up 2025-12-08 03:12:15,457 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:15,596 - INFO - Skip interface_detach for VM ctest-left_vm-96438971 in state BUILD 2025-12-08 03:12:15,596 - INFO - Deleting VM ctest-left_vm-96438971 2025-12-08 03:12:15,596 - ERROR - VM ctest-left_vm-96438971 has failed to come up 2025-12-08 03:12:15,596 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:15,596 - ERROR - VM ctest-left_vm-96438971 has failed to come up 2025-12-08 03:12:15,596 - ERROR - Nova failed to get host of the VM 2025-12-08 03:12:15,675 - INFO - Deleting VN ctest-trans_right_vn-90069759 2025-12-08 03:12:15,833 - DEBUG - Response for deleting network () 2025-12-08 03:12:15,833 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/c70ac585-7641-469f-b0da-c2815e83ff13 2025-12-08 03:12:15,839 - DEBUG - Response Code: 404 2025-12-08 03:12:15,840 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:15,846 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:15,871 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:15,986 - INFO - Validated that VN ctest-trans_right_vn-90069759 is not found in API Server 2025-12-08 03:12:15,996 - DEBUG - VN ctest-trans_right_vn-90069759 is not present in Agent 10.0.0.41 2025-12-08 03:12:16,019 - DEBUG - VN ctest-trans_right_vn-90069759 is not present in Agent 10.0.0.129 2025-12-08 03:12:16,019 - INFO - Validated that VN ctest-trans_right_vn-90069759 is not in any agent 2025-12-08 03:12:16,054 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-90069759 info 2025-12-08 03:12:16,054 - INFO - Deleting VN ctest-trans_left_vn-20301764 2025-12-08 03:12:16,268 - DEBUG - Response for deleting network () 2025-12-08 03:12:16,268 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/127ad526-d910-4f7d-aa51-e996c7194b2a 2025-12-08 03:12:16,273 - DEBUG - Response Code: 404 2025-12-08 03:12:16,274 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:16,278 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:16,331 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:16,426 - INFO - Validated that VN ctest-trans_left_vn-20301764 is not found in API Server 2025-12-08 03:12:16,435 - DEBUG - VN ctest-trans_left_vn-20301764 is not present in Agent 10.0.0.41 2025-12-08 03:12:16,454 - DEBUG - VN ctest-trans_left_vn-20301764 is not present in Agent 10.0.0.129 2025-12-08 03:12:16,454 - INFO - Validated that VN ctest-trans_left_vn-20301764 is not in any agent 2025-12-08 03:12:16,512 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-20301764 info 2025-12-08 03:12:16,512 - INFO - Deleting VN ctest-right_vn-95574729 2025-12-08 03:12:16,570 - DEBUG - VN 452ba28f-91ae-4a14-9530-5eafb610f194 still in use: Unable to complete operation on network 452ba28f-91ae-4a14-9530-5eafb610f194. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-7e8801d8-f8a4-41d4-b4f7-16b352c42f95'] 2025-12-08 03:12:16,571 - WARNING - Deleting VN ctest-right_vn-95574729 failed..Will retry 2025-12-08 03:12:18,731 - DEBUG - Response for deleting network () 2025-12-08 03:12:18,731 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/4739fa90-d752-4ce1-a49c-3e1ab67658fa 2025-12-08 03:12:18,739 - DEBUG - Response Code: 404 2025-12-08 03:12:18,739 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:18,748 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:18,761 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:18,855 - INFO - Validated that VN ctest-right_vn-95574729 is not found in API Server 2025-12-08 03:12:18,865 - DEBUG - VN ctest-right_vn-95574729 is not present in Agent 10.0.0.41 2025-12-08 03:12:18,876 - DEBUG - VN ctest-right_vn-95574729 is not present in Agent 10.0.0.129 2025-12-08 03:12:18,876 - INFO - Validated that VN ctest-right_vn-95574729 is not in any agent 2025-12-08 03:12:18,903 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-95574729 info 2025-12-08 03:12:18,903 - INFO - Deleting VN ctest-left_vn-29875997 2025-12-08 03:12:19,051 - DEBUG - Response for deleting network () 2025-12-08 03:12:19,051 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/95f82519-8a2b-4e76-8509-1e26b6504e94 2025-12-08 03:12:19,060 - DEBUG - Response Code: 404 2025-12-08 03:12:19,060 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:19,066 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:19,078 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:19,171 - INFO - Validated that VN ctest-left_vn-29875997 is not found in API Server 2025-12-08 03:12:19,181 - DEBUG - VN ctest-left_vn-29875997 is not present in Agent 10.0.0.41 2025-12-08 03:12:19,191 - DEBUG - VN ctest-left_vn-29875997 is not present in Agent 10.0.0.129 2025-12-08 03:12:19,191 - INFO - Validated that VN ctest-left_vn-29875997 is not in any agent 2025-12-08 03:12:19,222 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-29875997 info 2025-12-08 03:12:19,222 - INFO - Deleting VN ctest-mgmt_vn-51885993 2025-12-08 03:12:19,369 - DEBUG - Response for deleting network () 2025-12-08 03:12:19,369 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e30f9bf7-62b2-4159-afff-e431205a4fd4 2025-12-08 03:12:19,385 - DEBUG - Response Code: 404 2025-12-08 03:12:19,386 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-12-08 03:12:19,407 - DEBUG - Requesting: http://10.0.0.23:8082/domain/c5befdc1-279e-4ac1-9620-9608231491f8 2025-12-08 03:12:19,422 - DEBUG - Requesting: http://10.0.0.23:8082/project/c90ea538-4e85-4dde-84f6-f3037d80b932 2025-12-08 03:12:19,511 - INFO - Validated that VN ctest-mgmt_vn-51885993 is not found in API Server 2025-12-08 03:12:19,522 - DEBUG - VN ctest-mgmt_vn-51885993 is not present in Agent 10.0.0.41 2025-12-08 03:12:19,533 - DEBUG - VN ctest-mgmt_vn-51885993 is not present in Agent 10.0.0.129 2025-12-08 03:12:19,533 - INFO - Validated that VN ctest-mgmt_vn-51885993 is not in any agent 2025-12-08 03:12:19,562 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-51885993 info 2025-12-08 03:12:20,847 - DEBUG - No XMPP flaps were noticed during the test 2025-12-08 03:12:20,848 - INFO -
2025-12-08 03:12:20,848 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:15]
2025-12-08 03:12:20,848 - INFO - -------------------------------------------------------------------------------- 2025-12-08 03:12:21,677 - INFO - Deleted project: ctest-TestSvcHC-73892990, ID : c90ea538-4e85-4dde-84f6-f3037d80b932