2026-03-02 03:15:43,578 - INFO - Domain Default found not creating 2026-03-02 03:15:43,752 - INFO - Project ctest-TestSvcHC-47510988 not found, creating it 2026-03-02 03:15:44,342 - INFO - Created Project:ctest-TestSvcHC-47510988, ID : 3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:45,988 - INFO - ================================================================================ 2026-03-02 03:15:45,988 - INFO - STARTING TEST : test_svc_hc_basic 2026-03-02 03:15:47,263 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.254': '3', '10.20.0.193': '3'}, '10.0.0.240': {'10.20.0.254': '3', '10.20.0.193': '0'}} with 2026-03-02 03:15:47,263 - INFO - Initial checks done. Running the testcase now 2026-03-02 03:15:47,263 - INFO - 2026-03-02 03:15:48,011 - DEBUG - Response for create_network : {'network': {'id': '3076dd78-f900-4054-b894-6416aba4802a', 'name': 'ctest-mgmt_vn-96378985', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-mgmt_vn-96378985'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:15:48,380 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a1e8022-87d1-4033-896f-ea5ff38730b8', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': '3076dd78-f900-4054-b894-6416aba4802a', 'ip_version': 4, 'cidr': '215.201.241.192/26', 'allocation_pools': [{'start': '215.201.241.194', 'end': '215.201.241.254'}], 'gateway_ip': '215.201.241.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '215.201.241.194', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:15:48,403 - INFO - Created VN ctest-mgmt_vn-96378985 2026-03-02 03:15:48,414 - DEBUG - VN ctest-mgmt_vn-96378985 UUID is 3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:48,491 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:48,835 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:48,871 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:15:48,889 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:49,014 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:49,033 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:49,046 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/2e74cad0-f33d-4c8c-8dcf-9ee0984d6c4f 2026-03-02 03:15:49,070 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/2e74cad0-f33d-4c8c-8dcf-9ee0984d6c4f 2026-03-02 03:15:49,080 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/7ec29328-6a2b-41fc-bf3f-98a6a79324e1 2026-03-02 03:15:49,089 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:15:49,089 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:49,099 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/2e74cad0-f33d-4c8c-8dcf-9ee0984d6c4f 2026-03-02 03:15:49,117 - INFO - Verified VN network id 15 for VN 3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:49,118 - INFO - Verifications in API Server for VN ctest-mgmt_vn-96378985 passed 2026-03-02 03:15:49,118 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:49,129 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/2e74cad0-f33d-4c8c-8dcf-9ee0984d6c4f 2026-03-02 03:15:49,138 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/2e74cad0-f33d-4c8c-8dcf-9ee0984d6c4f 2026-03-02 03:15:49,163 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/7ec29328-6a2b-41fc-bf3f-98a6a79324e1 2026-03-02 03:15:49,184 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3492222072715755604', 'uuid-lslong': '13300365648063660074'}, 'enable': 'true', 'created': '2026-03-02T03:15:47', 'last-modified': '2026-03-02T03:15:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.869534'} 2026-03-02 03:15:49,191 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:15:49,200 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3492222072715755604', 'uuid-lslong': '13300365648063660074'}, 'enable': 'true', 'created': '2026-03-02T03:15:47', 'last-modified': '2026-03-02T03:15:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.888475'} 2026-03-02 03:15:49,207 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:15:49,213 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3492222072715755604', 'uuid-lslong': '13300365648063660074'}, 'enable': 'true', 'created': '2026-03-02T03:15:47', 'last-modified': '2026-03-02T03:15:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.904289'} 2026-03-02 03:15:49,219 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:15:49,220 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-96378985 passed 2026-03-02 03:15:49,220 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-96378985 in API_Server ====== 2026-03-02 03:15:49,220 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:49,226 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:15:49,240 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:49,356 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/3076dd78-f900-4054-b894-6416aba4802a 2026-03-02 03:15:49,367 - DEBUG - =>VN ctest-mgmt_vn-96378985 has no policy to be verified 2026-03-02 03:15:49,367 - DEBUG - Verifying the vn in opserver 2026-03-02 03:15:49,367 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985 virtual network link through opserver 10.0.0.242 2026-03-02 03:15:49,367 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:15:49,704 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:15:49,772 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985?flat'} 2026-03-02 03:15:49,772 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985 virtual network link through opserver 10.0.0.27 2026-03-02 03:15:49,772 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:15:50,123 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:15:50,221 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985?flat'} 2026-03-02 03:15:50,221 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985 virtual network link through opserver 10.0.0.23 2026-03-02 03:15:50,221 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:15:50,567 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:15:50,630 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985?flat'} 2026-03-02 03:15:50,630 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-96378985 is found in opserver 2026-03-02 03:15:50,651 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:15:50,662 - DEBUG - VRF ids for VN ctest-mgmt_vn-96378985: {} 2026-03-02 03:15:50,957 - DEBUG - Response for create_network : {'network': {'id': 'dab4ec2e-7bb5-4004-b85b-6609ea48971f', 'name': 'ctest-left_vn-39519775', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-left_vn-39519775'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:15:51,233 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a77e585f-676f-47cf-8448-20d99ade3fea', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': 'dab4ec2e-7bb5-4004-b85b-6609ea48971f', 'ip_version': 4, 'cidr': '105.153.227.64/26', 'allocation_pools': [{'start': '105.153.227.66', 'end': '105.153.227.126'}], 'gateway_ip': '105.153.227.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '105.153.227.66', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:15:51,256 - INFO - Created VN ctest-left_vn-39519775 2026-03-02 03:15:51,269 - DEBUG - VN ctest-left_vn-39519775 UUID is dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,344 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:51,351 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:15:51,373 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:51,482 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,503 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,520 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/6436fb98-934e-427f-982c-a64b8913030a 2026-03-02 03:15:51,536 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/6436fb98-934e-427f-982c-a64b8913030a 2026-03-02 03:15:51,547 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4799e37b-3778-4bfb-b0d6-340d5eff9673 2026-03-02 03:15:51,556 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:15:51,556 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,568 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/6436fb98-934e-427f-982c-a64b8913030a 2026-03-02 03:15:51,584 - INFO - Verified VN network id 16 for VN dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,584 - INFO - Verifications in API Server for VN ctest-left_vn-39519775 passed 2026-03-02 03:15:51,584 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,595 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/6436fb98-934e-427f-982c-a64b8913030a 2026-03-02 03:15:51,602 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/6436fb98-934e-427f-982c-a64b8913030a 2026-03-02 03:15:51,610 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/4799e37b-3778-4bfb-b0d6-340d5eff9673 2026-03-02 03:15:51,626 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15759480680464334852', 'uuid-lslong': '13284323718630774559'}, 'enable': 'true', 'created': '2026-03-02T03:15:50', 'last-modified': '2026-03-02T03:15:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.458674'} 2026-03-02 03:15:51,633 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:15:51,639 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15759480680464334852', 'uuid-lslong': '13284323718630774559'}, 'enable': 'true', 'created': '2026-03-02T03:15:50', 'last-modified': '2026-03-02T03:15:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.475380'} 2026-03-02 03:15:51,647 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:15:51,651 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15759480680464334852', 'uuid-lslong': '13284323718630774559'}, 'enable': 'true', 'created': '2026-03-02T03:15:50', 'last-modified': '2026-03-02T03:15:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485981'} 2026-03-02 03:15:51,656 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:15:51,657 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-39519775 passed 2026-03-02 03:15:51,657 - DEBUG - ====Verifying policy data for ctest-left_vn-39519775 in API_Server ====== 2026-03-02 03:15:51,657 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:51,663 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:15:51,675 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:51,772 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/dab4ec2e-7bb5-4004-b85b-6609ea48971f 2026-03-02 03:15:51,792 - DEBUG - =>VN ctest-left_vn-39519775 has no policy to be verified 2026-03-02 03:15:51,792 - DEBUG - Verifying the vn in opserver 2026-03-02 03:15:51,792 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775 virtual network link through opserver 10.0.0.242 2026-03-02 03:15:51,792 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:15:51,916 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775?flat'} 2026-03-02 03:15:51,916 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775 virtual network link through opserver 10.0.0.27 2026-03-02 03:15:51,916 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:15:51,982 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775?flat'} 2026-03-02 03:15:51,982 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775 virtual network link through opserver 10.0.0.23 2026-03-02 03:15:51,982 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:15:52,040 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775?flat'} 2026-03-02 03:15:52,040 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-39519775 is found in opserver 2026-03-02 03:15:52,060 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:15:52,070 - DEBUG - VRF ids for VN ctest-left_vn-39519775: {} 2026-03-02 03:15:52,394 - DEBUG - Response for create_network : {'network': {'id': 'fe0dae4d-f91a-4ac0-b844-58aaaec44e86', 'name': 'ctest-right_vn-86596665', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-right_vn-86596665'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:15:52,664 - DEBUG - Response for create_subnet : {'subnet': {'id': '465eb304-ebe8-4697-a47c-1adef0759b5a', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': 'fe0dae4d-f91a-4ac0-b844-58aaaec44e86', 'ip_version': 4, 'cidr': '52.100.171.128/26', 'allocation_pools': [{'start': '52.100.171.130', 'end': '52.100.171.190'}], 'gateway_ip': '52.100.171.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '52.100.171.130', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:15:52,691 - INFO - Created VN ctest-right_vn-86596665 2026-03-02 03:15:52,707 - DEBUG - VN ctest-right_vn-86596665 UUID is fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:52,783 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:52,790 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:15:52,802 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:52,927 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:52,963 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:52,980 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/5fde0680-0a86-4e58-b3a0-3567fa8906b1 2026-03-02 03:15:52,991 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/5fde0680-0a86-4e58-b3a0-3567fa8906b1 2026-03-02 03:15:53,000 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/7506509d-5c79-44f5-bb8f-ea43e617e77c 2026-03-02 03:15:53,011 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:15:53,011 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:53,022 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/5fde0680-0a86-4e58-b3a0-3567fa8906b1 2026-03-02 03:15:53,039 - INFO - Verified VN network id 17 for VN fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:53,039 - INFO - Verifications in API Server for VN ctest-right_vn-86596665 passed 2026-03-02 03:15:53,039 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:53,056 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/5fde0680-0a86-4e58-b3a0-3567fa8906b1 2026-03-02 03:15:53,065 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/5fde0680-0a86-4e58-b3a0-3567fa8906b1 2026-03-02 03:15:53,077 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/7506509d-5c79-44f5-bb8f-ea43e617e77c 2026-03-02 03:15:53,102 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18306479710245898944', 'uuid-lslong': '13277835091494850182'}, 'enable': 'true', 'created': '2026-03-02T03:15:52', 'last-modified': '2026-03-02T03:15:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490550'} 2026-03-02 03:15:53,109 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:15:53,116 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18306479710245898944', 'uuid-lslong': '13277835091494850182'}, 'enable': 'true', 'created': '2026-03-02T03:15:52', 'last-modified': '2026-03-02T03:15:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.507414'} 2026-03-02 03:15:53,124 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:15:53,133 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18306479710245898944', 'uuid-lslong': '13277835091494850182'}, 'enable': 'true', 'created': '2026-03-02T03:15:52', 'last-modified': '2026-03-02T03:15:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.520530'} 2026-03-02 03:15:53,140 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:15:53,140 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-86596665 passed 2026-03-02 03:15:53,140 - DEBUG - ====Verifying policy data for ctest-right_vn-86596665 in API_Server ====== 2026-03-02 03:15:53,140 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:15:53,149 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:15:53,207 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:15:53,336 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/fe0dae4d-f91a-4ac0-b844-58aaaec44e86 2026-03-02 03:15:53,368 - DEBUG - =>VN ctest-right_vn-86596665 has no policy to be verified 2026-03-02 03:15:53,368 - DEBUG - Verifying the vn in opserver 2026-03-02 03:15:53,368 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665 virtual network link through opserver 10.0.0.242 2026-03-02 03:15:53,368 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:15:53,540 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665?flat'} 2026-03-02 03:15:53,540 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665 virtual network link through opserver 10.0.0.27 2026-03-02 03:15:53,540 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:15:53,645 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665?flat'} 2026-03-02 03:15:53,645 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665 virtual network link through opserver 10.0.0.23 2026-03-02 03:15:53,645 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:15:53,793 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665?flat'} 2026-03-02 03:15:53,793 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-86596665 is found in opserver 2026-03-02 03:15:53,825 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:15:53,843 - DEBUG - VRF ids for VN ctest-right_vn-86596665: {} 2026-03-02 03:15:53,951 - DEBUG - Services list from nova: [, , , ] 2026-03-02 03:15:55,291 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5413-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5413-1) 2026-03-02 03:15:56,741 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5413-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5413-2) 2026-03-02 03:15:56,745 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-39445110'] 2026-03-02 03:15:57,066 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-39445110'] created succesfully 2026-03-02 03:15:57,558 - DEBUG - Image by name tiny_nat_fw not found 2026-03-02 03:15:57,558 - DEBUG - Installing image tiny_nat_fw 2026-03-02 03:15:57,558 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2026-03-02 03:15:57,558 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-02 03:15:57,558 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-02 03:15:57,558 - DEBUG - Unzip image 2026-03-02 03:15:57,559 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2026-03-02 03:15:57,585 - INFO - image /contrail-test/images/tinycore-in-network-nat.qcow2 is not found 2026-03-02 03:15:57,586 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-39445110'] 2026-03-02 03:15:57,714 - INFO - Service template: ['default-domain', 'ctest-service_template_1-39445110'] deleted successfully. 2026-03-02 03:15:57,715 - INFO - Skip interface_detach for VM ctest-right_vm-10290061 in state BUILD 2026-03-02 03:15:57,715 - INFO - Deleting VM ctest-right_vm-10290061 2026-03-02 03:15:57,798 - ERROR - VM ctest-right_vm-10290061 has failed to come up 2026-03-02 03:15:57,798 - ERROR - Nova failed to get host of the VM 2026-03-02 03:15:57,799 - ERROR - VM ctest-right_vm-10290061 has failed to come up 2026-03-02 03:15:57,799 - ERROR - Nova failed to get host of the VM 2026-03-02 03:15:57,935 - INFO - Skip interface_detach for VM ctest-left_vm-08097871 in state BUILD 2026-03-02 03:15:57,935 - INFO - Deleting VM ctest-left_vm-08097871 2026-03-02 03:15:57,935 - ERROR - VM ctest-left_vm-08097871 has failed to come up 2026-03-02 03:15:57,935 - ERROR - Nova failed to get host of the VM 2026-03-02 03:15:57,935 - ERROR - VM ctest-left_vm-08097871 has failed to come up 2026-03-02 03:15:57,935 - ERROR - Nova failed to get host of the VM 2026-03-02 03:15:58,031 - INFO - Deleting VN ctest-right_vn-86596665 2026-03-02 03:15:58,081 - DEBUG - VN fe0dae4d-f91a-4ac0-b844-58aaaec44e86 still in use: Unable to complete operation on network fe0dae4d-f91a-4ac0-b844-58aaaec44e86. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-91891306-bf74-4ccf-92c8-90198e509896'] 2026-03-02 03:15:58,081 - WARNING - Deleting VN ctest-right_vn-86596665 failed..Will retry 2026-03-02 03:16:00,322 - DEBUG - Response for deleting network () 2026-03-02 03:16:00,322 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/5fde0680-0a86-4e58-b3a0-3567fa8906b1 2026-03-02 03:16:00,340 - DEBUG - Response Code: 404 2026-03-02 03:16:00,340 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:00,360 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:00,378 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:00,481 - INFO - Validated that VN ctest-right_vn-86596665 is not found in API Server 2026-03-02 03:16:00,493 - DEBUG - VN ctest-right_vn-86596665 is not present in Agent 10.0.0.41 2026-03-02 03:16:00,504 - DEBUG - VN ctest-right_vn-86596665 is not present in Agent 10.0.0.240 2026-03-02 03:16:00,504 - INFO - Validated that VN ctest-right_vn-86596665 is not in any agent 2026-03-02 03:16:00,537 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-86596665 info 2026-03-02 03:16:00,538 - INFO - Deleting VN ctest-left_vn-39519775 2026-03-02 03:16:00,736 - DEBUG - Response for deleting network () 2026-03-02 03:16:00,736 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/6436fb98-934e-427f-982c-a64b8913030a 2026-03-02 03:16:00,745 - DEBUG - Response Code: 404 2026-03-02 03:16:00,746 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:00,754 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:00,808 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:00,924 - INFO - Validated that VN ctest-left_vn-39519775 is not found in API Server 2026-03-02 03:16:00,939 - DEBUG - VN ctest-left_vn-39519775 is not present in Agent 10.0.0.41 2026-03-02 03:16:00,958 - DEBUG - VN ctest-left_vn-39519775 is not present in Agent 10.0.0.240 2026-03-02 03:16:00,958 - INFO - Validated that VN ctest-left_vn-39519775 is not in any agent 2026-03-02 03:16:00,995 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-39519775 info 2026-03-02 03:16:00,995 - INFO - Deleting VN ctest-mgmt_vn-96378985 2026-03-02 03:16:01,255 - DEBUG - Response for deleting network () 2026-03-02 03:16:01,255 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/2e74cad0-f33d-4c8c-8dcf-9ee0984d6c4f 2026-03-02 03:16:01,261 - DEBUG - Response Code: 404 2026-03-02 03:16:01,262 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:01,268 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:01,329 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:01,445 - INFO - Validated that VN ctest-mgmt_vn-96378985 is not found in API Server 2026-03-02 03:16:01,463 - DEBUG - VN ctest-mgmt_vn-96378985 is not present in Agent 10.0.0.41 2026-03-02 03:16:01,488 - DEBUG - VN ctest-mgmt_vn-96378985 is not present in Agent 10.0.0.240 2026-03-02 03:16:01,488 - INFO - Validated that VN ctest-mgmt_vn-96378985 is not in any agent 2026-03-02 03:16:01,535 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-96378985 info 2026-03-02 03:16:02,847 - DEBUG - No XMPP flaps were noticed during the test 2026-03-02 03:16:02,847 - INFO - 2026-03-02 03:16:02,848 - INFO - END TEST : test_svc_hc_basic : SKIPPED[0:00:17] 2026-03-02 03:16:02,848 - INFO - -------------------------------------------------------------------------------- 2026-03-02 03:16:02,853 - INFO - ================================================================================ 2026-03-02 03:16:02,853 - INFO - STARTING TEST : test_svc_trans_segment_right_hc_fail_svm 2026-03-02 03:16:04,130 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.254': '3', '10.20.0.193': '3'}, '10.0.0.240': {'10.20.0.254': '3', '10.20.0.193': '0'}} with 2026-03-02 03:16:04,130 - INFO - Initial checks done. Running the testcase now 2026-03-02 03:16:04,130 - INFO - 2026-03-02 03:16:04,410 - DEBUG - Response for create_network : {'network': {'id': '20f4f4c5-ba8b-4095-bfeb-b944ae777659', 'name': 'ctest-mgmt_vn-12211020', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-mgmt_vn-12211020'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:16:04,732 - DEBUG - Response for create_subnet : {'subnet': {'id': '75678340-a213-4e62-9aed-e7093613aa27', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': '20f4f4c5-ba8b-4095-bfeb-b944ae777659', 'ip_version': 4, 'cidr': '173.103.158.128/26', 'allocation_pools': [{'start': '173.103.158.130', 'end': '173.103.158.190'}], 'gateway_ip': '173.103.158.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '173.103.158.130', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:16:04,760 - INFO - Created VN ctest-mgmt_vn-12211020 2026-03-02 03:16:04,776 - DEBUG - VN ctest-mgmt_vn-12211020 UUID is 20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:04,858 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:04,865 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:04,877 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:04,982 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:04,999 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:05,009 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/a1c9bd9b-7aa2-41e3-a188-2cb11f472735 2026-03-02 03:16:05,018 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/a1c9bd9b-7aa2-41e3-a188-2cb11f472735 2026-03-02 03:16:05,026 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/e72f0600-7f01-4f17-a3d9-461210afcbfa 2026-03-02 03:16:05,035 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:16:05,035 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:05,047 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/a1c9bd9b-7aa2-41e3-a188-2cb11f472735 2026-03-02 03:16:05,066 - INFO - Verified VN network id 15 for VN 20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:05,067 - INFO - Verifications in API Server for VN ctest-mgmt_vn-12211020 passed 2026-03-02 03:16:05,068 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:05,080 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/a1c9bd9b-7aa2-41e3-a188-2cb11f472735 2026-03-02 03:16:05,088 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/a1c9bd9b-7aa2-41e3-a188-2cb11f472735 2026-03-02 03:16:05,096 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/e72f0600-7f01-4f17-a3d9-461210afcbfa 2026-03-02 03:16:05,111 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2374792033606516885', 'uuid-lslong': '13829350785407219289'}, 'enable': 'true', 'created': '2026-03-02T03:16:04', 'last-modified': '2026-03-02T03:16:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463606'} 2026-03-02 03:16:05,122 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:16:05,129 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2374792033606516885', 'uuid-lslong': '13829350785407219289'}, 'enable': 'true', 'created': '2026-03-02T03:16:04', 'last-modified': '2026-03-02T03:16:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482648'} 2026-03-02 03:16:05,137 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:16:05,143 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2374792033606516885', 'uuid-lslong': '13829350785407219289'}, 'enable': 'true', 'created': '2026-03-02T03:16:04', 'last-modified': '2026-03-02T03:16:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.494977'} 2026-03-02 03:16:05,148 - DEBUG - Route Targets: ['target:64512:8000004'] 2026-03-02 03:16:05,149 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-12211020 passed 2026-03-02 03:16:05,149 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-12211020 in API_Server ====== 2026-03-02 03:16:05,149 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:05,156 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:05,169 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:05,274 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/20f4f4c5-ba8b-4095-bfeb-b944ae777659 2026-03-02 03:16:05,284 - DEBUG - =>VN ctest-mgmt_vn-12211020 has no policy to be verified 2026-03-02 03:16:05,284 - DEBUG - Verifying the vn in opserver 2026-03-02 03:16:05,284 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020 virtual network link through opserver 10.0.0.242 2026-03-02 03:16:05,285 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:16:05,297 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020?flat'} 2026-03-02 03:16:05,297 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020 virtual network link through opserver 10.0.0.27 2026-03-02 03:16:05,297 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:16:05,315 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020?flat'} 2026-03-02 03:16:05,315 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020 virtual network link through opserver 10.0.0.23 2026-03-02 03:16:05,315 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:16:05,330 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020?flat'} 2026-03-02 03:16:05,330 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-mgmt_vn-12211020 is found in opserver 2026-03-02 03:16:05,351 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:16:05,362 - DEBUG - VRF ids for VN ctest-mgmt_vn-12211020: {} 2026-03-02 03:16:05,666 - DEBUG - Response for create_network : {'network': {'id': 'b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324', 'name': 'ctest-left_vn-93921732', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-left_vn-93921732'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:16:05,940 - DEBUG - Response for create_subnet : {'subnet': {'id': '0afe6bac-e0d7-4f29-9dfb-6278a89e0754', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': 'b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324', 'ip_version': 4, 'cidr': '218.124.166.64/26', 'allocation_pools': [{'start': '218.124.166.66', 'end': '218.124.166.126'}], 'gateway_ip': '218.124.166.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.124.166.66', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:16:05,967 - INFO - Created VN ctest-left_vn-93921732 2026-03-02 03:16:05,978 - DEBUG - VN ctest-left_vn-93921732 UUID is b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,056 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:06,062 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:06,073 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:06,164 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,179 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,188 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/07d5c14b-17c3-4dbf-8b57-2ed4f1891919 2026-03-02 03:16:06,196 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/07d5c14b-17c3-4dbf-8b57-2ed4f1891919 2026-03-02 03:16:06,203 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/7e8ba00a-403c-4638-866c-d576729479e7 2026-03-02 03:16:06,212 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:16:06,212 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,224 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/07d5c14b-17c3-4dbf-8b57-2ed4f1891919 2026-03-02 03:16:06,238 - INFO - Verified VN network id 16 for VN b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,239 - INFO - Verifications in API Server for VN ctest-left_vn-93921732 passed 2026-03-02 03:16:06,239 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,248 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/07d5c14b-17c3-4dbf-8b57-2ed4f1891919 2026-03-02 03:16:06,255 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/07d5c14b-17c3-4dbf-8b57-2ed4f1891919 2026-03-02 03:16:06,262 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/7e8ba00a-403c-4638-866c-d576729479e7 2026-03-02 03:16:06,273 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13289293052947811694', 'uuid-lslong': '13798389605527892772'}, 'enable': 'true', 'created': '2026-03-02T03:16:05', 'last-modified': '2026-03-02T03:16:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398190'} 2026-03-02 03:16:06,279 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:16:06,284 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13289293052947811694', 'uuid-lslong': '13798389605527892772'}, 'enable': 'true', 'created': '2026-03-02T03:16:05', 'last-modified': '2026-03-02T03:16:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407798'} 2026-03-02 03:16:06,291 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:16:06,296 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13289293052947811694', 'uuid-lslong': '13798389605527892772'}, 'enable': 'true', 'created': '2026-03-02T03:16:05', 'last-modified': '2026-03-02T03:16:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.422048'} 2026-03-02 03:16:06,301 - DEBUG - Route Targets: ['target:64512:8000005'] 2026-03-02 03:16:06,301 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-93921732 passed 2026-03-02 03:16:06,301 - DEBUG - ====Verifying policy data for ctest-left_vn-93921732 in API_Server ====== 2026-03-02 03:16:06,301 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:06,306 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:06,317 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:06,412 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/b86d0d9f-3905-4d6e-bf7d-ba3d3deeb324 2026-03-02 03:16:06,423 - DEBUG - =>VN ctest-left_vn-93921732 has no policy to be verified 2026-03-02 03:16:06,423 - DEBUG - Verifying the vn in opserver 2026-03-02 03:16:06,423 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732 virtual network link through opserver 10.0.0.242 2026-03-02 03:16:06,423 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:16:06,435 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732?flat'} 2026-03-02 03:16:06,435 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732 virtual network link through opserver 10.0.0.27 2026-03-02 03:16:06,435 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:16:06,448 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732?flat'} 2026-03-02 03:16:06,448 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732 virtual network link through opserver 10.0.0.23 2026-03-02 03:16:06,448 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:16:06,460 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732?flat'} 2026-03-02 03:16:06,460 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-left_vn-93921732 is found in opserver 2026-03-02 03:16:06,483 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:16:06,493 - DEBUG - VRF ids for VN ctest-left_vn-93921732: {} 2026-03-02 03:16:06,786 - DEBUG - Response for create_network : {'network': {'id': '72a1b701-78f1-43da-9798-82e5ff3ebab4', 'name': 'ctest-right_vn-94476609', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-right_vn-94476609'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:16:07,006 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e4f8e8b0-c418-4779-af44-ff4177ca113d', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': '72a1b701-78f1-43da-9798-82e5ff3ebab4', 'ip_version': 4, 'cidr': '106.50.188.192/26', 'allocation_pools': [{'start': '106.50.188.194', 'end': '106.50.188.254'}], 'gateway_ip': '106.50.188.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '106.50.188.194', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:16:07,030 - INFO - Created VN ctest-right_vn-94476609 2026-03-02 03:16:07,041 - DEBUG - VN ctest-right_vn-94476609 UUID is 72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,112 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:07,117 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:07,130 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:07,228 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,246 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,256 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/9f10e35e-12fa-4332-b735-3dc82236fb4d 2026-03-02 03:16:07,267 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/9f10e35e-12fa-4332-b735-3dc82236fb4d 2026-03-02 03:16:07,274 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/6d49a6c0-8ead-4ca0-b2d6-9f6da81a042a 2026-03-02 03:16:07,282 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:16:07,282 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,290 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/9f10e35e-12fa-4332-b735-3dc82236fb4d 2026-03-02 03:16:07,308 - INFO - Verified VN network id 17 for VN 72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,308 - INFO - Verifications in API Server for VN ctest-right_vn-94476609 passed 2026-03-02 03:16:07,308 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,319 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/9f10e35e-12fa-4332-b735-3dc82236fb4d 2026-03-02 03:16:07,326 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/9f10e35e-12fa-4332-b735-3dc82236fb4d 2026-03-02 03:16:07,335 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/6d49a6c0-8ead-4ca0-b2d6-9f6da81a042a 2026-03-02 03:16:07,348 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8260084408526128090', 'uuid-lslong': '10923624820528560820'}, 'enable': 'true', 'created': '2026-03-02T03:16:06', 'last-modified': '2026-03-02T03:16:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.388627'} 2026-03-02 03:16:07,355 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:16:07,362 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8260084408526128090', 'uuid-lslong': '10923624820528560820'}, 'enable': 'true', 'created': '2026-03-02T03:16:06', 'last-modified': '2026-03-02T03:16:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.405733'} 2026-03-02 03:16:07,371 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:16:07,378 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8260084408526128090', 'uuid-lslong': '10923624820528560820'}, 'enable': 'true', 'created': '2026-03-02T03:16:06', 'last-modified': '2026-03-02T03:16:06', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424786'} 2026-03-02 03:16:07,384 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-03-02 03:16:07,385 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-94476609 passed 2026-03-02 03:16:07,385 - DEBUG - ====Verifying policy data for ctest-right_vn-94476609 in API_Server ====== 2026-03-02 03:16:07,385 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:07,390 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:07,403 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:07,495 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/72a1b701-78f1-43da-9798-82e5ff3ebab4 2026-03-02 03:16:07,507 - DEBUG - =>VN ctest-right_vn-94476609 has no policy to be verified 2026-03-02 03:16:07,507 - DEBUG - Verifying the vn in opserver 2026-03-02 03:16:07,507 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609 virtual network link through opserver 10.0.0.242 2026-03-02 03:16:07,508 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:16:07,520 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609?flat'} 2026-03-02 03:16:07,521 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609 virtual network link through opserver 10.0.0.27 2026-03-02 03:16:07,521 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:16:07,536 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609?flat'} 2026-03-02 03:16:07,536 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609 virtual network link through opserver 10.0.0.23 2026-03-02 03:16:07,536 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:16:07,548 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609?flat'} 2026-03-02 03:16:07,548 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-right_vn-94476609 is found in opserver 2026-03-02 03:16:07,573 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:16:07,584 - DEBUG - VRF ids for VN ctest-right_vn-94476609: {} 2026-03-02 03:16:07,853 - DEBUG - Response for create_network : {'network': {'id': 'd4f112e5-ee1a-4150-984b-8ee6e0d85657', 'name': 'ctest-trans_left_vn-41994767', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-trans_left_vn-41994767'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:16:08,142 - DEBUG - Response for create_subnet : {'subnet': {'id': '70771402-5ef7-46ad-8282-00d6e9118826', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': 'd4f112e5-ee1a-4150-984b-8ee6e0d85657', 'ip_version': 4, 'cidr': '36.27.65.128/26', 'allocation_pools': [{'start': '36.27.65.130', 'end': '36.27.65.190'}], 'gateway_ip': '36.27.65.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '36.27.65.130', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:16:08,168 - INFO - Created VN ctest-trans_left_vn-41994767 2026-03-02 03:16:08,184 - DEBUG - VN ctest-trans_left_vn-41994767 UUID is d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,278 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:08,285 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:08,298 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:08,398 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,411 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,422 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/163b5850-3e6c-4460-ba3e-2214dce3dfce 2026-03-02 03:16:08,429 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/163b5850-3e6c-4460-ba3e-2214dce3dfce 2026-03-02 03:16:08,437 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/6c7bbb77-e64d-4426-8249-39fe4de35d06 2026-03-02 03:16:08,445 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-02 03:16:08,445 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,458 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/163b5850-3e6c-4460-ba3e-2214dce3dfce 2026-03-02 03:16:08,476 - INFO - Verified VN network id 18 for VN d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,476 - INFO - Verifications in API Server for VN ctest-trans_left_vn-41994767 passed 2026-03-02 03:16:08,476 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,486 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/163b5850-3e6c-4460-ba3e-2214dce3dfce 2026-03-02 03:16:08,493 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/163b5850-3e6c-4460-ba3e-2214dce3dfce 2026-03-02 03:16:08,502 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/6c7bbb77-e64d-4426-8249-39fe4de35d06 2026-03-02 03:16:08,514 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15344066184179499344', 'uuid-lslong': '10974022039284242007'}, 'enable': 'true', 'created': '2026-03-02T03:16:07', 'last-modified': '2026-03-02T03:16:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443487'} 2026-03-02 03:16:08,522 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-02 03:16:08,528 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15344066184179499344', 'uuid-lslong': '10974022039284242007'}, 'enable': 'true', 'created': '2026-03-02T03:16:07', 'last-modified': '2026-03-02T03:16:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.457467'} 2026-03-02 03:16:08,535 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-02 03:16:08,540 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15344066184179499344', 'uuid-lslong': '10974022039284242007'}, 'enable': 'true', 'created': '2026-03-02T03:16:07', 'last-modified': '2026-03-02T03:16:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467979'} 2026-03-02 03:16:08,546 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-03-02 03:16:08,546 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-41994767 passed 2026-03-02 03:16:08,546 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-41994767 in API_Server ====== 2026-03-02 03:16:08,546 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:08,553 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:08,567 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:08,671 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/d4f112e5-ee1a-4150-984b-8ee6e0d85657 2026-03-02 03:16:08,686 - DEBUG - =>VN ctest-trans_left_vn-41994767 has no policy to be verified 2026-03-02 03:16:08,686 - DEBUG - Verifying the vn in opserver 2026-03-02 03:16:08,686 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767 virtual network link through opserver 10.0.0.242 2026-03-02 03:16:08,686 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:16:08,699 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767?flat'} 2026-03-02 03:16:08,699 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767 virtual network link through opserver 10.0.0.27 2026-03-02 03:16:08,699 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:16:08,714 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767?flat'} 2026-03-02 03:16:08,714 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767 virtual network link through opserver 10.0.0.23 2026-03-02 03:16:08,714 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:16:08,731 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767?flat'} 2026-03-02 03:16:08,731 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-trans_left_vn-41994767 is found in opserver 2026-03-02 03:16:08,751 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:16:08,761 - DEBUG - VRF ids for VN ctest-trans_left_vn-41994767: {} 2026-03-02 03:16:09,050 - DEBUG - Response for create_network : {'network': {'id': '12adb9b6-48c2-485c-b7bd-9a1a0cd88903', 'name': 'ctest-trans_right_vn-86424427', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcHC-47510988', 'ctest-trans_right_vn-86424427'], 'port_security_enabled': True, 'description': ''}} 2026-03-02 03:16:09,321 - DEBUG - Response for create_subnet : {'subnet': {'id': '286f6273-9894-4915-9e9b-14285194cff1', 'name': '', 'tenant_id': '3e130c37945c4bdebe5ee2e45dfede4a', 'network_id': '12adb9b6-48c2-485c-b7bd-9a1a0cd88903', 'ip_version': 4, 'cidr': '197.169.36.128/26', 'allocation_pools': [{'start': '197.169.36.130', 'end': '197.169.36.190'}], 'gateway_ip': '197.169.36.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '197.169.36.130', 'tags': [], 'project_id': '3e130c37945c4bdebe5ee2e45dfede4a'}} 2026-03-02 03:16:09,343 - INFO - Created VN ctest-trans_right_vn-86424427 2026-03-02 03:16:09,354 - DEBUG - VN ctest-trans_right_vn-86424427 UUID is 12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,425 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:09,431 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:09,441 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:09,556 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,569 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,582 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8099f73b-a9bc-44db-a588-1c4dc6739cbc 2026-03-02 03:16:09,589 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8099f73b-a9bc-44db-a588-1c4dc6739cbc 2026-03-02 03:16:09,598 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/550b26ae-5e58-4a5f-9ff2-1fc1c863fae9 2026-03-02 03:16:09,607 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-02 03:16:09,607 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,618 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8099f73b-a9bc-44db-a588-1c4dc6739cbc 2026-03-02 03:16:09,639 - INFO - Verified VN network id 19 for VN 12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,639 - INFO - Verifications in API Server for VN ctest-trans_right_vn-86424427 passed 2026-03-02 03:16:09,639 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,650 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8099f73b-a9bc-44db-a588-1c4dc6739cbc 2026-03-02 03:16:09,657 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8099f73b-a9bc-44db-a588-1c4dc6739cbc 2026-03-02 03:16:09,664 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/550b26ae-5e58-4a5f-9ff2-1fc1c863fae9 2026-03-02 03:16:09,676 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1345936056209524828', 'uuid-lslong': '13239907916214470915'}, 'enable': 'true', 'created': '2026-03-02T03:16:08', 'last-modified': '2026-03-02T03:16:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406323'} 2026-03-02 03:16:09,682 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-02 03:16:09,687 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1345936056209524828', 'uuid-lslong': '13239907916214470915'}, 'enable': 'true', 'created': '2026-03-02T03:16:08', 'last-modified': '2026-03-02T03:16:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.417527'} 2026-03-02 03:16:09,693 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-02 03:16:09,700 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcHC-47510988', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1345936056209524828', 'uuid-lslong': '13239907916214470915'}, 'enable': 'true', 'created': '2026-03-02T03:16:08', 'last-modified': '2026-03-02T03:16:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.430622'} 2026-03-02 03:16:09,705 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-03-02 03:16:09,705 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-86424427 passed 2026-03-02 03:16:09,705 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-86424427 in API_Server ====== 2026-03-02 03:16:09,705 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:09,711 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:09,723 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:09,817 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/12adb9b6-48c2-485c-b7bd-9a1a0cd88903 2026-03-02 03:16:09,839 - DEBUG - =>VN ctest-trans_right_vn-86424427 has no policy to be verified 2026-03-02 03:16:09,839 - DEBUG - Verifying the vn in opserver 2026-03-02 03:16:09,839 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427 virtual network link through opserver 10.0.0.242 2026-03-02 03:16:09,839 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-03-02 03:16:09,852 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427?flat'} 2026-03-02 03:16:09,852 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427 virtual network link through opserver 10.0.0.27 2026-03-02 03:16:09,852 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-03-02 03:16:09,867 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427?flat'} 2026-03-02 03:16:09,867 - DEBUG - Verifying the default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427 virtual network link through opserver 10.0.0.23 2026-03-02 03:16:09,867 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-03-02 03:16:09,881 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427?flat'} 2026-03-02 03:16:09,881 - INFO - Validated that VN default-domain:ctest-TestSvcHC-47510988:ctest-trans_right_vn-86424427 is found in opserver 2026-03-02 03:16:09,903 - DEBUG - Do not have enough data to verify VN in agent 2026-03-02 03:16:09,914 - DEBUG - VRF ids for VN ctest-trans_right_vn-86424427: {} 2026-03-02 03:16:11,118 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5413-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5413-2) 2026-03-02 03:16:12,544 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5413-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5413-1) 2026-03-02 03:16:12,545 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-51477868'] 2026-03-02 03:16:12,854 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-51477868'] created succesfully 2026-03-02 03:16:13,260 - DEBUG - Image by name tiny_trans_fw not found 2026-03-02 03:16:13,260 - DEBUG - Installing image tiny_trans_fw 2026-03-02 03:16:13,260 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2026-03-02 03:16:13,260 - DEBUG - Image build path file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-02 03:16:13,261 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-02 03:16:13,261 - DEBUG - Unzip image 2026-03-02 03:16:13,261 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2026-03-02 03:16:13,286 - INFO - image /contrail-test/images/tinycore-net-transparent-fw.qcow2 is not found 2026-03-02 03:16:13,287 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-51477868'] 2026-03-02 03:16:13,378 - INFO - Service template: ['default-domain', 'ctest-service_template_1-51477868'] deleted successfully. 2026-03-02 03:16:13,378 - INFO - Skip interface_detach for VM ctest-right_vm-54976816 in state BUILD 2026-03-02 03:16:13,378 - INFO - Deleting VM ctest-right_vm-54976816 2026-03-02 03:16:13,379 - ERROR - VM ctest-right_vm-54976816 has failed to come up 2026-03-02 03:16:13,379 - ERROR - Nova failed to get host of the VM 2026-03-02 03:16:13,379 - ERROR - VM ctest-right_vm-54976816 has failed to come up 2026-03-02 03:16:13,379 - ERROR - Nova failed to get host of the VM 2026-03-02 03:16:13,461 - INFO - Skip interface_detach for VM ctest-left_vm-16059764 in state BUILD 2026-03-02 03:16:13,461 - INFO - Deleting VM ctest-left_vm-16059764 2026-03-02 03:16:13,461 - ERROR - VM ctest-left_vm-16059764 has failed to come up 2026-03-02 03:16:13,461 - ERROR - Nova failed to get host of the VM 2026-03-02 03:16:13,461 - ERROR - VM ctest-left_vm-16059764 has failed to come up 2026-03-02 03:16:13,462 - ERROR - Nova failed to get host of the VM 2026-03-02 03:16:13,544 - INFO - Deleting VN ctest-trans_right_vn-86424427 2026-03-02 03:16:13,765 - DEBUG - Response for deleting network () 2026-03-02 03:16:13,766 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8099f73b-a9bc-44db-a588-1c4dc6739cbc 2026-03-02 03:16:13,779 - DEBUG - Response Code: 404 2026-03-02 03:16:13,779 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:13,786 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:13,808 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:13,913 - INFO - Validated that VN ctest-trans_right_vn-86424427 is not found in API Server 2026-03-02 03:16:13,927 - DEBUG - VN ctest-trans_right_vn-86424427 is not present in Agent 10.0.0.41 2026-03-02 03:16:13,938 - DEBUG - VN ctest-trans_right_vn-86424427 is not present in Agent 10.0.0.240 2026-03-02 03:16:13,938 - INFO - Validated that VN ctest-trans_right_vn-86424427 is not in any agent 2026-03-02 03:16:13,972 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-86424427 info 2026-03-02 03:16:13,972 - INFO - Deleting VN ctest-trans_left_vn-41994767 2026-03-02 03:16:14,166 - DEBUG - Response for deleting network () 2026-03-02 03:16:14,167 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/163b5850-3e6c-4460-ba3e-2214dce3dfce 2026-03-02 03:16:14,172 - DEBUG - Response Code: 404 2026-03-02 03:16:14,172 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:14,180 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:14,205 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:14,312 - INFO - Validated that VN ctest-trans_left_vn-41994767 is not found in API Server 2026-03-02 03:16:14,327 - DEBUG - VN ctest-trans_left_vn-41994767 is not present in Agent 10.0.0.41 2026-03-02 03:16:14,350 - DEBUG - VN ctest-trans_left_vn-41994767 is not present in Agent 10.0.0.240 2026-03-02 03:16:14,350 - INFO - Validated that VN ctest-trans_left_vn-41994767 is not in any agent 2026-03-02 03:16:14,409 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-41994767 info 2026-03-02 03:16:14,409 - INFO - Deleting VN ctest-right_vn-94476609 2026-03-02 03:16:14,467 - DEBUG - VN 72a1b701-78f1-43da-9798-82e5ff3ebab4 still in use: Unable to complete operation on network 72a1b701-78f1-43da-9798-82e5ff3ebab4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-a2c1a555-4ddb-43df-a757-e94c1b003409'] 2026-03-02 03:16:14,467 - WARNING - Deleting VN ctest-right_vn-94476609 failed..Will retry 2026-03-02 03:16:16,638 - DEBUG - Response for deleting network () 2026-03-02 03:16:16,638 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/9f10e35e-12fa-4332-b735-3dc82236fb4d 2026-03-02 03:16:16,645 - DEBUG - Response Code: 404 2026-03-02 03:16:16,645 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:16,655 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:16,670 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:16,793 - INFO - Validated that VN ctest-right_vn-94476609 is not found in API Server 2026-03-02 03:16:16,805 - DEBUG - VN ctest-right_vn-94476609 is not present in Agent 10.0.0.41 2026-03-02 03:16:16,818 - DEBUG - VN ctest-right_vn-94476609 is not present in Agent 10.0.0.240 2026-03-02 03:16:16,818 - INFO - Validated that VN ctest-right_vn-94476609 is not in any agent 2026-03-02 03:16:16,860 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-94476609 info 2026-03-02 03:16:16,860 - INFO - Deleting VN ctest-left_vn-93921732 2026-03-02 03:16:17,064 - DEBUG - Response for deleting network () 2026-03-02 03:16:17,064 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/07d5c14b-17c3-4dbf-8b57-2ed4f1891919 2026-03-02 03:16:17,077 - DEBUG - Response Code: 404 2026-03-02 03:16:17,078 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:17,083 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:17,096 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:17,190 - INFO - Validated that VN ctest-left_vn-93921732 is not found in API Server 2026-03-02 03:16:17,201 - DEBUG - VN ctest-left_vn-93921732 is not present in Agent 10.0.0.41 2026-03-02 03:16:17,212 - DEBUG - VN ctest-left_vn-93921732 is not present in Agent 10.0.0.240 2026-03-02 03:16:17,212 - INFO - Validated that VN ctest-left_vn-93921732 is not in any agent 2026-03-02 03:16:17,241 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-93921732 info 2026-03-02 03:16:17,241 - INFO - Deleting VN ctest-mgmt_vn-12211020 2026-03-02 03:16:17,378 - DEBUG - Response for deleting network () 2026-03-02 03:16:17,378 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/a1c9bd9b-7aa2-41e3-a188-2cb11f472735 2026-03-02 03:16:17,384 - DEBUG - Response Code: 404 2026-03-02 03:16:17,384 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-03-02 03:16:17,392 - DEBUG - Requesting: http://10.0.0.242:8082/domain/cc2d0805-fa5b-4698-bfcc-d7811c08231a 2026-03-02 03:16:17,407 - DEBUG - Requesting: http://10.0.0.242:8082/project/3e130c37-945c-4bde-be5e-e2e45dfede4a 2026-03-02 03:16:17,494 - INFO - Validated that VN ctest-mgmt_vn-12211020 is not found in API Server 2026-03-02 03:16:17,503 - DEBUG - VN ctest-mgmt_vn-12211020 is not present in Agent 10.0.0.41 2026-03-02 03:16:17,514 - DEBUG - VN ctest-mgmt_vn-12211020 is not present in Agent 10.0.0.240 2026-03-02 03:16:17,514 - INFO - Validated that VN ctest-mgmt_vn-12211020 is not in any agent 2026-03-02 03:16:17,544 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-12211020 info 2026-03-02 03:16:18,825 - DEBUG - No XMPP flaps were noticed during the test 2026-03-02 03:16:18,826 - INFO - 2026-03-02 03:16:18,826 - INFO - END TEST : test_svc_trans_segment_right_hc_fail_svm : SKIPPED[0:00:16] 2026-03-02 03:16:18,826 - INFO - -------------------------------------------------------------------------------- 2026-03-02 03:16:19,579 - INFO - Deleted project: ctest-TestSvcHC-47510988, ID : 3e130c37-945c-4bde-be5e-e2e45dfede4a