2025-07-23 16:30:35,102 - INFO - Domain Default found not creating 2025-07-23 16:30:35,271 - INFO - Project ctest-TestSvcRegr-43230030 not found, creating it 2025-07-23 16:30:35,852 - INFO - Created Project:ctest-TestSvcRegr-43230030, ID : 550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:37,388 - INFO - ================================================================================ 2025-07-23 16:30:37,389 - INFO - STARTING TEST : test_svc_in_net_nat_with_static_routes 2025-07-23 16:30:38,725 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-07-23 16:30:38,725 - INFO - Initial checks done. Running the testcase now 2025-07-23 16:30:38,725 - INFO - 2025-07-23 16:30:39,448 - DEBUG - Response for create_network : {'network': {'id': '0b365962-66e7-4f1e-b48c-6d3529e7c1ee', 'name': 'ctest-third-vn-97882691', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-third-vn-97882691'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:30:39,720 - DEBUG - Response for create_subnet : {'subnet': {'id': '9f838b43-3454-4d3d-a5a1-e3f415425e51', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': '0b365962-66e7-4f1e-b48c-6d3529e7c1ee', 'ip_version': 4, 'cidr': '63.157.153.64/26', 'allocation_pools': [{'start': '63.157.153.66', 'end': '63.157.153.126'}], 'gateway_ip': '63.157.153.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.157.153.66', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:30:39,746 - INFO - Created VN ctest-third-vn-97882691 2025-07-23 16:30:39,760 - DEBUG - VN ctest-third-vn-97882691 UUID is 0b365962-66e7-4f1e-b48c-6d3529e7c1ee 2025-07-23 16:30:39,910 - DEBUG - Services list from nova: [, , , ] 2025-07-23 16:30:41,067 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-2) 2025-07-23 16:30:41,118 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-07-23 16:30:46,204 - DEBUG - VM is in ACTIVE state now 2025-07-23 16:30:46,625 - DEBUG - Response for create_network : {'network': {'id': '7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420', 'name': 'ctest-mgmt_vn-56682723', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-mgmt_vn-56682723'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:30:46,889 - DEBUG - Response for create_subnet : {'subnet': {'id': '4a5a36f4-8586-4f23-9ef5-d6326400993d', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': '7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420', 'ip_version': 4, 'cidr': '142.105.189.192/26', 'allocation_pools': [{'start': '142.105.189.194', 'end': '142.105.189.254'}], 'gateway_ip': '142.105.189.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '142.105.189.194', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:30:46,913 - INFO - Created VN ctest-mgmt_vn-56682723 2025-07-23 16:30:46,924 - DEBUG - VN ctest-mgmt_vn-56682723 UUID is 7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,004 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:47,299 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:47,340 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:47,366 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:47,481 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,501 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,516 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b9290879-544b-4c41-b6ac-0e541a7f8849 2025-07-23 16:30:47,529 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b9290879-544b-4c41-b6ac-0e541a7f8849 2025-07-23 16:30:47,540 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f50930d0-6c1f-460a-8bdf-e10edf85caa0 2025-07-23 16:30:47,551 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:30:47,551 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,564 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b9290879-544b-4c41-b6ac-0e541a7f8849 2025-07-23 16:30:47,587 - INFO - Verified VN network id 13 for VN 7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,588 - INFO - Verifications in API Server for VN ctest-mgmt_vn-56682723 passed 2025-07-23 16:30:47,588 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,605 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b9290879-544b-4c41-b6ac-0e541a7f8849 2025-07-23 16:30:47,626 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b9290879-544b-4c41-b6ac-0e541a7f8849 2025-07-23 16:30:47,638 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/f50930d0-6c1f-460a-8bdf-e10edf85caa0 2025-07-23 16:30:47,658 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9132136742669143970', 'uuid-lslong': '12948319059096458272'}, 'enable': 'true', 'created': '2025-07-23T16:30:46', 'last-modified': '2025-07-23T16:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.817233'} 2025-07-23 16:30:47,667 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:30:47,674 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9132136742669143970', 'uuid-lslong': '12948319059096458272'}, 'enable': 'true', 'created': '2025-07-23T16:30:46', 'last-modified': '2025-07-23T16:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.840580'} 2025-07-23 16:30:47,682 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:30:47,689 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9132136742669143970', 'uuid-lslong': '12948319059096458272'}, 'enable': 'true', 'created': '2025-07-23T16:30:46', 'last-modified': '2025-07-23T16:30:46', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.855880'} 2025-07-23 16:30:47,699 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:30:47,699 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-56682723 passed 2025-07-23 16:30:47,699 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-56682723 in API_Server ====== 2025-07-23 16:30:47,699 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:47,708 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:47,725 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:47,840 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/7ebbddfb-bb16-4fa2-b3b1-ab94c3dd5420 2025-07-23 16:30:47,856 - DEBUG - =>VN ctest-mgmt_vn-56682723 has no policy to be verified 2025-07-23 16:30:47,856 - DEBUG - Verifying the vn in opserver 2025-07-23 16:30:47,856 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723 virtual network link through opserver 10.0.0.23 2025-07-23 16:30:47,856 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:30:48,172 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:30:48,242 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723?flat'} 2025-07-23 16:30:48,242 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723 virtual network link through opserver 10.0.0.249 2025-07-23 16:30:48,242 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:30:48,550 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:30:48,626 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723?flat'} 2025-07-23 16:30:48,626 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723 virtual network link through opserver 10.0.0.73 2025-07-23 16:30:48,627 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:30:48,921 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:30:48,980 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723?flat'} 2025-07-23 16:30:48,980 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-56682723 is found in opserver 2025-07-23 16:30:49,005 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:30:49,020 - DEBUG - VRF ids for VN ctest-mgmt_vn-56682723: {} 2025-07-23 16:30:49,315 - DEBUG - Response for create_network : {'network': {'id': '9af7cd6a-6056-4b79-b9de-f9de3f1f766c', 'name': 'ctest-left_vn-42029930', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-left_vn-42029930'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:30:49,602 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f08298da-498a-44a2-a676-de9ceab6ba35', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': '9af7cd6a-6056-4b79-b9de-f9de3f1f766c', 'ip_version': 4, 'cidr': '116.243.129.64/26', 'allocation_pools': [{'start': '116.243.129.66', 'end': '116.243.129.126'}], 'gateway_ip': '116.243.129.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '116.243.129.66', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:30:49,631 - INFO - Created VN ctest-left_vn-42029930 2025-07-23 16:30:49,645 - DEBUG - VN ctest-left_vn-42029930 UUID is 9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:49,742 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:49,751 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:49,770 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:49,870 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:49,886 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:49,896 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b356a50c-205e-44e2-a5bb-f058425f50bc 2025-07-23 16:30:49,908 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b356a50c-205e-44e2-a5bb-f058425f50bc 2025-07-23 16:30:49,917 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1a7acf62-87f9-44a0-a86f-9e34a6417956 2025-07-23 16:30:49,928 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:30:49,928 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:49,939 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b356a50c-205e-44e2-a5bb-f058425f50bc 2025-07-23 16:30:49,957 - INFO - Verified VN network id 14 for VN 9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:49,958 - INFO - Verifications in API Server for VN ctest-left_vn-42029930 passed 2025-07-23 16:30:49,958 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:49,972 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b356a50c-205e-44e2-a5bb-f058425f50bc 2025-07-23 16:30:49,982 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b356a50c-205e-44e2-a5bb-f058425f50bc 2025-07-23 16:30:49,991 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1a7acf62-87f9-44a0-a86f-9e34a6417956 2025-07-23 16:30:50,007 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11166619657854929785', 'uuid-lslong': '13393417074783516268'}, 'enable': 'true', 'created': '2025-07-23T16:30:49', 'last-modified': '2025-07-23T16:30:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496701'} 2025-07-23 16:30:50,014 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:30:50,021 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11166619657854929785', 'uuid-lslong': '13393417074783516268'}, 'enable': 'true', 'created': '2025-07-23T16:30:49', 'last-modified': '2025-07-23T16:30:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.505923'} 2025-07-23 16:30:50,028 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:30:50,035 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11166619657854929785', 'uuid-lslong': '13393417074783516268'}, 'enable': 'true', 'created': '2025-07-23T16:30:49', 'last-modified': '2025-07-23T16:30:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.520246'} 2025-07-23 16:30:50,045 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:30:50,045 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-42029930 passed 2025-07-23 16:30:50,045 - DEBUG - ====Verifying policy data for ctest-left_vn-42029930 in API_Server ====== 2025-07-23 16:30:50,045 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:50,053 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:50,066 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:50,162 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9af7cd6a-6056-4b79-b9de-f9de3f1f766c 2025-07-23 16:30:50,178 - DEBUG - =>VN ctest-left_vn-42029930 has no policy to be verified 2025-07-23 16:30:50,178 - DEBUG - Verifying the vn in opserver 2025-07-23 16:30:50,178 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930 virtual network link through opserver 10.0.0.23 2025-07-23 16:30:50,178 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:30:50,237 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930?flat'} 2025-07-23 16:30:50,237 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930 virtual network link through opserver 10.0.0.249 2025-07-23 16:30:50,237 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:30:50,294 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930?flat'} 2025-07-23 16:30:50,294 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930 virtual network link through opserver 10.0.0.73 2025-07-23 16:30:50,294 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:30:50,350 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930?flat'} 2025-07-23 16:30:50,350 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-42029930 is found in opserver 2025-07-23 16:30:50,394 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:30:50,421 - DEBUG - VRF ids for VN ctest-left_vn-42029930: {} 2025-07-23 16:30:50,716 - DEBUG - Response for create_network : {'network': {'id': 'e2fe43db-3e4f-4b4c-a977-31284cb05f86', 'name': 'ctest-right_vn-21713913', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-right_vn-21713913'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:30:50,947 - DEBUG - Response for create_subnet : {'subnet': {'id': '37ea8ec6-1094-4cd7-999d-dde9701e09b8', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': 'e2fe43db-3e4f-4b4c-a977-31284cb05f86', 'ip_version': 4, 'cidr': '151.140.224.64/26', 'allocation_pools': [{'start': '151.140.224.66', 'end': '151.140.224.126'}], 'gateway_ip': '151.140.224.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '151.140.224.66', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:30:50,971 - INFO - Created VN ctest-right_vn-21713913 2025-07-23 16:30:50,988 - DEBUG - VN ctest-right_vn-21713913 UUID is e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,075 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:51,081 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:51,095 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:51,201 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,215 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,226 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/31c52337-2e1b-45f4-8ebb-2e1bd43ac166 2025-07-23 16:30:51,235 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/31c52337-2e1b-45f4-8ebb-2e1bd43ac166 2025-07-23 16:30:51,245 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/514bff1a-e362-4849-b86a-0df99deb5add 2025-07-23 16:30:51,253 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:30:51,253 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,264 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/31c52337-2e1b-45f4-8ebb-2e1bd43ac166 2025-07-23 16:30:51,283 - INFO - Verified VN network id 15 for VN e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,284 - INFO - Verifications in API Server for VN ctest-right_vn-21713913 passed 2025-07-23 16:30:51,285 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,298 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/31c52337-2e1b-45f4-8ebb-2e1bd43ac166 2025-07-23 16:30:51,307 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/31c52337-2e1b-45f4-8ebb-2e1bd43ac166 2025-07-23 16:30:51,316 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/514bff1a-e362-4849-b86a-0df99deb5add 2025-07-23 16:30:51,331 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16356585505578502988', 'uuid-lslong': '12211282963793469318'}, 'enable': 'true', 'created': '2025-07-23T16:30:50', 'last-modified': '2025-07-23T16:30:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445297'} 2025-07-23 16:30:51,340 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:30:51,346 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16356585505578502988', 'uuid-lslong': '12211282963793469318'}, 'enable': 'true', 'created': '2025-07-23T16:30:50', 'last-modified': '2025-07-23T16:30:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466943'} 2025-07-23 16:30:51,354 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:30:51,361 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16356585505578502988', 'uuid-lslong': '12211282963793469318'}, 'enable': 'true', 'created': '2025-07-23T16:30:50', 'last-modified': '2025-07-23T16:30:50', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476568'} 2025-07-23 16:30:51,368 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:30:51,368 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-21713913 passed 2025-07-23 16:30:51,369 - DEBUG - ====Verifying policy data for ctest-right_vn-21713913 in API_Server ====== 2025-07-23 16:30:51,369 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:51,376 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:51,392 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:51,490 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/e2fe43db-3e4f-4b4c-a977-31284cb05f86 2025-07-23 16:30:51,503 - DEBUG - =>VN ctest-right_vn-21713913 has no policy to be verified 2025-07-23 16:30:51,503 - DEBUG - Verifying the vn in opserver 2025-07-23 16:30:51,503 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913 virtual network link through opserver 10.0.0.23 2025-07-23 16:30:51,504 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:30:51,561 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913?flat'} 2025-07-23 16:30:51,561 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913 virtual network link through opserver 10.0.0.249 2025-07-23 16:30:51,561 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:30:51,634 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913?flat'} 2025-07-23 16:30:51,634 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913 virtual network link through opserver 10.0.0.73 2025-07-23 16:30:51,635 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:30:51,705 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913?flat'} 2025-07-23 16:30:51,705 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-21713913 is found in opserver 2025-07-23 16:30:51,734 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:30:51,754 - DEBUG - VRF ids for VN ctest-right_vn-21713913: {} 2025-07-23 16:30:52,928 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-1) 2025-07-23 16:30:54,347 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-2) 2025-07-23 16:30:54,347 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-90687183'] 2025-07-23 16:30:54,650 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-90687183'] created succesfully 2025-07-23 16:30:55,088 - DEBUG - Image by name tiny_nat_fw not found 2025-07-23 16:30:55,088 - DEBUG - Installing image tiny_nat_fw 2025-07-23 16:30:55,088 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-23 16:30:55,088 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-07-23 16:30:55,088 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz 2025-07-23 16:30:55,109 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-in-network-nat.qcow2.gz -O /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:30:55,247 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:30:55,247 - DEBUG - Unzip image 2025-07-23 16:30:55,247 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:30:55,270 - DEBUG - Try to create image in user context 2025-07-23 16:30:55,345 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-90687183'] 2025-07-23 16:30:55,451 - INFO - Service template: ['default-domain', 'ctest-service_template_1-90687183'] deleted successfully. 2025-07-23 16:30:55,451 - INFO - Skip interface_detach for VM ctest-right_vm-49946187 in state BUILD 2025-07-23 16:30:55,452 - INFO - Deleting VM ctest-right_vm-49946187 2025-07-23 16:30:55,483 - ERROR - VM ctest-right_vm-49946187 has failed to come up 2025-07-23 16:30:55,483 - ERROR - Nova failed to get host of the VM 2025-07-23 16:30:55,483 - ERROR - VM ctest-right_vm-49946187 has failed to come up 2025-07-23 16:30:55,483 - ERROR - Nova failed to get host of the VM 2025-07-23 16:30:55,559 - INFO - Skip interface_detach for VM ctest-left_vm-50929977 in state BUILD 2025-07-23 16:30:55,559 - INFO - Deleting VM ctest-left_vm-50929977 2025-07-23 16:30:55,559 - ERROR - VM ctest-left_vm-50929977 has failed to come up 2025-07-23 16:30:55,559 - ERROR - Nova failed to get host of the VM 2025-07-23 16:30:55,559 - ERROR - VM ctest-left_vm-50929977 has failed to come up 2025-07-23 16:30:55,559 - ERROR - Nova failed to get host of the VM 2025-07-23 16:30:55,643 - INFO - Deleting VN ctest-right_vn-21713913 2025-07-23 16:30:55,696 - DEBUG - VN e2fe43db-3e4f-4b4c-a977-31284cb05f86 still in use: Unable to complete operation on network e2fe43db-3e4f-4b4c-a977-31284cb05f86. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-b3209602-c892-48c6-9550-4d9c42e42adc'] 2025-07-23 16:30:55,696 - WARNING - Deleting VN ctest-right_vn-21713913 failed..Will retry 2025-07-23 16:30:57,886 - DEBUG - Response for deleting network () 2025-07-23 16:30:57,887 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/31c52337-2e1b-45f4-8ebb-2e1bd43ac166 2025-07-23 16:30:57,894 - DEBUG - Response Code: 404 2025-07-23 16:30:57,894 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:57,911 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:57,932 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:58,056 - INFO - Validated that VN ctest-right_vn-21713913 is not found in API Server 2025-07-23 16:30:58,084 - DEBUG - VN ctest-right_vn-21713913 is not present in Agent 10.0.0.50 2025-07-23 16:30:58,102 - DEBUG - VN ctest-right_vn-21713913 is not present in Agent 10.0.0.130 2025-07-23 16:30:58,102 - INFO - Validated that VN ctest-right_vn-21713913 is not in any agent 2025-07-23 16:30:58,154 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-21713913 info 2025-07-23 16:30:58,154 - INFO - Deleting VN ctest-left_vn-42029930 2025-07-23 16:30:58,336 - DEBUG - Response for deleting network () 2025-07-23 16:30:58,337 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b356a50c-205e-44e2-a5bb-f058425f50bc 2025-07-23 16:30:58,349 - DEBUG - Response Code: 404 2025-07-23 16:30:58,349 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:58,360 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:58,374 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:58,469 - INFO - Validated that VN ctest-left_vn-42029930 is not found in API Server 2025-07-23 16:30:58,496 - DEBUG - VN ctest-left_vn-42029930 is not present in Agent 10.0.0.50 2025-07-23 16:30:58,510 - DEBUG - VN ctest-left_vn-42029930 is not present in Agent 10.0.0.130 2025-07-23 16:30:58,510 - INFO - Validated that VN ctest-left_vn-42029930 is not in any agent 2025-07-23 16:30:58,562 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-42029930 info 2025-07-23 16:30:58,562 - INFO - Deleting VN ctest-mgmt_vn-56682723 2025-07-23 16:30:58,739 - DEBUG - Response for deleting network () 2025-07-23 16:30:58,739 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b9290879-544b-4c41-b6ac-0e541a7f8849 2025-07-23 16:30:58,751 - DEBUG - Response Code: 404 2025-07-23 16:30:58,751 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:30:58,764 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:30:58,784 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:30:58,880 - INFO - Validated that VN ctest-mgmt_vn-56682723 is not found in API Server 2025-07-23 16:30:58,912 - DEBUG - VN ctest-mgmt_vn-56682723 is not present in Agent 10.0.0.50 2025-07-23 16:30:58,930 - DEBUG - VN ctest-mgmt_vn-56682723 is not present in Agent 10.0.0.130 2025-07-23 16:30:58,930 - INFO - Validated that VN ctest-mgmt_vn-56682723 is not in any agent 2025-07-23 16:30:58,989 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-56682723 info 2025-07-23 16:30:58,989 - INFO - Deleting VM ctest-vm-in-third-vn-43391404 2025-07-23 16:30:59,060 - INFO - Deleting VN ctest-third-vn-97882691 2025-07-23 16:30:59,114 - DEBUG - VN 0b365962-66e7-4f1e-b48c-6d3529e7c1ee still in use: Unable to complete operation on network 0b365962-66e7-4f1e-b48c-6d3529e7c1ee. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-d4c9481b-e2ef-425f-b2ae-ee9dd3c48d53'] 2025-07-23 16:30:59,114 - WARNING - Deleting VN ctest-third-vn-97882691 failed..Will retry 2025-07-23 16:31:01,315 - DEBUG - Response for deleting network () 2025-07-23 16:31:02,653 - ERROR -

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 49, in test_svc_in_net_nat_with_static_routes
    static_route={'left': routes})
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'

2025-07-23 16:31:02,676 - DEBUG - No XMPP flaps were noticed during the test 2025-07-23 16:31:02,676 - INFO -

2025-07-23 16:31:02,676 - INFO - END TEST : test_svc_in_net_nat_with_static_routes : FAILED[0:00:25]

2025-07-23 16:31:02,676 - INFO - -------------------------------------------------------------------------------- 2025-07-23 16:31:02,680 - INFO - ================================================================================ 2025-07-23 16:31:02,680 - INFO - STARTING TEST : test_svc_v2_transparent_datapath 2025-07-23 16:31:04,024 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-07-23 16:31:04,024 - INFO - Initial checks done. Running the testcase now 2025-07-23 16:31:04,024 - INFO - 2025-07-23 16:31:04,324 - DEBUG - Response for create_network : {'network': {'id': '24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01', 'name': 'ctest-mgmt_vn-77233904', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-mgmt_vn-77233904'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:04,568 - DEBUG - Response for create_subnet : {'subnet': {'id': '0d102b3c-5c66-4a3f-90dd-36c2ae1ae0db', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': '24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01', 'ip_version': 4, 'cidr': '110.68.132.0/26', 'allocation_pools': [{'start': '110.68.132.2', 'end': '110.68.132.62'}], 'gateway_ip': '110.68.132.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '110.68.132.2', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:31:04,590 - INFO - Created VN ctest-mgmt_vn-77233904 2025-07-23 16:31:04,603 - DEBUG - VN ctest-mgmt_vn-77233904 UUID is 24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:04,684 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:04,691 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:04,706 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:04,840 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:04,856 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:04,873 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/61809e4e-f810-4fd8-8262-e3e381031933 2025-07-23 16:31:04,888 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/61809e4e-f810-4fd8-8262-e3e381031933 2025-07-23 16:31:04,900 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ffbbd67c-9ace-45f1-9aa8-0ec9816376e5 2025-07-23 16:31:04,913 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:04,913 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:04,925 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/61809e4e-f810-4fd8-8262-e3e381031933 2025-07-23 16:31:04,944 - INFO - Verified VN network id 12 for VN 24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:04,945 - INFO - Verifications in API Server for VN ctest-mgmt_vn-77233904 passed 2025-07-23 16:31:04,945 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:04,958 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/61809e4e-f810-4fd8-8262-e3e381031933 2025-07-23 16:31:04,968 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/61809e4e-f810-4fd8-8262-e3e381031933 2025-07-23 16:31:04,978 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/ffbbd67c-9ace-45f1-9aa8-0ec9816376e5 2025-07-23 16:31:04,995 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2650750999190588271', 'uuid-lslong': '12280977769207216641'}, 'enable': 'true', 'created': '2025-07-23T16:31:04', 'last-modified': '2025-07-23T16:31:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493738'} 2025-07-23 16:31:05,004 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:05,012 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2650750999190588271', 'uuid-lslong': '12280977769207216641'}, 'enable': 'true', 'created': '2025-07-23T16:31:04', 'last-modified': '2025-07-23T16:31:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516031'} 2025-07-23 16:31:05,019 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:05,027 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2650750999190588271', 'uuid-lslong': '12280977769207216641'}, 'enable': 'true', 'created': '2025-07-23T16:31:04', 'last-modified': '2025-07-23T16:31:04', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.531225'} 2025-07-23 16:31:05,036 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:05,036 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-77233904 passed 2025-07-23 16:31:05,036 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-77233904 in API_Server ====== 2025-07-23 16:31:05,036 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:05,046 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:05,061 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:05,178 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/24c95bfd-4ec4-4b6f-aa6e-cc36b410ba01 2025-07-23 16:31:05,191 - DEBUG - =>VN ctest-mgmt_vn-77233904 has no policy to be verified 2025-07-23 16:31:05,191 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:05,191 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:05,191 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:05,205 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904?flat'} 2025-07-23 16:31:05,205 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:05,205 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:05,220 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904?flat'} 2025-07-23 16:31:05,220 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:05,220 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:05,234 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904?flat'} 2025-07-23 16:31:05,234 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-mgmt_vn-77233904 is found in opserver 2025-07-23 16:31:05,278 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:05,303 - DEBUG - VRF ids for VN ctest-mgmt_vn-77233904: {} 2025-07-23 16:31:05,607 - DEBUG - Response for create_network : {'network': {'id': '352181f9-81ef-48ad-a590-1375c8a193ab', 'name': 'ctest-left_vn-34744803', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-left_vn-34744803'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:05,876 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ab846742-aa0d-46cf-afdb-9dfd4479ab31', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': '352181f9-81ef-48ad-a590-1375c8a193ab', 'ip_version': 4, 'cidr': '171.8.15.0/26', 'allocation_pools': [{'start': '171.8.15.2', 'end': '171.8.15.62'}], 'gateway_ip': '171.8.15.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '171.8.15.2', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:31:05,898 - INFO - Created VN ctest-left_vn-34744803 2025-07-23 16:31:05,915 - DEBUG - VN ctest-left_vn-34744803 UUID is 352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,000 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:06,009 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:06,025 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:06,130 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,148 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,163 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d65423e6-bc94-48fc-ae5d-249a2cf38b19 2025-07-23 16:31:06,175 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d65423e6-bc94-48fc-ae5d-249a2cf38b19 2025-07-23 16:31:06,189 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/cdb6a6a4-12f1-4cae-a1fb-4ace775f551f 2025-07-23 16:31:06,200 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:06,200 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,211 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d65423e6-bc94-48fc-ae5d-249a2cf38b19 2025-07-23 16:31:06,231 - INFO - Verified VN network id 13 for VN 352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,232 - INFO - Verifications in API Server for VN ctest-left_vn-34744803 passed 2025-07-23 16:31:06,232 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,248 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d65423e6-bc94-48fc-ae5d-249a2cf38b19 2025-07-23 16:31:06,261 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d65423e6-bc94-48fc-ae5d-249a2cf38b19 2025-07-23 16:31:06,272 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/cdb6a6a4-12f1-4cae-a1fb-4ace775f551f 2025-07-23 16:31:06,288 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3828484066868414637', 'uuid-lslong': '11930056809502577579'}, 'enable': 'true', 'created': '2025-07-23T16:31:05', 'last-modified': '2025-07-23T16:31:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.484501'} 2025-07-23 16:31:06,295 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:06,302 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3828484066868414637', 'uuid-lslong': '11930056809502577579'}, 'enable': 'true', 'created': '2025-07-23T16:31:05', 'last-modified': '2025-07-23T16:31:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.504978'} 2025-07-23 16:31:06,309 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:06,316 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3828484066868414637', 'uuid-lslong': '11930056809502577579'}, 'enable': 'true', 'created': '2025-07-23T16:31:05', 'last-modified': '2025-07-23T16:31:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.524643'} 2025-07-23 16:31:06,325 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:06,325 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-34744803 passed 2025-07-23 16:31:06,325 - DEBUG - ====Verifying policy data for ctest-left_vn-34744803 in API_Server ====== 2025-07-23 16:31:06,325 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:06,337 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:06,357 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:06,462 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/352181f9-81ef-48ad-a590-1375c8a193ab 2025-07-23 16:31:06,477 - DEBUG - =>VN ctest-left_vn-34744803 has no policy to be verified 2025-07-23 16:31:06,477 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:06,477 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:06,477 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:06,495 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803?flat'} 2025-07-23 16:31:06,495 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:06,495 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:06,511 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803?flat'} 2025-07-23 16:31:06,511 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:06,511 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:06,527 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803?flat'} 2025-07-23 16:31:06,527 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-left_vn-34744803 is found in opserver 2025-07-23 16:31:06,554 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:06,568 - DEBUG - VRF ids for VN ctest-left_vn-34744803: {} 2025-07-23 16:31:06,896 - DEBUG - Response for create_network : {'network': {'id': 'adb0abf7-e6b9-4659-8341-9282e54bbe1c', 'name': 'ctest-right_vn-45348971', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-right_vn-45348971'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:07,173 - DEBUG - Response for create_subnet : {'subnet': {'id': '0b3a8ccf-036d-4224-b0a9-6d975c0c24ba', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': 'adb0abf7-e6b9-4659-8341-9282e54bbe1c', 'ip_version': 4, 'cidr': '85.143.76.0/26', 'allocation_pools': [{'start': '85.143.76.2', 'end': '85.143.76.62'}], 'gateway_ip': '85.143.76.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '85.143.76.2', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:31:07,204 - INFO - Created VN ctest-right_vn-45348971 2025-07-23 16:31:07,219 - DEBUG - VN ctest-right_vn-45348971 UUID is adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,310 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:07,320 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:07,333 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:07,431 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,443 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,454 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/a0e4bdc5-3e5b-498d-a445-d57b34e21109 2025-07-23 16:31:07,464 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/a0e4bdc5-3e5b-498d-a445-d57b34e21109 2025-07-23 16:31:07,475 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/0e43a0de-40a7-4f55-9fe6-dac70853b0f1 2025-07-23 16:31:07,483 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:07,483 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,495 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/a0e4bdc5-3e5b-498d-a445-d57b34e21109 2025-07-23 16:31:07,516 - INFO - Verified VN network id 14 for VN adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,516 - INFO - Verifications in API Server for VN ctest-right_vn-45348971 passed 2025-07-23 16:31:07,516 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,529 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/a0e4bdc5-3e5b-498d-a445-d57b34e21109 2025-07-23 16:31:07,538 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/a0e4bdc5-3e5b-498d-a445-d57b34e21109 2025-07-23 16:31:07,548 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/0e43a0de-40a7-4f55-9fe6-dac70853b0f1 2025-07-23 16:31:07,564 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12515692445678782041', 'uuid-lslong': '9458001783345102364'}, 'enable': 'true', 'created': '2025-07-23T16:31:06', 'last-modified': '2025-07-23T16:31:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.451651'} 2025-07-23 16:31:07,570 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:07,577 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12515692445678782041', 'uuid-lslong': '9458001783345102364'}, 'enable': 'true', 'created': '2025-07-23T16:31:06', 'last-modified': '2025-07-23T16:31:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465303'} 2025-07-23 16:31:07,585 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:07,593 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12515692445678782041', 'uuid-lslong': '9458001783345102364'}, 'enable': 'true', 'created': '2025-07-23T16:31:06', 'last-modified': '2025-07-23T16:31:07', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481807'} 2025-07-23 16:31:07,600 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:07,600 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-45348971 passed 2025-07-23 16:31:07,601 - DEBUG - ====Verifying policy data for ctest-right_vn-45348971 in API_Server ====== 2025-07-23 16:31:07,601 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:07,609 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:07,622 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:07,718 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/adb0abf7-e6b9-4659-8341-9282e54bbe1c 2025-07-23 16:31:07,730 - DEBUG - =>VN ctest-right_vn-45348971 has no policy to be verified 2025-07-23 16:31:07,730 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:07,730 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:07,730 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:07,745 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971?flat'} 2025-07-23 16:31:07,745 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:07,745 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:07,760 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971?flat'} 2025-07-23 16:31:07,761 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:07,761 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:07,775 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971?flat'} 2025-07-23 16:31:07,775 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-right_vn-45348971 is found in opserver 2025-07-23 16:31:07,802 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:07,816 - DEBUG - VRF ids for VN ctest-right_vn-45348971: {} 2025-07-23 16:31:08,120 - DEBUG - Response for create_network : {'network': {'id': 'cf02addd-b3c8-4504-93aa-79a47d4a4c3e', 'name': 'ctest-trans_left_vn-60286972', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-trans_left_vn-60286972'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:08,348 - DEBUG - Response for create_subnet : {'subnet': {'id': '34103354-b656-4bcc-9cf8-cdd8b3d5d61f', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': 'cf02addd-b3c8-4504-93aa-79a47d4a4c3e', 'ip_version': 4, 'cidr': '120.13.141.192/26', 'allocation_pools': [{'start': '120.13.141.194', 'end': '120.13.141.254'}], 'gateway_ip': '120.13.141.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '120.13.141.194', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:31:08,373 - INFO - Created VN ctest-trans_left_vn-60286972 2025-07-23 16:31:08,386 - DEBUG - VN ctest-trans_left_vn-60286972 UUID is cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,470 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:08,477 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:08,490 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:08,599 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,616 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,628 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/bd0f460e-baf2-401a-aeb1-c1b8db2656b2 2025-07-23 16:31:08,643 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/bd0f460e-baf2-401a-aeb1-c1b8db2656b2 2025-07-23 16:31:08,654 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/8b855858-3678-4d52-ac20-b020d63ae46b 2025-07-23 16:31:08,664 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:31:08,664 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,678 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/bd0f460e-baf2-401a-aeb1-c1b8db2656b2 2025-07-23 16:31:08,698 - INFO - Verified VN network id 15 for VN cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,698 - INFO - Verifications in API Server for VN ctest-trans_left_vn-60286972 passed 2025-07-23 16:31:08,698 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,713 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/bd0f460e-baf2-401a-aeb1-c1b8db2656b2 2025-07-23 16:31:08,726 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/bd0f460e-baf2-401a-aeb1-c1b8db2656b2 2025-07-23 16:31:08,737 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/8b855858-3678-4d52-ac20-b020d63ae46b 2025-07-23 16:31:08,755 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14916676083520128260', 'uuid-lslong': '10640450816999836734'}, 'enable': 'true', 'created': '2025-07-23T16:31:08', 'last-modified': '2025-07-23T16:31:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466205'} 2025-07-23 16:31:08,763 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:31:08,771 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14916676083520128260', 'uuid-lslong': '10640450816999836734'}, 'enable': 'true', 'created': '2025-07-23T16:31:08', 'last-modified': '2025-07-23T16:31:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.481611'} 2025-07-23 16:31:08,779 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:31:08,788 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14916676083520128260', 'uuid-lslong': '10640450816999836734'}, 'enable': 'true', 'created': '2025-07-23T16:31:08', 'last-modified': '2025-07-23T16:31:08', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499001'} 2025-07-23 16:31:08,799 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:31:08,799 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-60286972 passed 2025-07-23 16:31:08,800 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-60286972 in API_Server ====== 2025-07-23 16:31:08,800 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:08,808 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:08,823 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:08,933 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/cf02addd-b3c8-4504-93aa-79a47d4a4c3e 2025-07-23 16:31:08,948 - DEBUG - =>VN ctest-trans_left_vn-60286972 has no policy to be verified 2025-07-23 16:31:08,948 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:08,948 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:08,948 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:08,966 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972?flat'} 2025-07-23 16:31:08,966 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:08,966 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:08,981 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972?flat'} 2025-07-23 16:31:08,981 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:08,981 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:08,997 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972?flat'} 2025-07-23 16:31:08,997 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-trans_left_vn-60286972 is found in opserver 2025-07-23 16:31:09,049 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:09,067 - DEBUG - VRF ids for VN ctest-trans_left_vn-60286972: {} 2025-07-23 16:31:09,415 - DEBUG - Response for create_network : {'network': {'id': '63f03654-519d-4617-8643-fc144299e17c', 'name': 'ctest-trans_right_vn-97202602', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'project_id': '550906b288154a25a935da95f5c68d22', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-43230030', 'ctest-trans_right_vn-97202602'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:09,691 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd5ac3690-2ad0-42cb-b5c9-e6a1b532abc9', 'name': '', 'tenant_id': '550906b288154a25a935da95f5c68d22', 'network_id': '63f03654-519d-4617-8643-fc144299e17c', 'ip_version': 4, 'cidr': '144.162.251.64/26', 'allocation_pools': [{'start': '144.162.251.66', 'end': '144.162.251.126'}], 'gateway_ip': '144.162.251.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '144.162.251.66', 'tags': [], 'project_id': '550906b288154a25a935da95f5c68d22'}} 2025-07-23 16:31:09,725 - INFO - Created VN ctest-trans_right_vn-97202602 2025-07-23 16:31:09,746 - DEBUG - VN ctest-trans_right_vn-97202602 UUID is 63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:09,855 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:09,861 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:09,874 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:09,971 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:09,985 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:09,998 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d53c90f5-e730-46d8-bbc9-ed3f81951846 2025-07-23 16:31:10,009 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d53c90f5-e730-46d8-bbc9-ed3f81951846 2025-07-23 16:31:10,019 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/bf52cc41-0aef-4ac0-a677-3d3a6efe97f5 2025-07-23 16:31:10,027 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:31:10,027 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:10,039 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d53c90f5-e730-46d8-bbc9-ed3f81951846 2025-07-23 16:31:10,064 - INFO - Verified VN network id 16 for VN 63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:10,064 - INFO - Verifications in API Server for VN ctest-trans_right_vn-97202602 passed 2025-07-23 16:31:10,064 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:10,076 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d53c90f5-e730-46d8-bbc9-ed3f81951846 2025-07-23 16:31:10,089 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d53c90f5-e730-46d8-bbc9-ed3f81951846 2025-07-23 16:31:10,100 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/bf52cc41-0aef-4ac0-a677-3d3a6efe97f5 2025-07-23 16:31:10,122 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7201315539939837463', 'uuid-lslong': '9674853588468883836'}, 'enable': 'true', 'created': '2025-07-23T16:31:09', 'last-modified': '2025-07-23T16:31:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493014'} 2025-07-23 16:31:10,139 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:31:10,145 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7201315539939837463', 'uuid-lslong': '9674853588468883836'}, 'enable': 'true', 'created': '2025-07-23T16:31:09', 'last-modified': '2025-07-23T16:31:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.522875'} 2025-07-23 16:31:10,153 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:31:10,161 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-43230030', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7201315539939837463', 'uuid-lslong': '9674853588468883836'}, 'enable': 'true', 'created': '2025-07-23T16:31:09', 'last-modified': '2025-07-23T16:31:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.540451'} 2025-07-23 16:31:10,168 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:31:10,169 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-97202602 passed 2025-07-23 16:31:10,169 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-97202602 in API_Server ====== 2025-07-23 16:31:10,169 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:10,181 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:10,196 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:10,431 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/63f03654-519d-4617-8643-fc144299e17c 2025-07-23 16:31:10,500 - DEBUG - =>VN ctest-trans_right_vn-97202602 has no policy to be verified 2025-07-23 16:31:10,500 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:10,500 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:10,500 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:10,547 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602?flat'} 2025-07-23 16:31:10,548 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:10,548 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:10,579 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602?flat'} 2025-07-23 16:31:10,579 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:10,579 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:10,608 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602?flat'} 2025-07-23 16:31:10,608 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-43230030:ctest-trans_right_vn-97202602 is found in opserver 2025-07-23 16:31:10,655 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:10,678 - DEBUG - VRF ids for VN ctest-trans_right_vn-97202602: {} 2025-07-23 16:31:11,915 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-2) 2025-07-23 16:31:13,466 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-1) 2025-07-23 16:31:13,467 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-24900037'] 2025-07-23 16:31:13,784 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-24900037'] created succesfully 2025-07-23 16:31:14,208 - DEBUG - Image by name tiny_trans_fw not found 2025-07-23 16:31:14,208 - DEBUG - Installing image tiny_trans_fw 2025-07-23 16:31:14,209 - DEBUG - Image info {'name': 'tinycore-net-transparent-fw.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-07-23 16:31:14,209 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-07-23 16:31:14,209 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz 2025-07-23 16:31:14,232 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/tinycore//tinycore-net-transparent-fw.qcow2.gz -O /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-07-23 16:31:14,266 - DEBUG - Image has been downloaded to /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-07-23 16:31:14,267 - DEBUG - Unzip image 2025-07-23 16:31:14,267 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-net-transparent-fw.qcow2.gz 2025-07-23 16:31:14,289 - DEBUG - Try to create image in user context 2025-07-23 16:31:14,380 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-24900037'] 2025-07-23 16:31:14,519 - INFO - Service template: ['default-domain', 'ctest-service_template_1-24900037'] deleted successfully. 2025-07-23 16:31:14,520 - INFO - Skip interface_detach for VM ctest-right_vm-66580014 in state BUILD 2025-07-23 16:31:14,520 - INFO - Deleting VM ctest-right_vm-66580014 2025-07-23 16:31:14,520 - ERROR - VM ctest-right_vm-66580014 has failed to come up 2025-07-23 16:31:14,520 - ERROR - Nova failed to get host of the VM 2025-07-23 16:31:14,520 - ERROR - VM ctest-right_vm-66580014 has failed to come up 2025-07-23 16:31:14,520 - ERROR - Nova failed to get host of the VM 2025-07-23 16:31:14,594 - INFO - Skip interface_detach for VM ctest-left_vm-23001153 in state BUILD 2025-07-23 16:31:14,595 - INFO - Deleting VM ctest-left_vm-23001153 2025-07-23 16:31:14,595 - ERROR - VM ctest-left_vm-23001153 has failed to come up 2025-07-23 16:31:14,595 - ERROR - Nova failed to get host of the VM 2025-07-23 16:31:14,595 - ERROR - VM ctest-left_vm-23001153 has failed to come up 2025-07-23 16:31:14,595 - ERROR - Nova failed to get host of the VM 2025-07-23 16:31:14,679 - INFO - Deleting VN ctest-trans_right_vn-97202602 2025-07-23 16:31:14,900 - DEBUG - Response for deleting network () 2025-07-23 16:31:14,901 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d53c90f5-e730-46d8-bbc9-ed3f81951846 2025-07-23 16:31:14,908 - DEBUG - Response Code: 404 2025-07-23 16:31:14,908 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:14,922 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:14,940 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:15,034 - INFO - Validated that VN ctest-trans_right_vn-97202602 is not found in API Server 2025-07-23 16:31:15,060 - DEBUG - VN ctest-trans_right_vn-97202602 is not present in Agent 10.0.0.50 2025-07-23 16:31:15,079 - DEBUG - VN ctest-trans_right_vn-97202602 is not present in Agent 10.0.0.130 2025-07-23 16:31:15,079 - INFO - Validated that VN ctest-trans_right_vn-97202602 is not in any agent 2025-07-23 16:31:15,125 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-97202602 info 2025-07-23 16:31:15,125 - INFO - Deleting VN ctest-trans_left_vn-60286972 2025-07-23 16:31:15,304 - DEBUG - Response for deleting network () 2025-07-23 16:31:15,304 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/bd0f460e-baf2-401a-aeb1-c1b8db2656b2 2025-07-23 16:31:15,311 - DEBUG - Response Code: 404 2025-07-23 16:31:15,311 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:15,318 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:15,339 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:15,432 - INFO - Validated that VN ctest-trans_left_vn-60286972 is not found in API Server 2025-07-23 16:31:15,455 - DEBUG - VN ctest-trans_left_vn-60286972 is not present in Agent 10.0.0.50 2025-07-23 16:31:15,469 - DEBUG - VN ctest-trans_left_vn-60286972 is not present in Agent 10.0.0.130 2025-07-23 16:31:15,469 - INFO - Validated that VN ctest-trans_left_vn-60286972 is not in any agent 2025-07-23 16:31:15,524 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-60286972 info 2025-07-23 16:31:15,524 - INFO - Deleting VN ctest-right_vn-45348971 2025-07-23 16:31:15,590 - DEBUG - VN adb0abf7-e6b9-4659-8341-9282e54bbe1c still in use: Unable to complete operation on network adb0abf7-e6b9-4659-8341-9282e54bbe1c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-f2807d80-d906-4401-93fa-f905b0eacc35'] 2025-07-23 16:31:15,590 - WARNING - Deleting VN ctest-right_vn-45348971 failed..Will retry 2025-07-23 16:31:17,774 - DEBUG - Response for deleting network () 2025-07-23 16:31:17,774 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/a0e4bdc5-3e5b-498d-a445-d57b34e21109 2025-07-23 16:31:17,781 - DEBUG - Response Code: 404 2025-07-23 16:31:17,781 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:17,793 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:17,849 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:17,936 - INFO - Validated that VN ctest-right_vn-45348971 is not found in API Server 2025-07-23 16:31:17,966 - DEBUG - VN ctest-right_vn-45348971 is not present in Agent 10.0.0.50 2025-07-23 16:31:17,977 - DEBUG - VN ctest-right_vn-45348971 is not present in Agent 10.0.0.130 2025-07-23 16:31:17,977 - INFO - Validated that VN ctest-right_vn-45348971 is not in any agent 2025-07-23 16:31:18,026 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-45348971 info 2025-07-23 16:31:18,026 - INFO - Deleting VN ctest-left_vn-34744803 2025-07-23 16:31:18,200 - DEBUG - Response for deleting network () 2025-07-23 16:31:18,200 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/d65423e6-bc94-48fc-ae5d-249a2cf38b19 2025-07-23 16:31:18,206 - DEBUG - Response Code: 404 2025-07-23 16:31:18,207 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:18,220 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:18,235 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:18,329 - INFO - Validated that VN ctest-left_vn-34744803 is not found in API Server 2025-07-23 16:31:18,357 - DEBUG - VN ctest-left_vn-34744803 is not present in Agent 10.0.0.50 2025-07-23 16:31:18,370 - DEBUG - VN ctest-left_vn-34744803 is not present in Agent 10.0.0.130 2025-07-23 16:31:18,370 - INFO - Validated that VN ctest-left_vn-34744803 is not in any agent 2025-07-23 16:31:18,424 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-34744803 info 2025-07-23 16:31:18,425 - INFO - Deleting VN ctest-mgmt_vn-77233904 2025-07-23 16:31:18,579 - DEBUG - Response for deleting network () 2025-07-23 16:31:18,579 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/61809e4e-f810-4fd8-8262-e3e381031933 2025-07-23 16:31:18,586 - DEBUG - Response Code: 404 2025-07-23 16:31:18,586 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:18,595 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:18,631 - DEBUG - Requesting: http://10.0.0.23:8082/project/550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:18,734 - INFO - Validated that VN ctest-mgmt_vn-77233904 is not found in API Server 2025-07-23 16:31:18,761 - DEBUG - VN ctest-mgmt_vn-77233904 is not present in Agent 10.0.0.50 2025-07-23 16:31:18,773 - DEBUG - VN ctest-mgmt_vn-77233904 is not present in Agent 10.0.0.130 2025-07-23 16:31:18,774 - INFO - Validated that VN ctest-mgmt_vn-77233904 is not in any agent 2025-07-23 16:31:18,816 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-77233904 info 2025-07-23 16:31:20,151 - ERROR -

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/tcutils/util.py", line 1041, in wrapper
    return f(self, *func_args, **func_kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw.py", line 34, in test_svc_v2_transparent_datapath
    create_svms=True)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-net-transparent-fw.qcow2'

2025-07-23 16:31:20,174 - DEBUG - No XMPP flaps were noticed during the test 2025-07-23 16:31:20,174 - INFO -

2025-07-23 16:31:20,174 - INFO - END TEST : test_svc_v2_transparent_datapath : FAILED[0:00:18]

2025-07-23 16:31:20,174 - INFO - -------------------------------------------------------------------------------- 2025-07-23 16:31:20,919 - INFO - Deleted project: ctest-TestSvcRegr-43230030, ID : 550906b2-8815-4a25-a935-da95f5c68d22 2025-07-23 16:31:21,093 - INFO - Domain Default found not creating 2025-07-23 16:31:21,242 - INFO - Project ctest-TestSvcRegr-30977418 not found, creating it 2025-07-23 16:31:21,786 - INFO - Created Project:ctest-TestSvcRegr-30977418, ID : 3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:23,284 - INFO - ================================================================================ 2025-07-23 16:31:23,284 - INFO - STARTING TEST : test_svc_CEM_22032 2025-07-23 16:31:24,625 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-07-23 16:31:24,626 - INFO - Initial checks done. Running the testcase now 2025-07-23 16:31:24,626 - INFO - 2025-07-23 16:31:25,295 - DEBUG - Response for create_network : {'network': {'id': '8f3cfd7f-23a0-4426-bd31-0af3e879bf00', 'name': 'ctest-mgmt_vn-06340777', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'project_id': '3cac327fcf00424e969ee3e21298dd8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-30977418', 'ctest-mgmt_vn-06340777'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:25,572 - DEBUG - Response for create_subnet : {'subnet': {'id': '061eb43c-cd5a-41b0-8deb-3dec03523cb3', 'name': '', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'network_id': '8f3cfd7f-23a0-4426-bd31-0af3e879bf00', 'ip_version': 4, 'cidr': '133.155.129.192/26', 'allocation_pools': [{'start': '133.155.129.194', 'end': '133.155.129.254'}], 'gateway_ip': '133.155.129.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '133.155.129.194', 'tags': [], 'project_id': '3cac327fcf00424e969ee3e21298dd8a'}} 2025-07-23 16:31:25,595 - INFO - Created VN ctest-mgmt_vn-06340777 2025-07-23 16:31:25,607 - DEBUG - VN ctest-mgmt_vn-06340777 UUID is 8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:25,684 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:25,983 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:26,016 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:26,032 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:26,140 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:26,154 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:26,166 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/00e4e960-5e2a-4a08-825b-c87bcea8a1fc 2025-07-23 16:31:26,177 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/00e4e960-5e2a-4a08-825b-c87bcea8a1fc 2025-07-23 16:31:26,189 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/a05f131c-a5ab-4f4d-9463-103c8b4b68f7 2025-07-23 16:31:26,201 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:26,201 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:26,213 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/00e4e960-5e2a-4a08-825b-c87bcea8a1fc 2025-07-23 16:31:26,234 - INFO - Verified VN network id 12 for VN 8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:26,235 - INFO - Verifications in API Server for VN ctest-mgmt_vn-06340777 passed 2025-07-23 16:31:26,235 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:26,248 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/00e4e960-5e2a-4a08-825b-c87bcea8a1fc 2025-07-23 16:31:26,257 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/00e4e960-5e2a-4a08-825b-c87bcea8a1fc 2025-07-23 16:31:26,265 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/a05f131c-a5ab-4f4d-9463-103c8b4b68f7 2025-07-23 16:31:26,281 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10321403168526713894', 'uuid-lslong': '13632689589720825600'}, 'enable': 'true', 'created': '2025-07-23T16:31:25', 'last-modified': '2025-07-23T16:31:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.745635'} 2025-07-23 16:31:26,288 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:26,295 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10321403168526713894', 'uuid-lslong': '13632689589720825600'}, 'enable': 'true', 'created': '2025-07-23T16:31:25', 'last-modified': '2025-07-23T16:31:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771456'} 2025-07-23 16:31:26,302 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:26,308 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10321403168526713894', 'uuid-lslong': '13632689589720825600'}, 'enable': 'true', 'created': '2025-07-23T16:31:25', 'last-modified': '2025-07-23T16:31:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.784737'} 2025-07-23 16:31:26,315 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:31:26,315 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-06340777 passed 2025-07-23 16:31:26,315 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-06340777 in API_Server ====== 2025-07-23 16:31:26,315 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:26,322 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:26,337 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:26,444 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8f3cfd7f-23a0-4426-bd31-0af3e879bf00 2025-07-23 16:31:26,455 - DEBUG - =>VN ctest-mgmt_vn-06340777 has no policy to be verified 2025-07-23 16:31:26,455 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:26,455 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:26,455 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:26,747 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:26,802 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777?flat'} 2025-07-23 16:31:26,802 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:26,802 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:27,094 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:27,162 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777?flat'} 2025-07-23 16:31:27,162 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:27,162 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:27,464 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:27,534 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777?flat'} 2025-07-23 16:31:27,534 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-06340777 is found in opserver 2025-07-23 16:31:27,575 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:27,605 - DEBUG - VRF ids for VN ctest-mgmt_vn-06340777: {} 2025-07-23 16:31:27,925 - DEBUG - Response for create_network : {'network': {'id': '1c4fb0bb-29e3-49a9-a609-06c2902e0a82', 'name': 'service-left-vn-12512867', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'project_id': '3cac327fcf00424e969ee3e21298dd8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-30977418', 'service-left-vn-12512867'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:28,211 - DEBUG - Response for create_subnet : {'subnet': {'id': '8ea4ab2c-4371-4b11-9423-bc031e939783', 'name': '', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'network_id': '1c4fb0bb-29e3-49a9-a609-06c2902e0a82', 'ip_version': 4, 'cidr': '73.108.98.0/26', 'allocation_pools': [{'start': '73.108.98.2', 'end': '73.108.98.62'}], 'gateway_ip': '73.108.98.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.108.98.2', 'tags': [], 'project_id': '3cac327fcf00424e969ee3e21298dd8a'}} 2025-07-23 16:31:28,236 - INFO - Created VN service-left-vn-12512867 2025-07-23 16:31:28,261 - DEBUG - VN service-left-vn-12512867 UUID is 1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,349 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:28,357 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:28,370 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:28,510 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,525 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,537 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fd92d858-9a2c-4e2b-92ac-423c5f45b326 2025-07-23 16:31:28,549 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fd92d858-9a2c-4e2b-92ac-423c5f45b326 2025-07-23 16:31:28,560 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/2932ffd5-d0a4-4615-828b-8ea1be43fa76 2025-07-23 16:31:28,572 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:28,572 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,585 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fd92d858-9a2c-4e2b-92ac-423c5f45b326 2025-07-23 16:31:28,606 - INFO - Verified VN network id 13 for VN 1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,606 - INFO - Verifications in API Server for VN service-left-vn-12512867 passed 2025-07-23 16:31:28,606 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,617 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fd92d858-9a2c-4e2b-92ac-423c5f45b326 2025-07-23 16:31:28,625 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fd92d858-9a2c-4e2b-92ac-423c5f45b326 2025-07-23 16:31:28,634 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/2932ffd5-d0a4-4615-828b-8ea1be43fa76 2025-07-23 16:31:28,650 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2040043474130258345', 'uuid-lslong': '11964101317798791810'}, 'enable': 'true', 'created': '2025-07-23T16:31:27', 'last-modified': '2025-07-23T16:31:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516226'} 2025-07-23 16:31:28,661 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:28,672 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2040043474130258345', 'uuid-lslong': '11964101317798791810'}, 'enable': 'true', 'created': '2025-07-23T16:31:27', 'last-modified': '2025-07-23T16:31:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.540655'} 2025-07-23 16:31:28,680 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:28,686 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2040043474130258345', 'uuid-lslong': '11964101317798791810'}, 'enable': 'true', 'created': '2025-07-23T16:31:27', 'last-modified': '2025-07-23T16:31:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.553853'} 2025-07-23 16:31:28,693 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:31:28,693 - INFO - On all control nodes, Config, RI and RT verification for VN service-left-vn-12512867 passed 2025-07-23 16:31:28,693 - DEBUG - ====Verifying policy data for service-left-vn-12512867 in API_Server ====== 2025-07-23 16:31:28,693 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:28,700 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:28,714 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:28,819 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1c4fb0bb-29e3-49a9-a609-06c2902e0a82 2025-07-23 16:31:28,835 - DEBUG - =>VN service-left-vn-12512867 has no policy to be verified 2025-07-23 16:31:28,836 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:28,836 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:28,836 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:28,896 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867?flat'} 2025-07-23 16:31:28,896 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:28,896 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:28,952 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867?flat'} 2025-07-23 16:31:28,952 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:28,953 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:29,011 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867?flat'} 2025-07-23 16:31:29,011 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-30977418:service-left-vn-12512867 is found in opserver 2025-07-23 16:31:29,060 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:29,091 - DEBUG - VRF ids for VN service-left-vn-12512867: {} 2025-07-23 16:31:29,451 - DEBUG - Response for create_network : {'network': {'id': '5ffe73c7-5081-4010-bc29-3135a444cc0c', 'name': 'service-right-vn-83084469', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'project_id': '3cac327fcf00424e969ee3e21298dd8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-30977418', 'service-right-vn-83084469'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:31:29,749 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a10004fc-710d-4492-8f26-92e1e71c9c5e', 'name': '', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'network_id': '5ffe73c7-5081-4010-bc29-3135a444cc0c', 'ip_version': 4, 'cidr': '130.150.64.64/26', 'allocation_pools': [{'start': '130.150.64.66', 'end': '130.150.64.126'}], 'gateway_ip': '130.150.64.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '130.150.64.66', 'tags': [], 'project_id': '3cac327fcf00424e969ee3e21298dd8a'}} 2025-07-23 16:31:29,778 - INFO - Created VN service-right-vn-83084469 2025-07-23 16:31:29,795 - DEBUG - VN service-right-vn-83084469 UUID is 5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:29,876 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:29,883 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:29,896 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:30,000 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:30,015 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:30,026 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/399d9bd1-ceab-425f-ade4-ba5cec106a89 2025-07-23 16:31:30,038 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/399d9bd1-ceab-425f-ade4-ba5cec106a89 2025-07-23 16:31:30,048 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/96ca488e-7550-432f-8861-c1ede81fbd7a 2025-07-23 16:31:30,064 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:30,064 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:30,080 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/399d9bd1-ceab-425f-ade4-ba5cec106a89 2025-07-23 16:31:30,102 - INFO - Verified VN network id 14 for VN 5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:30,102 - INFO - Verifications in API Server for VN service-right-vn-83084469 passed 2025-07-23 16:31:30,102 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:30,115 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/399d9bd1-ceab-425f-ade4-ba5cec106a89 2025-07-23 16:31:30,127 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/399d9bd1-ceab-425f-ade4-ba5cec106a89 2025-07-23 16:31:30,138 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/96ca488e-7550-432f-8861-c1ede81fbd7a 2025-07-23 16:31:30,155 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6917093377573994512', 'uuid-lslong': '13558422259634588684'}, 'enable': 'true', 'created': '2025-07-23T16:31:29', 'last-modified': '2025-07-23T16:31:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.474722'} 2025-07-23 16:31:30,166 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:30,173 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6917093377573994512', 'uuid-lslong': '13558422259634588684'}, 'enable': 'true', 'created': '2025-07-23T16:31:29', 'last-modified': '2025-07-23T16:31:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493958'} 2025-07-23 16:31:30,181 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:30,191 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6917093377573994512', 'uuid-lslong': '13558422259634588684'}, 'enable': 'true', 'created': '2025-07-23T16:31:29', 'last-modified': '2025-07-23T16:31:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.508174'} 2025-07-23 16:31:30,199 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:31:30,199 - INFO - On all control nodes, Config, RI and RT verification for VN service-right-vn-83084469 passed 2025-07-23 16:31:30,200 - DEBUG - ====Verifying policy data for service-right-vn-83084469 in API_Server ====== 2025-07-23 16:31:30,200 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:31:30,208 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:31:30,220 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:31:30,325 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5ffe73c7-5081-4010-bc29-3135a444cc0c 2025-07-23 16:31:30,340 - DEBUG - =>VN service-right-vn-83084469 has no policy to be verified 2025-07-23 16:31:30,340 - DEBUG - Verifying the vn in opserver 2025-07-23 16:31:30,341 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469 virtual network link through opserver 10.0.0.23 2025-07-23 16:31:30,341 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:31:30,400 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469?flat'} 2025-07-23 16:31:30,400 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469 virtual network link through opserver 10.0.0.249 2025-07-23 16:31:30,400 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:31:30,461 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469?flat'} 2025-07-23 16:31:30,461 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469 virtual network link through opserver 10.0.0.73 2025-07-23 16:31:30,461 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:31:30,526 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469?flat'} 2025-07-23 16:31:30,526 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-30977418:service-right-vn-83084469 is found in opserver 2025-07-23 16:31:30,570 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:31:30,589 - DEBUG - VRF ids for VN service-right-vn-83084469: {} 2025-07-23 16:31:30,656 - DEBUG - Services list from nova: [, , , ] 2025-07-23 16:31:31,772 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-2) 2025-07-23 16:31:33,434 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-1) 2025-07-23 16:31:33,434 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-33076022'] 2025-07-23 16:31:33,742 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-33076022'] created succesfully 2025-07-23 16:33:14,475 - DEBUG - Installing image tiny_nat_fw 2025-07-23 16:33:14,475 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-23 16:33:14,475 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:33:14,475 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:33:14,476 - DEBUG - Unzip image 2025-07-23 16:33:14,476 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:33:14,493 - DEBUG - Try to create image in user context 2025-07-23 16:33:14,562 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-33076022'] 2025-07-23 16:33:14,655 - INFO - Service template: ['default-domain', 'ctest-service_template_1-33076022'] deleted successfully. 2025-07-23 16:33:14,656 - INFO - Skip interface_detach for VM ctest-right_vm-46286946 in state BUILD 2025-07-23 16:33:14,656 - INFO - Deleting VM ctest-right_vm-46286946 2025-07-23 16:33:14,699 - ERROR - VM ctest-right_vm-46286946 has failed to come up 2025-07-23 16:33:14,699 - ERROR - Nova failed to get host of the VM 2025-07-23 16:33:14,700 - ERROR - VM ctest-right_vm-46286946 has failed to come up 2025-07-23 16:33:14,700 - ERROR - Nova failed to get host of the VM 2025-07-23 16:33:14,802 - INFO - Skip interface_detach for VM ctest-left_vm-61688218 in state BUILD 2025-07-23 16:33:14,802 - INFO - Deleting VM ctest-left_vm-61688218 2025-07-23 16:33:14,802 - ERROR - VM ctest-left_vm-61688218 has failed to come up 2025-07-23 16:33:14,802 - ERROR - Nova failed to get host of the VM 2025-07-23 16:33:14,802 - ERROR - VM ctest-left_vm-61688218 has failed to come up 2025-07-23 16:33:14,802 - ERROR - Nova failed to get host of the VM 2025-07-23 16:33:14,893 - INFO - Deleting VN service-right-vn-83084469 2025-07-23 16:33:14,951 - DEBUG - VN 5ffe73c7-5081-4010-bc29-3135a444cc0c still in use: Unable to complete operation on network 5ffe73c7-5081-4010-bc29-3135a444cc0c. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c5a7cae1-68e4-47e2-b634-90d5ea32e8f6'] 2025-07-23 16:33:14,952 - WARNING - Deleting VN service-right-vn-83084469 failed..Will retry 2025-07-23 16:33:17,112 - DEBUG - Response for deleting network () 2025-07-23 16:33:17,112 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/399d9bd1-ceab-425f-ade4-ba5cec106a89 2025-07-23 16:33:17,118 - DEBUG - Response Code: 404 2025-07-23 16:33:17,119 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:17,125 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:17,153 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:17,246 - INFO - Validated that VN service-right-vn-83084469 is not found in API Server 2025-07-23 16:33:17,274 - DEBUG - VN service-right-vn-83084469 is not present in Agent 10.0.0.50 2025-07-23 16:33:17,287 - DEBUG - VN service-right-vn-83084469 is not present in Agent 10.0.0.130 2025-07-23 16:33:17,287 - INFO - Validated that VN service-right-vn-83084469 is not in any agent 2025-07-23 16:33:17,338 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-right-vn-83084469 info 2025-07-23 16:33:17,338 - INFO - Deleting VN service-left-vn-12512867 2025-07-23 16:33:17,518 - DEBUG - Response for deleting network () 2025-07-23 16:33:17,518 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/fd92d858-9a2c-4e2b-92ac-423c5f45b326 2025-07-23 16:33:17,525 - DEBUG - Response Code: 404 2025-07-23 16:33:17,525 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:17,540 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:17,562 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:17,660 - INFO - Validated that VN service-left-vn-12512867 is not found in API Server 2025-07-23 16:33:17,685 - DEBUG - VN service-left-vn-12512867 is not present in Agent 10.0.0.50 2025-07-23 16:33:17,697 - DEBUG - VN service-left-vn-12512867 is not present in Agent 10.0.0.130 2025-07-23 16:33:17,697 - INFO - Validated that VN service-left-vn-12512867 is not in any agent 2025-07-23 16:33:17,741 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN service-left-vn-12512867 info 2025-07-23 16:33:17,741 - INFO - Deleting VN ctest-mgmt_vn-06340777 2025-07-23 16:33:17,945 - DEBUG - Response for deleting network () 2025-07-23 16:33:17,945 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/00e4e960-5e2a-4a08-825b-c87bcea8a1fc 2025-07-23 16:33:17,952 - DEBUG - Response Code: 404 2025-07-23 16:33:17,952 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:17,969 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:17,999 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:18,119 - INFO - Validated that VN ctest-mgmt_vn-06340777 is not found in API Server 2025-07-23 16:33:18,150 - DEBUG - VN ctest-mgmt_vn-06340777 is not present in Agent 10.0.0.50 2025-07-23 16:33:18,166 - DEBUG - VN ctest-mgmt_vn-06340777 is not present in Agent 10.0.0.130 2025-07-23 16:33:18,166 - INFO - Validated that VN ctest-mgmt_vn-06340777 is not in any agent 2025-07-23 16:33:18,217 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-06340777 info 2025-07-23 16:33:19,549 - ERROR -

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 35, in test_svc_CEM_22032
    right_vn_name=get_random_name('service-right-vn', ''))
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'

2025-07-23 16:33:19,568 - DEBUG - No XMPP flaps were noticed during the test 2025-07-23 16:33:19,568 - INFO -

2025-07-23 16:33:19,568 - INFO - END TEST : test_svc_CEM_22032 : FAILED[0:01:56]

2025-07-23 16:33:19,568 - INFO - -------------------------------------------------------------------------------- 2025-07-23 16:33:19,572 - INFO - ================================================================================ 2025-07-23 16:33:19,572 - INFO - STARTING TEST : test_svc_in_network_datapath 2025-07-23 16:33:20,960 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-07-23 16:33:20,960 - INFO - Initial checks done. Running the testcase now 2025-07-23 16:33:20,960 - INFO - 2025-07-23 16:33:21,242 - DEBUG - Response for create_network : {'network': {'id': '8fffef2e-862d-465f-b1b3-67ce945d0fb6', 'name': 'ctest-mgmt_vn-17030105', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'project_id': '3cac327fcf00424e969ee3e21298dd8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-30977418', 'ctest-mgmt_vn-17030105'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:33:21,505 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ee21a809-6270-4d55-92dc-c7ef662d3fb4', 'name': '', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'network_id': '8fffef2e-862d-465f-b1b3-67ce945d0fb6', 'ip_version': 4, 'cidr': '98.178.212.64/26', 'allocation_pools': [{'start': '98.178.212.66', 'end': '98.178.212.126'}], 'gateway_ip': '98.178.212.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '98.178.212.66', 'tags': [], 'project_id': '3cac327fcf00424e969ee3e21298dd8a'}} 2025-07-23 16:33:21,531 - INFO - Created VN ctest-mgmt_vn-17030105 2025-07-23 16:33:21,548 - DEBUG - VN ctest-mgmt_vn-17030105 UUID is 8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:21,633 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:21,640 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:21,655 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:21,763 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:21,776 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:21,786 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6e1ed68c-ff3a-4cbc-acaa-53e1beb256f9 2025-07-23 16:33:21,795 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6e1ed68c-ff3a-4cbc-acaa-53e1beb256f9 2025-07-23 16:33:21,803 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/d09a9d36-31ca-4c0c-bd9c-157aac69579f 2025-07-23 16:33:21,811 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:33:21,811 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:21,821 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6e1ed68c-ff3a-4cbc-acaa-53e1beb256f9 2025-07-23 16:33:21,838 - INFO - Verified VN network id 12 for VN 8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:21,839 - INFO - Verifications in API Server for VN ctest-mgmt_vn-17030105 passed 2025-07-23 16:33:21,839 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:21,850 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6e1ed68c-ff3a-4cbc-acaa-53e1beb256f9 2025-07-23 16:33:21,858 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6e1ed68c-ff3a-4cbc-acaa-53e1beb256f9 2025-07-23 16:33:21,868 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/d09a9d36-31ca-4c0c-bd9c-157aac69579f 2025-07-23 16:33:21,881 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10376275049583560287', 'uuid-lslong': '12804692302494502838'}, 'enable': 'true', 'created': '2025-07-23T16:33:21', 'last-modified': '2025-07-23T16:33:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.441093'} 2025-07-23 16:33:21,888 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:33:21,898 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10376275049583560287', 'uuid-lslong': '12804692302494502838'}, 'enable': 'true', 'created': '2025-07-23T16:33:21', 'last-modified': '2025-07-23T16:33:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.456944'} 2025-07-23 16:33:21,907 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:33:21,916 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10376275049583560287', 'uuid-lslong': '12804692302494502838'}, 'enable': 'true', 'created': '2025-07-23T16:33:21', 'last-modified': '2025-07-23T16:33:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.474685'} 2025-07-23 16:33:21,924 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:33:21,924 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-17030105 passed 2025-07-23 16:33:21,925 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-17030105 in API_Server ====== 2025-07-23 16:33:21,925 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:21,932 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:21,945 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:22,058 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/8fffef2e-862d-465f-b1b3-67ce945d0fb6 2025-07-23 16:33:22,072 - DEBUG - =>VN ctest-mgmt_vn-17030105 has no policy to be verified 2025-07-23 16:33:22,072 - DEBUG - Verifying the vn in opserver 2025-07-23 16:33:22,072 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105 virtual network link through opserver 10.0.0.23 2025-07-23 16:33:22,073 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:33:22,085 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105?flat'} 2025-07-23 16:33:22,085 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105 virtual network link through opserver 10.0.0.249 2025-07-23 16:33:22,085 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:33:22,100 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105?flat'} 2025-07-23 16:33:22,100 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105 virtual network link through opserver 10.0.0.73 2025-07-23 16:33:22,100 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:33:22,113 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105?flat'} 2025-07-23 16:33:22,113 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-30977418:ctest-mgmt_vn-17030105 is found in opserver 2025-07-23 16:33:22,152 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:33:22,172 - DEBUG - VRF ids for VN ctest-mgmt_vn-17030105: {} 2025-07-23 16:33:22,486 - DEBUG - Response for create_network : {'network': {'id': '1586ff05-4629-405a-a9ca-61e4d840390c', 'name': 'ctest-left_vn-68233271', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'project_id': '3cac327fcf00424e969ee3e21298dd8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-30977418', 'ctest-left_vn-68233271'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:33:22,722 - DEBUG - Response for create_subnet : {'subnet': {'id': '68b40fd8-13fc-4d84-bc9c-a505b265542c', 'name': '', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'network_id': '1586ff05-4629-405a-a9ca-61e4d840390c', 'ip_version': 4, 'cidr': '12.57.12.64/26', 'allocation_pools': [{'start': '12.57.12.66', 'end': '12.57.12.126'}], 'gateway_ip': '12.57.12.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.57.12.66', 'tags': [], 'project_id': '3cac327fcf00424e969ee3e21298dd8a'}} 2025-07-23 16:33:22,747 - INFO - Created VN ctest-left_vn-68233271 2025-07-23 16:33:22,760 - DEBUG - VN ctest-left_vn-68233271 UUID is 1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:22,843 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:22,850 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:22,862 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:22,960 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:22,977 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:22,991 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e41078f8-90d5-491f-b575-7b7eaa4e73c2 2025-07-23 16:33:23,002 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e41078f8-90d5-491f-b575-7b7eaa4e73c2 2025-07-23 16:33:23,013 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/9cdd0215-ae75-425e-a89d-b0770a1a13c2 2025-07-23 16:33:23,029 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:33:23,029 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:23,050 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e41078f8-90d5-491f-b575-7b7eaa4e73c2 2025-07-23 16:33:23,076 - INFO - Verified VN network id 13 for VN 1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:23,077 - INFO - Verifications in API Server for VN ctest-left_vn-68233271 passed 2025-07-23 16:33:23,077 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:23,091 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e41078f8-90d5-491f-b575-7b7eaa4e73c2 2025-07-23 16:33:23,100 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e41078f8-90d5-491f-b575-7b7eaa4e73c2 2025-07-23 16:33:23,111 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/9cdd0215-ae75-425e-a89d-b0770a1a13c2 2025-07-23 16:33:23,128 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1551207519792742490', 'uuid-lslong': '12234698973213899020'}, 'enable': 'true', 'created': '2025-07-23T16:33:22', 'last-modified': '2025-07-23T16:33:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460645'} 2025-07-23 16:33:23,134 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:33:23,141 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1551207519792742490', 'uuid-lslong': '12234698973213899020'}, 'enable': 'true', 'created': '2025-07-23T16:33:22', 'last-modified': '2025-07-23T16:33:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.482436'} 2025-07-23 16:33:23,150 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:33:23,157 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1551207519792742490', 'uuid-lslong': '12234698973213899020'}, 'enable': 'true', 'created': '2025-07-23T16:33:22', 'last-modified': '2025-07-23T16:33:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491103'} 2025-07-23 16:33:23,167 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:33:23,167 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left_vn-68233271 passed 2025-07-23 16:33:23,167 - DEBUG - ====Verifying policy data for ctest-left_vn-68233271 in API_Server ====== 2025-07-23 16:33:23,167 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:23,176 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:23,190 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:23,324 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1586ff05-4629-405a-a9ca-61e4d840390c 2025-07-23 16:33:23,340 - DEBUG - =>VN ctest-left_vn-68233271 has no policy to be verified 2025-07-23 16:33:23,340 - DEBUG - Verifying the vn in opserver 2025-07-23 16:33:23,340 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271 virtual network link through opserver 10.0.0.23 2025-07-23 16:33:23,340 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:33:23,355 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271?flat'} 2025-07-23 16:33:23,355 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271 virtual network link through opserver 10.0.0.249 2025-07-23 16:33:23,355 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:33:23,373 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271?flat'} 2025-07-23 16:33:23,373 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271 virtual network link through opserver 10.0.0.73 2025-07-23 16:33:23,373 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:33:23,392 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271?flat'} 2025-07-23 16:33:23,392 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-30977418:ctest-left_vn-68233271 is found in opserver 2025-07-23 16:33:23,435 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:33:23,455 - DEBUG - VRF ids for VN ctest-left_vn-68233271: {} 2025-07-23 16:33:23,783 - DEBUG - Response for create_network : {'network': {'id': '4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f', 'name': 'ctest-right_vn-42827702', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'project_id': '3cac327fcf00424e969ee3e21298dd8a', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSvcRegr-30977418', 'ctest-right_vn-42827702'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:33:24,073 - DEBUG - Response for create_subnet : {'subnet': {'id': '00e9b139-fda5-4cc3-b5b9-76397d9cd9b3', 'name': '', 'tenant_id': '3cac327fcf00424e969ee3e21298dd8a', 'network_id': '4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f', 'ip_version': 4, 'cidr': '35.37.80.64/26', 'allocation_pools': [{'start': '35.37.80.66', 'end': '35.37.80.126'}], 'gateway_ip': '35.37.80.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.37.80.66', 'tags': [], 'project_id': '3cac327fcf00424e969ee3e21298dd8a'}} 2025-07-23 16:33:24,096 - INFO - Created VN ctest-right_vn-42827702 2025-07-23 16:33:24,112 - DEBUG - VN ctest-right_vn-42827702 UUID is 4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,198 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:24,205 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:24,218 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:24,333 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,353 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,365 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eb8d0496-31fd-44af-b1c8-623e427e861a 2025-07-23 16:33:24,374 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eb8d0496-31fd-44af-b1c8-623e427e861a 2025-07-23 16:33:24,382 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/21be543a-6262-4b9d-8a68-dcd16b5bc769 2025-07-23 16:33:24,390 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:33:24,390 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,400 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eb8d0496-31fd-44af-b1c8-623e427e861a 2025-07-23 16:33:24,420 - INFO - Verified VN network id 14 for VN 4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,420 - INFO - Verifications in API Server for VN ctest-right_vn-42827702 passed 2025-07-23 16:33:24,420 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,433 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eb8d0496-31fd-44af-b1c8-623e427e861a 2025-07-23 16:33:24,441 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eb8d0496-31fd-44af-b1c8-623e427e861a 2025-07-23 16:33:24,449 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/21be543a-6262-4b9d-8a68-dcd16b5bc769 2025-07-23 16:33:24,462 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4923746923512090170', 'uuid-lslong': '11357829964456887711'}, 'enable': 'true', 'created': '2025-07-23T16:33:23', 'last-modified': '2025-07-23T16:33:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463196'} 2025-07-23 16:33:24,470 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:33:24,476 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4923746923512090170', 'uuid-lslong': '11357829964456887711'}, 'enable': 'true', 'created': '2025-07-23T16:33:23', 'last-modified': '2025-07-23T16:33:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479843'} 2025-07-23 16:33:24,484 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:33:24,490 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSvcRegr-30977418', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4923746923512090170', 'uuid-lslong': '11357829964456887711'}, 'enable': 'true', 'created': '2025-07-23T16:33:23', 'last-modified': '2025-07-23T16:33:23', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493108'} 2025-07-23 16:33:24,496 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:33:24,496 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right_vn-42827702 passed 2025-07-23 16:33:24,496 - DEBUG - ====Verifying policy data for ctest-right_vn-42827702 in API_Server ====== 2025-07-23 16:33:24,497 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:33:24,503 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:33:24,517 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:33:24,617 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f 2025-07-23 16:33:24,628 - DEBUG - =>VN ctest-right_vn-42827702 has no policy to be verified 2025-07-23 16:33:24,628 - DEBUG - Verifying the vn in opserver 2025-07-23 16:33:24,628 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702 virtual network link through opserver 10.0.0.23 2025-07-23 16:33:24,628 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:33:24,644 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702?flat'} 2025-07-23 16:33:24,644 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702 virtual network link through opserver 10.0.0.249 2025-07-23 16:33:24,644 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:33:24,660 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702?flat'} 2025-07-23 16:33:24,660 - DEBUG - Verifying the default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702 virtual network link through opserver 10.0.0.73 2025-07-23 16:33:24,660 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:33:24,675 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702?flat'} 2025-07-23 16:33:24,675 - INFO - Validated that VN default-domain:ctest-TestSvcRegr-30977418:ctest-right_vn-42827702 is found in opserver 2025-07-23 16:33:24,717 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:33:24,737 - DEBUG - VRF ids for VN ctest-right_vn-42827702: {} 2025-07-23 16:33:25,883 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-1) 2025-07-23 16:33:27,353 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-2) 2025-07-23 16:33:27,354 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-15171530'] 2025-07-23 16:33:27,682 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-15171530'] created succesfully 2025-07-23 16:35:08,438 - DEBUG - Installing image tiny_nat_fw 2025-07-23 16:35:08,438 - DEBUG - Image info {'name': 'tinycore-in-network-nat.qcow2.gz', 'webserver': '', 'location': '/images/tinycore/', 'username': 'tc', 'password': 'secret', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hypervisor_type=qemu', 'name_docker': 'phusion-baseimage-enablesshd', 'vmdk': 'service_chain_images/nat_service/tiny_nat_fw/tinycore-in-network-nat-flat.vmdk', 'shrinked_vmdk': "'no'"} 2025-07-23 16:35:08,438 - DEBUG - Image build path file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:35:08,438 - DEBUG - Download image from local file file:///contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:35:08,439 - DEBUG - Unzip image 2025-07-23 16:35:08,439 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/tinycore-in-network-nat.qcow2.gz 2025-07-23 16:35:08,464 - DEBUG - Try to create image in user context 2025-07-23 16:35:08,547 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-15171530'] 2025-07-23 16:35:08,659 - INFO - Service template: ['default-domain', 'ctest-service_template_1-15171530'] deleted successfully. 2025-07-23 16:35:08,660 - INFO - Skip interface_detach for VM ctest-right_vm-57550543 in state BUILD 2025-07-23 16:35:08,660 - INFO - Deleting VM ctest-right_vm-57550543 2025-07-23 16:35:08,660 - ERROR - VM ctest-right_vm-57550543 has failed to come up 2025-07-23 16:35:08,660 - ERROR - Nova failed to get host of the VM 2025-07-23 16:35:08,660 - ERROR - VM ctest-right_vm-57550543 has failed to come up 2025-07-23 16:35:08,660 - ERROR - Nova failed to get host of the VM 2025-07-23 16:35:08,771 - INFO - Skip interface_detach for VM ctest-left_vm-17366953 in state BUILD 2025-07-23 16:35:08,771 - INFO - Deleting VM ctest-left_vm-17366953 2025-07-23 16:35:08,771 - ERROR - VM ctest-left_vm-17366953 has failed to come up 2025-07-23 16:35:08,771 - ERROR - Nova failed to get host of the VM 2025-07-23 16:35:08,771 - ERROR - VM ctest-left_vm-17366953 has failed to come up 2025-07-23 16:35:08,771 - ERROR - Nova failed to get host of the VM 2025-07-23 16:35:08,851 - INFO - Deleting VN ctest-right_vn-42827702 2025-07-23 16:35:08,919 - DEBUG - VN 4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f still in use: Unable to complete operation on network 4454a9bd-63dc-4e3a-9d9f-1e2d22bd859f. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-fa323fc8-117d-4125-a5a6-d5733a94d91a'] 2025-07-23 16:35:08,919 - WARNING - Deleting VN ctest-right_vn-42827702 failed..Will retry 2025-07-23 16:35:11,080 - DEBUG - Response for deleting network () 2025-07-23 16:35:11,080 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eb8d0496-31fd-44af-b1c8-623e427e861a 2025-07-23 16:35:11,088 - DEBUG - Response Code: 404 2025-07-23 16:35:11,088 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:35:11,094 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:35:11,118 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:35:11,211 - INFO - Validated that VN ctest-right_vn-42827702 is not found in API Server 2025-07-23 16:35:11,239 - DEBUG - VN ctest-right_vn-42827702 is not present in Agent 10.0.0.50 2025-07-23 16:35:11,251 - DEBUG - VN ctest-right_vn-42827702 is not present in Agent 10.0.0.130 2025-07-23 16:35:11,251 - INFO - Validated that VN ctest-right_vn-42827702 is not in any agent 2025-07-23 16:35:11,300 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right_vn-42827702 info 2025-07-23 16:35:11,300 - INFO - Deleting VN ctest-left_vn-68233271 2025-07-23 16:35:11,502 - DEBUG - Response for deleting network () 2025-07-23 16:35:11,502 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e41078f8-90d5-491f-b575-7b7eaa4e73c2 2025-07-23 16:35:11,514 - DEBUG - Response Code: 404 2025-07-23 16:35:11,514 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:35:11,522 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:35:11,541 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:35:11,659 - INFO - Validated that VN ctest-left_vn-68233271 is not found in API Server 2025-07-23 16:35:11,678 - DEBUG - VN ctest-left_vn-68233271 is not present in Agent 10.0.0.50 2025-07-23 16:35:11,690 - DEBUG - VN ctest-left_vn-68233271 is not present in Agent 10.0.0.130 2025-07-23 16:35:11,690 - INFO - Validated that VN ctest-left_vn-68233271 is not in any agent 2025-07-23 16:35:11,732 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left_vn-68233271 info 2025-07-23 16:35:11,732 - INFO - Deleting VN ctest-mgmt_vn-17030105 2025-07-23 16:35:11,883 - DEBUG - Response for deleting network () 2025-07-23 16:35:11,883 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/6e1ed68c-ff3a-4cbc-acaa-53e1beb256f9 2025-07-23 16:35:11,890 - DEBUG - Response Code: 404 2025-07-23 16:35:11,890 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:35:11,896 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:35:11,920 - DEBUG - Requesting: http://10.0.0.23:8082/project/3cac327f-cf00-424e-969e-e3e21298dd8a 2025-07-23 16:35:12,010 - INFO - Validated that VN ctest-mgmt_vn-17030105 is not found in API Server 2025-07-23 16:35:12,037 - DEBUG - VN ctest-mgmt_vn-17030105 is not present in Agent 10.0.0.50 2025-07-23 16:35:12,051 - DEBUG - VN ctest-mgmt_vn-17030105 is not present in Agent 10.0.0.130 2025-07-23 16:35:12,052 - INFO - Validated that VN ctest-mgmt_vn-17030105 is not in any agent 2025-07-23 16:35:12,095 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-17030105 info 2025-07-23 16:35:13,415 - ERROR -

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_firewall/test_svc_fw_basic.py", line 26, in test_svc_in_network_datapath
    create_svms=True)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/tinycore-in-network-nat.qcow2'

2025-07-23 16:35:13,440 - DEBUG - No XMPP flaps were noticed during the test 2025-07-23 16:35:13,440 - INFO -

2025-07-23 16:35:13,440 - INFO - END TEST : test_svc_in_network_datapath : FAILED[0:01:54]

2025-07-23 16:35:13,440 - INFO - -------------------------------------------------------------------------------- 2025-07-23 16:35:14,202 - INFO - Deleted project: ctest-TestSvcRegr-30977418, ID : 3cac327f-cf00-424e-969e-e3e21298dd8a