2025-10-29 18:57:49,593 - INFO - Domain Default found not creating 2025-10-29 18:57:49,874 - INFO - Project ctest-TestSVCV2Mirror-15427957 not found, creating it 2025-10-29 18:57:50,512 - INFO - Created Project:ctest-TestSVCV2Mirror-15427957, ID : 1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:52,238 - INFO - ================================================================================ 2025-10-29 18:57:52,238 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-10-29 18:57:52,238 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-10-29 18:57:53,611 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.20.0.201': '0', '10.20.0.200': '0'}, '10.0.0.27': {'10.20.0.201': '0', '10.20.0.200': '0'}} with 2025-10-29 18:57:53,611 - INFO - Initial checks done. Running the testcase now 2025-10-29 18:57:53,611 - INFO - 2025-10-29 18:57:54,269 - DEBUG - Response for create_network : {'network': {'id': '3cdbfe61-4490-4924-a46f-9046db3ea7f1', 'name': 'ctest-left-38213075', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-left-38213075'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:54,520 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b2405ed8-ac62-4a8c-8a5a-10f33cb615cf', 'name': '', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'network_id': '3cdbfe61-4490-4924-a46f-9046db3ea7f1', 'ip_version': 4, 'cidr': '204.57.229.64/26', 'allocation_pools': [{'start': '204.57.229.66', 'end': '204.57.229.126'}], 'gateway_ip': '204.57.229.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '204.57.229.66', 'tags': [], 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed'}} 2025-10-29 18:57:54,545 - INFO - Created VN ctest-left-38213075 2025-10-29 18:57:54,555 - DEBUG - VN ctest-left-38213075 UUID is 3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:54,637 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:54,936 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:54,964 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:54,978 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:55,080 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:55,093 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:55,102 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ffa45023-9414-4fcd-aca4-e47816fd7210 2025-10-29 18:57:55,113 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ffa45023-9414-4fcd-aca4-e47816fd7210 2025-10-29 18:57:55,123 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/f6b56aeb-447a-4195-96e6-27ae9b53d81c 2025-10-29 18:57:55,133 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:55,133 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:55,145 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ffa45023-9414-4fcd-aca4-e47816fd7210 2025-10-29 18:57:55,166 - INFO - Verified VN network id 11 for VN 3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:55,166 - INFO - Verifications in API Server for VN ctest-left-38213075 passed 2025-10-29 18:57:55,166 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:55,178 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ffa45023-9414-4fcd-aca4-e47816fd7210 2025-10-29 18:57:55,188 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ffa45023-9414-4fcd-aca4-e47816fd7210 2025-10-29 18:57:55,198 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/f6b56aeb-447a-4195-96e6-27ae9b53d81c 2025-10-29 18:57:55,213 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4385378355890899236', 'uuid-lslong': '11848847778635491313'}, 'enable': 'true', 'created': '2025-10-29T18:57:54', 'last-modified': '2025-10-29T18:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.747521'} 2025-10-29 18:57:55,225 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:55,232 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4385378355890899236', 'uuid-lslong': '11848847778635491313'}, 'enable': 'true', 'created': '2025-10-29T18:57:54', 'last-modified': '2025-10-29T18:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.771566'} 2025-10-29 18:57:55,238 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:55,243 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4385378355890899236', 'uuid-lslong': '11848847778635491313'}, 'enable': 'true', 'created': '2025-10-29T18:57:54', 'last-modified': '2025-10-29T18:57:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.781988'} 2025-10-29 18:57:55,248 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-29 18:57:55,248 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-38213075 passed 2025-10-29 18:57:55,248 - DEBUG - ====Verifying policy data for ctest-left-38213075 in API_Server ====== 2025-10-29 18:57:55,248 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:55,255 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:55,269 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:55,378 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/3cdbfe61-4490-4924-a46f-9046db3ea7f1 2025-10-29 18:57:55,390 - DEBUG - =>VN ctest-left-38213075 has no policy to be verified 2025-10-29 18:57:55,390 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:55,390 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:55,390 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:55,726 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:55,810 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075?flat'} 2025-10-29 18:57:55,810 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:55,810 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:56,178 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:56,248 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075?flat'} 2025-10-29 18:57:56,248 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:56,248 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:56,581 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:56,715 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075?flat'} 2025-10-29 18:57:56,715 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075 is found in opserver 2025-10-29 18:57:56,770 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:56,789 - DEBUG - VRF ids for VN ctest-left-38213075: {} 2025-10-29 18:57:57,184 - DEBUG - Response for create_network : {'network': {'id': 'ef1c417f-ee37-4a92-b8b0-c2ea24493148', 'name': 'ctest-right-53721492', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-right-53721492'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:57,457 - DEBUG - Response for create_subnet : {'subnet': {'id': '37127f95-e023-448e-9774-b780ebebf252', 'name': '', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'network_id': 'ef1c417f-ee37-4a92-b8b0-c2ea24493148', 'ip_version': 4, 'cidr': '121.3.14.128/26', 'allocation_pools': [{'start': '121.3.14.130', 'end': '121.3.14.190'}], 'gateway_ip': '121.3.14.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '121.3.14.130', 'tags': [], 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed'}} 2025-10-29 18:57:57,479 - INFO - Created VN ctest-right-53721492 2025-10-29 18:57:57,491 - DEBUG - VN ctest-right-53721492 UUID is ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,577 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:57,583 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:57,595 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:57,709 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,725 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,736 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b9a431a4-8db5-4c42-a19a-b18615fe12ae 2025-10-29 18:57:57,747 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b9a431a4-8db5-4c42-a19a-b18615fe12ae 2025-10-29 18:57:57,756 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6e0a402e-1355-4c2c-96d5-2482c9461e9d 2025-10-29 18:57:57,764 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:57,764 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,774 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b9a431a4-8db5-4c42-a19a-b18615fe12ae 2025-10-29 18:57:57,793 - INFO - Verified VN network id 12 for VN ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,793 - INFO - Verifications in API Server for VN ctest-right-53721492 passed 2025-10-29 18:57:57,793 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,807 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b9a431a4-8db5-4c42-a19a-b18615fe12ae 2025-10-29 18:57:57,816 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b9a431a4-8db5-4c42-a19a-b18615fe12ae 2025-10-29 18:57:57,825 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/6e0a402e-1355-4c2c-96d5-2482c9461e9d 2025-10-29 18:57:57,841 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17229718292125928082', 'uuid-lslong': '13308351209766728008'}, 'enable': 'true', 'created': '2025-10-29T18:57:57', 'last-modified': '2025-10-29T18:57:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420102'} 2025-10-29 18:57:57,847 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:57,852 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17229718292125928082', 'uuid-lslong': '13308351209766728008'}, 'enable': 'true', 'created': '2025-10-29T18:57:57', 'last-modified': '2025-10-29T18:57:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444636'} 2025-10-29 18:57:57,858 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:57,863 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17229718292125928082', 'uuid-lslong': '13308351209766728008'}, 'enable': 'true', 'created': '2025-10-29T18:57:57', 'last-modified': '2025-10-29T18:57:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452197'} 2025-10-29 18:57:57,868 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-29 18:57:57,868 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-53721492 passed 2025-10-29 18:57:57,869 - DEBUG - ====Verifying policy data for ctest-right-53721492 in API_Server ====== 2025-10-29 18:57:57,869 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:57,875 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:57,887 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:57,985 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef1c417f-ee37-4a92-b8b0-c2ea24493148 2025-10-29 18:57:57,996 - DEBUG - =>VN ctest-right-53721492 has no policy to be verified 2025-10-29 18:57:57,996 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:57,996 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:57,996 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:58,051 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492?flat'} 2025-10-29 18:57:58,052 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:58,052 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:58,158 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492?flat'} 2025-10-29 18:57:58,158 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:58,158 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:58,252 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492?flat'} 2025-10-29 18:57:58,252 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492 is found in opserver 2025-10-29 18:57:58,293 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:58,308 - DEBUG - VRF ids for VN ctest-right-53721492: {} 2025-10-29 18:57:58,574 - DEBUG - Response for create_network : {'network': {'id': '1a7a5a28-838e-4648-9993-4f45394071cc', 'name': 'ctest-mgmt_vn-67551494', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-mgmt_vn-67551494'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:57:58,802 - DEBUG - Response for create_subnet : {'subnet': {'id': '33814850-416c-4825-bf3e-57614e8f4d76', 'name': '', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'network_id': '1a7a5a28-838e-4648-9993-4f45394071cc', 'ip_version': 4, 'cidr': '175.48.106.64/26', 'allocation_pools': [{'start': '175.48.106.66', 'end': '175.48.106.126'}], 'gateway_ip': '175.48.106.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '175.48.106.66', 'tags': [], 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed'}} 2025-10-29 18:57:58,828 - INFO - Created VN ctest-mgmt_vn-67551494 2025-10-29 18:57:58,842 - DEBUG - VN ctest-mgmt_vn-67551494 UUID is 1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:58,928 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:58,935 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:58,953 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:59,068 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:59,081 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:59,092 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fd3a4973-d234-4729-8297-8b1c4b53dfb6 2025-10-29 18:57:59,100 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fd3a4973-d234-4729-8297-8b1c4b53dfb6 2025-10-29 18:57:59,109 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/449e4346-fb4e-42f2-b6c6-7d04811f60cd 2025-10-29 18:57:59,117 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:59,117 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:59,130 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fd3a4973-d234-4729-8297-8b1c4b53dfb6 2025-10-29 18:57:59,147 - INFO - Verified VN network id 13 for VN 1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:59,147 - INFO - Verifications in API Server for VN ctest-mgmt_vn-67551494 passed 2025-10-29 18:57:59,147 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:59,160 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fd3a4973-d234-4729-8297-8b1c4b53dfb6 2025-10-29 18:57:59,170 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fd3a4973-d234-4729-8297-8b1c4b53dfb6 2025-10-29 18:57:59,179 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/449e4346-fb4e-42f2-b6c6-7d04811f60cd 2025-10-29 18:57:59,196 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1907936522197157448', 'uuid-lslong': '11066275868111303116'}, 'enable': 'true', 'created': '2025-10-29T18:57:58', 'last-modified': '2025-10-29T18:57:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.449804'} 2025-10-29 18:57:59,203 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:59,214 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1907936522197157448', 'uuid-lslong': '11066275868111303116'}, 'enable': 'true', 'created': '2025-10-29T18:57:58', 'last-modified': '2025-10-29T18:57:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463933'} 2025-10-29 18:57:59,222 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:59,228 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1907936522197157448', 'uuid-lslong': '11066275868111303116'}, 'enable': 'true', 'created': '2025-10-29T18:57:58', 'last-modified': '2025-10-29T18:57:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493925'} 2025-10-29 18:57:59,235 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-29 18:57:59,235 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-67551494 passed 2025-10-29 18:57:59,235 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-67551494 in API_Server ====== 2025-10-29 18:57:59,235 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:57:59,242 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:57:59,255 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:57:59,363 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/1a7a5a28-838e-4648-9993-4f45394071cc 2025-10-29 18:57:59,373 - DEBUG - =>VN ctest-mgmt_vn-67551494 has no policy to be verified 2025-10-29 18:57:59,373 - DEBUG - Verifying the vn in opserver 2025-10-29 18:57:59,373 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494 virtual network link through opserver 10.0.0.249 2025-10-29 18:57:59,374 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:57:59,443 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494?flat'} 2025-10-29 18:57:59,443 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494 virtual network link through opserver 10.0.0.19 2025-10-29 18:57:59,443 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:57:59,458 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494?flat'} 2025-10-29 18:57:59,458 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494 virtual network link through opserver 10.0.0.41 2025-10-29 18:57:59,458 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:57:59,473 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494?flat'} 2025-10-29 18:57:59,473 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-mgmt_vn-67551494 is found in opserver 2025-10-29 18:57:59,520 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:57:59,534 - DEBUG - VRF ids for VN ctest-mgmt_vn-67551494: {} 2025-10-29 18:57:59,840 - DEBUG - Response for create_network : {'network': {'id': 'ce107dd5-7aa7-4c55-ac3c-871072d7e2f3', 'name': 'ctest-trans_left_vn-41121436', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-trans_left_vn-41121436'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:58:00,157 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c9850e09-1ca4-41f2-897d-1184ac575671', 'name': '', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'network_id': 'ce107dd5-7aa7-4c55-ac3c-871072d7e2f3', 'ip_version': 4, 'cidr': '105.234.180.128/26', 'allocation_pools': [{'start': '105.234.180.130', 'end': '105.234.180.190'}], 'gateway_ip': '105.234.180.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '105.234.180.130', 'tags': [], 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed'}} 2025-10-29 18:58:00,188 - INFO - Created VN ctest-trans_left_vn-41121436 2025-10-29 18:58:00,200 - DEBUG - VN ctest-trans_left_vn-41121436 UUID is ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,289 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:58:00,300 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:58:00,312 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:58:00,421 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,432 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,443 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3450e03-edfa-43d8-86ef-d442d0e33d77 2025-10-29 18:58:00,451 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3450e03-edfa-43d8-86ef-d442d0e33d77 2025-10-29 18:58:00,459 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d6bb01ad-1c8f-4fd8-bf90-3c3812f7d470 2025-10-29 18:58:00,467 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:58:00,467 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,478 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3450e03-edfa-43d8-86ef-d442d0e33d77 2025-10-29 18:58:00,497 - INFO - Verified VN network id 14 for VN ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,497 - INFO - Verifications in API Server for VN ctest-trans_left_vn-41121436 passed 2025-10-29 18:58:00,497 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,519 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3450e03-edfa-43d8-86ef-d442d0e33d77 2025-10-29 18:58:00,529 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3450e03-edfa-43d8-86ef-d442d0e33d77 2025-10-29 18:58:00,540 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/d6bb01ad-1c8f-4fd8-bf90-3c3812f7d470 2025-10-29 18:58:00,555 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14848506327279815765', 'uuid-lslong': '12410943177842221811'}, 'enable': 'true', 'created': '2025-10-29T18:57:59', 'last-modified': '2025-10-29T18:58:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.464717'} 2025-10-29 18:58:00,561 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:58:00,567 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14848506327279815765', 'uuid-lslong': '12410943177842221811'}, 'enable': 'true', 'created': '2025-10-29T18:57:59', 'last-modified': '2025-10-29T18:58:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.480208'} 2025-10-29 18:58:00,575 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:58:00,584 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14848506327279815765', 'uuid-lslong': '12410943177842221811'}, 'enable': 'true', 'created': '2025-10-29T18:57:59', 'last-modified': '2025-10-29T18:58:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.497853'} 2025-10-29 18:58:00,590 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-29 18:58:00,590 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-41121436 passed 2025-10-29 18:58:00,590 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-41121436 in API_Server ====== 2025-10-29 18:58:00,590 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:58:00,596 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:58:00,610 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:58:00,734 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 2025-10-29 18:58:00,748 - DEBUG - =>VN ctest-trans_left_vn-41121436 has no policy to be verified 2025-10-29 18:58:00,748 - DEBUG - Verifying the vn in opserver 2025-10-29 18:58:00,748 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 virtual network link through opserver 10.0.0.249 2025-10-29 18:58:00,749 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:58:00,763 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436?flat'} 2025-10-29 18:58:00,763 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 virtual network link through opserver 10.0.0.19 2025-10-29 18:58:00,763 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:58:00,836 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436?flat'} 2025-10-29 18:58:00,836 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 virtual network link through opserver 10.0.0.41 2025-10-29 18:58:00,836 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:58:00,908 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436?flat'} 2025-10-29 18:58:00,908 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is found in opserver 2025-10-29 18:58:00,962 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:58:00,984 - DEBUG - VRF ids for VN ctest-trans_left_vn-41121436: {} 2025-10-29 18:58:01,311 - DEBUG - Response for create_network : {'network': {'id': 'ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600', 'name': 'ctest-trans_right_vn-95412847', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-trans_right_vn-95412847'], 'port_security_enabled': True, 'description': ''}} 2025-10-29 18:58:01,535 - DEBUG - Response for create_subnet : {'subnet': {'id': '526654bd-bbc3-4dfc-a772-2563c71e5dda', 'name': '', 'tenant_id': '1d2f01c59cc64b64b20cb8bba320b2ed', 'network_id': 'ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600', 'ip_version': 4, 'cidr': '208.229.197.192/26', 'allocation_pools': [{'start': '208.229.197.194', 'end': '208.229.197.254'}], 'gateway_ip': '208.229.197.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '208.229.197.194', 'tags': [], 'project_id': '1d2f01c59cc64b64b20cb8bba320b2ed'}} 2025-10-29 18:58:01,556 - INFO - Created VN ctest-trans_right_vn-95412847 2025-10-29 18:58:01,571 - DEBUG - VN ctest-trans_right_vn-95412847 UUID is ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:01,651 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:58:01,658 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:58:01,670 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:58:01,774 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:01,789 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:01,803 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a0d69328-7084-4a66-ab95-f2143a7cda24 2025-10-29 18:58:01,816 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a0d69328-7084-4a66-ab95-f2143a7cda24 2025-10-29 18:58:01,827 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/dc6a686b-2aeb-4d69-864b-49c33f430f12 2025-10-29 18:58:01,836 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:58:01,836 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:01,849 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a0d69328-7084-4a66-ab95-f2143a7cda24 2025-10-29 18:58:01,870 - INFO - Verified VN network id 15 for VN ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:01,870 - INFO - Verifications in API Server for VN ctest-trans_right_vn-95412847 passed 2025-10-29 18:58:01,870 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:01,883 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a0d69328-7084-4a66-ab95-f2143a7cda24 2025-10-29 18:58:01,892 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a0d69328-7084-4a66-ab95-f2143a7cda24 2025-10-29 18:58:01,901 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/dc6a686b-2aeb-4d69-864b-49c33f430f12 2025-10-29 18:58:01,920 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12322895232528239407', 'uuid-lslong': '12041382567993927168'}, 'enable': 'true', 'created': '2025-10-29T18:58:01', 'last-modified': '2025-10-29T18:58:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431375'} 2025-10-29 18:58:01,934 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:58:01,943 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12322895232528239407', 'uuid-lslong': '12041382567993927168'}, 'enable': 'true', 'created': '2025-10-29T18:58:01', 'last-modified': '2025-10-29T18:58:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465155'} 2025-10-29 18:58:01,951 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:58:01,957 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-15427957', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12322895232528239407', 'uuid-lslong': '12041382567993927168'}, 'enable': 'true', 'created': '2025-10-29T18:58:01', 'last-modified': '2025-10-29T18:58:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476525'} 2025-10-29 18:58:01,963 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-29 18:58:01,963 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-95412847 passed 2025-10-29 18:58:01,963 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-95412847 in API_Server ====== 2025-10-29 18:58:01,964 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:58:01,971 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:58:01,984 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:58:02,109 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ab03b7ec-ab33-4b2f-a71b-95a5c9dbe600 2025-10-29 18:58:02,122 - DEBUG - =>VN ctest-trans_right_vn-95412847 has no policy to be verified 2025-10-29 18:58:02,122 - DEBUG - Verifying the vn in opserver 2025-10-29 18:58:02,122 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847 virtual network link through opserver 10.0.0.249 2025-10-29 18:58:02,122 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-29 18:58:02,140 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847?flat'} 2025-10-29 18:58:02,140 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847 virtual network link through opserver 10.0.0.19 2025-10-29 18:58:02,140 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-29 18:58:02,160 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847?flat'} 2025-10-29 18:58:02,160 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847 virtual network link through opserver 10.0.0.41 2025-10-29 18:58:02,160 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-29 18:58:02,177 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847?flat'} 2025-10-29 18:58:02,177 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_right_vn-95412847 is found in opserver 2025-10-29 18:58:02,205 - DEBUG - Do not have enough data to verify VN in agent 2025-10-29 18:58:02,223 - DEBUG - VRF ids for VN ctest-trans_right_vn-95412847: {} 2025-10-29 18:58:02,296 - DEBUG - Services list from nova: [, , , ] 2025-10-29 18:58:03,537 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-2) 2025-10-29 18:58:05,041 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-1) 2025-10-29 18:58:05,042 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-09563853'] 2025-10-29 18:58:05,337 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09563853'] created succesfully 2025-10-29 18:58:06,962 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4526-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4526-2) 2025-10-29 18:58:06,962 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:58:07,311 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:58:09,407 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:58:09,429 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 18:58:09,533 - INFO - Waiting for VM ctest-pt_svm0-11426221 to be up.. 2025-10-29 18:58:09,638 - DEBUG - VM is in ACTIVE state now 2025-10-29 18:58:09,638 - INFO - VM name : ctest-pt_svm0-11426221 2025-10-29 18:58:09,739 - DEBUG - VM ctest-pt_svm0-11426221 ID is f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:58:09,770 - DEBUG - VM ctest-pt_svm0-11426221 launched on Node an-jenkins-deploy-platform-ansible-os-4526-2 2025-10-29 18:58:09,873 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:58:09,881 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 18:58:13,076 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1029ms') 2025-10-29 18:58:13,076 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:13,101 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:17,175 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms') 2025-10-29 18:58:17,176 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:17,201 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:21,300 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2025-10-29 18:58:21,300 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:21,323 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:25,407 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-29 18:58:25,407 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:25,440 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:29,530 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-29 18:58:29,531 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:29,555 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:33,656 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2025-10-29 18:58:33,657 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:33,695 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:37,781 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-29 18:58:37,781 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:37,802 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:41,886 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-29 18:58:41,887 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:41,905 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:45,975 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-10-29 18:58:45,975 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:45,995 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:50,074 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2025-10-29 18:58:50,074 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 failed! 2025-10-29 18:58:50,098 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is 105.234.180.129 and allocation pool is NOT set 2025-10-29 18:58:52,162 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=7.80 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=0.742 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.742/4.270/7.799/3.528 ms') 2025-10-29 18:58:52,162 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 passed 2025-10-29 18:58:52,242 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:58:52,243 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-11426221, IP 105.234.180.131, Port 22 2025-10-29 18:58:52,315 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-29 18:58:52,450 - DEBUG - VM ctest-pt_svm0-11426221 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-29 18:58:57,451 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:58:57,452 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-11426221, IP 105.234.180.131, Port 22 2025-10-29 18:58:57,516 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-29 18:58:57,691 - DEBUG - VM ctest-pt_svm0-11426221 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-29 18:59:02,693 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:02,693 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-11426221, IP 105.234.180.131, Port 22 2025-10-29 18:59:02,763 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-29 18:59:02,861 - DEBUG - VM ctest-pt_svm0-11426221 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-29 18:59:07,862 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:07,862 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-11426221, IP 105.234.180.131, Port 22 2025-10-29 18:59:07,922 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-29 18:59:08,084 - DEBUG - VM ctest-pt_svm0-11426221 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-29 18:59:13,085 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:13,085 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-11426221, IP 105.234.180.131, Port 22 2025-10-29 18:59:13,250 - DEBUG - VM ctest-pt_svm0-11426221 is ready for SSH connections 2025-10-29 18:59:13,259 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-si-65376386'] 2025-10-29 18:59:13,817 - INFO - Waiting for VM ctest-left_vm-05716229 to be up.. 2025-10-29 18:59:13,922 - DEBUG - VM is in ACTIVE state now 2025-10-29 18:59:13,922 - INFO - VM name : ctest-left_vm-05716229 2025-10-29 18:59:14,052 - DEBUG - VM ctest-left_vm-05716229 ID is be6cf9ea-2288-4391-ba71-426a30ab957b 2025-10-29 18:59:14,052 - DEBUG - VM ctest-left_vm-05716229 launched on Node an-jenkins-deploy-platform-ansible-os-4526-2 2025-10-29 18:59:14,181 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/be6cf9ea-2288-4391-ba71-426a30ab957b 2025-10-29 18:59:14,191 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/a7357119-fd2f-4cbc-b167-5819cb7ece81 2025-10-29 18:59:15,367 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.32 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.04 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.037/3.180/5.324/2.143 ms') 2025-10-29 18:59:15,367 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-05716229 passed 2025-10-29 18:59:15,451 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:15,451 - DEBUG - Waiting to SSH to VM ctest-left_vm-05716229, IP 204.57.229.67, Port 22 2025-10-29 18:59:15,607 - DEBUG - VM ctest-left_vm-05716229 is ready for SSH connections 2025-10-29 18:59:15,608 - INFO - Waiting for VM ctest-right_vm-71355132 to be up.. 2025-10-29 18:59:15,723 - DEBUG - VM is in ACTIVE state now 2025-10-29 18:59:15,724 - INFO - VM name : ctest-right_vm-71355132 2025-10-29 18:59:15,851 - DEBUG - VM ctest-right_vm-71355132 ID is 5d04fbb3-ee50-4ecf-aaed-53a6bba7ff91 2025-10-29 18:59:15,852 - DEBUG - VM ctest-right_vm-71355132 launched on Node an-jenkins-deploy-platform-ansible-os-4526-1 2025-10-29 18:59:15,974 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/5d04fbb3-ee50-4ecf-aaed-53a6bba7ff91 2025-10-29 18:59:15,985 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/ccc66eec-6328-4218-a9dd-b9f1850eadbc 2025-10-29 18:59:17,258 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.79 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=5.15 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.793/4.472/5.151/0.679 ms') 2025-10-29 18:59:17,258 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-71355132 passed 2025-10-29 18:59:17,343 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:17,343 - DEBUG - Waiting to SSH to VM ctest-right_vm-71355132, IP 121.3.14.131, Port 22 2025-10-29 18:59:17,545 - DEBUG - VM ctest-right_vm-71355132 is ready for SSH connections 2025-10-29 18:59:17,555 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-si-65376386, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-29 18:59:17,913 - INFO - Attaching policy ctest-policy-57128291 to vn ctest-left-38213075 2025-10-29 18:59:18,302 - INFO - Attaching policy ctest-policy-57128291 to vn ctest-right-53721492 2025-10-29 18:59:18,657 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-09563853'] created succesfully 2025-10-29 18:59:18,871 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-si-65376386'] created succesfully 2025-10-29 18:59:18,871 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:59:18,885 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:59:18,909 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:59:19,063 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/b4b2b8c2-afcf-4060-a603-8d3bf814e1de 2025-10-29 18:59:19,077 - DEBUG - SI 'ctest-si-65376386' has service template ref to ctest-service_template_1-09563853 2025-10-29 18:59:19,077 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:59:19,088 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:59:19,110 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:59:19,254 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/b4b2b8c2-afcf-4060-a603-8d3bf814e1de 2025-10-29 18:59:19,267 - DEBUG - Requesting: http://10.0.0.249:8082/port-tuple/6414ffb7-d65e-44a1-9f35-393aaaa339fc 2025-10-29 18:59:19,279 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 18:59:19,538 - DEBUG - VM is in ACTIVE state now 2025-10-29 18:59:19,873 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:59:19,885 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 18:59:19,896 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/490e8090-e838-43d4-b1b1-17c9390efa87 2025-10-29 18:59:19,907 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/8be367d3-1f62-4175-b212-81920a48098f 2025-10-29 18:59:19,920 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/d5fa665d-26d5-45bf-9d08-649395bf7e34 2025-10-29 18:59:20,217 - DEBUG - VM is in ACTIVE state now 2025-10-29 18:59:20,218 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:59:20,227 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 18:59:21,417 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=3.26 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=34.8 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.257/19.014/34.772/15.757 ms') 2025-10-29 18:59:21,417 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-11426221 passed 2025-10-29 18:59:21,473 - DEBUG - VM ctest-pt_svm0-11426221 Tap interface: {'index': '4', 'name': 'tap00ffeb31-22', 'uuid': '00ffeb31-2243-4d79-af50-4d553fc00750', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436:ctest-trans_left_vn-41121436', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'vm_uuid': 'f6280b25-5537-490a-ba97-9c9e9834ccac', 'vm_name': 'ctest-pt_svm0-11426221', 'ip_addr': '105.234.180.131', 'mac_addr': '02:00:ff:eb:31:22', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '95', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-15427957:00ffeb31-2243-4d79-af50-4d553fc00750', 'sg_uuid_list': ['7c120f01-8a05-4ac2-88cd-ed50610ce321'], 'static_route_list': None, 'vm_project_uuid': '1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-29 18:59:21,473 - DEBUG - Agent 10.0.0.27 vrf name: default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436:ctest-trans_left_vn-41121436 2025-10-29 18:59:21,479 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436:ctest-trans_left_vn-41121436', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'table_label': '-1', 'vxlan_id': '14', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.249:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-29 18:59:21,587 - DEBUG - VM ctest-pt_svm0-11426221 : Tap interface tap00ffeb31-22 is set to Active 2025-10-29 18:59:21,587 - DEBUG - Tap interface tap00ffeb31-22 detail : {'index': '4', 'name': 'tap00ffeb31-22', 'uuid': '00ffeb31-2243-4d79-af50-4d553fc00750', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436:ctest-trans_left_vn-41121436', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '14', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436', 'vm_uuid': 'f6280b25-5537-490a-ba97-9c9e9834ccac', 'vm_name': 'ctest-pt_svm0-11426221', 'ip_addr': '105.234.180.131', 'mac_addr': '02:00:ff:eb:31:22', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '95', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-15427957:00ffeb31-2243-4d79-af50-4d553fc00750', 'sg_uuid_list': ['7c120f01-8a05-4ac2-88cd-ed50610ce321'], 'static_route_list': None, 'vm_project_uuid': '1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-29 18:59:21,707 - DEBUG - Starting Layer 2 verification in Agent 2025-10-29 18:59:21,737 - DEBUG - Layer 2 path is seen for VM MAC 02:00:ff:eb:31:22 in agent 10.0.0.27 2025-10-29 18:59:21,737 - DEBUG - Active layer 2 route in agent is present for VMI tap00ffeb31-22 2025-10-29 18:59:21,738 - DEBUG - L2 label(35) matches bw route table and interface table 2025-10-29 18:59:21,765 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is found in Agent of node 10.0.0.27 2025-10-29 18:59:21,880 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 is consistent in agent 10.0.0.27 2025-10-29 18:59:21,880 - DEBUG - Route for VM IP ['105.234.180.131'] is consistent in agent 10.0.0.27 2025-10-29 18:59:21,880 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-trans_left_vn-41121436 verification for VM ctest-pt_svm0-11426221 in Agent 10.0.0.27 passed 2025-10-29 18:59:22,010 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2025-10-29 18:59:22,031 - DEBUG - Route for VM MAC 02:00:ff:eb:31:22 is consistent in agent 10.0.0.27 2025-10-29 18:59:22,032 - INFO - VM ctest-pt_svm0-11426221 verifications in Compute nodes passed 2025-10-29 18:59:22,032 - DEBUG - The SVMs in the SI are : [] 2025-10-29 18:59:22,032 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 18:59:22,056 - DEBUG - Service VM for SI 'ctest-si-65376386' is launched 2025-10-29 18:59:22,056 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:59:22,071 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:59:22,101 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:59:22,216 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/b4b2b8c2-afcf-4060-a603-8d3bf814e1de 2025-10-29 18:59:22,232 - DEBUG - SI ctest-si-65376386 has Port Tuple: ['ctest-port_tuple-51460549'] 2025-10-29 18:59:22,298 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075 2025-10-29 18:59:22,418 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492 2025-10-29 18:59:22,419 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:22,419 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:22,419 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 121.3.14.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-10-29 18:59:22,419 - DEBUG - ping -s 56 -c 3 -W 1 121.3.14.131 2025-10-29 18:59:39,759 - DEBUG - PING 121.3.14.131 (121.3.14.131) 56(84) bytes of data. 64 bytes from 121.3.14.131: icmp_req=1 ttl=63 time=15.6 ms 64 bytes from 121.3.14.131: icmp_req=2 ttl=63 time=2.44 ms 64 bytes from 121.3.14.131: icmp_req=3 ttl=63 time=2.11 ms --- 121.3.14.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 2.113/6.722/15.606/6.283 ms 2025-10-29 18:59:39,759 - INFO - Ping to IP 121.3.14.131 from VM ctest-left_vm-05716229 passed 2025-10-29 18:59:39,768 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-si-65376386, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-left-38213075, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-right-53721492, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-15427957:ctest-si-65376386, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-29 18:59:39,837 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-29 18:59:39,837 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 18:59:39,843 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 18:59:39,856 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 18:59:39,957 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/b4b2b8c2-afcf-4060-a603-8d3bf814e1de 2025-10-29 18:59:39,975 - DEBUG - Requesting: http://10.0.0.249:8082/port-tuple/6414ffb7-d65e-44a1-9f35-393aaaa339fc 2025-10-29 18:59:39,985 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 18:59:40,194 - DEBUG - Executing command: rm -f /tmp/mirror-tap00ffeb31-22_ctest-random-78299621.pcap 2025-10-29 18:59:50,340 - INFO - Starting tcpdump to capture the mirrored packets. 2025-10-29 18:59:50,340 - DEBUG - Executing command: sudo tcpdump -ni tap00ffeb31-22 -U udp port 8099 -w /tmp/mirror-tap00ffeb31-22_ctest-random-78299621.pcap 2025-10-29 19:00:00,354 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 121.3.14.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-10-29 19:00:00,355 - DEBUG - ping -s 56 -c 3 -W 1 121.3.14.131 2025-10-29 19:00:02,840 - DEBUG - PING 121.3.14.131 (121.3.14.131) 56(84) bytes of data. 64 bytes from 121.3.14.131: icmp_req=1 ttl=63 time=4.26 ms 64 bytes from 121.3.14.131: icmp_req=2 ttl=63 time=1.81 ms 64 bytes from 121.3.14.131: icmp_req=3 ttl=63 time=1.86 ms --- 121.3.14.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.810/2.647/4.269/1.147 ms 2025-10-29 19:00:02,841 - INFO - Ping to IP 121.3.14.131 from VM ctest-left_vm-05716229 passed 2025-10-29 19:00:02,841 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:02,859 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:02,880 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:03,009 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/b4b2b8c2-afcf-4060-a603-8d3bf814e1de 2025-10-29 19:00:03,020 - DEBUG - Requesting: http://10.0.0.249:8082/port-tuple/6414ffb7-d65e-44a1-9f35-393aaaa339fc 2025-10-29 19:00:03,029 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/00ffeb31-2243-4d79-af50-4d553fc00750 2025-10-29 19:00:03,178 - DEBUG - Waiting for the tcpdump write to complete. 2025-10-29 19:00:05,179 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap00ffeb31-22_ctest-random-78299621.pcap| awk '{print $2}') 2025-10-29 19:00:05,182 - DEBUG - Executing command: sync 2025-10-29 19:00:08,210 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap00ffeb31-22_ctest-random-78299621.pcap | wc -l 2025-10-29 19:00:08,228 - DEBUG - STDOUT: 12 2025-10-29 19:00:08,228 - DEBUG - STDERR: reading from file /tmp/mirror-tap00ffeb31-22_ctest-random-78299621.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-10-29 19:00:08,229 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap00ffeb31-22_ctest-random-78299621.pcap 2025-10-29 19:00:08,274 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-11426221' 2025-10-29 19:00:08,274 - INFO - Dettaching policy ctest-policy-57128291 from vn ctest-right-53721492 2025-10-29 19:00:08,467 - INFO - Dettaching policy ctest-policy-57128291 from vn ctest-left-38213075 2025-10-29 19:00:08,841 - INFO - Deleted policy ctest-policy-57128291 2025-10-29 19:00:08,841 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-si-65376386'] 2025-10-29 19:00:08,962 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-15427957', 'ctest-si-65376386'] 2025-10-29 19:00:08,962 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:08,972 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:09,008 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:09,095 - DEBUG - Service instance ctest-si-65376386 removed from api server 2025-10-29 19:00:09,096 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/f6280b25-5537-490a-ba97-9c9e9834ccac 2025-10-29 19:00:09,111 - DEBUG - All Service VMs unlinked from SI ctest-si-65376386 2025-10-29 19:00:09,120 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-29 19:00:09,120 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-29 19:00:09,173 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-29 19:00:09,173 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-29 19:00:09,173 - INFO - Deleting VM ctest-pt_svm0-11426221 2025-10-29 19:00:09,263 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-09563853'] 2025-10-29 19:00:09,369 - INFO - Service template: ['default-domain', 'ctest-service_template_1-09563853'] deleted successfully. 2025-10-29 19:00:09,369 - INFO - Deleting VM ctest-right_vm-71355132 2025-10-29 19:00:09,451 - INFO - Deleting VM ctest-left_vm-05716229 2025-10-29 19:00:09,536 - INFO - Deleting VN ctest-trans_right_vn-95412847 2025-10-29 19:00:09,710 - DEBUG - Response for deleting network () 2025-10-29 19:00:09,710 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/a0d69328-7084-4a66-ab95-f2143a7cda24 2025-10-29 19:00:09,716 - DEBUG - Response Code: 404 2025-10-29 19:00:09,716 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:09,723 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:09,754 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:09,869 - INFO - Validated that VN ctest-trans_right_vn-95412847 is not found in API Server 2025-10-29 19:00:09,896 - DEBUG - VN ctest-trans_right_vn-95412847 is not present in Agent 10.0.0.73 2025-10-29 19:00:09,907 - DEBUG - VN ctest-trans_right_vn-95412847 is not present in Agent 10.0.0.27 2025-10-29 19:00:09,907 - INFO - Validated that VN ctest-trans_right_vn-95412847 is not in any agent 2025-10-29 19:00:09,971 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-95412847 info 2025-10-29 19:00:09,971 - INFO - Deleting VN ctest-trans_left_vn-41121436 2025-10-29 19:00:10,052 - DEBUG - VN ce107dd5-7aa7-4c55-ac3c-871072d7e2f3 still in use: Unable to complete operation on network ce107dd5-7aa7-4c55-ac3c-871072d7e2f3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-ff56eb73-40f8-4e2a-aecc-a8bf5556379e'] 2025-10-29 19:00:10,053 - WARNING - Deleting VN ctest-trans_left_vn-41121436 failed..Will retry 2025-10-29 19:00:12,247 - DEBUG - Response for deleting network () 2025-10-29 19:00:12,247 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b3450e03-edfa-43d8-86ef-d442d0e33d77 2025-10-29 19:00:12,255 - DEBUG - Response Code: 404 2025-10-29 19:00:12,255 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:12,265 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:12,288 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:12,411 - INFO - Validated that VN ctest-trans_left_vn-41121436 is not found in API Server 2025-10-29 19:00:12,423 - DEBUG - VN ctest-trans_left_vn-41121436 is not present in Agent 10.0.0.73 2025-10-29 19:00:12,435 - DEBUG - VN ctest-trans_left_vn-41121436 is not present in Agent 10.0.0.27 2025-10-29 19:00:12,435 - INFO - Validated that VN ctest-trans_left_vn-41121436 is not in any agent 2025-10-29 19:00:12,471 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-41121436 info 2025-10-29 19:00:12,471 - INFO - Deleting VN ctest-mgmt_vn-67551494 2025-10-29 19:00:12,642 - DEBUG - Response for deleting network () 2025-10-29 19:00:12,642 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/fd3a4973-d234-4729-8297-8b1c4b53dfb6 2025-10-29 19:00:12,648 - DEBUG - Response Code: 404 2025-10-29 19:00:12,648 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:12,654 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:12,674 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:12,769 - INFO - Validated that VN ctest-mgmt_vn-67551494 is not found in API Server 2025-10-29 19:00:12,792 - DEBUG - VN ctest-mgmt_vn-67551494 is not present in Agent 10.0.0.73 2025-10-29 19:00:12,806 - DEBUG - VN ctest-mgmt_vn-67551494 is not present in Agent 10.0.0.27 2025-10-29 19:00:12,806 - INFO - Validated that VN ctest-mgmt_vn-67551494 is not in any agent 2025-10-29 19:00:12,846 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-67551494 info 2025-10-29 19:00:12,846 - INFO - Deleting VN ctest-right-53721492 2025-10-29 19:00:13,060 - DEBUG - Response for deleting network () 2025-10-29 19:00:13,060 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/b9a431a4-8db5-4c42-a19a-b18615fe12ae 2025-10-29 19:00:13,067 - DEBUG - Response Code: 404 2025-10-29 19:00:13,067 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:13,074 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:13,088 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:13,194 - INFO - Validated that VN ctest-right-53721492 is not found in API Server 2025-10-29 19:00:13,217 - DEBUG - VN ctest-right-53721492 is not present in Agent 10.0.0.73 2025-10-29 19:00:13,229 - DEBUG - VN ctest-right-53721492 is not present in Agent 10.0.0.27 2025-10-29 19:00:13,229 - INFO - Validated that VN ctest-right-53721492 is not in any agent 2025-10-29 19:00:13,270 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-53721492 info 2025-10-29 19:00:13,271 - INFO - Deleting VN ctest-left-38213075 2025-10-29 19:00:13,476 - DEBUG - Response for deleting network () 2025-10-29 19:00:13,476 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ffa45023-9414-4fcd-aca4-e47816fd7210 2025-10-29 19:00:13,483 - DEBUG - Response Code: 404 2025-10-29 19:00:13,483 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-29 19:00:13,492 - DEBUG - Requesting: http://10.0.0.249:8082/domain/ab5f52cf-59f5-4d8f-a294-1eaf08d80442 2025-10-29 19:00:13,507 - DEBUG - Requesting: http://10.0.0.249:8082/project/1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed 2025-10-29 19:00:13,617 - INFO - Validated that VN ctest-left-38213075 is not found in API Server 2025-10-29 19:00:13,645 - DEBUG - VN ctest-left-38213075 is not present in Agent 10.0.0.73 2025-10-29 19:00:13,661 - DEBUG - VN ctest-left-38213075 is not present in Agent 10.0.0.27 2025-10-29 19:00:13,661 - INFO - Validated that VN ctest-left-38213075 is not in any agent 2025-10-29 19:00:13,701 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-38213075 info 2025-10-29 19:00:15,066 - DEBUG - No XMPP flaps were noticed during the test 2025-10-29 19:00:15,066 - INFO -

2025-10-29 19:00:15,067 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:23]

2025-10-29 19:00:15,068 - INFO - -------------------------------------------------------------------------------- 2025-10-29 19:00:15,849 - INFO - Deleted project: ctest-TestSVCV2Mirror-15427957, ID : 1d2f01c5-9cc6-4b64-b20c-b8bba320b2ed