2025-10-30 11:12:11,089 - INFO - Domain Default found not creating 2025-10-30 11:12:11,293 - INFO - Project ctest-TestSVCV2Mirror-71633481 not found, creating it 2025-10-30 11:12:11,884 - INFO - Created Project:ctest-TestSVCV2Mirror-71633481, ID : ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:13,447 - INFO - ================================================================================ 2025-10-30 11:12:13,447 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-10-30 11:12:13,448 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-10-30 11:12:14,771 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.131': '0', '10.20.0.128': '0'}, '10.0.0.27': {'10.20.0.145': '0', '10.20.0.128': '0'}} with 2025-10-30 11:12:14,772 - INFO - Initial checks done. Running the testcase now 2025-10-30 11:12:14,772 - INFO - 2025-10-30 11:12:15,512 - DEBUG - Response for create_network : {'network': {'id': 'ef21940c-df40-4907-b47b-9024ccd19ed4', 'name': 'ctest-left-18920195', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-left-18920195'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:12:15,864 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ba628fd9-8009-4e06-a1ce-aa2f413ef0c7', 'name': '', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'network_id': 'ef21940c-df40-4907-b47b-9024ccd19ed4', 'ip_version': 4, 'cidr': '60.111.186.192/26', 'allocation_pools': [{'start': '60.111.186.194', 'end': '60.111.186.254'}], 'gateway_ip': '60.111.186.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '60.111.186.194', 'tags': [], 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575'}} 2025-10-30 11:12:15,887 - INFO - Created VN ctest-left-18920195 2025-10-30 11:12:15,903 - DEBUG - VN ctest-left-18920195 UUID is ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,002 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:16,326 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:16,361 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:16,376 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:16,472 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,485 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,498 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/bcf6e92f-0211-4b01-ba4d-590325c1f690 2025-10-30 11:12:16,508 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/bcf6e92f-0211-4b01-ba4d-590325c1f690 2025-10-30 11:12:16,517 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a6ae1b9b-049a-489c-a596-dcfee3d1ee04 2025-10-30 11:12:16,538 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:12:16,538 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,551 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/bcf6e92f-0211-4b01-ba4d-590325c1f690 2025-10-30 11:12:16,569 - INFO - Verified VN network id 15 for VN ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,569 - INFO - Verifications in API Server for VN ctest-left-18920195 passed 2025-10-30 11:12:16,569 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,582 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/bcf6e92f-0211-4b01-ba4d-590325c1f690 2025-10-30 11:12:16,592 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/bcf6e92f-0211-4b01-ba4d-590325c1f690 2025-10-30 11:12:16,600 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/a6ae1b9b-049a-489c-a596-dcfee3d1ee04 2025-10-30 11:12:16,614 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17231216432302278919', 'uuid-lslong': '13005146836691951316'}, 'enable': 'true', 'created': '2025-10-30T11:12:15', 'last-modified': '2025-10-30T11:12:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.819132'} 2025-10-30 11:12:16,623 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:12:16,630 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17231216432302278919', 'uuid-lslong': '13005146836691951316'}, 'enable': 'true', 'created': '2025-10-30T11:12:15', 'last-modified': '2025-10-30T11:12:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.834131'} 2025-10-30 11:12:16,639 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:12:16,648 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17231216432302278919', 'uuid-lslong': '13005146836691951316'}, 'enable': 'true', 'created': '2025-10-30T11:12:15', 'last-modified': '2025-10-30T11:12:15', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.847267'} 2025-10-30 11:12:16,656 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-30 11:12:16,657 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-18920195 passed 2025-10-30 11:12:16,657 - DEBUG - ====Verifying policy data for ctest-left-18920195 in API_Server ====== 2025-10-30 11:12:16,657 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:16,667 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:16,682 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:16,793 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/ef21940c-df40-4907-b47b-9024ccd19ed4 2025-10-30 11:12:16,804 - DEBUG - =>VN ctest-left-18920195 has no policy to be verified 2025-10-30 11:12:16,804 - DEBUG - Verifying the vn in opserver 2025-10-30 11:12:16,804 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195 virtual network link through opserver 10.0.0.249 2025-10-30 11:12:16,804 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:17,116 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:17,191 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195?flat'} 2025-10-30 11:12:17,191 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195 virtual network link through opserver 10.0.0.33 2025-10-30 11:12:17,191 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:17,497 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:17,584 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195?flat'} 2025-10-30 11:12:17,584 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195 virtual network link through opserver 10.0.0.19 2025-10-30 11:12:17,584 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:17,920 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:17,980 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195?flat'} 2025-10-30 11:12:17,980 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195 is found in opserver 2025-10-30 11:12:18,005 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:12:18,019 - DEBUG - VRF ids for VN ctest-left-18920195: {} 2025-10-30 11:12:18,351 - DEBUG - Response for create_network : {'network': {'id': '9fe5800b-41a2-4b7d-9e44-773b15a2ad15', 'name': 'ctest-right-17356437', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-right-17356437'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:12:18,636 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ef5b2445-0b7d-46b3-b653-e725ce3cf76c', 'name': '', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'network_id': '9fe5800b-41a2-4b7d-9e44-773b15a2ad15', 'ip_version': 4, 'cidr': '220.202.120.128/26', 'allocation_pools': [{'start': '220.202.120.130', 'end': '220.202.120.190'}], 'gateway_ip': '220.202.120.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.202.120.130', 'tags': [], 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575'}} 2025-10-30 11:12:18,669 - INFO - Created VN ctest-right-17356437 2025-10-30 11:12:18,684 - DEBUG - VN ctest-right-17356437 UUID is 9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:18,776 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:18,783 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:18,798 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:18,901 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:18,916 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:18,930 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e12973d6-7091-46b5-8f8e-dfc409a781f4 2025-10-30 11:12:18,942 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e12973d6-7091-46b5-8f8e-dfc409a781f4 2025-10-30 11:12:18,952 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/fc66d7b5-7cec-400c-a3e9-3cb228d66ea1 2025-10-30 11:12:18,964 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:12:18,964 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:18,980 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e12973d6-7091-46b5-8f8e-dfc409a781f4 2025-10-30 11:12:19,000 - INFO - Verified VN network id 16 for VN 9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:19,000 - INFO - Verifications in API Server for VN ctest-right-17356437 passed 2025-10-30 11:12:19,000 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:19,016 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e12973d6-7091-46b5-8f8e-dfc409a781f4 2025-10-30 11:12:19,025 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e12973d6-7091-46b5-8f8e-dfc409a781f4 2025-10-30 11:12:19,035 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/fc66d7b5-7cec-400c-a3e9-3cb228d66ea1 2025-10-30 11:12:19,049 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11521756007531432829', 'uuid-lslong': '11404371252058696981'}, 'enable': 'true', 'created': '2025-10-30T11:12:18', 'last-modified': '2025-10-30T11:12:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.477685'} 2025-10-30 11:12:19,058 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:12:19,065 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11521756007531432829', 'uuid-lslong': '11404371252058696981'}, 'enable': 'true', 'created': '2025-10-30T11:12:18', 'last-modified': '2025-10-30T11:12:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.496063'} 2025-10-30 11:12:19,074 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:12:19,081 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11521756007531432829', 'uuid-lslong': '11404371252058696981'}, 'enable': 'true', 'created': '2025-10-30T11:12:18', 'last-modified': '2025-10-30T11:12:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506610'} 2025-10-30 11:12:19,089 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-30 11:12:19,089 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-17356437 passed 2025-10-30 11:12:19,089 - DEBUG - ====Verifying policy data for ctest-right-17356437 in API_Server ====== 2025-10-30 11:12:19,089 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:19,097 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:19,112 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:19,227 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/9fe5800b-41a2-4b7d-9e44-773b15a2ad15 2025-10-30 11:12:19,238 - DEBUG - =>VN ctest-right-17356437 has no policy to be verified 2025-10-30 11:12:19,238 - DEBUG - Verifying the vn in opserver 2025-10-30 11:12:19,238 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437 virtual network link through opserver 10.0.0.249 2025-10-30 11:12:19,238 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:19,302 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437?flat'} 2025-10-30 11:12:19,302 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437 virtual network link through opserver 10.0.0.33 2025-10-30 11:12:19,302 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:19,382 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437?flat'} 2025-10-30 11:12:19,382 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437 virtual network link through opserver 10.0.0.19 2025-10-30 11:12:19,382 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:19,457 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437?flat'} 2025-10-30 11:12:19,457 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437 is found in opserver 2025-10-30 11:12:19,482 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:12:19,498 - DEBUG - VRF ids for VN ctest-right-17356437: {} 2025-10-30 11:12:19,791 - DEBUG - Response for create_network : {'network': {'id': 'd58428b5-cace-4c64-ab4a-aaba1ea72c7a', 'name': 'ctest-mgmt_vn-81622334', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-mgmt_vn-81622334'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:12:20,033 - DEBUG - Response for create_subnet : {'subnet': {'id': '436c8255-e57e-41da-9488-6c3715fdb3f3', 'name': '', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'network_id': 'd58428b5-cace-4c64-ab4a-aaba1ea72c7a', 'ip_version': 4, 'cidr': '90.13.32.192/26', 'allocation_pools': [{'start': '90.13.32.194', 'end': '90.13.32.254'}], 'gateway_ip': '90.13.32.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '90.13.32.194', 'tags': [], 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575'}} 2025-10-30 11:12:20,061 - INFO - Created VN ctest-mgmt_vn-81622334 2025-10-30 11:12:20,077 - DEBUG - VN ctest-mgmt_vn-81622334 UUID is d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,172 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:20,184 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:20,204 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:20,320 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,337 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,350 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/173a8d85-02e4-46dd-b846-f7b853fcabb0 2025-10-30 11:12:20,360 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/173a8d85-02e4-46dd-b846-f7b853fcabb0 2025-10-30 11:12:20,376 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/05087800-de33-4e0c-b093-499469756059 2025-10-30 11:12:20,386 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:12:20,386 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,398 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/173a8d85-02e4-46dd-b846-f7b853fcabb0 2025-10-30 11:12:20,422 - INFO - Verified VN network id 17 for VN d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,423 - INFO - Verifications in API Server for VN ctest-mgmt_vn-81622334 passed 2025-10-30 11:12:20,424 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,441 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/173a8d85-02e4-46dd-b846-f7b853fcabb0 2025-10-30 11:12:20,450 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/173a8d85-02e4-46dd-b846-f7b853fcabb0 2025-10-30 11:12:20,459 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/05087800-de33-4e0c-b093-499469756059 2025-10-30 11:12:20,472 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15385466988261166180', 'uuid-lslong': '12342865445117176954'}, 'enable': 'true', 'created': '2025-10-30T11:12:19', 'last-modified': '2025-10-30T11:12:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.512830'} 2025-10-30 11:12:20,478 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:12:20,485 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15385466988261166180', 'uuid-lslong': '12342865445117176954'}, 'enable': 'true', 'created': '2025-10-30T11:12:19', 'last-modified': '2025-10-30T11:12:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525877'} 2025-10-30 11:12:20,494 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:12:20,500 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15385466988261166180', 'uuid-lslong': '12342865445117176954'}, 'enable': 'true', 'created': '2025-10-30T11:12:19', 'last-modified': '2025-10-30T11:12:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.531335'} 2025-10-30 11:12:20,509 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-30 11:12:20,509 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-81622334 passed 2025-10-30 11:12:20,510 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-81622334 in API_Server ====== 2025-10-30 11:12:20,510 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:20,517 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:20,532 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:20,634 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/d58428b5-cace-4c64-ab4a-aaba1ea72c7a 2025-10-30 11:12:20,649 - DEBUG - =>VN ctest-mgmt_vn-81622334 has no policy to be verified 2025-10-30 11:12:20,649 - DEBUG - Verifying the vn in opserver 2025-10-30 11:12:20,649 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334 virtual network link through opserver 10.0.0.249 2025-10-30 11:12:20,649 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:20,719 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334?flat'} 2025-10-30 11:12:20,719 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334 virtual network link through opserver 10.0.0.33 2025-10-30 11:12:20,719 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:20,785 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334?flat'} 2025-10-30 11:12:20,785 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334 virtual network link through opserver 10.0.0.19 2025-10-30 11:12:20,785 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:20,853 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334?flat'} 2025-10-30 11:12:20,853 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-mgmt_vn-81622334 is found in opserver 2025-10-30 11:12:20,879 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:12:20,891 - DEBUG - VRF ids for VN ctest-mgmt_vn-81622334: {} 2025-10-30 11:12:21,239 - DEBUG - Response for create_network : {'network': {'id': '69f47495-b64b-42a5-92cd-abae20ebbff1', 'name': 'ctest-trans_left_vn-66244852', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-trans_left_vn-66244852'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:12:21,561 - DEBUG - Response for create_subnet : {'subnet': {'id': '34fd6545-2513-42f2-a66b-ca56e4dafe9c', 'name': '', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'network_id': '69f47495-b64b-42a5-92cd-abae20ebbff1', 'ip_version': 4, 'cidr': '198.205.239.64/26', 'allocation_pools': [{'start': '198.205.239.66', 'end': '198.205.239.126'}], 'gateway_ip': '198.205.239.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '198.205.239.66', 'tags': [], 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575'}} 2025-10-30 11:12:21,588 - INFO - Created VN ctest-trans_left_vn-66244852 2025-10-30 11:12:21,604 - DEBUG - VN ctest-trans_left_vn-66244852 UUID is 69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:21,710 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:21,717 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:21,731 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:21,850 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:21,874 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:21,884 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ee500ea9-a066-48ad-9f10-70492b5a062c 2025-10-30 11:12:21,899 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ee500ea9-a066-48ad-9f10-70492b5a062c 2025-10-30 11:12:21,908 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/00ce3ec2-6633-4366-bb46-06f61957a7fa 2025-10-30 11:12:21,916 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:12:21,917 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:21,927 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ee500ea9-a066-48ad-9f10-70492b5a062c 2025-10-30 11:12:21,944 - INFO - Verified VN network id 18 for VN 69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:21,944 - INFO - Verifications in API Server for VN ctest-trans_left_vn-66244852 passed 2025-10-30 11:12:21,944 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:21,956 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ee500ea9-a066-48ad-9f10-70492b5a062c 2025-10-30 11:12:21,965 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ee500ea9-a066-48ad-9f10-70492b5a062c 2025-10-30 11:12:21,973 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/00ce3ec2-6633-4366-bb46-06f61957a7fa 2025-10-30 11:12:21,989 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7634855454657168037', 'uuid-lslong': '10578299864128143345'}, 'enable': 'true', 'created': '2025-10-30T11:12:21', 'last-modified': '2025-10-30T11:12:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.493221'} 2025-10-30 11:12:21,996 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:12:22,003 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7634855454657168037', 'uuid-lslong': '10578299864128143345'}, 'enable': 'true', 'created': '2025-10-30T11:12:21', 'last-modified': '2025-10-30T11:12:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476393'} 2025-10-30 11:12:22,009 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:12:22,017 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7634855454657168037', 'uuid-lslong': '10578299864128143345'}, 'enable': 'true', 'created': '2025-10-30T11:12:21', 'last-modified': '2025-10-30T11:12:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532361'} 2025-10-30 11:12:22,027 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-30 11:12:22,028 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-66244852 passed 2025-10-30 11:12:22,029 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-66244852 in API_Server ====== 2025-10-30 11:12:22,029 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:22,036 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:22,056 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:22,166 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/69f47495-b64b-42a5-92cd-abae20ebbff1 2025-10-30 11:12:22,182 - DEBUG - =>VN ctest-trans_left_vn-66244852 has no policy to be verified 2025-10-30 11:12:22,182 - DEBUG - Verifying the vn in opserver 2025-10-30 11:12:22,182 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 virtual network link through opserver 10.0.0.249 2025-10-30 11:12:22,182 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:22,197 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852?flat'} 2025-10-30 11:12:22,197 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 virtual network link through opserver 10.0.0.33 2025-10-30 11:12:22,197 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:22,211 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852?flat'} 2025-10-30 11:12:22,211 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 virtual network link through opserver 10.0.0.19 2025-10-30 11:12:22,211 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:22,228 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852?flat'} 2025-10-30 11:12:22,228 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is found in opserver 2025-10-30 11:12:22,255 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:12:22,270 - DEBUG - VRF ids for VN ctest-trans_left_vn-66244852: {} 2025-10-30 11:12:22,632 - DEBUG - Response for create_network : {'network': {'id': '29c7ddfc-c524-438d-81cd-fe5a7f277da4', 'name': 'ctest-trans_right_vn-58553025', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-trans_right_vn-58553025'], 'port_security_enabled': True, 'description': ''}} 2025-10-30 11:12:22,955 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b9d968ac-282c-4dec-bf2d-6dfa60dd1281', 'name': '', 'tenant_id': 'ba6a6c5c7b394810a2c5a531a339b575', 'network_id': '29c7ddfc-c524-438d-81cd-fe5a7f277da4', 'ip_version': 4, 'cidr': '35.54.175.128/26', 'allocation_pools': [{'start': '35.54.175.130', 'end': '35.54.175.190'}], 'gateway_ip': '35.54.175.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.54.175.130', 'tags': [], 'project_id': 'ba6a6c5c7b394810a2c5a531a339b575'}} 2025-10-30 11:12:22,984 - INFO - Created VN ctest-trans_right_vn-58553025 2025-10-30 11:12:22,996 - DEBUG - VN ctest-trans_right_vn-58553025 UUID is 29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,082 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:23,096 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:23,112 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:23,220 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,234 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,246 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08fc7756-46e5-41bd-b427-ca5d4d28bc64 2025-10-30 11:12:23,255 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08fc7756-46e5-41bd-b427-ca5d4d28bc64 2025-10-30 11:12:23,268 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/5c5a19af-0290-4b34-b962-4627eb817c06 2025-10-30 11:12:23,278 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:23,278 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,290 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08fc7756-46e5-41bd-b427-ca5d4d28bc64 2025-10-30 11:12:23,317 - INFO - Verified VN network id 19 for VN 29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,317 - INFO - Verifications in API Server for VN ctest-trans_right_vn-58553025 passed 2025-10-30 11:12:23,317 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,331 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08fc7756-46e5-41bd-b427-ca5d4d28bc64 2025-10-30 11:12:23,341 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08fc7756-46e5-41bd-b427-ca5d4d28bc64 2025-10-30 11:12:23,350 - DEBUG - Requesting: http://10.0.0.249:8082/route-target/5c5a19af-0290-4b34-b962-4627eb817c06 2025-10-30 11:12:23,364 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3010618953629451149', 'uuid-lslong': '9353411665752194468'}, 'enable': 'true', 'created': '2025-10-30T11:12:22', 'last-modified': '2025-10-30T11:12:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486614'} 2025-10-30 11:12:23,372 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:23,379 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3010618953629451149', 'uuid-lslong': '9353411665752194468'}, 'enable': 'true', 'created': '2025-10-30T11:12:22', 'last-modified': '2025-10-30T11:12:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499685'} 2025-10-30 11:12:23,385 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:23,392 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-71633481', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3010618953629451149', 'uuid-lslong': '9353411665752194468'}, 'enable': 'true', 'created': '2025-10-30T11:12:22', 'last-modified': '2025-10-30T11:12:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.506633'} 2025-10-30 11:12:23,399 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-30 11:12:23,400 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-58553025 passed 2025-10-30 11:12:23,400 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-58553025 in API_Server ====== 2025-10-30 11:12:23,400 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:12:23,407 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:12:23,429 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:12:23,535 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-network/29c7ddfc-c524-438d-81cd-fe5a7f277da4 2025-10-30 11:12:23,548 - DEBUG - =>VN ctest-trans_right_vn-58553025 has no policy to be verified 2025-10-30 11:12:23,548 - DEBUG - Verifying the vn in opserver 2025-10-30 11:12:23,548 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025 virtual network link through opserver 10.0.0.249 2025-10-30 11:12:23,548 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-30 11:12:23,561 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025?flat'} 2025-10-30 11:12:23,561 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025 virtual network link through opserver 10.0.0.33 2025-10-30 11:12:23,561 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-30 11:12:23,577 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025?flat'} 2025-10-30 11:12:23,578 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025 virtual network link through opserver 10.0.0.19 2025-10-30 11:12:23,578 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-30 11:12:23,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025?flat'} 2025-10-30 11:12:23,594 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_right_vn-58553025 is found in opserver 2025-10-30 11:12:23,620 - DEBUG - Do not have enough data to verify VN in agent 2025-10-30 11:12:23,634 - DEBUG - VRF ids for VN ctest-trans_right_vn-58553025: {} 2025-10-30 11:12:23,702 - DEBUG - Services list from nova: [, , , ] 2025-10-30 11:12:24,883 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-1) 2025-10-30 11:12:26,317 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-2) 2025-10-30 11:12:26,317 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-17311099'] 2025-10-30 11:12:26,641 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-17311099'] created succesfully 2025-10-30 11:12:28,136 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4541-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4541-1) 2025-10-30 11:12:28,136 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:12:28,489 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:12:28,532 - DEBUG - Response Code: 404 2025-10-30 11:12:30,532 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:12:30,544 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:12:30,625 - INFO - Waiting for VM ctest-pt_svm0-90837539 to be up.. 2025-10-30 11:12:30,720 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-10-30 11:12:35,813 - DEBUG - VM is in ACTIVE state now 2025-10-30 11:12:35,813 - INFO - VM name : ctest-pt_svm0-90837539 2025-10-30 11:12:35,904 - DEBUG - VM ctest-pt_svm0-90837539 ID is e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:12:35,933 - DEBUG - VM ctest-pt_svm0-90837539 launched on Node an-jenkins-deploy-platform-ansible-os-4541-1 2025-10-30 11:12:36,029 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:12:36,038 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:12:39,235 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-30 11:12:39,235 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:12:39,251 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:12:43,329 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-30 11:12:43,329 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:12:43,348 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:12:47,421 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-30 11:12:47,421 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:12:47,436 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:12:51,523 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-30 11:12:51,524 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:12:51,540 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:12:55,619 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-30 11:12:55,619 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:12:55,635 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:12:59,719 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-30 11:12:59,719 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:12:59,735 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:03,810 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2025-10-30 11:13:03,810 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:13:03,826 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:07,908 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-30 11:13:07,908 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:13:07,924 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:11,997 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-30 11:13:11,997 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:13:12,012 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:16,098 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-30 11:13:16,098 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:13:16,115 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:20,194 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms') 2025-10-30 11:13:20,194 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:13:20,209 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:24,289 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-30 11:13:24,289 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 failed! 2025-10-30 11:13:24,304 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is 198.205.239.65 and allocation pool is NOT set 2025-10-30 11:13:26,379 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=9.09 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=0.915 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.915/5.004/9.094/4.089 ms') 2025-10-30 11:13:26,379 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 passed 2025-10-30 11:13:26,450 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:26,450 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-90837539, IP 198.205.239.67, Port 22 2025-10-30 11:13:26,530 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 11:13:26,651 - DEBUG - VM ctest-pt_svm0-90837539 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 11:13:31,652 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:31,652 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-90837539, IP 198.205.239.67, Port 22 2025-10-30 11:13:31,720 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 11:13:31,815 - DEBUG - VM ctest-pt_svm0-90837539 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 11:13:36,815 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:36,816 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-90837539, IP 198.205.239.67, Port 22 2025-10-30 11:13:36,884 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 11:13:36,976 - DEBUG - VM ctest-pt_svm0-90837539 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 11:13:41,977 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:41,978 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-90837539, IP 198.205.239.67, Port 22 2025-10-30 11:13:42,048 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 11:13:42,138 - DEBUG - VM ctest-pt_svm0-90837539 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 11:13:47,138 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:47,138 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-90837539, IP 198.205.239.67, Port 22 2025-10-30 11:13:47,207 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-30 11:13:47,296 - DEBUG - VM ctest-pt_svm0-90837539 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-30 11:13:52,296 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:52,297 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-90837539, IP 198.205.239.67, Port 22 2025-10-30 11:13:52,472 - DEBUG - VM ctest-pt_svm0-90837539 is ready for SSH connections 2025-10-30 11:13:52,481 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-si-84495193'] 2025-10-30 11:13:52,997 - INFO - Waiting for VM ctest-left_vm-53882887 to be up.. 2025-10-30 11:13:53,117 - DEBUG - VM is in ACTIVE state now 2025-10-30 11:13:53,117 - INFO - VM name : ctest-left_vm-53882887 2025-10-30 11:13:53,247 - DEBUG - VM ctest-left_vm-53882887 ID is a869fcea-5392-49c8-b8ef-c8b1b161a325 2025-10-30 11:13:53,247 - DEBUG - VM ctest-left_vm-53882887 launched on Node an-jenkins-deploy-platform-ansible-os-4541-1 2025-10-30 11:13:53,366 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/a869fcea-5392-49c8-b8ef-c8b1b161a325 2025-10-30 11:13:53,377 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/14fbcae2-d4a8-4339-8ae5-d08cd6113ca3 2025-10-30 11:13:54,548 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.05 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.51 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.512/2.779/3.047/0.267 ms') 2025-10-30 11:13:54,548 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-53882887 passed 2025-10-30 11:13:54,618 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:54,618 - DEBUG - Waiting to SSH to VM ctest-left_vm-53882887, IP 60.111.186.195, Port 22 2025-10-30 11:13:54,794 - DEBUG - VM ctest-left_vm-53882887 is ready for SSH connections 2025-10-30 11:13:54,794 - INFO - Waiting for VM ctest-right_vm-50728093 to be up.. 2025-10-30 11:13:54,875 - DEBUG - VM is in ACTIVE state now 2025-10-30 11:13:54,875 - INFO - VM name : ctest-right_vm-50728093 2025-10-30 11:13:54,987 - DEBUG - VM ctest-right_vm-50728093 ID is 83cf88f0-5ce6-4508-ae50-d0a2ceb04d59 2025-10-30 11:13:54,987 - DEBUG - VM ctest-right_vm-50728093 launched on Node an-jenkins-deploy-platform-ansible-os-4541-2 2025-10-30 11:13:55,091 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/83cf88f0-5ce6-4508-ae50-d0a2ceb04d59 2025-10-30 11:13:55,103 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/a70b5aed-a75c-413c-bf3a-5b58914ba929 2025-10-30 11:13:56,268 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.658 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.658/2.691/4.724/2.033 ms') 2025-10-30 11:13:56,268 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-50728093 passed 2025-10-30 11:13:56,338 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:13:56,338 - DEBUG - Waiting to SSH to VM ctest-right_vm-50728093, IP 220.202.120.131, Port 22 2025-10-30 11:13:56,505 - DEBUG - VM ctest-right_vm-50728093 is ready for SSH connections 2025-10-30 11:13:56,512 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-si-84495193, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-30 11:13:56,869 - INFO - Attaching policy ctest-policy-80056640 to vn ctest-left-18920195 2025-10-30 11:13:57,271 - INFO - Attaching policy ctest-policy-80056640 to vn ctest-right-17356437 2025-10-30 11:13:57,629 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-17311099'] created succesfully 2025-10-30 11:13:57,837 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-si-84495193'] created succesfully 2025-10-30 11:13:57,837 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:13:57,845 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:13:57,865 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:13:57,969 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/3e230b3f-6947-4dba-acbd-33256cbf3bcf 2025-10-30 11:13:57,984 - DEBUG - SI 'ctest-si-84495193' has service template ref to ctest-service_template_1-17311099 2025-10-30 11:13:57,984 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:13:57,990 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:13:58,005 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:13:58,108 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/3e230b3f-6947-4dba-acbd-33256cbf3bcf 2025-10-30 11:13:58,117 - DEBUG - Requesting: http://10.0.0.249:8082/port-tuple/20e7a59b-bf70-4a7f-9126-efc818f77f86 2025-10-30 11:13:58,125 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:13:58,347 - DEBUG - VM is in ACTIVE state now 2025-10-30 11:13:58,644 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:13:58,655 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:13:58,667 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/430d7f40-c5c4-4ce9-8e91-12be676db451 2025-10-30 11:13:58,676 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/a0542806-94c4-45ce-aede-2d6b2b6a9939 2025-10-30 11:13:58,685 - DEBUG - Requesting: http://10.0.0.19:8082/instance-ip/baf26347-eed1-46ad-80cf-71fa83e1e6c4 2025-10-30 11:13:58,895 - DEBUG - VM is in ACTIVE state now 2025-10-30 11:13:58,896 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:13:58,905 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:14:00,065 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=5.97 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=2.23 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.228/4.098/5.968/1.870 ms') 2025-10-30 11:14:00,065 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-90837539 passed 2025-10-30 11:14:00,104 - DEBUG - VM ctest-pt_svm0-90837539 Tap interface: {'index': '4', 'name': 'tapae6c6947-4b', 'uuid': 'ae6c6947-4bad-4981-861b-699941bf8f4f', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852:ctest-trans_left_vn-66244852', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'vm_uuid': 'e5a498d9-f846-4015-8b18-fe1d8fc590a7', 'vm_name': 'ctest-pt_svm0-90837539', 'ip_addr': '198.205.239.67', 'mac_addr': '02:ae:6c:69:47:4b', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ae6c6947-4bad-4981-861b-699941bf8f4f', 'sg_uuid_list': ['1be3f9fb-4a98-4c65-8d63-94e23343b127'], 'static_route_list': None, 'vm_project_uuid': 'ba6a6c5c-7b39-4810-a2c5-a531a339b575', 'admin_state': 'Enabled', 'flow_key_idx': '38', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 11:14:00,104 - DEBUG - Agent 10.0.0.41 vrf name: default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852:ctest-trans_left_vn-66244852 2025-10-30 11:14:00,111 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852:ctest-trans_left_vn-66244852', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'table_label': '-1', 'vxlan_id': '18', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.252:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-30 11:14:00,209 - DEBUG - VM ctest-pt_svm0-90837539 : Tap interface tapae6c6947-4b is set to Active 2025-10-30 11:14:00,209 - DEBUG - Tap interface tapae6c6947-4b detail : {'index': '4', 'name': 'tapae6c6947-4b', 'uuid': 'ae6c6947-4bad-4981-861b-699941bf8f4f', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852:ctest-trans_left_vn-66244852', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852', 'vm_uuid': 'e5a498d9-f846-4015-8b18-fe1d8fc590a7', 'vm_name': 'ctest-pt_svm0-90837539', 'ip_addr': '198.205.239.67', 'mac_addr': '02:ae:6c:69:47:4b', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-71633481:ae6c6947-4bad-4981-861b-699941bf8f4f', 'sg_uuid_list': ['1be3f9fb-4a98-4c65-8d63-94e23343b127'], 'static_route_list': None, 'vm_project_uuid': 'ba6a6c5c-7b39-4810-a2c5-a531a339b575', 'admin_state': 'Enabled', 'flow_key_idx': '38', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-30 11:14:00,335 - DEBUG - Starting Layer 2 verification in Agent 2025-10-30 11:14:00,350 - DEBUG - Layer 2 path is seen for VM MAC 02:ae:6c:69:47:4b in agent 10.0.0.41 2025-10-30 11:14:00,350 - DEBUG - Active layer 2 route in agent is present for VMI tapae6c6947-4b 2025-10-30 11:14:00,350 - DEBUG - L2 label(35) matches bw route table and interface table 2025-10-30 11:14:00,364 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is found in Agent of node 10.0.0.41 2025-10-30 11:14:00,472 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 is consistent in agent 10.0.0.41 2025-10-30 11:14:00,472 - DEBUG - Route for VM IP ['198.205.239.67'] is consistent in agent 10.0.0.41 2025-10-30 11:14:00,472 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-trans_left_vn-66244852 verification for VM ctest-pt_svm0-90837539 in Agent 10.0.0.41 passed 2025-10-30 11:14:00,590 - DEBUG - Starting all layer 2 verification in agent 10.0.0.41 2025-10-30 11:14:00,607 - DEBUG - Route for VM MAC 02:ae:6c:69:47:4b is consistent in agent 10.0.0.41 2025-10-30 11:14:00,614 - INFO - VM ctest-pt_svm0-90837539 verifications in Compute nodes passed 2025-10-30 11:14:00,614 - DEBUG - The SVMs in the SI are : [] 2025-10-30 11:14:00,614 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:14:00,627 - DEBUG - Service VM for SI 'ctest-si-84495193' is launched 2025-10-30 11:14:00,627 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:14:00,635 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:14:00,650 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:14:00,752 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/3e230b3f-6947-4dba-acbd-33256cbf3bcf 2025-10-30 11:14:00,763 - DEBUG - SI ctest-si-84495193 has Port Tuple: ['ctest-port_tuple-67668755'] 2025-10-30 11:14:00,829 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195 2025-10-30 11:14:00,941 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437 2025-10-30 11:14:00,941 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:14:00,941 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:14:00,941 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 220.202.120.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-10-30 11:14:00,941 - DEBUG - ping -s 56 -c 3 -W 1 220.202.120.131 2025-10-30 11:15:01,073 - DEBUG - PING 220.202.120.131 (220.202.120.131) 56(84) bytes of data. 64 bytes from 220.202.120.131: icmp_req=1 ttl=63 time=8.70 ms 64 bytes from 220.202.120.131: icmp_req=2 ttl=63 time=1.77 ms 64 bytes from 220.202.120.131: icmp_req=3 ttl=63 time=1.96 ms --- 220.202.120.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.779/4.150/8.705/3.221 ms 2025-10-30 11:15:01,073 - INFO - Ping to IP 220.202.120.131 from VM ctest-left_vm-53882887 passed 2025-10-30 11:15:01,082 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-si-84495193, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-left-18920195, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-right-17356437, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-71633481:ctest-si-84495193, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-30 11:15:01,155 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-30 11:15:01,155 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:01,163 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:01,210 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:01,315 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/3e230b3f-6947-4dba-acbd-33256cbf3bcf 2025-10-30 11:15:01,326 - DEBUG - Requesting: http://10.0.0.249:8082/port-tuple/20e7a59b-bf70-4a7f-9126-efc818f77f86 2025-10-30 11:15:01,333 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:15:01,533 - DEBUG - Executing command: rm -f /tmp/mirror-tapae6c6947-4b_ctest-random-32070138.pcap 2025-10-30 11:15:12,051 - INFO - Starting tcpdump to capture the mirrored packets. 2025-10-30 11:15:12,051 - DEBUG - Executing command: sudo tcpdump -ni tapae6c6947-4b -U udp port 8099 -w /tmp/mirror-tapae6c6947-4b_ctest-random-32070138.pcap 2025-10-30 11:15:22,085 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 220.202.120.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.41, gateway password: c0ntrail123 2025-10-30 11:15:22,085 - DEBUG - ping -s 56 -c 3 -W 1 220.202.120.131 2025-10-30 11:15:24,637 - DEBUG - PING 220.202.120.131 (220.202.120.131) 56(84) bytes of data. 64 bytes from 220.202.120.131: icmp_req=1 ttl=63 time=4.75 ms 64 bytes from 220.202.120.131: icmp_req=2 ttl=63 time=1.65 ms 64 bytes from 220.202.120.131: icmp_req=3 ttl=63 time=1.44 ms --- 220.202.120.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.448/2.620/4.756/1.513 ms 2025-10-30 11:15:24,637 - INFO - Ping to IP 220.202.120.131 from VM ctest-left_vm-53882887 passed 2025-10-30 11:15:24,637 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:24,646 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:24,662 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:24,775 - DEBUG - Requesting: http://10.0.0.249:8082/service-instance/3e230b3f-6947-4dba-acbd-33256cbf3bcf 2025-10-30 11:15:24,785 - DEBUG - Requesting: http://10.0.0.249:8082/port-tuple/20e7a59b-bf70-4a7f-9126-efc818f77f86 2025-10-30 11:15:24,794 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/ae6c6947-4bad-4981-861b-699941bf8f4f 2025-10-30 11:15:24,915 - DEBUG - Waiting for the tcpdump write to complete. 2025-10-30 11:15:26,916 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tapae6c6947-4b_ctest-random-32070138.pcap| awk '{print $2}') 2025-10-30 11:15:26,919 - DEBUG - Executing command: sync 2025-10-30 11:15:29,943 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapae6c6947-4b_ctest-random-32070138.pcap | wc -l 2025-10-30 11:15:29,959 - DEBUG - STDOUT: 12 2025-10-30 11:15:29,959 - DEBUG - STDERR: reading from file /tmp/mirror-tapae6c6947-4b_ctest-random-32070138.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-10-30 11:15:29,959 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapae6c6947-4b_ctest-random-32070138.pcap 2025-10-30 11:15:30,004 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-90837539' 2025-10-30 11:15:30,004 - INFO - Dettaching policy ctest-policy-80056640 from vn ctest-right-17356437 2025-10-30 11:15:30,182 - INFO - Dettaching policy ctest-policy-80056640 from vn ctest-left-18920195 2025-10-30 11:15:30,599 - INFO - Deleted policy ctest-policy-80056640 2025-10-30 11:15:30,599 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-si-84495193'] 2025-10-30 11:15:30,718 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-71633481', 'ctest-si-84495193'] 2025-10-30 11:15:30,719 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:30,734 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:30,754 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:30,888 - DEBUG - Service instance ctest-si-84495193 removed from api server 2025-10-30 11:15:30,888 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/e5a498d9-f846-4015-8b18-fe1d8fc590a7 2025-10-30 11:15:30,901 - DEBUG - All Service VMs unlinked from SI ctest-si-84495193 2025-10-30 11:15:30,909 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-30 11:15:30,909 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-30 11:15:30,961 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-30 11:15:30,961 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-30 11:15:30,961 - INFO - Deleting VM ctest-pt_svm0-90837539 2025-10-30 11:15:31,073 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-17311099'] 2025-10-30 11:15:31,161 - INFO - Service template: ['default-domain', 'ctest-service_template_1-17311099'] deleted successfully. 2025-10-30 11:15:31,161 - INFO - Deleting VM ctest-right_vm-50728093 2025-10-30 11:15:31,244 - INFO - Deleting VM ctest-left_vm-53882887 2025-10-30 11:15:31,328 - INFO - Deleting VN ctest-trans_right_vn-58553025 2025-10-30 11:15:31,546 - DEBUG - Response for deleting network () 2025-10-30 11:15:31,546 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/08fc7756-46e5-41bd-b427-ca5d4d28bc64 2025-10-30 11:15:31,553 - DEBUG - Response Code: 404 2025-10-30 11:15:31,554 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:31,561 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:31,579 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:31,687 - INFO - Validated that VN ctest-trans_right_vn-58553025 is not found in API Server 2025-10-30 11:15:31,708 - DEBUG - VN ctest-trans_right_vn-58553025 is not present in Agent 10.0.0.41 2025-10-30 11:15:31,727 - DEBUG - VN ctest-trans_right_vn-58553025 is not present in Agent 10.0.0.27 2025-10-30 11:15:31,727 - INFO - Validated that VN ctest-trans_right_vn-58553025 is not in any agent 2025-10-30 11:15:31,764 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-58553025 info 2025-10-30 11:15:31,764 - INFO - Deleting VN ctest-trans_left_vn-66244852 2025-10-30 11:15:31,848 - DEBUG - VN 69f47495-b64b-42a5-92cd-abae20ebbff1 still in use: Unable to complete operation on network 69f47495-b64b-42a5-92cd-abae20ebbff1. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-0be226de-6e6c-40ee-a9d0-4f561a8d18e1'] 2025-10-30 11:15:31,848 - WARNING - Deleting VN ctest-trans_left_vn-66244852 failed..Will retry 2025-10-30 11:15:34,041 - DEBUG - Response for deleting network () 2025-10-30 11:15:34,042 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/ee500ea9-a066-48ad-9f10-70492b5a062c 2025-10-30 11:15:34,049 - DEBUG - Response Code: 404 2025-10-30 11:15:34,049 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:34,057 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:34,112 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:34,208 - INFO - Validated that VN ctest-trans_left_vn-66244852 is not found in API Server 2025-10-30 11:15:34,220 - DEBUG - VN ctest-trans_left_vn-66244852 is not present in Agent 10.0.0.41 2025-10-30 11:15:34,230 - DEBUG - VN ctest-trans_left_vn-66244852 is not present in Agent 10.0.0.27 2025-10-30 11:15:34,230 - INFO - Validated that VN ctest-trans_left_vn-66244852 is not in any agent 2025-10-30 11:15:34,267 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-66244852 info 2025-10-30 11:15:34,267 - INFO - Deleting VN ctest-mgmt_vn-81622334 2025-10-30 11:15:34,440 - DEBUG - Response for deleting network () 2025-10-30 11:15:34,440 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/173a8d85-02e4-46dd-b846-f7b853fcabb0 2025-10-30 11:15:34,446 - DEBUG - Response Code: 404 2025-10-30 11:15:34,446 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:34,456 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:34,470 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:34,583 - INFO - Validated that VN ctest-mgmt_vn-81622334 is not found in API Server 2025-10-30 11:15:34,599 - DEBUG - VN ctest-mgmt_vn-81622334 is not present in Agent 10.0.0.41 2025-10-30 11:15:34,611 - DEBUG - VN ctest-mgmt_vn-81622334 is not present in Agent 10.0.0.27 2025-10-30 11:15:34,611 - INFO - Validated that VN ctest-mgmt_vn-81622334 is not in any agent 2025-10-30 11:15:34,650 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-81622334 info 2025-10-30 11:15:34,650 - INFO - Deleting VN ctest-right-17356437 2025-10-30 11:15:34,857 - DEBUG - Response for deleting network () 2025-10-30 11:15:34,857 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/e12973d6-7091-46b5-8f8e-dfc409a781f4 2025-10-30 11:15:34,865 - DEBUG - Response Code: 404 2025-10-30 11:15:34,865 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:34,878 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:34,896 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:35,017 - INFO - Validated that VN ctest-right-17356437 is not found in API Server 2025-10-30 11:15:35,032 - DEBUG - VN ctest-right-17356437 is not present in Agent 10.0.0.41 2025-10-30 11:15:35,045 - DEBUG - VN ctest-right-17356437 is not present in Agent 10.0.0.27 2025-10-30 11:15:35,046 - INFO - Validated that VN ctest-right-17356437 is not in any agent 2025-10-30 11:15:35,085 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-17356437 info 2025-10-30 11:15:35,086 - INFO - Deleting VN ctest-left-18920195 2025-10-30 11:15:35,274 - DEBUG - Response for deleting network () 2025-10-30 11:15:35,274 - DEBUG - Requesting: http://10.0.0.249:8082/routing-instance/bcf6e92f-0211-4b01-ba4d-590325c1f690 2025-10-30 11:15:35,281 - DEBUG - Response Code: 404 2025-10-30 11:15:35,282 - DEBUG - Requesting: http://10.0.0.249:8082/domains 2025-10-30 11:15:35,297 - DEBUG - Requesting: http://10.0.0.249:8082/domain/4bebd65a-549d-4c48-a839-bfb2f679c79a 2025-10-30 11:15:35,356 - DEBUG - Requesting: http://10.0.0.249:8082/project/ba6a6c5c-7b39-4810-a2c5-a531a339b575 2025-10-30 11:15:35,458 - INFO - Validated that VN ctest-left-18920195 is not found in API Server 2025-10-30 11:15:35,472 - DEBUG - VN ctest-left-18920195 is not present in Agent 10.0.0.41 2025-10-30 11:15:35,484 - DEBUG - VN ctest-left-18920195 is not present in Agent 10.0.0.27 2025-10-30 11:15:35,484 - INFO - Validated that VN ctest-left-18920195 is not in any agent 2025-10-30 11:15:35,523 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-18920195 info 2025-10-30 11:15:36,811 - DEBUG - No XMPP flaps were noticed during the test 2025-10-30 11:15:36,811 - INFO -

2025-10-30 11:15:36,811 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:03:23]

2025-10-30 11:15:36,812 - INFO - -------------------------------------------------------------------------------- 2025-10-30 11:15:37,615 - INFO - Deleted project: ctest-TestSVCV2Mirror-71633481, ID : ba6a6c5c-7b39-4810-a2c5-a531a339b575