2026-05-18 03:23:46,173 - INFO - Domain Default found not creating 2026-05-18 03:23:46,348 - INFO - Project ctest-TestSVCV2Mirror-23161477 not found, creating it 2026-05-18 03:23:46,840 - INFO - Created Project:ctest-TestSVCV2Mirror-23161477, ID : 52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:23:48,720 - INFO - ================================================================================ 2026-05-18 03:23:48,721 - INFO - STARTING TEST : test_svc_v2_mirroring 2026-05-18 03:23:48,721 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2026-05-18 03:23:50,049 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.20.0.129': '0', '10.20.0.25': '2'}, '10.0.0.130': {'10.20.0.25': '0', '10.20.0.129': '3'}} with 2026-05-18 03:23:50,049 - INFO - Initial checks done. Running the testcase now 2026-05-18 03:23:50,050 - INFO - 2026-05-18 03:23:50,787 - DEBUG - Response for create_network : {'network': {'id': 'f949c471-99de-4848-a14d-1e1a4b22b9b9', 'name': 'ctest-left-83025573', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-left-83025573'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:51,116 - DEBUG - Response for create_subnet : {'subnet': {'id': '0469e98f-d1da-4350-95b7-0a3eb468589d', 'name': '', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'network_id': 'f949c471-99de-4848-a14d-1e1a4b22b9b9', 'ip_version': 4, 'cidr': '188.47.89.192/26', 'allocation_pools': [{'start': '188.47.89.194', 'end': '188.47.89.254'}], 'gateway_ip': '188.47.89.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '188.47.89.194', 'tags': [], 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f'}} 2026-05-18 03:23:51,140 - INFO - Created VN ctest-left-83025573 2026-05-18 03:23:51,155 - DEBUG - VN ctest-left-83025573 UUID is f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,230 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:51,543 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:51,576 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:51,593 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:23:51,693 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,709 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,721 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/84db5fe8-e8b5-49b5-8737-2e71a5e402ef 2026-05-18 03:23:51,730 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/84db5fe8-e8b5-49b5-8737-2e71a5e402ef 2026-05-18 03:23:51,737 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4fe3d167-0926-42b5-8af9-aacf114db252 2026-05-18 03:23:51,746 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:51,746 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,756 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/84db5fe8-e8b5-49b5-8737-2e71a5e402ef 2026-05-18 03:23:51,774 - INFO - Verified VN network id 13 for VN f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,774 - INFO - Verifications in API Server for VN ctest-left-83025573 passed 2026-05-18 03:23:51,774 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,787 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/84db5fe8-e8b5-49b5-8737-2e71a5e402ef 2026-05-18 03:23:51,796 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/84db5fe8-e8b5-49b5-8737-2e71a5e402ef 2026-05-18 03:23:51,804 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4fe3d167-0926-42b5-8af9-aacf114db252 2026-05-18 03:23:51,824 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17963104580935764040', 'uuid-lslong': '11622979311591668153'}, 'enable': 'true', 'created': '2026-05-18T03:23:50', 'last-modified': '2026-05-18T03:23:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.767056'} 2026-05-18 03:23:51,832 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:51,838 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17963104580935764040', 'uuid-lslong': '11622979311591668153'}, 'enable': 'true', 'created': '2026-05-18T03:23:50', 'last-modified': '2026-05-18T03:23:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.789517'} 2026-05-18 03:23:51,844 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:51,850 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17963104580935764040', 'uuid-lslong': '11622979311591668153'}, 'enable': 'true', 'created': '2026-05-18T03:23:50', 'last-modified': '2026-05-18T03:23:51', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.801707'} 2026-05-18 03:23:51,857 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-05-18 03:23:51,857 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-83025573 passed 2026-05-18 03:23:51,857 - DEBUG - ====Verifying policy data for ctest-left-83025573 in API_Server ====== 2026-05-18 03:23:51,857 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:51,865 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:51,878 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:23:51,969 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/f949c471-99de-4848-a14d-1e1a4b22b9b9 2026-05-18 03:23:51,981 - DEBUG - =>VN ctest-left-83025573 has no policy to be verified 2026-05-18 03:23:51,981 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:51,981 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:51,981 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:52,287 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:52,357 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573?flat'} 2026-05-18 03:23:52,357 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:52,357 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:52,664 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:52,738 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573?flat'} 2026-05-18 03:23:52,738 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:52,738 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:53,053 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:53,123 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573?flat'} 2026-05-18 03:23:53,123 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573 is found in opserver 2026-05-18 03:23:53,145 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:53,157 - DEBUG - VRF ids for VN ctest-left-83025573: {} 2026-05-18 03:23:53,440 - DEBUG - Response for create_network : {'network': {'id': '13c083bd-ca18-4c2f-b83f-5927bc0774aa', 'name': 'ctest-right-89335119', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-right-89335119'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:23:53,663 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c332ca3d-7895-41cb-892b-4d46eae80069', 'name': '', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'network_id': '13c083bd-ca18-4c2f-b83f-5927bc0774aa', 'ip_version': 4, 'cidr': '108.165.103.128/26', 'allocation_pools': [{'start': '108.165.103.130', 'end': '108.165.103.190'}], 'gateway_ip': '108.165.103.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '108.165.103.130', 'tags': [], 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f'}} 2026-05-18 03:23:53,692 - INFO - Created VN ctest-right-89335119 2026-05-18 03:23:53,704 - DEBUG - VN ctest-right-89335119 UUID is 13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:53,784 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:53,791 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:53,805 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:23:53,913 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:53,932 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:53,942 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:53,954 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:53,974 - DEBUG - Route Targets: [] 2026-05-18 03:23:53,974 - DEBUG - RT names not yet present for VN ctest-right-89335119 2026-05-18 03:23:58,975 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:58,982 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:59,000 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:23:59,102 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:59,113 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:59,123 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:59,132 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:59,140 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74432682-722c-44a0-b66d-0c71765bd932 2026-05-18 03:23:59,146 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:59,146 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:59,156 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:59,172 - INFO - Verified VN network id 14 for VN 13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:59,172 - INFO - Verifications in API Server for VN ctest-right-89335119 passed 2026-05-18 03:23:59,172 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:59,182 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:59,194 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:23:59,202 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/74432682-722c-44a0-b66d-0c71765bd932 2026-05-18 03:23:59,214 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1423282333411724335', 'uuid-lslong': '13276428253704713386'}, 'enable': 'true', 'created': '2026-05-18T03:23:53', 'last-modified': '2026-05-18T03:23:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.605076'} 2026-05-18 03:23:59,221 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:59,228 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1423282333411724335', 'uuid-lslong': '13276428253704713386'}, 'enable': 'true', 'created': '2026-05-18T03:23:53', 'last-modified': '2026-05-18T03:23:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.620364'} 2026-05-18 03:23:59,235 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:59,241 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1423282333411724335', 'uuid-lslong': '13276428253704713386'}, 'enable': 'true', 'created': '2026-05-18T03:23:53', 'last-modified': '2026-05-18T03:23:53', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.633963'} 2026-05-18 03:23:59,247 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-05-18 03:23:59,248 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-89335119 passed 2026-05-18 03:23:59,248 - DEBUG - ====Verifying policy data for ctest-right-89335119 in API_Server ====== 2026-05-18 03:23:59,248 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:23:59,254 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:23:59,267 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:23:59,353 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/13c083bd-ca18-4c2f-b83f-5927bc0774aa 2026-05-18 03:23:59,365 - DEBUG - =>VN ctest-right-89335119 has no policy to be verified 2026-05-18 03:23:59,365 - DEBUG - Verifying the vn in opserver 2026-05-18 03:23:59,365 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119 virtual network link through opserver 10.0.0.23 2026-05-18 03:23:59,365 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:23:59,445 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119?flat'} 2026-05-18 03:23:59,446 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119 virtual network link through opserver 10.0.0.22 2026-05-18 03:23:59,446 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:23:59,516 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119?flat'} 2026-05-18 03:23:59,516 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119 virtual network link through opserver 10.0.0.240 2026-05-18 03:23:59,516 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:23:59,588 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119?flat'} 2026-05-18 03:23:59,588 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119 is found in opserver 2026-05-18 03:23:59,610 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:23:59,620 - DEBUG - VRF ids for VN ctest-right-89335119: {} 2026-05-18 03:23:59,932 - DEBUG - Response for create_network : {'network': {'id': '5e2bcf40-76e8-4e48-ae02-b8c3671cf998', 'name': 'ctest-mgmt_vn-65903687', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-mgmt_vn-65903687'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:24:00,176 - DEBUG - Response for create_subnet : {'subnet': {'id': '574cc705-e18b-4555-b4bd-57ca71c8e68b', 'name': '', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'network_id': '5e2bcf40-76e8-4e48-ae02-b8c3671cf998', 'ip_version': 4, 'cidr': '215.0.108.192/26', 'allocation_pools': [{'start': '215.0.108.194', 'end': '215.0.108.254'}], 'gateway_ip': '215.0.108.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '215.0.108.194', 'tags': [], 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f'}} 2026-05-18 03:24:00,203 - INFO - Created VN ctest-mgmt_vn-65903687 2026-05-18 03:24:00,215 - DEBUG - VN ctest-mgmt_vn-65903687 UUID is 5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,311 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:24:00,318 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:24:00,335 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:24:00,460 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,481 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,499 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b3fa0626-e41a-486f-a8c9-b4915cc8977e 2026-05-18 03:24:00,509 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b3fa0626-e41a-486f-a8c9-b4915cc8977e 2026-05-18 03:24:00,517 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/9d0c7a0c-0802-4f40-98ea-0acaf37786a6 2026-05-18 03:24:00,535 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:24:00,535 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,549 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b3fa0626-e41a-486f-a8c9-b4915cc8977e 2026-05-18 03:24:00,579 - INFO - Verified VN network id 15 for VN 5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,579 - INFO - Verifications in API Server for VN ctest-mgmt_vn-65903687 passed 2026-05-18 03:24:00,579 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,598 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b3fa0626-e41a-486f-a8c9-b4915cc8977e 2026-05-18 03:24:00,615 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b3fa0626-e41a-486f-a8c9-b4915cc8977e 2026-05-18 03:24:00,626 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/9d0c7a0c-0802-4f40-98ea-0acaf37786a6 2026-05-18 03:24:00,642 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6785745139343576648', 'uuid-lslong': '12538787461940967832'}, 'enable': 'true', 'created': '2026-05-18T03:23:59', 'last-modified': '2026-05-18T03:24:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.548621'} 2026-05-18 03:24:00,649 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:24:00,658 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6785745139343576648', 'uuid-lslong': '12538787461940967832'}, 'enable': 'true', 'created': '2026-05-18T03:23:59', 'last-modified': '2026-05-18T03:24:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.552012'} 2026-05-18 03:24:00,664 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:24:00,672 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6785745139343576648', 'uuid-lslong': '12538787461940967832'}, 'enable': 'true', 'created': '2026-05-18T03:23:59', 'last-modified': '2026-05-18T03:24:00', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.568507'} 2026-05-18 03:24:00,689 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-05-18 03:24:00,689 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-65903687 passed 2026-05-18 03:24:00,689 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-65903687 in API_Server ====== 2026-05-18 03:24:00,689 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:24:00,699 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:24:00,714 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:24:00,831 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5e2bcf40-76e8-4e48-ae02-b8c3671cf998 2026-05-18 03:24:00,843 - DEBUG - =>VN ctest-mgmt_vn-65903687 has no policy to be verified 2026-05-18 03:24:00,843 - DEBUG - Verifying the vn in opserver 2026-05-18 03:24:00,843 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687 virtual network link through opserver 10.0.0.23 2026-05-18 03:24:00,843 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:24:00,932 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687?flat'} 2026-05-18 03:24:00,932 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687 virtual network link through opserver 10.0.0.22 2026-05-18 03:24:00,932 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:24:01,023 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687?flat'} 2026-05-18 03:24:01,023 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687 virtual network link through opserver 10.0.0.240 2026-05-18 03:24:01,023 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:24:01,150 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687?flat'} 2026-05-18 03:24:01,150 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-mgmt_vn-65903687 is found in opserver 2026-05-18 03:24:01,183 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:24:01,202 - DEBUG - VRF ids for VN ctest-mgmt_vn-65903687: {} 2026-05-18 03:24:01,548 - DEBUG - Response for create_network : {'network': {'id': '5741eedb-dbf8-4414-8bf9-0dfd3538bb9b', 'name': 'ctest-trans_left_vn-67371571', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-trans_left_vn-67371571'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:24:01,812 - DEBUG - Response for create_subnet : {'subnet': {'id': 'ed0adc0d-f8b6-480c-b5f7-95d5b132eb28', 'name': '', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'network_id': '5741eedb-dbf8-4414-8bf9-0dfd3538bb9b', 'ip_version': 4, 'cidr': '53.81.84.128/26', 'allocation_pools': [{'start': '53.81.84.130', 'end': '53.81.84.190'}], 'gateway_ip': '53.81.84.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '53.81.84.130', 'tags': [], 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f'}} 2026-05-18 03:24:01,839 - INFO - Created VN ctest-trans_left_vn-67371571 2026-05-18 03:24:01,855 - DEBUG - VN ctest-trans_left_vn-67371571 UUID is 5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:01,942 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:24:01,948 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:24:01,961 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:24:02,043 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:02,066 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:02,076 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eda8eb0b-2b0a-407f-95bb-382e20d7f8ec 2026-05-18 03:24:02,084 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eda8eb0b-2b0a-407f-95bb-382e20d7f8ec 2026-05-18 03:24:02,091 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/45145b03-dc9b-4d64-baa6-40e47958d3f4 2026-05-18 03:24:02,098 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:24:02,098 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:02,109 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eda8eb0b-2b0a-407f-95bb-382e20d7f8ec 2026-05-18 03:24:02,126 - INFO - Verified VN network id 16 for VN 5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:02,127 - INFO - Verifications in API Server for VN ctest-trans_left_vn-67371571 passed 2026-05-18 03:24:02,127 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:02,136 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eda8eb0b-2b0a-407f-95bb-382e20d7f8ec 2026-05-18 03:24:02,146 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eda8eb0b-2b0a-407f-95bb-382e20d7f8ec 2026-05-18 03:24:02,154 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/45145b03-dc9b-4d64-baa6-40e47958d3f4 2026-05-18 03:24:02,169 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6287569182841652244', 'uuid-lslong': '10086108221643733915'}, 'enable': 'true', 'created': '2026-05-18T03:24:01', 'last-modified': '2026-05-18T03:24:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420593'} 2026-05-18 03:24:02,178 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:24:02,188 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6287569182841652244', 'uuid-lslong': '10086108221643733915'}, 'enable': 'true', 'created': '2026-05-18T03:24:01', 'last-modified': '2026-05-18T03:24:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443416'} 2026-05-18 03:24:02,197 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:24:02,205 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6287569182841652244', 'uuid-lslong': '10086108221643733915'}, 'enable': 'true', 'created': '2026-05-18T03:24:01', 'last-modified': '2026-05-18T03:24:01', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459780'} 2026-05-18 03:24:02,211 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-05-18 03:24:02,211 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-67371571 passed 2026-05-18 03:24:02,211 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-67371571 in API_Server ====== 2026-05-18 03:24:02,211 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:24:02,217 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:24:02,269 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:24:02,377 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5741eedb-dbf8-4414-8bf9-0dfd3538bb9b 2026-05-18 03:24:02,389 - DEBUG - =>VN ctest-trans_left_vn-67371571 has no policy to be verified 2026-05-18 03:24:02,389 - DEBUG - Verifying the vn in opserver 2026-05-18 03:24:02,389 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 virtual network link through opserver 10.0.0.23 2026-05-18 03:24:02,389 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:24:02,403 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571?flat'} 2026-05-18 03:24:02,403 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 virtual network link through opserver 10.0.0.22 2026-05-18 03:24:02,403 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:24:02,419 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571?flat'} 2026-05-18 03:24:02,419 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 virtual network link through opserver 10.0.0.240 2026-05-18 03:24:02,419 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:24:02,434 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571?flat'} 2026-05-18 03:24:02,434 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is found in opserver 2026-05-18 03:24:02,460 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:24:02,472 - DEBUG - VRF ids for VN ctest-trans_left_vn-67371571: {} 2026-05-18 03:24:02,794 - DEBUG - Response for create_network : {'network': {'id': '5705262a-22fb-40cb-ac22-7d7443228b03', 'name': 'ctest-trans_right_vn-94612229', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-trans_right_vn-94612229'], 'port_security_enabled': True, 'description': ''}} 2026-05-18 03:24:03,062 - DEBUG - Response for create_subnet : {'subnet': {'id': '4e156237-ae6d-430a-b6b0-d4dcb438d07b', 'name': '', 'tenant_id': '52b94e2e7d8d4e9f93138a5d85299f4f', 'network_id': '5705262a-22fb-40cb-ac22-7d7443228b03', 'ip_version': 4, 'cidr': '1.82.184.192/26', 'allocation_pools': [{'start': '1.82.184.194', 'end': '1.82.184.254'}], 'gateway_ip': '1.82.184.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '1.82.184.194', 'tags': [], 'project_id': '52b94e2e7d8d4e9f93138a5d85299f4f'}} 2026-05-18 03:24:03,086 - INFO - Created VN ctest-trans_right_vn-94612229 2026-05-18 03:24:03,098 - DEBUG - VN ctest-trans_right_vn-94612229 UUID is 5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,176 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:24:03,183 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:24:03,197 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:24:03,300 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,315 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,328 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b5251fcb-7309-4354-92e4-492b59413a20 2026-05-18 03:24:03,342 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b5251fcb-7309-4354-92e4-492b59413a20 2026-05-18 03:24:03,353 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c6918315-00d9-4387-98f4-fbadcfdbc6fd 2026-05-18 03:24:03,362 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:24:03,362 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,372 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b5251fcb-7309-4354-92e4-492b59413a20 2026-05-18 03:24:03,395 - INFO - Verified VN network id 17 for VN 5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,396 - INFO - Verifications in API Server for VN ctest-trans_right_vn-94612229 passed 2026-05-18 03:24:03,396 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,406 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b5251fcb-7309-4354-92e4-492b59413a20 2026-05-18 03:24:03,414 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b5251fcb-7309-4354-92e4-492b59413a20 2026-05-18 03:24:03,424 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c6918315-00d9-4387-98f4-fbadcfdbc6fd 2026-05-18 03:24:03,440 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6270460018600657099', 'uuid-lslong': '12403614262027782915'}, 'enable': 'true', 'created': '2026-05-18T03:24:02', 'last-modified': '2026-05-18T03:24:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.441491'} 2026-05-18 03:24:03,451 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:24:03,458 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6270460018600657099', 'uuid-lslong': '12403614262027782915'}, 'enable': 'true', 'created': '2026-05-18T03:24:02', 'last-modified': '2026-05-18T03:24:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.453407'} 2026-05-18 03:24:03,464 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:24:03,474 - DEBUG - Control-node 10.0.0.240 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-23161477', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6270460018600657099', 'uuid-lslong': '12403614262027782915'}, 'enable': 'true', 'created': '2026-05-18T03:24:02', 'last-modified': '2026-05-18T03:24:02', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.466588'} 2026-05-18 03:24:03,487 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-05-18 03:24:03,487 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-94612229 passed 2026-05-18 03:24:03,487 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-94612229 in API_Server ====== 2026-05-18 03:24:03,487 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:24:03,497 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:24:03,509 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:24:03,602 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/5705262a-22fb-40cb-ac22-7d7443228b03 2026-05-18 03:24:03,618 - DEBUG - =>VN ctest-trans_right_vn-94612229 has no policy to be verified 2026-05-18 03:24:03,618 - DEBUG - Verifying the vn in opserver 2026-05-18 03:24:03,618 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229 virtual network link through opserver 10.0.0.23 2026-05-18 03:24:03,618 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-05-18 03:24:03,631 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229?flat'} 2026-05-18 03:24:03,631 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229 virtual network link through opserver 10.0.0.22 2026-05-18 03:24:03,631 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2026-05-18 03:24:03,649 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229?flat'} 2026-05-18 03:24:03,649 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229 virtual network link through opserver 10.0.0.240 2026-05-18 03:24:03,649 - DEBUG - Requesting: http://10.0.0.240:8081/analytics/uves/virtual-networks 2026-05-18 03:24:03,665 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229', 'href': 'http://10.0.0.240:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229?flat'} 2026-05-18 03:24:03,665 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_right_vn-94612229 is found in opserver 2026-05-18 03:24:03,690 - DEBUG - Do not have enough data to verify VN in agent 2026-05-18 03:24:03,703 - DEBUG - VRF ids for VN ctest-trans_right_vn-94612229: {} 2026-05-18 03:24:03,899 - DEBUG - Services list from nova: [, , , ] 2026-05-18 03:24:05,148 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 03:24:06,685 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-1) 2026-05-18 03:24:06,686 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-14304681'] 2026-05-18 03:24:07,010 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-14304681'] created succesfully 2026-05-18 03:24:08,603 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5792-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5792-2) 2026-05-18 03:24:08,604 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:24:08,924 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:24:08,959 - DEBUG - Response Code: 404 2026-05-18 03:24:10,959 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:24:10,972 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:24:11,056 - INFO - Waiting for VM ctest-pt_svm0-54267745 to be up.. 2026-05-18 03:24:11,169 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2026-05-18 03:24:16,263 - DEBUG - VM is in ACTIVE state now 2026-05-18 03:24:16,263 - INFO - VM name : ctest-pt_svm0-54267745 2026-05-18 03:24:16,353 - DEBUG - VM ctest-pt_svm0-54267745 ID is 59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:24:16,382 - DEBUG - VM ctest-pt_svm0-54267745 launched on Node an-jenkins-deploy-platform-ansible-os-5792-2 2026-05-18 03:24:16,476 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:24:16,487 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:24:19,681 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1036ms') 2026-05-18 03:24:19,681 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:19,700 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:23,769 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2026-05-18 03:24:23,770 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:23,785 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:27,874 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2026-05-18 03:24:27,874 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:27,903 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:31,999 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2026-05-18 03:24:31,999 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:32,017 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:36,091 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2026-05-18 03:24:36,091 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:36,111 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:40,193 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-05-18 03:24:40,193 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:40,210 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:44,287 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-05-18 03:24:44,288 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:44,304 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:48,379 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2026-05-18 03:24:48,379 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:48,396 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:52,508 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1033ms') 2026-05-18 03:24:52,508 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:52,523 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:56,638 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1030ms') 2026-05-18 03:24:56,638 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 failed! 2026-05-18 03:24:56,654 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is 53.81.84.129 and allocation pool is NOT set 2026-05-18 03:24:58,723 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=64 time=12.1 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=64 time=2.77 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.770/7.435/12.100/4.665 ms') 2026-05-18 03:24:58,723 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 passed 2026-05-18 03:24:58,796 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:24:58,796 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54267745, IP 53.81.84.131, Port 22 2026-05-18 03:24:58,864 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 03:24:58,948 - DEBUG - VM ctest-pt_svm0-54267745 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 03:25:03,949 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:03,949 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54267745, IP 53.81.84.131, Port 22 2026-05-18 03:25:04,016 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 03:25:04,110 - DEBUG - VM ctest-pt_svm0-54267745 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 03:25:09,111 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:09,111 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54267745, IP 53.81.84.131, Port 22 2026-05-18 03:25:09,189 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 03:25:09,289 - DEBUG - VM ctest-pt_svm0-54267745 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 03:25:14,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:14,290 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54267745, IP 53.81.84.131, Port 22 2026-05-18 03:25:14,350 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-18 03:25:14,444 - DEBUG - VM ctest-pt_svm0-54267745 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-18 03:25:19,445 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:19,445 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-54267745, IP 53.81.84.131, Port 22 2026-05-18 03:25:19,611 - DEBUG - VM ctest-pt_svm0-54267745 is ready for SSH connections 2026-05-18 03:25:19,619 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-si-75144066'] 2026-05-18 03:25:20,124 - INFO - Waiting for VM ctest-left_vm-90394785 to be up.. 2026-05-18 03:25:20,241 - DEBUG - VM is in ACTIVE state now 2026-05-18 03:25:20,241 - INFO - VM name : ctest-left_vm-90394785 2026-05-18 03:25:20,362 - DEBUG - VM ctest-left_vm-90394785 ID is e54dd032-7b63-4e26-a8fa-6d3de3668a13 2026-05-18 03:25:20,362 - DEBUG - VM ctest-left_vm-90394785 launched on Node an-jenkins-deploy-platform-ansible-os-5792-2 2026-05-18 03:25:20,508 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/e54dd032-7b63-4e26-a8fa-6d3de3668a13 2026-05-18 03:25:20,525 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/f67c0fc7-0e8a-4c5c-ae83-9d1585b30923 2026-05-18 03:25:21,697 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.17 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=1.04 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.043/2.107/3.171/1.064 ms') 2026-05-18 03:25:21,697 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-left_vm-90394785 passed 2026-05-18 03:25:21,773 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:21,774 - DEBUG - Waiting to SSH to VM ctest-left_vm-90394785, IP 188.47.89.195, Port 22 2026-05-18 03:25:21,943 - DEBUG - VM ctest-left_vm-90394785 is ready for SSH connections 2026-05-18 03:25:21,944 - INFO - Waiting for VM ctest-right_vm-92769278 to be up.. 2026-05-18 03:25:22,038 - DEBUG - VM is in ACTIVE state now 2026-05-18 03:25:22,039 - INFO - VM name : ctest-right_vm-92769278 2026-05-18 03:25:22,126 - DEBUG - VM ctest-right_vm-92769278 ID is 232e1c12-0fbd-4fcd-9093-cf0b4b8ddddb 2026-05-18 03:25:22,127 - DEBUG - VM ctest-right_vm-92769278 launched on Node an-jenkins-deploy-platform-ansible-os-5792-1 2026-05-18 03:25:22,226 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/232e1c12-0fbd-4fcd-9093-cf0b4b8ddddb 2026-05-18 03:25:22,237 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/dea81a98-4475-4226-a9b0-472ef19b8916 2026-05-18 03:25:23,408 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.05 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.13 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.127/3.087/4.047/0.960 ms') 2026-05-18 03:25:23,408 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-right_vm-92769278 passed 2026-05-18 03:25:23,482 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:23,483 - DEBUG - Waiting to SSH to VM ctest-right_vm-92769278, IP 108.165.103.131, Port 22 2026-05-18 03:25:23,659 - DEBUG - VM ctest-right_vm-92769278 is ready for SSH connections 2026-05-18 03:25:23,668 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-si-75144066, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-05-18 03:25:24,018 - INFO - Attaching policy ctest-policy-38219360 to vn ctest-left-83025573 2026-05-18 03:25:24,415 - INFO - Attaching policy ctest-policy-38219360 to vn ctest-right-89335119 2026-05-18 03:25:24,750 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-14304681'] created succesfully 2026-05-18 03:25:24,945 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-si-75144066'] created succesfully 2026-05-18 03:25:24,945 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:25:24,951 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:25:24,966 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:25:25,066 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/21a2f9e4-ca9b-4ed2-9f95-2aba361b7637 2026-05-18 03:25:25,079 - DEBUG - SI 'ctest-si-75144066' has service template ref to ctest-service_template_1-14304681 2026-05-18 03:25:25,079 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:25:25,085 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:25:25,101 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:25:25,211 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/21a2f9e4-ca9b-4ed2-9f95-2aba361b7637 2026-05-18 03:25:25,221 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/3dc5ac61-2c80-497d-a4a0-18baf732cbd3 2026-05-18 03:25:25,228 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:25:25,456 - DEBUG - VM is in ACTIVE state now 2026-05-18 03:25:25,745 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:25:25,753 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:25:25,765 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/0501643e-3c0e-4cac-ac1a-5d147a1ca212 2026-05-18 03:25:25,775 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/58cf7974-c5b8-40c8-a784-26af80c24fa8 2026-05-18 03:25:25,783 - DEBUG - Requesting: http://10.0.0.240:8082/instance-ip/82ab209a-4465-481c-afcf-e442ceb9fe4e 2026-05-18 03:25:25,973 - DEBUG - VM is in ACTIVE state now 2026-05-18 03:25:25,973 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:25:25,981 - DEBUG - Requesting: http://10.0.0.240:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:25:27,140 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=64 time=5.24 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=64 time=1.55 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.552/3.394/5.236/1.842 ms') 2026-05-18 03:25:27,140 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-54267745 passed 2026-05-18 03:25:27,175 - DEBUG - VM ctest-pt_svm0-54267745 Tap interface: {'index': '6', 'name': 'tap9cd19b94-83', 'uuid': '9cd19b94-83e0-469d-acf3-aa1b1eee480e', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571:ctest-trans_left_vn-67371571', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '47', 'l2_label': '49', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'vm_uuid': '59a42c4b-8163-4293-a9a4-444d242e161a', 'vm_name': 'ctest-pt_svm0-54267745', 'ip_addr': '53.81.84.131', 'mac_addr': '02:9c:d1:9b:94:83', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-23161477:9cd19b94-83e0-469d-acf3-aa1b1eee480e', 'sg_uuid_list': ['94469543-41e2-4578-9d2a-ea48a578faa5'], 'static_route_list': None, 'vm_project_uuid': '52b94e2e-7d8d-4e9f-9313-8a5d85299f4f', 'admin_state': 'Enabled', 'flow_key_idx': '61', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-18 03:25:27,175 - DEBUG - Agent 10.0.0.130 vrf name: default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571:ctest-trans_left_vn-67371571 2026-05-18 03:25:27,181 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571:ctest-trans_left_vn-67371571', 'ucindex': '5', 'mcindex': '5', 'l2index': '5', 'source': 'Config; ', 'uc6index': '5', 'vn': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'table_label': '-1', 'vxlan_id': '16', 'evpnindex': '5', 'brindex': '5', 'mplsindex': '0', 'RD': '10.20.0.192:5', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-05-18 03:25:27,266 - DEBUG - VM ctest-pt_svm0-54267745 : Tap interface tap9cd19b94-83 is set to Active 2026-05-18 03:25:27,266 - DEBUG - Tap interface tap9cd19b94-83 detail : {'index': '6', 'name': 'tap9cd19b94-83', 'uuid': '9cd19b94-83e0-469d-acf3-aa1b1eee480e', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571:ctest-trans_left_vn-67371571', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '47', 'l2_label': '49', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571', 'vm_uuid': '59a42c4b-8163-4293-a9a4-444d242e161a', 'vm_name': 'ctest-pt_svm0-54267745', 'ip_addr': '53.81.84.131', 'mac_addr': '02:9c:d1:9b:94:83', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-23161477:9cd19b94-83e0-469d-acf3-aa1b1eee480e', 'sg_uuid_list': ['94469543-41e2-4578-9d2a-ea48a578faa5'], 'static_route_list': None, 'vm_project_uuid': '52b94e2e-7d8d-4e9f-9313-8a5d85299f4f', 'admin_state': 'Enabled', 'flow_key_idx': '61', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-05-18 03:25:27,382 - DEBUG - Starting Layer 2 verification in Agent 2026-05-18 03:25:27,393 - DEBUG - Layer 2 path is seen for VM MAC 02:9c:d1:9b:94:83 in agent 10.0.0.130 2026-05-18 03:25:27,393 - DEBUG - Active layer 2 route in agent is present for VMI tap9cd19b94-83 2026-05-18 03:25:27,393 - DEBUG - L2 label(49) matches bw route table and interface table 2026-05-18 03:25:27,410 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is found in Agent of node 10.0.0.130 2026-05-18 03:25:27,551 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 is consistent in agent 10.0.0.130 2026-05-18 03:25:27,552 - DEBUG - Route for VM IP ['53.81.84.131'] is consistent in agent 10.0.0.130 2026-05-18 03:25:27,552 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-trans_left_vn-67371571 verification for VM ctest-pt_svm0-54267745 in Agent 10.0.0.130 passed 2026-05-18 03:25:27,666 - DEBUG - Starting all layer 2 verification in agent 10.0.0.130 2026-05-18 03:25:27,688 - DEBUG - Route for VM MAC 02:9c:d1:9b:94:83 is consistent in agent 10.0.0.130 2026-05-18 03:25:27,688 - INFO - VM ctest-pt_svm0-54267745 verifications in Compute nodes passed 2026-05-18 03:25:27,688 - DEBUG - The SVMs in the SI are : [] 2026-05-18 03:25:27,688 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:25:27,700 - DEBUG - Service VM for SI 'ctest-si-75144066' is launched 2026-05-18 03:25:27,700 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:25:27,707 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:25:27,721 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:25:27,822 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/21a2f9e4-ca9b-4ed2-9f95-2aba361b7637 2026-05-18 03:25:27,836 - DEBUG - SI ctest-si-75144066 has Port Tuple: ['ctest-port_tuple-07751017'] 2026-05-18 03:25:27,916 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573 2026-05-18 03:25:27,991 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119 2026-05-18 03:25:27,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:27,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:25:27,992 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.165.103.131, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2026-05-18 03:25:27,992 - DEBUG - ping -s 56 -c 3 -W 1 108.165.103.131 2026-05-18 03:26:19,745 - DEBUG - PING 108.165.103.131 (108.165.103.131) 56(84) bytes of data. 64 bytes from 108.165.103.131: icmp_req=1 ttl=63 time=11.3 ms 64 bytes from 108.165.103.131: icmp_req=2 ttl=63 time=1.54 ms 64 bytes from 108.165.103.131: icmp_req=3 ttl=63 time=1.49 ms --- 108.165.103.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.495/4.790/11.334/4.627 ms 2026-05-18 03:26:19,745 - INFO - Ping to IP 108.165.103.131 from VM ctest-left_vm-90394785 passed 2026-05-18 03:26:19,752 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-si-75144066, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-left-83025573, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-right-89335119, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-23161477:ctest-si-75144066, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-05-18 03:26:19,824 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-18 03:26:19,824 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:19,831 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:19,843 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:19,956 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/21a2f9e4-ca9b-4ed2-9f95-2aba361b7637 2026-05-18 03:26:19,970 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/3dc5ac61-2c80-497d-a4a0-18baf732cbd3 2026-05-18 03:26:19,983 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:26:20,215 - DEBUG - Executing command: rm -f /tmp/mirror-tap9cd19b94-83_ctest-random-89566544.pcap 2026-05-18 03:26:30,351 - INFO - Starting tcpdump to capture the mirrored packets. 2026-05-18 03:26:30,351 - DEBUG - Executing command: sudo tcpdump -ni tap9cd19b94-83 -U udp port 8099 -w /tmp/mirror-tap9cd19b94-83_ctest-random-89566544.pcap 2026-05-18 03:26:40,382 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 108.165.103.131, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.130, gateway password: c0ntrail123 2026-05-18 03:26:40,382 - DEBUG - ping -s 56 -c 3 -W 1 108.165.103.131 2026-05-18 03:26:42,869 - DEBUG - PING 108.165.103.131 (108.165.103.131) 56(84) bytes of data. 64 bytes from 108.165.103.131: icmp_req=1 ttl=63 time=4.28 ms 64 bytes from 108.165.103.131: icmp_req=2 ttl=63 time=1.39 ms 64 bytes from 108.165.103.131: icmp_req=3 ttl=63 time=2.42 ms --- 108.165.103.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.395/2.699/4.281/1.195 ms 2026-05-18 03:26:42,869 - INFO - Ping to IP 108.165.103.131 from VM ctest-left_vm-90394785 passed 2026-05-18 03:26:42,869 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:42,878 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:42,892 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:42,994 - DEBUG - Requesting: http://10.0.0.23:8082/service-instance/21a2f9e4-ca9b-4ed2-9f95-2aba361b7637 2026-05-18 03:26:43,004 - DEBUG - Requesting: http://10.0.0.23:8082/port-tuple/3dc5ac61-2c80-497d-a4a0-18baf732cbd3 2026-05-18 03:26:43,013 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/9cd19b94-83e0-469d-acf3-aa1b1eee480e 2026-05-18 03:26:43,130 - DEBUG - Waiting for the tcpdump write to complete. 2026-05-18 03:26:45,130 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap9cd19b94-83_ctest-random-89566544.pcap| awk '{print $2}') 2026-05-18 03:26:45,133 - DEBUG - Executing command: sync 2026-05-18 03:26:48,161 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap9cd19b94-83_ctest-random-89566544.pcap | wc -l 2026-05-18 03:26:48,177 - DEBUG - STDOUT: 12 2026-05-18 03:26:48,178 - DEBUG - STDERR: reading from file /tmp/mirror-tap9cd19b94-83_ctest-random-89566544.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-05-18 03:26:48,179 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap9cd19b94-83_ctest-random-89566544.pcap 2026-05-18 03:26:48,223 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-54267745' 2026-05-18 03:26:48,223 - INFO - Dettaching policy ctest-policy-38219360 from vn ctest-right-89335119 2026-05-18 03:26:48,392 - INFO - Dettaching policy ctest-policy-38219360 from vn ctest-left-83025573 2026-05-18 03:26:48,638 - INFO - Deleted policy ctest-policy-38219360 2026-05-18 03:26:48,639 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-si-75144066'] 2026-05-18 03:26:48,740 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-23161477', 'ctest-si-75144066'] 2026-05-18 03:26:48,740 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:48,747 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:48,761 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:48,920 - DEBUG - Service instance ctest-si-75144066 removed from api server 2026-05-18 03:26:48,920 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/59a42c4b-8163-4293-a9a4-444d242e161a 2026-05-18 03:26:48,930 - DEBUG - All Service VMs unlinked from SI ctest-si-75144066 2026-05-18 03:26:48,939 - DEBUG - 0 svc intances found in all projects. They are [] 2026-05-18 03:26:48,939 - DEBUG - 0 svc intances found in current project. They are [] 2026-05-18 03:26:48,997 - DEBUG - 0 svc intances found in all projects. They are [] 2026-05-18 03:26:48,997 - DEBUG - 0 svc intances found in current project. They are [] 2026-05-18 03:26:48,998 - INFO - Deleting VM ctest-pt_svm0-54267745 2026-05-18 03:26:49,099 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-14304681'] 2026-05-18 03:26:49,248 - INFO - Service template: ['default-domain', 'ctest-service_template_1-14304681'] deleted successfully. 2026-05-18 03:26:49,248 - INFO - Deleting VM ctest-right_vm-92769278 2026-05-18 03:26:49,338 - INFO - Deleting VM ctest-left_vm-90394785 2026-05-18 03:26:49,444 - INFO - Deleting VN ctest-trans_right_vn-94612229 2026-05-18 03:26:49,647 - DEBUG - Response for deleting network () 2026-05-18 03:26:49,647 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b5251fcb-7309-4354-92e4-492b59413a20 2026-05-18 03:26:49,655 - DEBUG - Response Code: 404 2026-05-18 03:26:49,656 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:49,665 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:49,685 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:49,807 - INFO - Validated that VN ctest-trans_right_vn-94612229 is not found in API Server 2026-05-18 03:26:49,820 - DEBUG - VN ctest-trans_right_vn-94612229 is not present in Agent 10.0.0.65 2026-05-18 03:26:49,838 - DEBUG - VN ctest-trans_right_vn-94612229 is not present in Agent 10.0.0.130 2026-05-18 03:26:49,838 - INFO - Validated that VN ctest-trans_right_vn-94612229 is not in any agent 2026-05-18 03:26:49,890 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-94612229 info 2026-05-18 03:26:49,890 - INFO - Deleting VN ctest-trans_left_vn-67371571 2026-05-18 03:26:49,964 - DEBUG - VN 5741eedb-dbf8-4414-8bf9-0dfd3538bb9b still in use: Unable to complete operation on network 5741eedb-dbf8-4414-8bf9-0dfd3538bb9b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-03ffbfc4-67da-4213-902b-03011ad96467'] 2026-05-18 03:26:49,964 - WARNING - Deleting VN ctest-trans_left_vn-67371571 failed..Will retry 2026-05-18 03:26:52,153 - DEBUG - Response for deleting network () 2026-05-18 03:26:52,154 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/eda8eb0b-2b0a-407f-95bb-382e20d7f8ec 2026-05-18 03:26:52,160 - DEBUG - Response Code: 404 2026-05-18 03:26:52,160 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:52,167 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:52,181 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:52,284 - INFO - Validated that VN ctest-trans_left_vn-67371571 is not found in API Server 2026-05-18 03:26:52,298 - DEBUG - VN ctest-trans_left_vn-67371571 is not present in Agent 10.0.0.65 2026-05-18 03:26:52,307 - DEBUG - VN ctest-trans_left_vn-67371571 is not present in Agent 10.0.0.130 2026-05-18 03:26:52,307 - INFO - Validated that VN ctest-trans_left_vn-67371571 is not in any agent 2026-05-18 03:26:52,338 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-67371571 info 2026-05-18 03:26:52,338 - INFO - Deleting VN ctest-mgmt_vn-65903687 2026-05-18 03:26:52,543 - DEBUG - Response for deleting network () 2026-05-18 03:26:52,543 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b3fa0626-e41a-486f-a8c9-b4915cc8977e 2026-05-18 03:26:52,550 - DEBUG - Response Code: 404 2026-05-18 03:26:52,550 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:52,556 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:52,614 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:52,711 - INFO - Validated that VN ctest-mgmt_vn-65903687 is not found in API Server 2026-05-18 03:26:52,726 - DEBUG - VN ctest-mgmt_vn-65903687 is not present in Agent 10.0.0.65 2026-05-18 03:26:52,736 - DEBUG - VN ctest-mgmt_vn-65903687 is not present in Agent 10.0.0.130 2026-05-18 03:26:52,736 - INFO - Validated that VN ctest-mgmt_vn-65903687 is not in any agent 2026-05-18 03:26:52,773 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-65903687 info 2026-05-18 03:26:52,773 - INFO - Deleting VN ctest-right-89335119 2026-05-18 03:26:53,007 - DEBUG - Response for deleting network () 2026-05-18 03:26:53,007 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/0e9c0573-30fc-4f7d-935e-62c621328638 2026-05-18 03:26:53,014 - DEBUG - Response Code: 404 2026-05-18 03:26:53,014 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:53,021 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:53,035 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:53,137 - INFO - Validated that VN ctest-right-89335119 is not found in API Server 2026-05-18 03:26:53,160 - DEBUG - VN ctest-right-89335119 is not present in Agent 10.0.0.65 2026-05-18 03:26:53,171 - DEBUG - VN ctest-right-89335119 is not present in Agent 10.0.0.130 2026-05-18 03:26:53,171 - INFO - Validated that VN ctest-right-89335119 is not in any agent 2026-05-18 03:26:53,211 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-89335119 info 2026-05-18 03:26:53,211 - INFO - Deleting VN ctest-left-83025573 2026-05-18 03:26:53,387 - DEBUG - Response for deleting network () 2026-05-18 03:26:53,387 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/84db5fe8-e8b5-49b5-8737-2e71a5e402ef 2026-05-18 03:26:53,393 - DEBUG - Response Code: 404 2026-05-18 03:26:53,393 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2026-05-18 03:26:53,404 - DEBUG - Requesting: http://10.0.0.23:8082/domain/4bbec0ba-f2cb-4fcb-b8f1-efc2a7bf0989 2026-05-18 03:26:53,418 - DEBUG - Requesting: http://10.0.0.23:8082/project/52b94e2e-7d8d-4e9f-9313-8a5d85299f4f 2026-05-18 03:26:53,514 - INFO - Validated that VN ctest-left-83025573 is not found in API Server 2026-05-18 03:26:53,530 - DEBUG - VN ctest-left-83025573 is not present in Agent 10.0.0.65 2026-05-18 03:26:53,542 - DEBUG - VN ctest-left-83025573 is not present in Agent 10.0.0.130 2026-05-18 03:26:53,542 - INFO - Validated that VN ctest-left-83025573 is not in any agent 2026-05-18 03:26:53,582 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-83025573 info 2026-05-18 03:26:54,873 - DEBUG - No XMPP flaps were noticed during the test 2026-05-18 03:26:54,873 - INFO - 2026-05-18 03:26:54,873 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:03:06] 2026-05-18 03:26:54,873 - INFO - -------------------------------------------------------------------------------- 2026-05-18 03:26:55,814 - INFO - Deleted project: ctest-TestSVCV2Mirror-23161477, ID : 52b94e2e-7d8d-4e9f-9313-8a5d85299f4f