2026-04-20 03:16:09,219 - INFO - Domain Default found not creating 2026-04-20 03:16:09,389 - INFO - Project ctest-TestSVCV2Mirror-33240169 not found, creating it 2026-04-20 03:16:09,932 - INFO - Created Project:ctest-TestSVCV2Mirror-33240169, ID : d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:11,446 - INFO - ================================================================================ 2026-04-20 03:16:11,446 - INFO - STARTING TEST : test_svc_v2_mirroring 2026-04-20 03:16:11,446 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2026-04-20 03:16:12,713 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.20.0.129': '0', '10.20.0.25': '0'}, '10.0.0.65': {'10.20.0.25': '0', '10.20.0.129': '1'}} with 2026-04-20 03:16:12,713 - INFO - Initial checks done. Running the testcase now 2026-04-20 03:16:12,713 - INFO - 2026-04-20 03:16:13,453 - DEBUG - Response for create_network : {'network': {'id': '198cbbaf-2c9f-40b9-b57e-74ff85dfa924', 'name': 'ctest-left-19611779', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-left-19611779'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:16:13,813 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd1bd740d-9b79-4388-8fa3-0d8a71c035cc', 'name': '', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'network_id': '198cbbaf-2c9f-40b9-b57e-74ff85dfa924', 'ip_version': 4, 'cidr': '35.254.18.0/26', 'allocation_pools': [{'start': '35.254.18.2', 'end': '35.254.18.62'}], 'gateway_ip': '35.254.18.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35.254.18.2', 'tags': [], 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6'}} 2026-04-20 03:16:13,834 - INFO - Created VN ctest-left-19611779 2026-04-20 03:16:13,846 - DEBUG - VN ctest-left-19611779 UUID is 198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:13,928 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:14,243 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:14,286 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:14,308 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:14,406 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:14,417 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:14,427 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b48734b8-e82f-4b7a-b6ca-4bd856869d33 2026-04-20 03:16:14,434 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b48734b8-e82f-4b7a-b6ca-4bd856869d33 2026-04-20 03:16:14,440 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ca2c47dd-10dc-4613-8fb9-ab3b425c00e5 2026-04-20 03:16:14,447 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:16:14,447 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:14,457 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b48734b8-e82f-4b7a-b6ca-4bd856869d33 2026-04-20 03:16:14,472 - INFO - Verified VN network id 17 for VN 198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:14,473 - INFO - Verifications in API Server for VN ctest-left-19611779 passed 2026-04-20 03:16:14,473 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:14,483 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b48734b8-e82f-4b7a-b6ca-4bd856869d33 2026-04-20 03:16:14,490 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b48734b8-e82f-4b7a-b6ca-4bd856869d33 2026-04-20 03:16:14,498 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ca2c47dd-10dc-4613-8fb9-ab3b425c00e5 2026-04-20 03:16:14,513 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1841052708729995449', 'uuid-lslong': '13078019008742009124'}, 'enable': 'true', 'created': '2026-04-20T03:16:13', 'last-modified': '2026-04-20T03:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.744748'} 2026-04-20 03:16:14,523 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:16:14,529 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1841052708729995449', 'uuid-lslong': '13078019008742009124'}, 'enable': 'true', 'created': '2026-04-20T03:16:13', 'last-modified': '2026-04-20T03:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.762012'} 2026-04-20 03:16:14,536 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:16:14,542 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1841052708729995449', 'uuid-lslong': '13078019008742009124'}, 'enable': 'true', 'created': '2026-04-20T03:16:13', 'last-modified': '2026-04-20T03:16:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.778275'} 2026-04-20 03:16:14,549 - DEBUG - Route Targets: ['target:64512:8000007'] 2026-04-20 03:16:14,549 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-19611779 passed 2026-04-20 03:16:14,550 - DEBUG - ====Verifying policy data for ctest-left-19611779 in API_Server ====== 2026-04-20 03:16:14,550 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:14,555 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:14,567 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:14,664 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/198cbbaf-2c9f-40b9-b57e-74ff85dfa924 2026-04-20 03:16:14,676 - DEBUG - =>VN ctest-left-19611779 has no policy to be verified 2026-04-20 03:16:14,676 - DEBUG - Verifying the vn in opserver 2026-04-20 03:16:14,676 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779 virtual network link through opserver 10.0.0.38 2026-04-20 03:16:14,676 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:16:15,000 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:16:15,081 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779?flat'} 2026-04-20 03:16:15,081 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779 virtual network link through opserver 10.0.0.27 2026-04-20 03:16:15,081 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:16:15,433 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:16:15,546 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779?flat'} 2026-04-20 03:16:15,546 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779 virtual network link through opserver 10.0.0.23 2026-04-20 03:16:15,546 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:16:15,859 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:16:15,993 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779?flat'} 2026-04-20 03:16:15,993 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779 is found in opserver 2026-04-20 03:16:16,020 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:16:16,033 - DEBUG - VRF ids for VN ctest-left-19611779: {} 2026-04-20 03:16:16,315 - DEBUG - Response for create_network : {'network': {'id': 'e5ab434b-1d28-47af-9402-01f92d443bfe', 'name': 'ctest-right-32963383', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-right-32963383'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:16:16,519 - DEBUG - Response for create_subnet : {'subnet': {'id': '669b1354-40e3-407b-905a-d637454c3b47', 'name': '', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'network_id': 'e5ab434b-1d28-47af-9402-01f92d443bfe', 'ip_version': 4, 'cidr': '7.51.129.64/26', 'allocation_pools': [{'start': '7.51.129.66', 'end': '7.51.129.126'}], 'gateway_ip': '7.51.129.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '7.51.129.66', 'tags': [], 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6'}} 2026-04-20 03:16:16,543 - INFO - Created VN ctest-right-32963383 2026-04-20 03:16:16,555 - DEBUG - VN ctest-right-32963383 UUID is e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,620 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:16,626 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:16,637 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:16,723 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,744 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,752 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/26fa29e8-c639-4b29-8ae7-a467421ebae8 2026-04-20 03:16:16,760 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/26fa29e8-c639-4b29-8ae7-a467421ebae8 2026-04-20 03:16:16,766 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/c5fdb1db-ef7a-4291-bdb6-131f1052a846 2026-04-20 03:16:16,773 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:16:16,773 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,783 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/26fa29e8-c639-4b29-8ae7-a467421ebae8 2026-04-20 03:16:16,798 - INFO - Verified VN network id 18 for VN e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,798 - INFO - Verifications in API Server for VN ctest-right-32963383 passed 2026-04-20 03:16:16,798 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,808 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/26fa29e8-c639-4b29-8ae7-a467421ebae8 2026-04-20 03:16:16,817 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/26fa29e8-c639-4b29-8ae7-a467421ebae8 2026-04-20 03:16:16,824 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/c5fdb1db-ef7a-4291-bdb6-131f1052a846 2026-04-20 03:16:16,837 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16549395245593806767', 'uuid-lslong': '10665089037284686846'}, 'enable': 'true', 'created': '2026-04-20T03:16:16', 'last-modified': '2026-04-20T03:16:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.377330'} 2026-04-20 03:16:16,844 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:16:16,850 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16549395245593806767', 'uuid-lslong': '10665089037284686846'}, 'enable': 'true', 'created': '2026-04-20T03:16:16', 'last-modified': '2026-04-20T03:16:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387727'} 2026-04-20 03:16:16,856 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:16:16,861 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16549395245593806767', 'uuid-lslong': '10665089037284686846'}, 'enable': 'true', 'created': '2026-04-20T03:16:16', 'last-modified': '2026-04-20T03:16:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.396152'} 2026-04-20 03:16:16,868 - DEBUG - Route Targets: ['target:64512:8000008'] 2026-04-20 03:16:16,868 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-32963383 passed 2026-04-20 03:16:16,869 - DEBUG - ====Verifying policy data for ctest-right-32963383 in API_Server ====== 2026-04-20 03:16:16,869 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:16,876 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:16,886 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:16,980 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/e5ab434b-1d28-47af-9402-01f92d443bfe 2026-04-20 03:16:16,997 - DEBUG - =>VN ctest-right-32963383 has no policy to be verified 2026-04-20 03:16:16,997 - DEBUG - Verifying the vn in opserver 2026-04-20 03:16:16,997 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383 virtual network link through opserver 10.0.0.38 2026-04-20 03:16:16,997 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:16:17,073 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383?flat'} 2026-04-20 03:16:17,074 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383 virtual network link through opserver 10.0.0.27 2026-04-20 03:16:17,074 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:16:17,133 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383?flat'} 2026-04-20 03:16:17,134 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383 virtual network link through opserver 10.0.0.23 2026-04-20 03:16:17,134 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:16:17,203 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383?flat'} 2026-04-20 03:16:17,203 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383 is found in opserver 2026-04-20 03:16:17,223 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:16:17,235 - DEBUG - VRF ids for VN ctest-right-32963383: {} 2026-04-20 03:16:17,534 - DEBUG - Response for create_network : {'network': {'id': '1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5', 'name': 'ctest-mgmt_vn-20223915', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-mgmt_vn-20223915'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:16:17,726 - DEBUG - Response for create_subnet : {'subnet': {'id': '7fdb66c0-82b4-4c7a-9576-8f161d8c9ce8', 'name': '', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'network_id': '1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5', 'ip_version': 4, 'cidr': '83.68.84.0/26', 'allocation_pools': [{'start': '83.68.84.2', 'end': '83.68.84.62'}], 'gateway_ip': '83.68.84.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '83.68.84.2', 'tags': [], 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6'}} 2026-04-20 03:16:17,751 - INFO - Created VN ctest-mgmt_vn-20223915 2026-04-20 03:16:17,761 - DEBUG - VN ctest-mgmt_vn-20223915 UUID is 1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:17,848 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:17,854 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:17,865 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:17,980 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:17,994 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:18,005 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e2c69ad3-bb58-4222-9a52-57b23272fcfc 2026-04-20 03:16:18,015 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e2c69ad3-bb58-4222-9a52-57b23272fcfc 2026-04-20 03:16:18,022 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/523604fc-17a4-4505-b122-774205393fdc 2026-04-20 03:16:18,034 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:16:18,034 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:18,044 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e2c69ad3-bb58-4222-9a52-57b23272fcfc 2026-04-20 03:16:18,061 - INFO - Verified VN network id 19 for VN 1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:18,061 - INFO - Verifications in API Server for VN ctest-mgmt_vn-20223915 passed 2026-04-20 03:16:18,061 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:18,071 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e2c69ad3-bb58-4222-9a52-57b23272fcfc 2026-04-20 03:16:18,079 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e2c69ad3-bb58-4222-9a52-57b23272fcfc 2026-04-20 03:16:18,088 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/523604fc-17a4-4505-b122-774205393fdc 2026-04-20 03:16:18,101 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2118673936697803981', 'uuid-lslong': '12473485043329919733'}, 'enable': 'true', 'created': '2026-04-20T03:16:17', 'last-modified': '2026-04-20T03:16:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423767'} 2026-04-20 03:16:18,106 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:16:18,112 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2118673936697803981', 'uuid-lslong': '12473485043329919733'}, 'enable': 'true', 'created': '2026-04-20T03:16:17', 'last-modified': '2026-04-20T03:16:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.435536'} 2026-04-20 03:16:18,121 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:16:18,128 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2118673936697803981', 'uuid-lslong': '12473485043329919733'}, 'enable': 'true', 'created': '2026-04-20T03:16:17', 'last-modified': '2026-04-20T03:16:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445941'} 2026-04-20 03:16:18,134 - DEBUG - Route Targets: ['target:64512:8000009'] 2026-04-20 03:16:18,134 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-20223915 passed 2026-04-20 03:16:18,134 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-20223915 in API_Server ====== 2026-04-20 03:16:18,135 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:18,141 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:18,155 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:18,254 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/1d670ab8-5fc0-44cd-ad1a-b88f3ed3eaf5 2026-04-20 03:16:18,264 - DEBUG - =>VN ctest-mgmt_vn-20223915 has no policy to be verified 2026-04-20 03:16:18,264 - DEBUG - Verifying the vn in opserver 2026-04-20 03:16:18,264 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915 virtual network link through opserver 10.0.0.38 2026-04-20 03:16:18,264 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:16:18,341 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915?flat'} 2026-04-20 03:16:18,341 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915 virtual network link through opserver 10.0.0.27 2026-04-20 03:16:18,341 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:16:18,410 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915?flat'} 2026-04-20 03:16:18,411 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915 virtual network link through opserver 10.0.0.23 2026-04-20 03:16:18,411 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:16:18,497 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915?flat'} 2026-04-20 03:16:18,497 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-mgmt_vn-20223915 is found in opserver 2026-04-20 03:16:18,518 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:16:18,529 - DEBUG - VRF ids for VN ctest-mgmt_vn-20223915: {} 2026-04-20 03:16:18,813 - DEBUG - Response for create_network : {'network': {'id': '5fc9c620-2ed8-4090-807b-8458f5a9b2a4', 'name': 'ctest-trans_left_vn-81737895', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-trans_left_vn-81737895'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:16:19,071 - DEBUG - Response for create_subnet : {'subnet': {'id': '43f20f22-2ba9-43f2-86c9-408c7e86add7', 'name': '', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'network_id': '5fc9c620-2ed8-4090-807b-8458f5a9b2a4', 'ip_version': 4, 'cidr': '125.179.215.64/26', 'allocation_pools': [{'start': '125.179.215.66', 'end': '125.179.215.126'}], 'gateway_ip': '125.179.215.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '125.179.215.66', 'tags': [], 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6'}} 2026-04-20 03:16:19,093 - INFO - Created VN ctest-trans_left_vn-81737895 2026-04-20 03:16:19,105 - DEBUG - VN ctest-trans_left_vn-81737895 UUID is 5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:19,188 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:19,195 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:19,205 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:19,290 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:19,302 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:19,313 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:19,337 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:19,350 - DEBUG - Route Targets: [] 2026-04-20 03:16:19,350 - DEBUG - RT names not yet present for VN ctest-trans_left_vn-81737895 2026-04-20 03:16:24,351 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:24,358 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:24,371 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:24,455 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:24,464 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:24,473 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:24,481 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:24,488 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/095de039-78fc-40e5-8f6c-002a57edd32b 2026-04-20 03:16:24,494 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:16:24,495 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:24,503 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:24,517 - INFO - Verified VN network id 20 for VN 5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:24,517 - INFO - Verifications in API Server for VN ctest-trans_left_vn-81737895 passed 2026-04-20 03:16:24,517 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:24,526 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:24,532 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:16:24,539 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/095de039-78fc-40e5-8f6c-002a57edd32b 2026-04-20 03:16:24,551 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6902265745449173136', 'uuid-lslong': '9258138976603714212'}, 'enable': 'true', 'created': '2026-04-20T03:16:18', 'last-modified': '2026-04-20T03:16:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.547052'} 2026-04-20 03:16:24,557 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:16:24,564 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6902265745449173136', 'uuid-lslong': '9258138976603714212'}, 'enable': 'true', 'created': '2026-04-20T03:16:18', 'last-modified': '2026-04-20T03:16:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.553172'} 2026-04-20 03:16:24,572 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:16:24,578 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6902265745449173136', 'uuid-lslong': '9258138976603714212'}, 'enable': 'true', 'created': '2026-04-20T03:16:18', 'last-modified': '2026-04-20T03:16:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.564565'} 2026-04-20 03:16:24,584 - DEBUG - Route Targets: ['target:64512:8000010'] 2026-04-20 03:16:24,585 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-81737895 passed 2026-04-20 03:16:24,585 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-81737895 in API_Server ====== 2026-04-20 03:16:24,585 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:24,591 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:24,602 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:24,696 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/5fc9c620-2ed8-4090-807b-8458f5a9b2a4 2026-04-20 03:16:24,708 - DEBUG - =>VN ctest-trans_left_vn-81737895 has no policy to be verified 2026-04-20 03:16:24,708 - DEBUG - Verifying the vn in opserver 2026-04-20 03:16:24,708 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 virtual network link through opserver 10.0.0.38 2026-04-20 03:16:24,708 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:16:24,723 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895?flat'} 2026-04-20 03:16:24,723 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 virtual network link through opserver 10.0.0.27 2026-04-20 03:16:24,723 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:16:24,737 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895?flat'} 2026-04-20 03:16:24,737 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 virtual network link through opserver 10.0.0.23 2026-04-20 03:16:24,737 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:16:24,749 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895?flat'} 2026-04-20 03:16:24,749 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is found in opserver 2026-04-20 03:16:24,771 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:16:24,781 - DEBUG - VRF ids for VN ctest-trans_left_vn-81737895: {} 2026-04-20 03:16:25,043 - DEBUG - Response for create_network : {'network': {'id': '89157c34-e6bf-46e3-8c93-7d2ef5ff5426', 'name': 'ctest-trans_right_vn-82291484', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-trans_right_vn-82291484'], 'port_security_enabled': True, 'description': ''}} 2026-04-20 03:16:25,277 - DEBUG - Response for create_subnet : {'subnet': {'id': '88b1f7ca-8aaa-4378-9129-45ea2e9ca731', 'name': '', 'tenant_id': 'd6508d8d41e04f2199a3c057c0cf3db6', 'network_id': '89157c34-e6bf-46e3-8c93-7d2ef5ff5426', 'ip_version': 4, 'cidr': '220.249.8.128/26', 'allocation_pools': [{'start': '220.249.8.130', 'end': '220.249.8.190'}], 'gateway_ip': '220.249.8.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '220.249.8.130', 'tags': [], 'project_id': 'd6508d8d41e04f2199a3c057c0cf3db6'}} 2026-04-20 03:16:25,300 - INFO - Created VN ctest-trans_right_vn-82291484 2026-04-20 03:16:25,312 - DEBUG - VN ctest-trans_right_vn-82291484 UUID is 89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,382 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:25,387 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:25,398 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:25,494 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,506 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,515 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c11e83c-abf6-4203-b397-28a1e24e2699 2026-04-20 03:16:25,521 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c11e83c-abf6-4203-b397-28a1e24e2699 2026-04-20 03:16:25,529 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/79d02f87-f7db-4c3c-960a-5577df276c11 2026-04-20 03:16:25,538 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:16:25,538 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,547 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c11e83c-abf6-4203-b397-28a1e24e2699 2026-04-20 03:16:25,562 - INFO - Verified VN network id 21 for VN 89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,562 - INFO - Verifications in API Server for VN ctest-trans_right_vn-82291484 passed 2026-04-20 03:16:25,562 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,570 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c11e83c-abf6-4203-b397-28a1e24e2699 2026-04-20 03:16:25,576 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c11e83c-abf6-4203-b397-28a1e24e2699 2026-04-20 03:16:25,583 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/79d02f87-f7db-4c3c-960a-5577df276c11 2026-04-20 03:16:25,594 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9877937924358489827', 'uuid-lslong': '10129577627535496230'}, 'enable': 'true', 'created': '2026-04-20T03:16:24', 'last-modified': '2026-04-20T03:16:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.362710'} 2026-04-20 03:16:25,601 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:16:25,606 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9877937924358489827', 'uuid-lslong': '10129577627535496230'}, 'enable': 'true', 'created': '2026-04-20T03:16:24', 'last-modified': '2026-04-20T03:16:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.378254'} 2026-04-20 03:16:25,613 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:16:25,618 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-33240169', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9877937924358489827', 'uuid-lslong': '10129577627535496230'}, 'enable': 'true', 'created': '2026-04-20T03:16:24', 'last-modified': '2026-04-20T03:16:25', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398896'} 2026-04-20 03:16:25,623 - DEBUG - Route Targets: ['target:64512:8000011'] 2026-04-20 03:16:25,623 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-82291484 passed 2026-04-20 03:16:25,624 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-82291484 in API_Server ====== 2026-04-20 03:16:25,624 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:16:25,629 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:16:25,640 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:16:25,730 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/89157c34-e6bf-46e3-8c93-7d2ef5ff5426 2026-04-20 03:16:25,740 - DEBUG - =>VN ctest-trans_right_vn-82291484 has no policy to be verified 2026-04-20 03:16:25,740 - DEBUG - Verifying the vn in opserver 2026-04-20 03:16:25,740 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484 virtual network link through opserver 10.0.0.38 2026-04-20 03:16:25,740 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2026-04-20 03:16:25,752 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484?flat'} 2026-04-20 03:16:25,752 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484 virtual network link through opserver 10.0.0.27 2026-04-20 03:16:25,752 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2026-04-20 03:16:25,766 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484?flat'} 2026-04-20 03:16:25,767 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484 virtual network link through opserver 10.0.0.23 2026-04-20 03:16:25,767 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2026-04-20 03:16:25,778 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484?flat'} 2026-04-20 03:16:25,778 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_right_vn-82291484 is found in opserver 2026-04-20 03:16:25,800 - DEBUG - Do not have enough data to verify VN in agent 2026-04-20 03:16:25,811 - DEBUG - VRF ids for VN ctest-trans_right_vn-82291484: {} 2026-04-20 03:16:25,940 - DEBUG - Services list from nova: [, , , ] 2026-04-20 03:16:27,054 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-2) 2026-04-20 03:16:28,532 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-1) 2026-04-20 03:16:28,533 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-08420156'] 2026-04-20 03:16:28,836 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-08420156'] created succesfully 2026-04-20 03:16:30,373 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5644-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5644-2) 2026-04-20 03:16:30,373 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:16:30,689 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:16:30,719 - DEBUG - Response Code: 404 2026-04-20 03:16:32,721 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:16:32,734 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:16:32,808 - INFO - Waiting for VM ctest-pt_svm0-69551703 to be up.. 2026-04-20 03:16:32,890 - DEBUG - VM is in ACTIVE state now 2026-04-20 03:16:32,890 - INFO - VM name : ctest-pt_svm0-69551703 2026-04-20 03:16:32,973 - DEBUG - VM ctest-pt_svm0-69551703 ID is e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:16:32,999 - DEBUG - VM ctest-pt_svm0-69551703 launched on Node an-jenkins-deploy-platform-ansible-os-5644-2 2026-04-20 03:16:33,082 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:16:33,089 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:16:36,260 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-04-20 03:16:36,260 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:16:36,276 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:16:40,344 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-04-20 03:16:40,345 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:16:40,356 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:16:44,438 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2026-04-20 03:16:44,438 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:16:44,452 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:16:48,544 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms') 2026-04-20 03:16:48,544 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:16:48,557 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:16:52,632 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-04-20 03:16:52,632 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:16:52,644 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:16:56,729 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1027ms') 2026-04-20 03:16:56,729 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:16:56,746 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:17:00,827 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2026-04-20 03:17:00,827 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:17:00,841 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:17:04,927 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2026-04-20 03:17:04,927 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:17:04,942 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:17:09,018 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms') 2026-04-20 03:17:09,018 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:17:09,038 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:17:13,115 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1008ms') 2026-04-20 03:17:13,115 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:17:13,128 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:17:17,210 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2026-04-20 03:17:17,210 - DEBUG - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 failed! 2026-04-20 03:17:17,223 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is 125.179.215.65 and allocation pool is NOT set 2026-04-20 03:17:19,294 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=64 time=11.9 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=64 time=3.49 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.485/7.693/11.902/4.208 ms') 2026-04-20 03:17:19,294 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 passed 2026-04-20 03:17:19,367 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:19,367 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-69551703, IP 125.179.215.67, Port 22 2026-04-20 03:17:19,434 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-20 03:17:19,514 - DEBUG - VM ctest-pt_svm0-69551703 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-20 03:17:24,515 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:24,515 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-69551703, IP 125.179.215.67, Port 22 2026-04-20 03:17:24,593 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-20 03:17:24,685 - DEBUG - VM ctest-pt_svm0-69551703 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-20 03:17:29,686 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:29,687 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-69551703, IP 125.179.215.67, Port 22 2026-04-20 03:17:29,754 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-20 03:17:29,845 - DEBUG - VM ctest-pt_svm0-69551703 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-20 03:17:34,846 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:34,846 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-69551703, IP 125.179.215.67, Port 22 2026-04-20 03:17:34,904 - DEBUG - Error on ssh to ubuntu@169.254.0.6:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.6/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.6/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.6/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-04-20 03:17:34,984 - DEBUG - VM ctest-pt_svm0-69551703 is NOT ready for SSH connections, VM status: ACTIVE 2026-04-20 03:17:39,985 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:39,985 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-69551703, IP 125.179.215.67, Port 22 2026-04-20 03:17:40,151 - DEBUG - VM ctest-pt_svm0-69551703 is ready for SSH connections 2026-04-20 03:17:40,157 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-si-18211497'] 2026-04-20 03:17:40,624 - INFO - Waiting for VM ctest-left_vm-18270099 to be up.. 2026-04-20 03:17:40,737 - DEBUG - VM is in ACTIVE state now 2026-04-20 03:17:40,737 - INFO - VM name : ctest-left_vm-18270099 2026-04-20 03:17:40,851 - DEBUG - VM ctest-left_vm-18270099 ID is 0c76763e-b062-40a2-a04a-5ee5032397b3 2026-04-20 03:17:40,851 - DEBUG - VM ctest-left_vm-18270099 launched on Node an-jenkins-deploy-platform-ansible-os-5644-2 2026-04-20 03:17:40,969 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/0c76763e-b062-40a2-a04a-5ee5032397b3 2026-04-20 03:17:40,979 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/4ce114ad-043c-43d4-ae43-1b91c9309355 2026-04-20 03:17:42,138 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=3.44 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=1.43 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.427/2.432/3.438/1.005 ms') 2026-04-20 03:17:42,138 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-left_vm-18270099 passed 2026-04-20 03:17:42,203 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:42,204 - DEBUG - Waiting to SSH to VM ctest-left_vm-18270099, IP 35.254.18.3, Port 22 2026-04-20 03:17:42,375 - DEBUG - VM ctest-left_vm-18270099 is ready for SSH connections 2026-04-20 03:17:42,375 - INFO - Waiting for VM ctest-right_vm-08308693 to be up.. 2026-04-20 03:17:42,468 - DEBUG - VM is in ACTIVE state now 2026-04-20 03:17:42,469 - INFO - VM name : ctest-right_vm-08308693 2026-04-20 03:17:42,548 - DEBUG - VM ctest-right_vm-08308693 ID is d2dc87c5-7315-4632-a937-e3d82abebd2d 2026-04-20 03:17:42,548 - DEBUG - VM ctest-right_vm-08308693 launched on Node an-jenkins-deploy-platform-ansible-os-5644-1 2026-04-20 03:17:42,645 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/d2dc87c5-7315-4632-a937-e3d82abebd2d 2026-04-20 03:17:42,654 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/1f34a33e-917e-41b3-86d0-c9fd3181e56f 2026-04-20 03:17:43,822 - DEBUG - (True, 'PING 169.254.0.5 (169.254.0.5) 56(84) bytes of data.\r\n64 bytes from 169.254.0.5: icmp_seq=1 ttl=63 time=4.39 ms\r\n64 bytes from 169.254.0.5: icmp_seq=2 ttl=63 time=2.92 ms\r\n\r\n--- 169.254.0.5 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.919/3.656/4.393/0.737 ms') 2026-04-20 03:17:43,822 - INFO - Ping to Metadata IP 169.254.0.5 of VM ctest-right_vm-08308693 passed 2026-04-20 03:17:43,892 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:43,892 - DEBUG - Waiting to SSH to VM ctest-right_vm-08308693, IP 7.51.129.67, Port 22 2026-04-20 03:17:44,062 - DEBUG - VM ctest-right_vm-08308693 is ready for SSH connections 2026-04-20 03:17:44,069 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-si-18211497, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-04-20 03:17:44,407 - INFO - Attaching policy ctest-policy-22032178 to vn ctest-left-19611779 2026-04-20 03:17:44,782 - INFO - Attaching policy ctest-policy-22032178 to vn ctest-right-32963383 2026-04-20 03:17:45,105 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-08420156'] created succesfully 2026-04-20 03:17:45,308 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-si-18211497'] created succesfully 2026-04-20 03:17:45,308 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:17:45,315 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:17:45,329 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:17:45,436 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/b18ac89b-6417-4035-b2d4-076755bed154 2026-04-20 03:17:45,453 - DEBUG - SI 'ctest-si-18211497' has service template ref to ctest-service_template_1-08420156 2026-04-20 03:17:45,453 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:17:45,460 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:17:45,471 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:17:45,563 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/b18ac89b-6417-4035-b2d4-076755bed154 2026-04-20 03:17:45,585 - DEBUG - Requesting: http://10.0.0.38:8082/port-tuple/e7aad398-8593-4917-bb07-18fe3b136479 2026-04-20 03:17:45,592 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:17:45,801 - DEBUG - VM is in ACTIVE state now 2026-04-20 03:17:46,061 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:17:46,068 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:17:46,076 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/42f735f8-83d5-472d-bddc-1a8a5847c927 2026-04-20 03:17:46,084 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/acc91267-a407-4965-afeb-80c89012c78c 2026-04-20 03:17:46,092 - DEBUG - Requesting: http://10.0.0.23:8082/instance-ip/b872a340-4345-4685-b492-222c74b82c08 2026-04-20 03:17:46,268 - DEBUG - VM is in ACTIVE state now 2026-04-20 03:17:46,268 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:17:46,275 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:17:47,428 - DEBUG - (True, 'PING 169.254.0.6 (169.254.0.6) 56(84) bytes of data.\r\n64 bytes from 169.254.0.6: icmp_seq=1 ttl=64 time=2.65 ms\r\n64 bytes from 169.254.0.6: icmp_seq=2 ttl=64 time=0.390 ms\r\n\r\n--- 169.254.0.6 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.390/1.518/2.646/1.128 ms') 2026-04-20 03:17:47,429 - INFO - Ping to Metadata IP 169.254.0.6 of VM ctest-pt_svm0-69551703 passed 2026-04-20 03:17:47,461 - DEBUG - VM ctest-pt_svm0-69551703 Tap interface: {'index': '6', 'name': 'tapdcb9231a-40', 'uuid': 'dcb9231a-401e-40e6-ab44-51b0412c093e', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895:ctest-trans_left_vn-81737895', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '47', 'l2_label': '49', 'vxlan_id': '20', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'vm_uuid': 'e28fdfd4-296d-40ca-aa7f-18b109eab2aa', 'vm_name': 'ctest-pt_svm0-69551703', 'ip_addr': '125.179.215.67', 'mac_addr': '02:dc:b9:23:1a:40', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-33240169:dcb9231a-401e-40e6-ab44-51b0412c093e', 'sg_uuid_list': ['60192211-3239-4b57-9bb5-2f5b8f57705f'], 'static_route_list': None, 'vm_project_uuid': 'd6508d8d-41e0-4f21-99a3-c057c0cf3db6', 'admin_state': 'Enabled', 'flow_key_idx': '61', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-20 03:17:47,461 - DEBUG - Agent 10.0.0.65 vrf name: default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895:ctest-trans_left_vn-81737895 2026-04-20 03:17:47,467 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895:ctest-trans_left_vn-81737895', 'ucindex': '5', 'mcindex': '5', 'l2index': '5', 'source': 'Config; ', 'uc6index': '5', 'vn': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'table_label': '-1', 'vxlan_id': '20', 'evpnindex': '5', 'brindex': '5', 'mplsindex': '0', 'RD': '10.20.0.192:5', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2026-04-20 03:17:47,546 - DEBUG - VM ctest-pt_svm0-69551703 : Tap interface tapdcb9231a-40 is set to Active 2026-04-20 03:17:47,546 - DEBUG - Tap interface tapdcb9231a-40 detail : {'index': '6', 'name': 'tapdcb9231a-40', 'uuid': 'dcb9231a-401e-40e6-ab44-51b0412c093e', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895:ctest-trans_left_vn-81737895', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '47', 'l2_label': '49', 'vxlan_id': '20', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895', 'vm_uuid': 'e28fdfd4-296d-40ca-aa7f-18b109eab2aa', 'vm_name': 'ctest-pt_svm0-69551703', 'ip_addr': '125.179.215.67', 'mac_addr': '02:dc:b9:23:1a:40', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-33240169:dcb9231a-401e-40e6-ab44-51b0412c093e', 'sg_uuid_list': ['60192211-3239-4b57-9bb5-2f5b8f57705f'], 'static_route_list': None, 'vm_project_uuid': 'd6508d8d-41e0-4f21-99a3-c057c0cf3db6', 'admin_state': 'Enabled', 'flow_key_idx': '61', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2026-04-20 03:17:47,665 - DEBUG - Starting Layer 2 verification in Agent 2026-04-20 03:17:47,679 - DEBUG - Layer 2 path is seen for VM MAC 02:dc:b9:23:1a:40 in agent 10.0.0.65 2026-04-20 03:17:47,679 - DEBUG - Active layer 2 route in agent is present for VMI tapdcb9231a-40 2026-04-20 03:17:47,679 - DEBUG - L2 label(49) matches bw route table and interface table 2026-04-20 03:17:47,691 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is found in Agent of node 10.0.0.65 2026-04-20 03:17:47,825 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 is consistent in agent 10.0.0.65 2026-04-20 03:17:47,825 - DEBUG - Route for VM IP ['125.179.215.67'] is consistent in agent 10.0.0.65 2026-04-20 03:17:47,825 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-trans_left_vn-81737895 verification for VM ctest-pt_svm0-69551703 in Agent 10.0.0.65 passed 2026-04-20 03:17:47,936 - DEBUG - Starting all layer 2 verification in agent 10.0.0.65 2026-04-20 03:17:47,946 - DEBUG - Route for VM MAC 02:dc:b9:23:1a:40 is consistent in agent 10.0.0.65 2026-04-20 03:17:47,947 - INFO - VM ctest-pt_svm0-69551703 verifications in Compute nodes passed 2026-04-20 03:17:47,947 - DEBUG - The SVMs in the SI are : [] 2026-04-20 03:17:47,947 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:17:47,956 - DEBUG - Service VM for SI 'ctest-si-18211497' is launched 2026-04-20 03:17:47,957 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:17:47,962 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:17:47,972 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:17:48,068 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/b18ac89b-6417-4035-b2d4-076755bed154 2026-04-20 03:17:48,078 - DEBUG - SI ctest-si-18211497 has Port Tuple: ['ctest-port_tuple-43761439'] 2026-04-20 03:17:48,140 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779 2026-04-20 03:17:48,244 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383 2026-04-20 03:17:48,244 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:48,244 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:17:48,245 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 7.51.129.67, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2026-04-20 03:17:48,245 - DEBUG - ping -s 56 -c 3 -W 1 7.51.129.67 2026-04-20 03:18:06,381 - DEBUG - PING 7.51.129.67 (7.51.129.67) 56(84) bytes of data. 64 bytes from 7.51.129.67: icmp_req=1 ttl=63 time=7.81 ms 64 bytes from 7.51.129.67: icmp_req=2 ttl=63 time=1.74 ms 64 bytes from 7.51.129.67: icmp_req=3 ttl=63 time=1.42 ms --- 7.51.129.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.426/3.660/7.812/2.939 ms 2026-04-20 03:18:06,381 - INFO - Ping to IP 7.51.129.67 from VM ctest-left_vm-18270099 passed 2026-04-20 03:18:06,388 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-si-18211497, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-left-19611779, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-right-32963383, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-33240169:ctest-si-18211497, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2026-04-20 03:18:06,455 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-04-20 03:18:06,455 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:06,466 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:06,499 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:06,590 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/b18ac89b-6417-4035-b2d4-076755bed154 2026-04-20 03:18:06,602 - DEBUG - Requesting: http://10.0.0.38:8082/port-tuple/e7aad398-8593-4917-bb07-18fe3b136479 2026-04-20 03:18:06,613 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:18:06,811 - DEBUG - Executing command: rm -f /tmp/mirror-tapdcb9231a-40_ctest-random-07030166.pcap 2026-04-20 03:18:16,950 - INFO - Starting tcpdump to capture the mirrored packets. 2026-04-20 03:18:16,951 - DEBUG - Executing command: sudo tcpdump -ni tapdcb9231a-40 -U udp port 8099 -w /tmp/mirror-tapdcb9231a-40_ctest-random-07030166.pcap 2026-04-20 03:18:26,982 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 7.51.129.67, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123 2026-04-20 03:18:26,982 - DEBUG - ping -s 56 -c 3 -W 1 7.51.129.67 2026-04-20 03:18:29,480 - DEBUG - PING 7.51.129.67 (7.51.129.67) 56(84) bytes of data. 64 bytes from 7.51.129.67: icmp_req=1 ttl=63 time=5.01 ms 64 bytes from 7.51.129.67: icmp_req=2 ttl=63 time=1.20 ms 64 bytes from 7.51.129.67: icmp_req=3 ttl=63 time=2.05 ms --- 7.51.129.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2005ms rtt min/avg/max/mdev = 1.204/2.758/5.014/1.633 ms 2026-04-20 03:18:29,481 - INFO - Ping to IP 7.51.129.67 from VM ctest-left_vm-18270099 passed 2026-04-20 03:18:29,481 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:29,493 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:29,509 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:29,595 - DEBUG - Requesting: http://10.0.0.38:8082/service-instance/b18ac89b-6417-4035-b2d4-076755bed154 2026-04-20 03:18:29,604 - DEBUG - Requesting: http://10.0.0.38:8082/port-tuple/e7aad398-8593-4917-bb07-18fe3b136479 2026-04-20 03:18:29,611 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine-interface/dcb9231a-401e-40e6-ab44-51b0412c093e 2026-04-20 03:18:29,710 - DEBUG - Waiting for the tcpdump write to complete. 2026-04-20 03:18:31,711 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tapdcb9231a-40_ctest-random-07030166.pcap| awk '{print $2}') 2026-04-20 03:18:31,713 - DEBUG - Executing command: sync 2026-04-20 03:18:34,744 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapdcb9231a-40_ctest-random-07030166.pcap | wc -l 2026-04-20 03:18:34,759 - DEBUG - STDOUT: 12 2026-04-20 03:18:34,759 - DEBUG - STDERR: reading from file /tmp/mirror-tapdcb9231a-40_ctest-random-07030166.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-04-20 03:18:34,759 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapdcb9231a-40_ctest-random-07030166.pcap 2026-04-20 03:18:34,802 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-69551703' 2026-04-20 03:18:34,803 - INFO - Dettaching policy ctest-policy-22032178 from vn ctest-right-32963383 2026-04-20 03:18:35,005 - INFO - Dettaching policy ctest-policy-22032178 from vn ctest-left-19611779 2026-04-20 03:18:35,338 - INFO - Deleted policy ctest-policy-22032178 2026-04-20 03:18:35,339 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-si-18211497'] 2026-04-20 03:18:35,445 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-33240169', 'ctest-si-18211497'] 2026-04-20 03:18:35,446 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:35,459 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:35,475 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:35,567 - DEBUG - Service instance ctest-si-18211497 removed from api server 2026-04-20 03:18:35,568 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-machine/e28fdfd4-296d-40ca-aa7f-18b109eab2aa 2026-04-20 03:18:35,582 - DEBUG - All Service VMs unlinked from SI ctest-si-18211497 2026-04-20 03:18:35,595 - DEBUG - 0 svc intances found in all projects. They are [] 2026-04-20 03:18:35,595 - DEBUG - 0 svc intances found in current project. They are [] 2026-04-20 03:18:35,644 - DEBUG - 0 svc intances found in all projects. They are [] 2026-04-20 03:18:35,644 - DEBUG - 0 svc intances found in current project. They are [] 2026-04-20 03:18:35,644 - INFO - Deleting VM ctest-pt_svm0-69551703 2026-04-20 03:18:35,733 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-08420156'] 2026-04-20 03:18:35,820 - INFO - Service template: ['default-domain', 'ctest-service_template_1-08420156'] deleted successfully. 2026-04-20 03:18:35,820 - INFO - Deleting VM ctest-right_vm-08308693 2026-04-20 03:18:35,892 - INFO - Deleting VM ctest-left_vm-18270099 2026-04-20 03:18:35,976 - INFO - Deleting VN ctest-trans_right_vn-82291484 2026-04-20 03:18:36,137 - DEBUG - Response for deleting network () 2026-04-20 03:18:36,137 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/6c11e83c-abf6-4203-b397-28a1e24e2699 2026-04-20 03:18:36,146 - DEBUG - Response Code: 404 2026-04-20 03:18:36,146 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:36,157 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:36,180 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:36,289 - INFO - Validated that VN ctest-trans_right_vn-82291484 is not found in API Server 2026-04-20 03:18:36,305 - DEBUG - VN ctest-trans_right_vn-82291484 is not present in Agent 10.0.0.240 2026-04-20 03:18:36,322 - DEBUG - VN ctest-trans_right_vn-82291484 is not present in Agent 10.0.0.65 2026-04-20 03:18:36,322 - INFO - Validated that VN ctest-trans_right_vn-82291484 is not in any agent 2026-04-20 03:18:36,362 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-82291484 info 2026-04-20 03:18:36,362 - INFO - Deleting VN ctest-trans_left_vn-81737895 2026-04-20 03:18:36,421 - DEBUG - VN 5fc9c620-2ed8-4090-807b-8458f5a9b2a4 still in use: Unable to complete operation on network 5fc9c620-2ed8-4090-807b-8458f5a9b2a4. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c7a6cb06-1cd8-46f7-969d-9bfd6e9a3d01'] 2026-04-20 03:18:36,421 - WARNING - Deleting VN ctest-trans_left_vn-81737895 failed..Will retry 2026-04-20 03:18:38,577 - DEBUG - Response for deleting network () 2026-04-20 03:18:38,577 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/acd3a7d5-3129-4e5a-8310-b925a020f972 2026-04-20 03:18:38,582 - DEBUG - Response Code: 404 2026-04-20 03:18:38,582 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:38,596 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:38,651 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:38,744 - INFO - Validated that VN ctest-trans_left_vn-81737895 is not found in API Server 2026-04-20 03:18:38,755 - DEBUG - VN ctest-trans_left_vn-81737895 is not present in Agent 10.0.0.240 2026-04-20 03:18:38,764 - DEBUG - VN ctest-trans_left_vn-81737895 is not present in Agent 10.0.0.65 2026-04-20 03:18:38,764 - INFO - Validated that VN ctest-trans_left_vn-81737895 is not in any agent 2026-04-20 03:18:38,794 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-81737895 info 2026-04-20 03:18:38,794 - INFO - Deleting VN ctest-mgmt_vn-20223915 2026-04-20 03:18:38,930 - DEBUG - Response for deleting network () 2026-04-20 03:18:38,930 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/e2c69ad3-bb58-4222-9a52-57b23272fcfc 2026-04-20 03:18:38,935 - DEBUG - Response Code: 404 2026-04-20 03:18:38,935 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:38,939 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:38,952 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:39,046 - INFO - Validated that VN ctest-mgmt_vn-20223915 is not found in API Server 2026-04-20 03:18:39,058 - DEBUG - VN ctest-mgmt_vn-20223915 is not present in Agent 10.0.0.240 2026-04-20 03:18:39,069 - DEBUG - VN ctest-mgmt_vn-20223915 is not present in Agent 10.0.0.65 2026-04-20 03:18:39,069 - INFO - Validated that VN ctest-mgmt_vn-20223915 is not in any agent 2026-04-20 03:18:39,096 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-20223915 info 2026-04-20 03:18:39,096 - INFO - Deleting VN ctest-right-32963383 2026-04-20 03:18:39,235 - DEBUG - Response for deleting network () 2026-04-20 03:18:39,235 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/26fa29e8-c639-4b29-8ae7-a467421ebae8 2026-04-20 03:18:39,240 - DEBUG - Response Code: 404 2026-04-20 03:18:39,241 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:39,247 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:39,260 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:39,345 - INFO - Validated that VN ctest-right-32963383 is not found in API Server 2026-04-20 03:18:39,357 - DEBUG - VN ctest-right-32963383 is not present in Agent 10.0.0.240 2026-04-20 03:18:39,370 - DEBUG - VN ctest-right-32963383 is not present in Agent 10.0.0.65 2026-04-20 03:18:39,371 - INFO - Validated that VN ctest-right-32963383 is not in any agent 2026-04-20 03:18:39,400 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-32963383 info 2026-04-20 03:18:39,401 - INFO - Deleting VN ctest-left-19611779 2026-04-20 03:18:39,545 - DEBUG - Response for deleting network () 2026-04-20 03:18:39,545 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/b48734b8-e82f-4b7a-b6ca-4bd856869d33 2026-04-20 03:18:39,552 - DEBUG - Response Code: 404 2026-04-20 03:18:39,552 - DEBUG - Requesting: http://10.0.0.38:8082/domains 2026-04-20 03:18:39,559 - DEBUG - Requesting: http://10.0.0.38:8082/domain/c2b9cdf0-ff50-48aa-bc48-322f89577022 2026-04-20 03:18:39,618 - DEBUG - Requesting: http://10.0.0.38:8082/project/d6508d8d-41e0-4f21-99a3-c057c0cf3db6 2026-04-20 03:18:39,717 - INFO - Validated that VN ctest-left-19611779 is not found in API Server 2026-04-20 03:18:39,729 - DEBUG - VN ctest-left-19611779 is not present in Agent 10.0.0.240 2026-04-20 03:18:39,742 - DEBUG - VN ctest-left-19611779 is not present in Agent 10.0.0.65 2026-04-20 03:18:39,742 - INFO - Validated that VN ctest-left-19611779 is not in any agent 2026-04-20 03:18:39,773 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-19611779 info 2026-04-20 03:18:41,029 - DEBUG - No XMPP flaps were noticed during the test 2026-04-20 03:18:41,030 - INFO -

2026-04-20 03:18:41,030 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:30]

2026-04-20 03:18:41,030 - INFO - -------------------------------------------------------------------------------- 2026-04-20 03:18:41,746 - INFO - Deleted project: ctest-TestSVCV2Mirror-33240169, ID : d6508d8d-41e0-4f21-99a3-c057c0cf3db6