2025-07-31 03:02:15,152 - INFO - Domain Default found not creating 2025-07-31 03:02:15,383 - INFO - Project ctest-TestIntfMirror-40773914 not found, creating it 2025-07-31 03:02:15,930 - INFO - Created Project:ctest-TestIntfMirror-40773914, ID : 6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:17,782 - INFO - ================================================================================ 2025-07-31 03:02:17,782 - INFO - STARTING TEST : test_intf_mirror_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 2025-07-31 03:02:17,782 - INFO - TEST DESCRIPTION : Validate the interface mirroring src vm, dst vm and analyzer vm on different CNs, all in different VNs 2025-07-31 03:02:19,097 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 03:02:19,097 - INFO - Initial checks done. Running the testcase now 2025-07-31 03:02:19,097 - INFO - 2025-07-31 03:02:19,097 - INFO - src compute an-jenkins-deploy-platform-ansible-os-3732-1 -> dst compute an-jenkins-deploy-platform-ansible-os-3732-2 => analyzer compute an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:02:19,809 - DEBUG - Response for create_network : {'network': {'id': 'cc0bb92e-5563-4944-9354-e31004f1e95c', 'name': 'ctest-vn1-48888093', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn1-48888093'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:02:20,165 - DEBUG - Response for create_subnet : {'subnet': {'id': 'c3e82b54-a190-48a6-bd06-1c063bebd0cb', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'cc0bb92e-5563-4944-9354-e31004f1e95c', 'ip_version': 4, 'cidr': '70.227.123.192/26', 'allocation_pools': [{'start': '70.227.123.194', 'end': '70.227.123.254'}], 'gateway_ip': '70.227.123.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '70.227.123.194', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:02:20,187 - INFO - Created VN ctest-vn1-48888093 2025-07-31 03:02:20,199 - DEBUG - VN ctest-vn1-48888093 UUID is cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:20,281 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:20,573 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:20,609 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:02:20,648 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:20,767 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:20,785 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:20,798 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e4c43e2-1e6c-42f1-a451-2f9e21120970 2025-07-31 03:02:20,808 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e4c43e2-1e6c-42f1-a451-2f9e21120970 2025-07-31 03:02:20,817 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e6732900-dd1b-45a5-b172-c08484521d24 2025-07-31 03:02:20,826 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:02:20,826 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:20,838 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e4c43e2-1e6c-42f1-a451-2f9e21120970 2025-07-31 03:02:20,857 - INFO - Verified VN network id 11 for VN cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:20,857 - INFO - Verifications in API Server for VN ctest-vn1-48888093 passed 2025-07-31 03:02:20,857 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:20,868 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e4c43e2-1e6c-42f1-a451-2f9e21120970 2025-07-31 03:02:20,878 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e4c43e2-1e6c-42f1-a451-2f9e21120970 2025-07-31 03:02:20,890 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e6732900-dd1b-45a5-b172-c08484521d24 2025-07-31 03:02:20,906 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14703049017133320516', 'uuid-lslong': '10616359879561046364'}, 'enable': 'true', 'created': '2025-07-31T03:02:19', 'last-modified': '2025-07-31T03:02:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.796064'} 2025-07-31 03:02:20,914 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:02:20,926 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14703049017133320516', 'uuid-lslong': '10616359879561046364'}, 'enable': 'true', 'created': '2025-07-31T03:02:19', 'last-modified': '2025-07-31T03:02:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.824805'} 2025-07-31 03:02:20,936 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:02:20,944 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14703049017133320516', 'uuid-lslong': '10616359879561046364'}, 'enable': 'true', 'created': '2025-07-31T03:02:19', 'last-modified': '2025-07-31T03:02:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.835540'} 2025-07-31 03:02:20,951 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:02:20,951 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-48888093 passed 2025-07-31 03:02:20,952 - DEBUG - ====Verifying policy data for ctest-vn1-48888093 in API_Server ====== 2025-07-31 03:02:20,952 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:20,958 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:02:20,971 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:21,097 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cc0bb92e-5563-4944-9354-e31004f1e95c 2025-07-31 03:02:21,109 - DEBUG - =>VN ctest-vn1-48888093 has no policy to be verified 2025-07-31 03:02:21,109 - DEBUG - Verifying the vn in opserver 2025-07-31 03:02:21,109 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 virtual network link through opserver 10.0.0.41 2025-07-31 03:02:21,109 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:02:21,424 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:02:21,488 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093?flat'} 2025-07-31 03:02:21,488 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 virtual network link through opserver 10.0.0.38 2025-07-31 03:02:21,488 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:02:21,798 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:02:21,859 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093?flat'} 2025-07-31 03:02:21,859 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 virtual network link through opserver 10.0.0.61 2025-07-31 03:02:21,860 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:02:22,164 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:02:22,250 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093?flat'} 2025-07-31 03:02:22,250 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 is found in opserver 2025-07-31 03:02:22,301 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:02:22,325 - DEBUG - VRF ids for VN ctest-vn1-48888093: {} 2025-07-31 03:02:22,699 - DEBUG - Response for create_network : {'network': {'id': '44b57915-8641-44b1-b3c4-34c5a955f1cf', 'name': 'ctest-vn2-09712053', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn2-09712053'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:02:22,898 - DEBUG - Response for create_subnet : {'subnet': {'id': '5cff63ab-7944-4126-bbfe-0c8ea43c57c9', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '44b57915-8641-44b1-b3c4-34c5a955f1cf', 'ip_version': 4, 'cidr': '128.210.133.0/26', 'allocation_pools': [{'start': '128.210.133.2', 'end': '128.210.133.62'}], 'gateway_ip': '128.210.133.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '128.210.133.2', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:02:22,920 - INFO - Created VN ctest-vn2-09712053 2025-07-31 03:02:22,934 - DEBUG - VN ctest-vn2-09712053 UUID is 44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,009 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:23,015 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:02:23,027 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:23,125 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,150 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,163 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/e15c29a3-b69a-4ade-8c31-337b44e67979 2025-07-31 03:02:23,173 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/e15c29a3-b69a-4ade-8c31-337b44e67979 2025-07-31 03:02:23,181 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/bf758d41-16e8-423d-a6e5-f7649f1235fe 2025-07-31 03:02:23,188 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:02:23,188 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,198 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/e15c29a3-b69a-4ade-8c31-337b44e67979 2025-07-31 03:02:23,218 - INFO - Verified VN network id 12 for VN 44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,218 - INFO - Verifications in API Server for VN ctest-vn2-09712053 passed 2025-07-31 03:02:23,219 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,234 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/e15c29a3-b69a-4ade-8c31-337b44e67979 2025-07-31 03:02:23,244 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/e15c29a3-b69a-4ade-8c31-337b44e67979 2025-07-31 03:02:23,253 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/bf758d41-16e8-423d-a6e5-f7649f1235fe 2025-07-31 03:02:23,274 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4950996498717426865', 'uuid-lslong': '12953536451778572751'}, 'enable': 'true', 'created': '2025-07-31T03:02:22', 'last-modified': '2025-07-31T03:02:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.423982'} 2025-07-31 03:02:23,284 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:02:23,292 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4950996498717426865', 'uuid-lslong': '12953536451778572751'}, 'enable': 'true', 'created': '2025-07-31T03:02:22', 'last-modified': '2025-07-31T03:02:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.443629'} 2025-07-31 03:02:23,299 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:02:23,305 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4950996498717426865', 'uuid-lslong': '12953536451778572751'}, 'enable': 'true', 'created': '2025-07-31T03:02:22', 'last-modified': '2025-07-31T03:02:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.462189'} 2025-07-31 03:02:23,312 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:02:23,312 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-09712053 passed 2025-07-31 03:02:23,312 - DEBUG - ====Verifying policy data for ctest-vn2-09712053 in API_Server ====== 2025-07-31 03:02:23,312 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:23,327 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:02:23,344 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:23,472 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/44b57915-8641-44b1-b3c4-34c5a955f1cf 2025-07-31 03:02:23,486 - DEBUG - =>VN ctest-vn2-09712053 has no policy to be verified 2025-07-31 03:02:23,486 - DEBUG - Verifying the vn in opserver 2025-07-31 03:02:23,486 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 virtual network link through opserver 10.0.0.41 2025-07-31 03:02:23,486 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:02:23,555 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053?flat'} 2025-07-31 03:02:23,555 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 virtual network link through opserver 10.0.0.38 2025-07-31 03:02:23,555 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:02:23,657 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053?flat'} 2025-07-31 03:02:23,657 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 virtual network link through opserver 10.0.0.61 2025-07-31 03:02:23,657 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:02:23,782 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053?flat'} 2025-07-31 03:02:23,782 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 is found in opserver 2025-07-31 03:02:23,823 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:02:23,843 - DEBUG - VRF ids for VN ctest-vn2-09712053: {} 2025-07-31 03:02:24,127 - DEBUG - Response for create_network : {'network': {'id': 'a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108', 'name': 'ctest-vn3-59001426', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn3-59001426'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:02:24,365 - DEBUG - Response for create_subnet : {'subnet': {'id': '55631377-2e20-4542-8d77-266626c6b7a8', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108', 'ip_version': 4, 'cidr': '113.185.24.128/26', 'allocation_pools': [{'start': '113.185.24.130', 'end': '113.185.24.190'}], 'gateway_ip': '113.185.24.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '113.185.24.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:02:24,389 - INFO - Created VN ctest-vn3-59001426 2025-07-31 03:02:24,404 - DEBUG - VN ctest-vn3-59001426 UUID is a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,480 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:24,488 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:02:24,502 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:24,613 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,629 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,640 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/db92ac12-43ed-440c-a375-7014e7afb96e 2025-07-31 03:02:24,650 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/db92ac12-43ed-440c-a375-7014e7afb96e 2025-07-31 03:02:24,659 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/421d3b43-a8d0-48c5-aba1-d68bf0ad36b0 2025-07-31 03:02:24,669 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:02:24,669 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,683 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/db92ac12-43ed-440c-a375-7014e7afb96e 2025-07-31 03:02:24,702 - INFO - Verified VN network id 13 for VN a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,702 - INFO - Verifications in API Server for VN ctest-vn3-59001426 passed 2025-07-31 03:02:24,702 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,716 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/db92ac12-43ed-440c-a375-7014e7afb96e 2025-07-31 03:02:24,726 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/db92ac12-43ed-440c-a375-7014e7afb96e 2025-07-31 03:02:24,736 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/421d3b43-a8d0-48c5-aba1-d68bf0ad36b0 2025-07-31 03:02:24,752 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11720281713283255492', 'uuid-lslong': '11476832459838644488'}, 'enable': 'true', 'created': '2025-07-31T03:02:24', 'last-modified': '2025-07-31T03:02:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.437736'} 2025-07-31 03:02:24,760 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:02:24,766 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11720281713283255492', 'uuid-lslong': '11476832459838644488'}, 'enable': 'true', 'created': '2025-07-31T03:02:24', 'last-modified': '2025-07-31T03:02:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.452639'} 2025-07-31 03:02:24,773 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:02:24,779 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11720281713283255492', 'uuid-lslong': '11476832459838644488'}, 'enable': 'true', 'created': '2025-07-31T03:02:24', 'last-modified': '2025-07-31T03:02:24', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459705'} 2025-07-31 03:02:24,788 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:02:24,788 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-59001426 passed 2025-07-31 03:02:24,788 - DEBUG - ====Verifying policy data for ctest-vn3-59001426 in API_Server ====== 2025-07-31 03:02:24,788 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:02:24,799 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:02:24,823 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:02:24,968 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108 2025-07-31 03:02:24,986 - DEBUG - =>VN ctest-vn3-59001426 has no policy to be verified 2025-07-31 03:02:24,986 - DEBUG - Verifying the vn in opserver 2025-07-31 03:02:24,986 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 virtual network link through opserver 10.0.0.41 2025-07-31 03:02:24,986 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:02:25,061 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426?flat'} 2025-07-31 03:02:25,061 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 virtual network link through opserver 10.0.0.38 2025-07-31 03:02:25,061 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:02:25,153 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426?flat'} 2025-07-31 03:02:25,154 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 virtual network link through opserver 10.0.0.61 2025-07-31 03:02:25,154 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:02:25,234 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426?flat'} 2025-07-31 03:02:25,234 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 is found in opserver 2025-07-31 03:02:25,269 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:02:25,285 - DEBUG - VRF ids for VN ctest-vn3-59001426: {} 2025-07-31 03:02:25,292 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:02:25,589 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:02:25,954 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:02:26,450 - INFO - Attaching policy ctest-vn1_vn2_pass-17452738 to vn ctest-vn1-48888093 2025-07-31 03:02:27,300 - INFO - Attaching policy ctest-vn1_vn2_pass-17452738 to vn ctest-vn2-09712053 2025-07-31 03:02:27,964 - INFO - Attaching policy ctest-vn1_vn3_pass-45940797 to vn ctest-vn1-48888093 2025-07-31 03:02:28,437 - INFO - Attaching policy ctest-vn1_vn3_pass-45940797 to vn ctest-vn3-59001426 2025-07-31 03:02:28,878 - INFO - Attaching policy ctest-vn2_vn3_pass-52958506 to vn ctest-vn2-09712053 2025-07-31 03:02:29,339 - INFO - Attaching policy ctest-vn2_vn3_pass-52958506 to vn ctest-vn3-59001426 2025-07-31 03:02:29,892 - DEBUG - Services list from nova: [, , , ] 2025-07-31 03:02:31,774 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-1) 2025-07-31 03:02:33,161 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-2) 2025-07-31 03:02:34,609 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3732-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3732-2) 2025-07-31 03:02:34,721 - DEBUG - VM is in ACTIVE state now 2025-07-31 03:02:34,721 - INFO - VM name : ctest-src_vm-92742463 2025-07-31 03:02:34,827 - DEBUG - VM ctest-src_vm-92742463 ID is 5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:34,933 - DEBUG - VM is in ACTIVE state now 2025-07-31 03:02:34,960 - DEBUG - VM ctest-src_vm-92742463 launched on Node an-jenkins-deploy-platform-ansible-os-3732-1 2025-07-31 03:02:35,057 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:35,478 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:35,510 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:35,518 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/1d161a8f-d679-44bb-b00a-ba5387310749 2025-07-31 03:02:35,530 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:35,538 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/1d161a8f-d679-44bb-b00a-ba5387310749 2025-07-31 03:02:35,574 - DEBUG - Requesting: http://10.0.0.61:8082/instance-ip/1fe84631-8390-4ea2-b22d-97306f2e6a69 2025-07-31 03:02:35,594 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:02:35,595 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:35,615 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/1d161a8f-d679-44bb-b00a-ba5387310749 2025-07-31 03:02:35,641 - DEBUG - Requesting: http://10.0.0.61:8082/instance-ip/1fe84631-8390-4ea2-b22d-97306f2e6a69 2025-07-31 03:02:35,653 - INFO - VM ctest-src_vm-92742463 verfication in all API Servers passed 2025-07-31 03:02:35,677 - DEBUG - VM ctest-src_vm-92742463 Tap interface: {'index': '3', 'name': 'tap1d161a8f-d6', 'uuid': '1d161a8f-d679-44bb-b00a-ba5387310749', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093:ctest-vn1-48888093', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'vm_uuid': '5e28b289-e095-4af2-9368-2fa8d9f1e411', 'vm_name': 'ctest-src_vm-92742463', 'ip_addr': '70.227.123.195', 'mac_addr': '02:1d:16:1a:8f:d6', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '18', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-31 03:02:35,677 - DEBUG - Agent 10.0.0.27 vrf name: default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093:ctest-vn1-48888093 2025-07-31 03:02:35,686 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093:ctest-vn1-48888093', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-07-31 03:02:35,817 - DEBUG - VM ctest-src_vm-92742463 : Tap interface tap1d161a8f-d6 is set to Active 2025-07-31 03:02:35,817 - DEBUG - Tap interface tap1d161a8f-d6 detail : {'index': '3', 'name': 'tap1d161a8f-d6', 'uuid': '1d161a8f-d679-44bb-b00a-ba5387310749', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093:ctest-vn1-48888093', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'vm_uuid': '5e28b289-e095-4af2-9368-2fa8d9f1e411', 'vm_name': 'ctest-src_vm-92742463', 'ip_addr': '70.227.123.195', 'mac_addr': '02:1d:16:1a:8f:d6', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '18', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-31 03:02:35,977 - DEBUG - Starting Layer 2 verification in Agent 2025-07-31 03:02:36,001 - DEBUG - Layer 2 path is seen for VM MAC 02:1d:16:1a:8f:d6 in agent 10.0.0.27 2025-07-31 03:02:36,001 - DEBUG - Active layer 2 route in agent is present for VMI tap1d161a8f-d6 2025-07-31 03:02:36,002 - DEBUG - L2 label(29) matches bw route table and interface table 2025-07-31 03:02:36,015 - DEBUG - VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 is found in Agent of node 10.0.0.27 2025-07-31 03:02:36,199 - DEBUG - VRF IDs of VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 is consistent in agent 10.0.0.27 2025-07-31 03:02:36,200 - DEBUG - Route for VM IP ['70.227.123.195'] is consistent in agent 10.0.0.27 2025-07-31 03:02:36,200 - DEBUG - VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 verification for VM ctest-src_vm-92742463 in Agent 10.0.0.27 passed 2025-07-31 03:02:36,379 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2025-07-31 03:02:36,407 - DEBUG - Route for VM MAC 02:1d:16:1a:8f:d6 is consistent in agent 10.0.0.27 2025-07-31 03:02:39,621 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-07-31 03:02:39,621 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-src_vm-92742463 failed! 2025-07-31 03:02:39,640 - DEBUG - Gateway for vn default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 is 70.227.123.193 and allocation pool is NOT set 2025-07-31 03:02:43,719 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-07-31 03:02:43,719 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-src_vm-92742463 failed! 2025-07-31 03:02:43,744 - DEBUG - Gateway for vn default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 is 70.227.123.193 and allocation pool is NOT set 2025-07-31 03:02:45,822 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=6.18 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.80 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.802/4.492/6.183/1.690 ms') 2025-07-31 03:02:45,822 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-src_vm-92742463 passed 2025-07-31 03:02:45,823 - INFO - VM ctest-src_vm-92742463 verifications in Compute nodes passed 2025-07-31 03:02:46,294 - DEBUG - Validated VM route 70.227.123.195 in vrouter of 10.0.0.27 2025-07-31 03:02:46,301 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-07-31 03:02:46,301 - INFO - Validated routes of VM ctest-src_vm-92742463 in all vrouters 2025-07-31 03:02:46,868 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-07-31 03:02:47,022 - DEBUG - Layer2 route found for VM MAC 02:1d:16:1a:8f:d6 in Control-node 10.0.0.38 2025-07-31 03:02:47,022 - DEBUG - L2 Label for VM ctest-src_vm-92742463 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2025-07-31 03:02:47,023 - DEBUG - Starting all layer2 verification in 10.0.0.61 Control Node 2025-07-31 03:02:47,224 - DEBUG - Layer2 route found for VM MAC 02:1d:16:1a:8f:d6 in Control-node 10.0.0.61 2025-07-31 03:02:47,224 - DEBUG - L2 Label for VM ctest-src_vm-92742463 same between Control-node 10.0.0.61 and Agent, Expected: 29, Seen: 29 2025-07-31 03:02:47,224 - INFO - Verification in Control-nodes for VM ctest-src_vm-92742463 passed 2025-07-31 03:02:47,225 - DEBUG - Verifying the vm in opserver 2025-07-31 03:02:47,225 - DEBUG - Verifying in collector 10.0.0.61 ... 2025-07-31 03:02:47,225 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat 2025-07-31 03:02:47,245 - DEBUG - Failed to get VM ctest-src_vm-92742463, ID 5e28b289-e095-4af2-9368-2fa8d9f1e411 info from Opserver 2025-07-31 03:02:49,247 - DEBUG - Verifying the vm in opserver 2025-07-31 03:02:49,247 - DEBUG - Verifying in collector 10.0.0.61 ... 2025-07-31 03:02:49,247 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat 2025-07-31 03:02:49,270 - DEBUG - Failed to get VM ctest-src_vm-92742463, ID 5e28b289-e095-4af2-9368-2fa8d9f1e411 info from Opserver 2025-07-31 03:02:51,271 - DEBUG - Verifying the vm in opserver 2025-07-31 03:02:51,271 - DEBUG - Verifying in collector 10.0.0.61 ... 2025-07-31 03:02:51,272 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat 2025-07-31 03:02:51,302 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749?flat 2025-07-31 03:02:51,351 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749?flat 2025-07-31 03:02:51,403 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat 2025-07-31 03:02:51,423 - DEBUG - Verifying vm in vn uve 2025-07-31 03:02:51,423 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749?flat 2025-07-31 03:02:51,464 - DEBUG - VM uve shows interface as {'uuid': '1d161a8f-d679-44bb-b00a-ba5387310749', 'fixed_ip4_list': ['70.227.123.195'], 'ip4_active': True, 'l2_active': True, '__T': 1753930969637104, 'ip6_active': False, 'vm_uuid': '5e28b289-e095-4af2-9368-2fa8d9f1e411', 'gateway': '70.227.123.193', 'vm_name': 'ctest-src_vm-92742463', 'vhostuser_mode': 0, 'virtual_network': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093', 'ip6_address': '::', 'tx_vlan': 65535, 'active': True, 'admin_state': True, 'label': 25, 'mac_address': '02:1d:16:1a:8f:d6', 'is_health_check_active': True, 'rx_vlan': 65535, 'ip_address': '70.227.123.195', 'vn_uuid': 'cc0bb92e-5563-4944-9354-e31004f1e95c', 'port_mirror_enabled': False} 2025-07-31 03:02:51,464 - DEBUG - VM uve shows ip address as ['70.227.123.195', '::'] 2025-07-31 03:02:51,465 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:02:51,465 - INFO - Verifying through opserver in 10.0.0.41 2025-07-31 03:02:51,465 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093?flat 2025-07-31 03:02:51,507 - DEBUG - expected vm list 5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:02:51,507 - DEBUG - Extracted vm list ['5e28b289-e095-4af2-9368-2fa8d9f1e411'] 2025-07-31 03:02:51,507 - INFO - VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is present in default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:02:51,507 - DEBUG - Verifying vm in vrouter uve 2025-07-31 03:02:51,507 - DEBUG - Getting info from collector 10.0.0.61.. 2025-07-31 03:02:51,507 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat 2025-07-31 03:02:51,524 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3732-1'] 2025-07-31 03:02:51,525 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:02:51,580 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat 2025-07-31 03:02:51,622 - DEBUG - VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-1 uve 2025-07-31 03:02:51,622 - DEBUG - Validated that VM ctest-src_vm-92742463 is in Vrouter an-jenkins-deploy-platform-ansible-os-3732-1 UVE 2025-07-31 03:02:51,622 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-07-31 03:02:51,634 - DEBUG - Expected tap interface of VM uuid 5e28b289-e095-4af2-9368-2fa8d9f1e411 is default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749 2025-07-31 03:02:51,635 - DEBUG - Expected VN of VM uuid 5e28b289-e095-4af2-9368-2fa8d9f1e411 is default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:02:51,635 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:02:51,694 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat 2025-07-31 03:02:51,757 - DEBUG - VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-1 uve 2025-07-31 03:02:51,757 - INFO - tap interface default-domain:ctest-TestIntfMirror-40773914:1d161a8f-d679-44bb-b00a-ba5387310749 of vm 5e28b289-e095-4af2-9368-2fa8d9f1e411 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-1 uve 2025-07-31 03:02:51,757 - DEBUG - Connected network default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 of vm 5e28b289-e095-4af2-9368-2fa8d9f1e411 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-1 uve 2025-07-31 03:02:51,758 - DEBUG - Verifying the 5e28b289-e095-4af2-9368-2fa8d9f1e411 virtual network link through opserver 10.0.0.41 2025-07-31 03:02:51,758 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-07-31 03:02:51,779 - DEBUG - VM link and name as {'name': '5e28b289-e095-4af2-9368-2fa8d9f1e411', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat'} 2025-07-31 03:02:51,779 - DEBUG - Verifying the 5e28b289-e095-4af2-9368-2fa8d9f1e411 virtual network link through opserver 10.0.0.38 2025-07-31 03:02:51,779 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-07-31 03:02:51,800 - DEBUG - VM link and name as {'name': '5e28b289-e095-4af2-9368-2fa8d9f1e411', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat'} 2025-07-31 03:02:51,800 - DEBUG - Verifying the 5e28b289-e095-4af2-9368-2fa8d9f1e411 virtual network link through opserver 10.0.0.61 2025-07-31 03:02:51,800 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-07-31 03:02:51,818 - DEBUG - VM link and name as {'name': '5e28b289-e095-4af2-9368-2fa8d9f1e411', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411?flat'} 2025-07-31 03:02:51,818 - INFO - VM ctest-src_vm-92742463 validations in Opserver passed 2025-07-31 03:02:51,964 - DEBUG - VM is in ACTIVE state now 2025-07-31 03:02:51,964 - INFO - VM name : ctest-dst_vm-89929140 2025-07-31 03:02:52,145 - DEBUG - VM ctest-dst_vm-89929140 ID is eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:02:52,321 - DEBUG - VM is in ACTIVE state now 2025-07-31 03:02:52,322 - DEBUG - VM ctest-dst_vm-89929140 launched on Node an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:02:52,456 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:02:52,468 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:02:52,478 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/5224dbbf-45a1-45bb-a835-1f9d756b8418 2025-07-31 03:02:52,490 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:02:52,499 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/5224dbbf-45a1-45bb-a835-1f9d756b8418 2025-07-31 03:02:52,512 - DEBUG - Requesting: http://10.0.0.61:8082/instance-ip/32e922c7-c6d7-44ee-8396-fec1da7044b9 2025-07-31 03:02:52,524 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:02:52,524 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:02:52,535 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/5224dbbf-45a1-45bb-a835-1f9d756b8418 2025-07-31 03:02:52,548 - DEBUG - Requesting: http://10.0.0.61:8082/instance-ip/32e922c7-c6d7-44ee-8396-fec1da7044b9 2025-07-31 03:02:52,558 - INFO - VM ctest-dst_vm-89929140 verfication in all API Servers passed 2025-07-31 03:02:52,589 - DEBUG - VM ctest-dst_vm-89929140 Tap interface: {'index': '3', 'name': 'tap5224dbbf-45', 'uuid': '5224dbbf-45a1-45bb-a835-1f9d756b8418', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053:ctest-vn2-09712053', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'vm_uuid': 'eedc58ef-9469-4cff-91cc-58667a08371c', 'vm_name': 'ctest-dst_vm-89929140', 'ip_addr': '128.210.133.3', 'mac_addr': '02:52:24:db:bf:45', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '14', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-31 03:02:52,589 - DEBUG - Agent 10.0.0.57 vrf name: default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053:ctest-vn2-09712053 2025-07-31 03:02:52,597 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053:ctest-vn2-09712053', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.201:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-07-31 03:02:52,753 - DEBUG - VM ctest-dst_vm-89929140 : Tap interface tap5224dbbf-45 is set to Active 2025-07-31 03:02:52,754 - DEBUG - Tap interface tap5224dbbf-45 detail : {'index': '3', 'name': 'tap5224dbbf-45', 'uuid': '5224dbbf-45a1-45bb-a835-1f9d756b8418', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053:ctest-vn2-09712053', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'vm_uuid': 'eedc58ef-9469-4cff-91cc-58667a08371c', 'vm_name': 'ctest-dst_vm-89929140', 'ip_addr': '128.210.133.3', 'mac_addr': '02:52:24:db:bf:45', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '14', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-31 03:02:52,932 - DEBUG - Starting Layer 2 verification in Agent 2025-07-31 03:02:52,955 - DEBUG - Layer 2 path is seen for VM MAC 02:52:24:db:bf:45 in agent 10.0.0.57 2025-07-31 03:02:52,956 - DEBUG - Active layer 2 route in agent is present for VMI tap5224dbbf-45 2025-07-31 03:02:52,956 - DEBUG - L2 label(29) matches bw route table and interface table 2025-07-31 03:02:52,973 - DEBUG - VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 is found in Agent of node 10.0.0.57 2025-07-31 03:02:53,143 - DEBUG - VRF IDs of VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 is consistent in agent 10.0.0.57 2025-07-31 03:02:53,143 - DEBUG - Route for VM IP ['128.210.133.3'] is consistent in agent 10.0.0.57 2025-07-31 03:02:53,143 - DEBUG - VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 verification for VM ctest-dst_vm-89929140 in Agent 10.0.0.57 passed 2025-07-31 03:02:53,316 - DEBUG - Starting all layer 2 verification in agent 10.0.0.57 2025-07-31 03:02:53,338 - DEBUG - Route for VM MAC 02:52:24:db:bf:45 is consistent in agent 10.0.0.57 2025-07-31 03:02:54,569 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.62 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.39 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.387/2.505/3.623/1.118 ms') 2025-07-31 03:02:54,570 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-dst_vm-89929140 passed 2025-07-31 03:02:54,570 - INFO - VM ctest-dst_vm-89929140 verifications in Compute nodes passed 2025-07-31 03:02:54,916 - DEBUG - Validated VM route 128.210.133.3 in vrouter of 10.0.0.57 2025-07-31 03:02:54,924 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-07-31 03:02:54,924 - INFO - Validated routes of VM ctest-dst_vm-89929140 in all vrouters 2025-07-31 03:02:55,468 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-07-31 03:02:55,642 - DEBUG - Layer2 route found for VM MAC 02:52:24:db:bf:45 in Control-node 10.0.0.38 2025-07-31 03:02:55,642 - DEBUG - L2 Label for VM ctest-dst_vm-89929140 same between Control-node 10.0.0.38 and Agent, Expected: 29, Seen: 29 2025-07-31 03:02:55,642 - DEBUG - Starting all layer2 verification in 10.0.0.61 Control Node 2025-07-31 03:02:55,811 - DEBUG - Layer2 route found for VM MAC 02:52:24:db:bf:45 in Control-node 10.0.0.61 2025-07-31 03:02:55,812 - DEBUG - L2 Label for VM ctest-dst_vm-89929140 same between Control-node 10.0.0.61 and Agent, Expected: 29, Seen: 29 2025-07-31 03:02:55,812 - INFO - Verification in Control-nodes for VM ctest-dst_vm-89929140 passed 2025-07-31 03:02:55,812 - DEBUG - Verifying the vm in opserver 2025-07-31 03:02:55,812 - DEBUG - Verifying in collector 10.0.0.61 ... 2025-07-31 03:02:55,812 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c?flat 2025-07-31 03:02:55,831 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418?flat 2025-07-31 03:02:55,853 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418?flat 2025-07-31 03:02:55,875 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c?flat 2025-07-31 03:02:55,896 - DEBUG - Verifying vm in vn uve 2025-07-31 03:02:55,896 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418?flat 2025-07-31 03:02:55,922 - DEBUG - VM uve shows interface as {'uuid': '5224dbbf-45a1-45bb-a835-1f9d756b8418', 'fixed_ip4_list': ['128.210.133.3'], 'ip4_active': True, 'l2_active': True, '__T': 1753930965801174, 'ip6_active': False, 'vm_uuid': 'eedc58ef-9469-4cff-91cc-58667a08371c', 'gateway': '128.210.133.1', 'vm_name': 'ctest-dst_vm-89929140', 'vhostuser_mode': 0, 'virtual_network': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053', 'ip6_address': '::', 'tx_vlan': 65535, 'active': True, 'admin_state': True, 'label': 25, 'mac_address': '02:52:24:db:bf:45', 'is_health_check_active': True, 'rx_vlan': 65535, 'ip_address': '128.210.133.3', 'vn_uuid': '44b57915-8641-44b1-b3c4-34c5a955f1cf', 'port_mirror_enabled': False} 2025-07-31 03:02:55,922 - DEBUG - VM uve shows ip address as ['128.210.133.3', '::'] 2025-07-31 03:02:55,922 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:02:55,922 - INFO - Verifying through opserver in 10.0.0.41 2025-07-31 03:02:55,923 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053?flat 2025-07-31 03:02:55,945 - DEBUG - expected vm list eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:02:55,945 - DEBUG - Extracted vm list ['eedc58ef-9469-4cff-91cc-58667a08371c'] 2025-07-31 03:02:55,945 - INFO - VM eedc58ef-9469-4cff-91cc-58667a08371c is present in default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:02:55,946 - DEBUG - Verifying vm in vrouter uve 2025-07-31 03:02:55,946 - DEBUG - Getting info from collector 10.0.0.61.. 2025-07-31 03:02:55,946 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c?flat 2025-07-31 03:02:55,963 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3732-2'] 2025-07-31 03:02:55,963 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:02:56,017 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:02:56,061 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:02:56,061 - DEBUG - Validated that VM ctest-dst_vm-89929140 is in Vrouter an-jenkins-deploy-platform-ansible-os-3732-2 UVE 2025-07-31 03:02:56,061 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-07-31 03:02:56,071 - DEBUG - Expected tap interface of VM uuid eedc58ef-9469-4cff-91cc-58667a08371c is default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418 2025-07-31 03:02:56,071 - DEBUG - Expected VN of VM uuid eedc58ef-9469-4cff-91cc-58667a08371c is default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:02:56,071 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:02:56,141 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:02:56,177 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:02:56,178 - INFO - tap interface default-domain:ctest-TestIntfMirror-40773914:5224dbbf-45a1-45bb-a835-1f9d756b8418 of vm eedc58ef-9469-4cff-91cc-58667a08371c is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:02:56,178 - DEBUG - Connected network default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 of vm eedc58ef-9469-4cff-91cc-58667a08371c is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:02:56,178 - DEBUG - Verifying the eedc58ef-9469-4cff-91cc-58667a08371c virtual network link through opserver 10.0.0.41 2025-07-31 03:02:56,178 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-07-31 03:02:56,191 - DEBUG - VM link and name as {'name': 'eedc58ef-9469-4cff-91cc-58667a08371c', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c?flat'} 2025-07-31 03:02:56,191 - DEBUG - Verifying the eedc58ef-9469-4cff-91cc-58667a08371c virtual network link through opserver 10.0.0.38 2025-07-31 03:02:56,191 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-07-31 03:02:56,209 - DEBUG - VM link and name as {'name': 'eedc58ef-9469-4cff-91cc-58667a08371c', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c?flat'} 2025-07-31 03:02:56,209 - DEBUG - Verifying the eedc58ef-9469-4cff-91cc-58667a08371c virtual network link through opserver 10.0.0.61 2025-07-31 03:02:56,209 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-07-31 03:02:56,223 - DEBUG - VM link and name as {'name': 'eedc58ef-9469-4cff-91cc-58667a08371c', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c?flat'} 2025-07-31 03:02:56,223 - INFO - VM ctest-dst_vm-89929140 validations in Opserver passed 2025-07-31 03:02:56,306 - DEBUG - VM is in ACTIVE state now 2025-07-31 03:02:56,306 - INFO - VM name : ctest-analyzer_vm-53857462 2025-07-31 03:02:56,397 - DEBUG - VM ctest-analyzer_vm-53857462 ID is a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:02:56,468 - DEBUG - VM is in ACTIVE state now 2025-07-31 03:02:56,469 - DEBUG - VM ctest-analyzer_vm-53857462 launched on Node an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:02:56,554 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:02:56,565 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:02:56,573 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/a5dc1f2e-babb-434e-9a4c-4bd14284ab46 2025-07-31 03:02:56,583 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:02:56,590 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/a5dc1f2e-babb-434e-9a4c-4bd14284ab46 2025-07-31 03:02:56,601 - DEBUG - Requesting: http://10.0.0.61:8082/instance-ip/90d449fb-f2d0-45c8-8f3f-0c93c39e50c4 2025-07-31 03:02:56,614 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:02:56,614 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:02:56,621 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine-interface/a5dc1f2e-babb-434e-9a4c-4bd14284ab46 2025-07-31 03:02:56,633 - DEBUG - Requesting: http://10.0.0.61:8082/instance-ip/90d449fb-f2d0-45c8-8f3f-0c93c39e50c4 2025-07-31 03:02:56,641 - INFO - VM ctest-analyzer_vm-53857462 verfication in all API Servers passed 2025-07-31 03:02:56,671 - DEBUG - VM ctest-analyzer_vm-53857462 Tap interface: {'index': '4', 'name': 'tapa5dc1f2e-ba', 'uuid': 'a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426:ctest-vn3-59001426', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'vm_uuid': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'vm_name': 'ctest-analyzer_vm-53857462', 'ip_addr': '113.185.24.131', 'mac_addr': '02:a5:dc:1f:2e:ba', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '15', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-31 03:02:56,671 - DEBUG - Agent 10.0.0.57 vrf name: default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426:ctest-vn3-59001426 2025-07-31 03:02:56,677 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426:ctest-vn3-59001426', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.201:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-07-31 03:02:56,806 - DEBUG - VM ctest-analyzer_vm-53857462 : Tap interface tapa5dc1f2e-ba is set to Active 2025-07-31 03:02:56,806 - DEBUG - Tap interface tapa5dc1f2e-ba detail : {'index': '4', 'name': 'tapa5dc1f2e-ba', 'uuid': 'a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426:ctest-vn3-59001426', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'vm_uuid': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'vm_name': 'ctest-analyzer_vm-53857462', 'ip_addr': '113.185.24.131', 'mac_addr': '02:a5:dc:1f:2e:ba', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '15', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-07-31 03:02:56,972 - DEBUG - Starting Layer 2 verification in Agent 2025-07-31 03:02:56,993 - DEBUG - Layer 2 path is seen for VM MAC 02:a5:dc:1f:2e:ba in agent 10.0.0.57 2025-07-31 03:02:56,993 - DEBUG - Active layer 2 route in agent is present for VMI tapa5dc1f2e-ba 2025-07-31 03:02:56,993 - DEBUG - L2 label(36) matches bw route table and interface table 2025-07-31 03:02:57,012 - DEBUG - VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 is found in Agent of node 10.0.0.57 2025-07-31 03:02:57,160 - DEBUG - VRF IDs of VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 is consistent in agent 10.0.0.57 2025-07-31 03:02:57,160 - DEBUG - Route for VM IP ['113.185.24.131'] is consistent in agent 10.0.0.57 2025-07-31 03:02:57,160 - DEBUG - VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 verification for VM ctest-analyzer_vm-53857462 in Agent 10.0.0.57 passed 2025-07-31 03:02:57,330 - DEBUG - Starting all layer 2 verification in agent 10.0.0.57 2025-07-31 03:02:57,346 - DEBUG - Route for VM MAC 02:a5:dc:1f:2e:ba is consistent in agent 10.0.0.57 2025-07-31 03:02:58,584 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.65 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.501 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.501/2.077/3.653/1.576 ms') 2025-07-31 03:02:58,584 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-analyzer_vm-53857462 passed 2025-07-31 03:02:58,585 - INFO - VM ctest-analyzer_vm-53857462 verifications in Compute nodes passed 2025-07-31 03:02:59,000 - DEBUG - Validated VM route 113.185.24.131 in vrouter of 10.0.0.57 2025-07-31 03:02:59,008 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-07-31 03:02:59,008 - INFO - Validated routes of VM ctest-analyzer_vm-53857462 in all vrouters 2025-07-31 03:02:59,587 - DEBUG - Starting all layer2 verification in 10.0.0.38 Control Node 2025-07-31 03:02:59,732 - DEBUG - Layer2 route found for VM MAC 02:a5:dc:1f:2e:ba in Control-node 10.0.0.38 2025-07-31 03:02:59,732 - DEBUG - L2 Label for VM ctest-analyzer_vm-53857462 same between Control-node 10.0.0.38 and Agent, Expected: 36, Seen: 36 2025-07-31 03:02:59,732 - DEBUG - Starting all layer2 verification in 10.0.0.61 Control Node 2025-07-31 03:02:59,913 - DEBUG - Layer2 route found for VM MAC 02:a5:dc:1f:2e:ba in Control-node 10.0.0.61 2025-07-31 03:02:59,913 - DEBUG - L2 Label for VM ctest-analyzer_vm-53857462 same between Control-node 10.0.0.61 and Agent, Expected: 36, Seen: 36 2025-07-31 03:02:59,913 - INFO - Verification in Control-nodes for VM ctest-analyzer_vm-53857462 passed 2025-07-31 03:02:59,913 - DEBUG - Verifying the vm in opserver 2025-07-31 03:02:59,914 - DEBUG - Verifying in collector 10.0.0.61 ... 2025-07-31 03:02:59,914 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5?flat 2025-07-31 03:02:59,929 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46?flat 2025-07-31 03:02:59,951 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46?flat 2025-07-31 03:02:59,970 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5?flat 2025-07-31 03:02:59,986 - DEBUG - Verifying vm in vn uve 2025-07-31 03:02:59,986 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46?flat 2025-07-31 03:03:00,006 - DEBUG - VM uve shows interface as {'uuid': 'a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'fixed_ip4_list': ['113.185.24.131'], 'ip4_active': True, 'l2_active': True, '__T': 1753930965801190, 'ip6_active': False, 'vm_uuid': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'gateway': '113.185.24.129', 'vm_name': 'ctest-analyzer_vm-53857462', 'vhostuser_mode': 0, 'virtual_network': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'ip6_address': '::', 'tx_vlan': 65535, 'active': True, 'admin_state': True, 'label': 32, 'mac_address': '02:a5:dc:1f:2e:ba', 'is_health_check_active': True, 'rx_vlan': 65535, 'ip_address': '113.185.24.131', 'vn_uuid': 'a2a6ce1f-1bc1-4cc4-9f45-e650bb5ae108', 'port_mirror_enabled': False} 2025-07-31 03:03:00,006 - DEBUG - VM uve shows ip address as ['113.185.24.131', '::'] 2025-07-31 03:03:00,006 - DEBUG - VM uve shows virtual network as default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:00,006 - INFO - Verifying through opserver in 10.0.0.41 2025-07-31 03:03:00,007 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426?flat 2025-07-31 03:03:00,027 - DEBUG - expected vm list a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:03:00,027 - DEBUG - Extracted vm list ['a24f209f-0e73-4562-ac37-49029b8e26c5'] 2025-07-31 03:03:00,027 - INFO - VM a24f209f-0e73-4562-ac37-49029b8e26c5 is present in default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:00,028 - DEBUG - Verifying vm in vrouter uve 2025-07-31 03:03:00,028 - DEBUG - Getting info from collector 10.0.0.61.. 2025-07-31 03:03:00,028 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5?flat 2025-07-31 03:03:00,043 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-3732-2'] 2025-07-31 03:03:00,043 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:00,087 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:00,131 - DEBUG - VM a24f209f-0e73-4562-ac37-49029b8e26c5 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:00,132 - DEBUG - Validated that VM ctest-analyzer_vm-53857462 is in Vrouter an-jenkins-deploy-platform-ansible-os-3732-2 UVE 2025-07-31 03:03:00,132 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-07-31 03:03:00,143 - DEBUG - Expected tap interface of VM uuid a24f209f-0e73-4562-ac37-49029b8e26c5 is default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46 2025-07-31 03:03:00,143 - DEBUG - Expected VN of VM uuid a24f209f-0e73-4562-ac37-49029b8e26c5 is default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:00,143 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:00,185 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:00,223 - DEBUG - VM a24f209f-0e73-4562-ac37-49029b8e26c5 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:00,223 - INFO - tap interface default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46 of vm a24f209f-0e73-4562-ac37-49029b8e26c5 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:00,223 - DEBUG - Connected network default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 of vm a24f209f-0e73-4562-ac37-49029b8e26c5 is present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:00,223 - DEBUG - Verifying the a24f209f-0e73-4562-ac37-49029b8e26c5 virtual network link through opserver 10.0.0.41 2025-07-31 03:03:00,224 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-07-31 03:03:00,237 - DEBUG - VM link and name as {'name': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5?flat'} 2025-07-31 03:03:00,237 - DEBUG - Verifying the a24f209f-0e73-4562-ac37-49029b8e26c5 virtual network link through opserver 10.0.0.38 2025-07-31 03:03:00,237 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-07-31 03:03:00,251 - DEBUG - VM link and name as {'name': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5?flat'} 2025-07-31 03:03:00,251 - DEBUG - Verifying the a24f209f-0e73-4562-ac37-49029b8e26c5 virtual network link through opserver 10.0.0.61 2025-07-31 03:03:00,251 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-07-31 03:03:00,264 - DEBUG - VM link and name as {'name': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5?flat'} 2025-07-31 03:03:00,264 - INFO - VM ctest-analyzer_vm-53857462 validations in Opserver passed 2025-07-31 03:03:00,662 - DEBUG - VM has booted up.. 2025-07-31 03:03:01,060 - DEBUG - VM has booted up.. 2025-07-31 03:03:01,200 - DEBUG - VM has booted up.. 2025-07-31 03:03:01,269 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:03:01,381 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:03:01,489 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:01,489 - INFO - Compute/VM: SRC: an-jenkins-deploy-platform-ansible-os-3732-1 / 70.227.123.195, -> DST: an-jenkins-deploy-platform-ansible-os-3732-2 / 128.210.133.3 => ANALYZER: an-jenkins-deploy-platform-ansible-os-3732-2 / 113.185.24.131 2025-07-31 03:03:01,892 - DEBUG - SVM state is active 2025-07-31 03:03:02,081 - DEBUG - svm_obj:'{'manager': , '_info': {'id': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'name': 'ctest-analyzer_vm-53857462', 'status': 'ACTIVE', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'user_id': '8b42f6ebb66341279b1273e574007767', 'metadata': {}, 'hostId': '639930dcc4255cb9e95ea76253aaa5e138e75095545ea88338362ff9', 'image': {'id': 'a8b7157a-eda5-4511-84d1-9dbb73527ae6', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.41:8774/images/a8b7157a-eda5-4511-84d1-9dbb73527ae6'}]}, 'flavor': {'id': 'e1f1aa2e-fae4-483a-8cee-e0bcb93bf81f', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.41:8774/flavors/e1f1aa2e-fae4-483a-8cee-e0bcb93bf81f'}]}, 'created': '2025-07-31T03:02:34Z', 'updated': '2025-07-31T03:02:37Z', 'addresses': {'ctest-vn3-59001426': [{'version': 4, 'addr': '113.185.24.131', 'OS-EXT-IPS:type': 'fixed', 'OS-EXT-IPS-MAC:mac_addr': '02:a5:dc:1f:2e:ba'}]}, 'accessIPv4': '', 'accessIPv6': '', 'links': [{'rel': 'self', 'href': 'http://10.0.0.41:8774/v2.1/servers/a24f209f-0e73-4562-ac37-49029b8e26c5'}, {'rel': 'bookmark', 'href': 'http://10.0.0.41:8774/servers/a24f209f-0e73-4562-ac37-49029b8e26c5'}], 'OS-DCF:diskConfig': 'MANUAL', 'progress': 0, 'OS-EXT-AZ:availability_zone': 'nova', 'config_drive': '', 'key_name': 'ctest_ctest-TestIntfMirror-40773914ctest-TestIntfMirror-40773914key1', 'OS-SRV-USG:launched_at': '2025-07-31T03:02:37.000000', 'OS-SRV-USG:terminated_at': None, 'OS-EXT-SRV-ATTR:host': 'an-jenkins-deploy-platform-ansible-os-3732-2', 'OS-EXT-SRV-ATTR:instance_name': 'instance-00000009', 'OS-EXT-SRV-ATTR:hypervisor_hostname': 'an-jenkins-deploy-platform-ansible-os-3732-2.', 'OS-EXT-STS:task_state': None, 'OS-EXT-STS:vm_state': 'active', 'OS-EXT-STS:power_state': 1, 'os-extended-volumes:volumes_attached': [], 'security_groups': [{'name': 'default'}]}, 'id': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'name': 'ctest-analyzer_vm-53857462', 'status': 'ACTIVE', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'user_id': '8b42f6ebb66341279b1273e574007767', 'metadata': {}, 'hostId': '639930dcc4255cb9e95ea76253aaa5e138e75095545ea88338362ff9', 'image': {'id': 'a8b7157a-eda5-4511-84d1-9dbb73527ae6', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.41:8774/images/a8b7157a-eda5-4511-84d1-9dbb73527ae6'}]}, 'flavor': {'id': 'e1f1aa2e-fae4-483a-8cee-e0bcb93bf81f', 'links': [{'rel': 'bookmark', 'href': 'http://10.0.0.41:8774/flavors/e1f1aa2e-fae4-483a-8cee-e0bcb93bf81f'}]}, 'created': '2025-07-31T03:02:34Z', 'updated': '2025-07-31T03:02:37Z', 'addresses': {'ctest-vn3-59001426': [{'version': 4, 'addr': '113.185.24.131', 'OS-EXT-IPS:type': 'fixed', 'OS-EXT-IPS-MAC:mac_addr': '02:a5:dc:1f:2e:ba'}]}, 'accessIPv4': '', 'accessIPv6': '', 'links': [{'rel': 'self', 'href': 'http://10.0.0.41:8774/v2.1/servers/a24f209f-0e73-4562-ac37-49029b8e26c5'}, {'rel': 'bookmark', 'href': 'http://10.0.0.41:8774/servers/a24f209f-0e73-4562-ac37-49029b8e26c5'}], 'OS-DCF:diskConfig': 'MANUAL', 'progress': 0, 'OS-EXT-AZ:availability_zone': 'nova', 'config_drive': '', 'key_name': 'ctest_ctest-TestIntfMirror-40773914ctest-TestIntfMirror-40773914key1', 'OS-SRV-USG:launched_at': '2025-07-31T03:02:37.000000', 'OS-SRV-USG:terminated_at': None, 'OS-EXT-SRV-ATTR:host': 'an-jenkins-deploy-platform-ansible-os-3732-2', 'OS-EXT-SRV-ATTR:instance_name': 'instance-00000009', 'OS-EXT-SRV-ATTR:hypervisor_hostname': 'an-jenkins-deploy-platform-ansible-os-3732-2.', 'OS-EXT-STS:task_state': None, 'OS-EXT-STS:vm_state': 'active', 'OS-EXT-STS:power_state': 1, 'os-extended-volumes:volumes_attached': [], 'security_groups': [{'name': 'default'}], '_loaded': True, 'x_openstack_request_ids': []}' compute_ip:'10.0.0.57' agent_inspect:'[{'index': '4', 'name': 'tapa5dc1f2e-ba', 'uuid': 'a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'vrf_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426:ctest-vn3-59001426', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '32', 'l2_label': '36', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426', 'vm_uuid': 'a24f209f-0e73-4562-ac37-49029b8e26c5', 'vm_name': 'ctest-analyzer_vm-53857462', 'ip_addr': '113.185.24.131', 'mac_addr': '02:a5:dc:1f:2e:ba', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '15', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestIntfMirror-40773914:a5dc1f2e-babb-434e-9a4c-4bd14284ab46', 'sg_uuid_list': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'static_route_list': None, 'vm_project_uuid': '6b42921d-30ba-4d9b-a14e-460ba13c347f', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}]' 2025-07-31 03:03:02,164 - DEBUG - Executing command: rm -f /tmp/mirror-tapa5dc1f2e-ba_ctest-random-04549769.pcap 2025-07-31 03:03:12,625 - INFO - Starting tcpdump to capture the mirrored packets. 2025-07-31 03:03:12,625 - DEBUG - Executing command: sudo tcpdump -ni tapa5dc1f2e-ba -U udp port 8099 -w /tmp/mirror-tapa5dc1f2e-ba_ctest-random-04549769.pcap 2025-07-31 03:03:22,654 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 03:03:22,654 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-07-31 03:03:22,655 - DEBUG - Running remote_cmd, Cmd : ping -s 1200 -c 5 -W 1 128.210.133.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-07-31 03:03:22,656 - DEBUG - ping -s 1200 -c 5 -W 1 128.210.133.3 2025-07-31 03:03:27,766 - DEBUG - PING 128.210.133.3 (128.210.133.3): 1200 data bytes 1208 bytes from 128.210.133.3: seq=0 ttl=63 time=8.611 ms 1208 bytes from 128.210.133.3: seq=1 ttl=63 time=1.958 ms 1208 bytes from 128.210.133.3: seq=2 ttl=63 time=2.173 ms 1208 bytes from 128.210.133.3: seq=3 ttl=63 time=1.667 ms 1208 bytes from 128.210.133.3: seq=4 ttl=63 time=1.438 ms --- 128.210.133.3 ping statistics --- 5 packets transmitted, 5 packets received, 0% packet loss round-trip min/avg/max = 1.438/3.169/8.611 ms 2025-07-31 03:03:27,766 - INFO - Ping to IP 128.210.133.3 from VM ctest-src_vm-92742463 passed 2025-07-31 03:03:37,767 - INFO - Ping from 70.227.123.195 to 128.210.133.3 executed with c=5, expected mirrored packets 5 Ingress,5 Egress count = 10 2025-07-31 03:03:37,769 - DEBUG - Waiting for the tcpdump write to complete. 2025-07-31 03:03:39,770 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tapa5dc1f2e-ba_ctest-random-04549769.pcap| awk '{print $2}') 2025-07-31 03:03:39,774 - DEBUG - Executing command: sync 2025-07-31 03:03:42,805 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapa5dc1f2e-ba_ctest-random-04549769.pcap | grep "length [1-9][2-9][0-9][0-9][0-9]*" | wc -l 2025-07-31 03:03:42,826 - DEBUG - STDOUT: 10 2025-07-31 03:03:42,827 - DEBUG - STDERR: reading from file /tmp/mirror-tapa5dc1f2e-ba_ctest-random-04549769.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-07-31 03:03:42,827 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapa5dc1f2e-ba_ctest-random-04549769.pcap 2025-07-31 03:03:42,877 - INFO - 10 ICMP packets are mirrored to the analyzer service VM 'ctest-analyzer_vm-53857462' 2025-07-31 03:03:42,878 - INFO - Disabling intf mirroring on sub intf port 2025-07-31 03:03:42,878 - INFO - interface_mirror enabled..disabling it.. 2025-07-31 03:03:42,906 - INFO - Deleting VM ctest-analyzer_vm-53857462 2025-07-31 03:03:43,056 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:03:43,057 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:03:43,072 - DEBUG - VM ID a24f209f-0e73-4562-ac37-49029b8e26c5 of VM ctest-analyzer_vm-53857462 is still found in API Server 2025-07-31 03:03:45,073 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:03:45,073 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:03:45,086 - DEBUG - Response Code: 404 2025-07-31 03:03:45,087 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:03:45,097 - DEBUG - Response Code: 404 2025-07-31 03:03:45,097 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/a24f209f-0e73-4562-ac37-49029b8e26c5 2025-07-31 03:03:45,108 - DEBUG - Response Code: 404 2025-07-31 03:03:45,109 - INFO - VM ctest-analyzer_vm-53857462 is fully removed in API-Server 2025-07-31 03:03:45,307 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-07-31 03:03:45,409 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:45,433 - DEBUG - Validated that vrouter 10.0.0.57 does not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:45,433 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 2025-07-31 03:03:45,433 - INFO - VM ctest-analyzer_vm-53857462 is removed in Compute, and routes are removed in all compute nodes 2025-07-31 03:03:45,786 - INFO - Routes for VM ctest-analyzer_vm-53857462 is removed in all control-nodes 2025-07-31 03:03:45,787 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:45,914 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:45,979 - DEBUG - VM a24f209f-0e73-4562-ac37-49029b8e26c5 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:45,979 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:03:45,980 - DEBUG - interface for vm a24f209f-0e73-4562-ac37-49029b8e26c5 deleted from vrouter uve ... 2025-07-31 03:03:45,980 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:03:45,980 - DEBUG - Validated that VM a24f209f-0e73-4562-ac37-49029b8e26c5 is removed in Vrouter UVE 2025-07-31 03:03:45,980 - DEBUG - Verifying through opserver in 10.0.0.41 2025-07-31 03:03:45,980 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426?flat 2025-07-31 03:03:46,044 - DEBUG - a24f209f-0e73-4562-ac37-49029b8e26c5 BM not in default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-59001426 uve 2025-07-31 03:03:46,044 - DEBUG - Validated that VM a24f209f-0e73-4562-ac37-49029b8e26c5 is not present in the VN UVE 2025-07-31 03:03:46,044 - DEBUG - Verifying the a24f209f-0e73-4562-ac37-49029b8e26c5 virtual network link through opserver 10.0.0.41 2025-07-31 03:03:46,044 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-07-31 03:03:46,073 - INFO - a24f209f-0e73-4562-ac37-49029b8e26c5 vm uve deleted from opserver 2025-07-31 03:03:46,073 - DEBUG - Verifying the a24f209f-0e73-4562-ac37-49029b8e26c5 virtual network link through opserver 10.0.0.38 2025-07-31 03:03:46,073 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-07-31 03:03:46,095 - INFO - a24f209f-0e73-4562-ac37-49029b8e26c5 vm uve deleted from opserver 2025-07-31 03:03:46,095 - DEBUG - Verifying the a24f209f-0e73-4562-ac37-49029b8e26c5 virtual network link through opserver 10.0.0.61 2025-07-31 03:03:46,095 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-07-31 03:03:46,117 - INFO - a24f209f-0e73-4562-ac37-49029b8e26c5 vm uve deleted from opserver 2025-07-31 03:03:46,118 - INFO - Validated that VM a24f209f-0e73-4562-ac37-49029b8e26c5 is removed from Opserver 2025-07-31 03:03:46,118 - INFO - Deleting VM ctest-dst_vm-89929140 2025-07-31 03:03:46,270 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:03:46,271 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:03:46,298 - DEBUG - VM ID eedc58ef-9469-4cff-91cc-58667a08371c of VM ctest-dst_vm-89929140 is still found in API Server 2025-07-31 03:03:48,299 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:03:48,299 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:03:48,309 - DEBUG - Response Code: 404 2025-07-31 03:03:48,309 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:03:48,319 - DEBUG - Response Code: 404 2025-07-31 03:03:48,319 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/eedc58ef-9469-4cff-91cc-58667a08371c 2025-07-31 03:03:48,329 - DEBUG - Response Code: 404 2025-07-31 03:03:48,329 - INFO - VM ctest-dst_vm-89929140 is fully removed in API-Server 2025-07-31 03:03:48,504 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-07-31 03:03:48,565 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:03:48,585 - DEBUG - Validated that vrouter 10.0.0.57 does not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:03:48,585 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 2025-07-31 03:03:48,585 - INFO - VM ctest-dst_vm-89929140 is removed in Compute, and routes are removed in all compute nodes 2025-07-31 03:03:48,931 - INFO - Routes for VM ctest-dst_vm-89929140 is removed in all control-nodes 2025-07-31 03:03:48,931 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:49,048 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:49,111 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:49,112 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:03:49,112 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:03:49,112 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:03:52,113 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:52,189 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:52,244 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:52,244 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:03:52,244 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:03:52,244 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:03:55,245 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:55,366 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:55,420 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:55,420 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:03:55,420 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:03:55,420 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:03:58,421 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:03:58,529 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:03:58,589 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:03:58,589 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:03:58,589 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:03:58,589 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:01,590 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:01,647 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:04:01,692 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:04:01,692 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:01,692 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:04:01,692 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:04,693 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:04,781 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:04:04,820 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:04:04,820 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:04,820 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:04:04,820 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:07,821 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:07,956 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:04:08,073 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:04:08,073 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:08,073 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:04:08,074 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:11,075 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:11,170 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:04:11,233 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:04:11,233 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:11,233 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:04:11,233 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:14,233 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:14,346 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:04:14,408 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is still present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:04:14,408 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:14,408 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:04:14,408 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:17,409 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-2:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:17,532 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-2?flat 2025-07-31 03:04:17,594 - DEBUG - VM eedc58ef-9469-4cff-91cc-58667a08371c is not present in vrouter an-jenkins-deploy-platform-ansible-os-3732-2 uve 2025-07-31 03:04:17,595 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:17,595 - DEBUG - interface for vm eedc58ef-9469-4cff-91cc-58667a08371c deleted from vrouter uve ... 2025-07-31 03:04:17,595 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:17,595 - DEBUG - Validated that VM eedc58ef-9469-4cff-91cc-58667a08371c is removed in Vrouter UVE 2025-07-31 03:04:17,595 - DEBUG - Verifying through opserver in 10.0.0.41 2025-07-31 03:04:17,595 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053?flat 2025-07-31 03:04:17,649 - DEBUG - eedc58ef-9469-4cff-91cc-58667a08371c BM not in default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-09712053 uve 2025-07-31 03:04:17,649 - DEBUG - Validated that VM eedc58ef-9469-4cff-91cc-58667a08371c is not present in the VN UVE 2025-07-31 03:04:17,649 - DEBUG - Verifying the eedc58ef-9469-4cff-91cc-58667a08371c virtual network link through opserver 10.0.0.41 2025-07-31 03:04:17,650 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-07-31 03:04:17,680 - INFO - eedc58ef-9469-4cff-91cc-58667a08371c vm uve deleted from opserver 2025-07-31 03:04:17,681 - DEBUG - Verifying the eedc58ef-9469-4cff-91cc-58667a08371c virtual network link through opserver 10.0.0.38 2025-07-31 03:04:17,681 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-07-31 03:04:17,704 - INFO - eedc58ef-9469-4cff-91cc-58667a08371c vm uve deleted from opserver 2025-07-31 03:04:17,704 - DEBUG - Verifying the eedc58ef-9469-4cff-91cc-58667a08371c virtual network link through opserver 10.0.0.61 2025-07-31 03:04:17,705 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-07-31 03:04:17,727 - INFO - eedc58ef-9469-4cff-91cc-58667a08371c vm uve deleted from opserver 2025-07-31 03:04:17,727 - INFO - Validated that VM eedc58ef-9469-4cff-91cc-58667a08371c is removed from Opserver 2025-07-31 03:04:17,728 - INFO - Deleting VM ctest-src_vm-92742463 2025-07-31 03:04:17,889 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:04:17,889 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:17,905 - DEBUG - VM ID 5e28b289-e095-4af2-9368-2fa8d9f1e411 of VM ctest-src_vm-92742463 is still found in API Server 2025-07-31 03:04:19,906 - DEBUG - Verifying in api server 10.0.0.61 2025-07-31 03:04:19,906 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:19,922 - DEBUG - Response Code: 404 2025-07-31 03:04:19,923 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:19,937 - DEBUG - Response Code: 404 2025-07-31 03:04:19,938 - DEBUG - Requesting: http://10.0.0.61:8082/virtual-machine/5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:19,950 - DEBUG - Response Code: 404 2025-07-31 03:04:19,951 - INFO - VM ctest-src_vm-92742463 is fully removed in API-Server 2025-07-31 03:04:20,149 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-07-31 03:04:20,245 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:04:20,272 - DEBUG - Validated that vrouter 10.0.0.57 does not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:04:20,272 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 2025-07-31 03:04:20,273 - INFO - VM ctest-src_vm-92742463 is removed in Compute, and routes are removed in all compute nodes 2025-07-31 03:04:20,570 - INFO - Routes for VM ctest-src_vm-92742463 is removed in all control-nodes 2025-07-31 03:04:20,570 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3732-1:Compute:contrail-vrouter-agent:0?flat 2025-07-31 03:04:20,687 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3732-1?flat 2025-07-31 03:04:20,749 - DEBUG - VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is not present in vrouter an-jenkins-deploy-platform-ansible-os-3732-1 uve 2025-07-31 03:04:20,749 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-07-31 03:04:20,750 - DEBUG - interface for vm 5e28b289-e095-4af2-9368-2fa8d9f1e411 deleted from vrouter uve ... 2025-07-31 03:04:20,750 - DEBUG - Deleted interface not in error interface list ... 2025-07-31 03:04:20,750 - DEBUG - Validated that VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is removed in Vrouter UVE 2025-07-31 03:04:20,750 - DEBUG - Verifying through opserver in 10.0.0.41 2025-07-31 03:04:20,750 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093?flat 2025-07-31 03:04:20,803 - DEBUG - 5e28b289-e095-4af2-9368-2fa8d9f1e411 BM not in default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-48888093 uve 2025-07-31 03:04:20,803 - DEBUG - Validated that VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is not present in the VN UVE 2025-07-31 03:04:20,803 - DEBUG - Verifying the 5e28b289-e095-4af2-9368-2fa8d9f1e411 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:20,803 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-07-31 03:04:20,827 - DEBUG - No links retuned for 5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:20,827 - INFO - 5e28b289-e095-4af2-9368-2fa8d9f1e411 vm uve deleted from opserver 2025-07-31 03:04:20,827 - DEBUG - Verifying the 5e28b289-e095-4af2-9368-2fa8d9f1e411 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:20,827 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-machines 2025-07-31 03:04:20,852 - DEBUG - No links retuned for 5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:20,853 - INFO - 5e28b289-e095-4af2-9368-2fa8d9f1e411 vm uve deleted from opserver 2025-07-31 03:04:20,853 - DEBUG - Verifying the 5e28b289-e095-4af2-9368-2fa8d9f1e411 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:20,853 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-machines 2025-07-31 03:04:20,878 - DEBUG - No links retuned for 5e28b289-e095-4af2-9368-2fa8d9f1e411 2025-07-31 03:04:20,878 - INFO - 5e28b289-e095-4af2-9368-2fa8d9f1e411 vm uve deleted from opserver 2025-07-31 03:04:20,879 - INFO - Validated that VM 5e28b289-e095-4af2-9368-2fa8d9f1e411 is removed from Opserver 2025-07-31 03:04:20,879 - INFO - Dettaching policy ctest-vn2_vn3_pass-52958506 from vn ctest-vn3-59001426 2025-07-31 03:04:21,148 - INFO - Dettaching policy ctest-vn2_vn3_pass-52958506 from vn ctest-vn2-09712053 2025-07-31 03:04:21,405 - INFO - Dettaching policy ctest-vn1_vn3_pass-45940797 from vn ctest-vn3-59001426 2025-07-31 03:04:21,640 - INFO - Dettaching policy ctest-vn1_vn3_pass-45940797 from vn ctest-vn1-48888093 2025-07-31 03:04:21,892 - INFO - Dettaching policy ctest-vn1_vn2_pass-17452738 from vn ctest-vn2-09712053 2025-07-31 03:04:22,111 - INFO - Dettaching policy ctest-vn1_vn2_pass-17452738 from vn ctest-vn1-48888093 2025-07-31 03:04:22,370 - INFO - Deleted policy ctest-vn2_vn3_pass-52958506 2025-07-31 03:04:22,417 - INFO - Deleted policy ctest-vn1_vn3_pass-45940797 2025-07-31 03:04:22,463 - INFO - Deleted policy ctest-vn1_vn2_pass-17452738 2025-07-31 03:04:22,464 - INFO - Deleting VN ctest-vn3-59001426 2025-07-31 03:04:22,639 - DEBUG - Response for deleting network () 2025-07-31 03:04:22,639 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/db92ac12-43ed-440c-a375-7014e7afb96e 2025-07-31 03:04:22,647 - DEBUG - Response Code: 404 2025-07-31 03:04:22,648 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:22,654 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:22,669 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:22,774 - INFO - Validated that VN ctest-vn3-59001426 is not found in API Server 2025-07-31 03:04:22,787 - DEBUG - VN ctest-vn3-59001426 is not present in Agent 10.0.0.27 2025-07-31 03:04:22,800 - DEBUG - VN ctest-vn3-59001426 is not present in Agent 10.0.0.57 2025-07-31 03:04:22,800 - INFO - Validated that VN ctest-vn3-59001426 is not in any agent 2025-07-31 03:04:22,841 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-59001426 info 2025-07-31 03:04:22,841 - INFO - Deleting VN ctest-vn2-09712053 2025-07-31 03:04:23,033 - DEBUG - Response for deleting network () 2025-07-31 03:04:23,033 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/e15c29a3-b69a-4ade-8c31-337b44e67979 2025-07-31 03:04:23,048 - DEBUG - Response Code: 404 2025-07-31 03:04:23,048 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:23,054 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:23,108 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:23,223 - INFO - Validated that VN ctest-vn2-09712053 is not found in API Server 2025-07-31 03:04:23,238 - DEBUG - VN ctest-vn2-09712053 is not present in Agent 10.0.0.27 2025-07-31 03:04:23,255 - DEBUG - VN ctest-vn2-09712053 is not present in Agent 10.0.0.57 2025-07-31 03:04:23,255 - INFO - Validated that VN ctest-vn2-09712053 is not in any agent 2025-07-31 03:04:23,309 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-09712053 info 2025-07-31 03:04:23,309 - INFO - Deleting VN ctest-vn1-48888093 2025-07-31 03:04:23,498 - DEBUG - Response for deleting network () 2025-07-31 03:04:23,498 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e4c43e2-1e6c-42f1-a451-2f9e21120970 2025-07-31 03:04:23,508 - DEBUG - Response Code: 404 2025-07-31 03:04:23,509 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:23,534 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:23,555 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:23,668 - INFO - Validated that VN ctest-vn1-48888093 is not found in API Server 2025-07-31 03:04:23,686 - DEBUG - VN ctest-vn1-48888093 is not present in Agent 10.0.0.27 2025-07-31 03:04:23,697 - DEBUG - VN ctest-vn1-48888093 is not present in Agent 10.0.0.57 2025-07-31 03:04:23,697 - INFO - Validated that VN ctest-vn1-48888093 is not in any agent 2025-07-31 03:04:23,739 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-48888093 info 2025-07-31 03:04:25,131 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 03:04:25,131 - INFO - END TEST : test_intf_mirror_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 : PASSED[0:02:08] 2025-07-31 03:04:25,132 - INFO - -------------------------------------------------------------------------------- 2025-07-31 03:04:25,143 - INFO - ================================================================================ 2025-07-31 03:04:25,143 - INFO - STARTING TEST : test_intf_mirror_with_subintf_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 2025-07-31 03:04:25,144 - INFO - TEST DESCRIPTION : Validate the interface mirroring src vm, dst vm and analyzer vm on different CNs, all in different VNs when src vmi, dst vmi and analyzer vmi are sub interfaces 2025-07-31 03:04:26,526 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 03:04:26,527 - INFO - Initial checks done. Running the testcase now 2025-07-31 03:04:26,527 - INFO - 2025-07-31 03:04:26,528 - INFO - src compute an-jenkins-deploy-platform-ansible-os-3732-1 -> dst compute an-jenkins-deploy-platform-ansible-os-3732-2 => analyzer compute an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:04:26,894 - DEBUG - Response for create_network : {'network': {'id': '922e4a99-d743-4db2-9d36-3eb083339017', 'name': 'ctest-vn1-79219050', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn1-79219050'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:04:27,120 - DEBUG - Response for create_subnet : {'subnet': {'id': 'cb32c8e2-f24e-416c-be01-1503cd515197', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '922e4a99-d743-4db2-9d36-3eb083339017', 'ip_version': 4, 'cidr': '64.122.79.128/26', 'allocation_pools': [{'start': '64.122.79.130', 'end': '64.122.79.190'}], 'gateway_ip': '64.122.79.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '64.122.79.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:27,139 - INFO - Created VN ctest-vn1-79219050 2025-07-31 03:04:27,151 - DEBUG - VN ctest-vn1-79219050 UUID is 922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,227 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:27,235 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:27,248 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:27,373 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,399 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,413 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/aa776f2d-49cb-403e-b79b-bbda50761384 2025-07-31 03:04:27,432 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/aa776f2d-49cb-403e-b79b-bbda50761384 2025-07-31 03:04:27,444 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/a2795f31-3621-4aed-9d80-c85afa5b651b 2025-07-31 03:04:27,453 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:04:27,453 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,469 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/aa776f2d-49cb-403e-b79b-bbda50761384 2025-07-31 03:04:27,489 - INFO - Verified VN network id 11 for VN 922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,490 - INFO - Verifications in API Server for VN ctest-vn1-79219050 passed 2025-07-31 03:04:27,490 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,503 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/aa776f2d-49cb-403e-b79b-bbda50761384 2025-07-31 03:04:27,512 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/aa776f2d-49cb-403e-b79b-bbda50761384 2025-07-31 03:04:27,523 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/a2795f31-3621-4aed-9d80-c85afa5b651b 2025-07-31 03:04:27,549 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10533438603068132786', 'uuid-lslong': '11328310840533422103'}, 'enable': 'true', 'created': '2025-07-31T03:04:26', 'last-modified': '2025-07-31T03:04:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.469508'} 2025-07-31 03:04:27,563 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:04:27,569 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10533438603068132786', 'uuid-lslong': '11328310840533422103'}, 'enable': 'true', 'created': '2025-07-31T03:04:26', 'last-modified': '2025-07-31T03:04:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487744'} 2025-07-31 03:04:27,575 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:04:27,581 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10533438603068132786', 'uuid-lslong': '11328310840533422103'}, 'enable': 'true', 'created': '2025-07-31T03:04:26', 'last-modified': '2025-07-31T03:04:27', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499251'} 2025-07-31 03:04:27,587 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:04:27,588 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-79219050 passed 2025-07-31 03:04:27,588 - DEBUG - ====Verifying policy data for ctest-vn1-79219050 in API_Server ====== 2025-07-31 03:04:27,588 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:27,594 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:27,607 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:27,728 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/922e4a99-d743-4db2-9d36-3eb083339017 2025-07-31 03:04:27,742 - DEBUG - =>VN ctest-vn1-79219050 has no policy to be verified 2025-07-31 03:04:27,742 - DEBUG - Verifying the vn in opserver 2025-07-31 03:04:27,742 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:27,742 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:04:27,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050?flat'} 2025-07-31 03:04:27,755 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:27,755 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:04:27,769 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050?flat'} 2025-07-31 03:04:27,769 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:27,769 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:04:27,782 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050?flat'} 2025-07-31 03:04:27,783 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050 is found in opserver 2025-07-31 03:04:27,813 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:04:27,827 - DEBUG - VRF ids for VN ctest-vn1-79219050: {} 2025-07-31 03:04:28,135 - DEBUG - Response for create_network : {'network': {'id': 'dfa71cb7-04b6-46e4-86fc-ccc31423b5f2', 'name': 'ctest-vn2-18920373', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn2-18920373'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:04:28,376 - DEBUG - Response for create_subnet : {'subnet': {'id': '93d342cf-7082-4ab5-b001-076b7bba6f88', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'dfa71cb7-04b6-46e4-86fc-ccc31423b5f2', 'ip_version': 4, 'cidr': '11.238.7.128/26', 'allocation_pools': [{'start': '11.238.7.130', 'end': '11.238.7.190'}], 'gateway_ip': '11.238.7.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.238.7.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:28,396 - INFO - Created VN ctest-vn2-18920373 2025-07-31 03:04:28,414 - DEBUG - VN ctest-vn2-18920373 UUID is dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:28,497 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:28,507 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:28,527 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:28,661 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:28,694 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:28,708 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/01474142-9a89-4adc-985d-da0a85e77ed8 2025-07-31 03:04:28,722 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/01474142-9a89-4adc-985d-da0a85e77ed8 2025-07-31 03:04:28,733 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/94b33de3-8865-43c6-a668-2c8ef53b4506 2025-07-31 03:04:28,743 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:04:28,743 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:28,769 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/01474142-9a89-4adc-985d-da0a85e77ed8 2025-07-31 03:04:28,790 - INFO - Verified VN network id 12 for VN dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:28,790 - INFO - Verifications in API Server for VN ctest-vn2-18920373 passed 2025-07-31 03:04:28,790 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:28,808 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/01474142-9a89-4adc-985d-da0a85e77ed8 2025-07-31 03:04:28,823 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/01474142-9a89-4adc-985d-da0a85e77ed8 2025-07-31 03:04:28,834 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/94b33de3-8865-43c6-a668-2c8ef53b4506 2025-07-31 03:04:28,854 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16115881363952256740', 'uuid-lslong': '9726874433442002418'}, 'enable': 'true', 'created': '2025-07-31T03:04:28', 'last-modified': '2025-07-31T03:04:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.533767'} 2025-07-31 03:04:28,865 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:04:28,874 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16115881363952256740', 'uuid-lslong': '9726874433442002418'}, 'enable': 'true', 'created': '2025-07-31T03:04:28', 'last-modified': '2025-07-31T03:04:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.549258'} 2025-07-31 03:04:28,883 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:04:28,890 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16115881363952256740', 'uuid-lslong': '9726874433442002418'}, 'enable': 'true', 'created': '2025-07-31T03:04:28', 'last-modified': '2025-07-31T03:04:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.570135'} 2025-07-31 03:04:28,898 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:04:28,898 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-18920373 passed 2025-07-31 03:04:28,898 - DEBUG - ====Verifying policy data for ctest-vn2-18920373 in API_Server ====== 2025-07-31 03:04:28,898 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:28,910 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:28,933 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:29,092 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/dfa71cb7-04b6-46e4-86fc-ccc31423b5f2 2025-07-31 03:04:29,117 - DEBUG - =>VN ctest-vn2-18920373 has no policy to be verified 2025-07-31 03:04:29,117 - DEBUG - Verifying the vn in opserver 2025-07-31 03:04:29,117 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:29,117 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:04:29,142 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373?flat'} 2025-07-31 03:04:29,142 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:29,142 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:04:29,166 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373?flat'} 2025-07-31 03:04:29,166 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:29,166 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:04:29,188 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373?flat'} 2025-07-31 03:04:29,189 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373 is found in opserver 2025-07-31 03:04:29,237 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:04:29,262 - DEBUG - VRF ids for VN ctest-vn2-18920373: {} 2025-07-31 03:04:29,585 - DEBUG - Response for create_network : {'network': {'id': 'bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98', 'name': 'ctest-vn3-48038929', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn3-48038929'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:04:29,854 - DEBUG - Response for create_subnet : {'subnet': {'id': '07e6b572-0992-4899-96e3-4e97e03c3d17', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98', 'ip_version': 4, 'cidr': '145.180.5.192/26', 'allocation_pools': [{'start': '145.180.5.194', 'end': '145.180.5.254'}], 'gateway_ip': '145.180.5.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '145.180.5.194', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:29,877 - INFO - Created VN ctest-vn3-48038929 2025-07-31 03:04:29,889 - DEBUG - VN ctest-vn3-48038929 UUID is bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:29,968 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:29,976 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:29,991 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:30,116 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:30,134 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:30,148 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/eb5c3f97-c0f1-48f1-b519-5c90438cef66 2025-07-31 03:04:30,159 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/eb5c3f97-c0f1-48f1-b519-5c90438cef66 2025-07-31 03:04:30,173 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/9eb0a86f-90ff-4fb6-b784-42ffdcb5f3e4 2025-07-31 03:04:30,184 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:04:30,184 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:30,203 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/eb5c3f97-c0f1-48f1-b519-5c90438cef66 2025-07-31 03:04:30,237 - INFO - Verified VN network id 13 for VN bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:30,237 - INFO - Verifications in API Server for VN ctest-vn3-48038929 passed 2025-07-31 03:04:30,237 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:30,263 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/eb5c3f97-c0f1-48f1-b519-5c90438cef66 2025-07-31 03:04:30,280 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/eb5c3f97-c0f1-48f1-b519-5c90438cef66 2025-07-31 03:04:30,295 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/9eb0a86f-90ff-4fb6-b784-42ffdcb5f3e4 2025-07-31 03:04:30,328 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13544510784136301579', 'uuid-lslong': '9310705053673073304'}, 'enable': 'true', 'created': '2025-07-31T03:04:29', 'last-modified': '2025-07-31T03:04:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.526957'} 2025-07-31 03:04:30,350 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:04:30,363 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13544510784136301579', 'uuid-lslong': '9310705053673073304'}, 'enable': 'true', 'created': '2025-07-31T03:04:29', 'last-modified': '2025-07-31T03:04:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.558164'} 2025-07-31 03:04:30,375 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:04:30,383 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13544510784136301579', 'uuid-lslong': '9310705053673073304'}, 'enable': 'true', 'created': '2025-07-31T03:04:29', 'last-modified': '2025-07-31T03:04:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.584354'} 2025-07-31 03:04:30,394 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:04:30,394 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-48038929 passed 2025-07-31 03:04:30,394 - DEBUG - ====Verifying policy data for ctest-vn3-48038929 in API_Server ====== 2025-07-31 03:04:30,394 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:30,408 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:30,433 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:30,563 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/bbf7c4cb-d8e4-4c0b-8136-44ea849e2a98 2025-07-31 03:04:30,578 - DEBUG - =>VN ctest-vn3-48038929 has no policy to be verified 2025-07-31 03:04:30,578 - DEBUG - Verifying the vn in opserver 2025-07-31 03:04:30,578 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:30,578 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:04:30,594 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929?flat'} 2025-07-31 03:04:30,595 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:30,595 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:04:30,613 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929?flat'} 2025-07-31 03:04:30,613 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:30,614 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:04:30,631 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929?flat'} 2025-07-31 03:04:30,631 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929 is found in opserver 2025-07-31 03:04:30,666 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:04:30,682 - DEBUG - VRF ids for VN ctest-vn3-48038929: {} 2025-07-31 03:04:30,689 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:04:31,041 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-79219050, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:04:31,390 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-18920373, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-48038929, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:04:31,827 - INFO - Attaching policy ctest-vn1_vn2_pass-96831411 to vn ctest-vn1-79219050 2025-07-31 03:04:32,248 - INFO - Attaching policy ctest-vn1_vn2_pass-96831411 to vn ctest-vn2-18920373 2025-07-31 03:04:32,668 - INFO - Attaching policy ctest-vn1_vn3_pass-90854115 to vn ctest-vn1-79219050 2025-07-31 03:04:33,134 - INFO - Attaching policy ctest-vn1_vn3_pass-90854115 to vn ctest-vn3-48038929 2025-07-31 03:04:33,570 - INFO - Attaching policy ctest-vn2_vn3_pass-77024729 to vn ctest-vn2-18920373 2025-07-31 03:04:34,035 - INFO - Attaching policy ctest-vn2_vn3_pass-77024729 to vn ctest-vn3-48038929 2025-07-31 03:04:34,791 - DEBUG - Response for create_network : {'network': {'id': 'fb9d30eb-5bc7-48c8-ba9d-69bf88c17820', 'name': 'ctest-src_parent_port_vn-28358154', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-src_parent_port_vn-28358154'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:04:35,011 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f3a66329-7cd5-4bcb-8164-3eb8a1d2e8ff', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'fb9d30eb-5bc7-48c8-ba9d-69bf88c17820', 'ip_version': 4, 'cidr': '193.83.184.128/26', 'allocation_pools': [{'start': '193.83.184.130', 'end': '193.83.184.190'}], 'gateway_ip': '193.83.184.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '193.83.184.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:35,031 - INFO - Created VN ctest-src_parent_port_vn-28358154 2025-07-31 03:04:35,044 - DEBUG - VN ctest-src_parent_port_vn-28358154 UUID is fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,129 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:35,137 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:35,153 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:35,278 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,294 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,309 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/90d31716-af2e-4155-86d2-6f31d69ab8c8 2025-07-31 03:04:35,322 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/90d31716-af2e-4155-86d2-6f31d69ab8c8 2025-07-31 03:04:35,333 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/843b2110-e28e-4142-88f4-8afddbf0d174 2025-07-31 03:04:35,344 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:04:35,345 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,362 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/90d31716-af2e-4155-86d2-6f31d69ab8c8 2025-07-31 03:04:35,385 - INFO - Verified VN network id 14 for VN fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,385 - INFO - Verifications in API Server for VN ctest-src_parent_port_vn-28358154 passed 2025-07-31 03:04:35,385 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,402 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/90d31716-af2e-4155-86d2-6f31d69ab8c8 2025-07-31 03:04:35,414 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/90d31716-af2e-4155-86d2-6f31d69ab8c8 2025-07-31 03:04:35,428 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/843b2110-e28e-4142-88f4-8afddbf0d174 2025-07-31 03:04:35,460 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18130701462278719688', 'uuid-lslong': '13447020333752219680'}, 'enable': 'true', 'created': '2025-07-31T03:04:34', 'last-modified': '2025-07-31T03:04:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.513282'} 2025-07-31 03:04:35,477 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:04:35,489 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18130701462278719688', 'uuid-lslong': '13447020333752219680'}, 'enable': 'true', 'created': '2025-07-31T03:04:34', 'last-modified': '2025-07-31T03:04:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.542393'} 2025-07-31 03:04:35,502 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:04:35,513 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18130701462278719688', 'uuid-lslong': '13447020333752219680'}, 'enable': 'true', 'created': '2025-07-31T03:04:34', 'last-modified': '2025-07-31T03:04:34', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.555316'} 2025-07-31 03:04:35,529 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:04:35,530 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-src_parent_port_vn-28358154 passed 2025-07-31 03:04:35,530 - DEBUG - ====Verifying policy data for ctest-src_parent_port_vn-28358154 in API_Server ====== 2025-07-31 03:04:35,530 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:35,547 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:35,583 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:35,712 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/fb9d30eb-5bc7-48c8-ba9d-69bf88c17820 2025-07-31 03:04:35,727 - DEBUG - =>VN ctest-src_parent_port_vn-28358154 has no policy to be verified 2025-07-31 03:04:35,727 - DEBUG - Verifying the vn in opserver 2025-07-31 03:04:35,727 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:35,727 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:04:35,745 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154?flat'} 2025-07-31 03:04:35,745 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:35,745 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:04:35,764 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154?flat'} 2025-07-31 03:04:35,764 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:35,764 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:04:35,784 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154?flat'} 2025-07-31 03:04:35,784 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-28358154 is found in opserver 2025-07-31 03:04:35,824 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:04:35,845 - DEBUG - VRF ids for VN ctest-src_parent_port_vn-28358154: {} 2025-07-31 03:04:35,845 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-48445689']} 2025-07-31 03:04:36,164 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-48445689', 'id': '22b98854-5142-46fb-80d8-2d6b20c84685', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'fb9d30eb-5bc7-48c8-ba9d-69bf88c17820', 'mac_address': '02:22:b9:88:54:51', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '193.83.184.131', 'subnet_id': 'f3a66329-7cd5-4bcb-8164-3eb8a1d2e8ff'}], 'security_groups': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:36,164 - DEBUG - Created port 22b98854-5142-46fb-80d8-2d6b20c84685 2025-07-31 03:04:36,244 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-05241868']} 2025-07-31 03:04:36,741 - DEBUG - Created port 5e2d29d7-414e-4642-a6fc-a6e987785fc6 2025-07-31 03:04:37,284 - DEBUG - Response for create_network : {'network': {'id': 'cd0f6275-2daa-4deb-a53b-f625cab5c0b3', 'name': 'ctest-dst_parent_port_vn-70884227', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-dst_parent_port_vn-70884227'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:04:37,556 - DEBUG - Response for create_subnet : {'subnet': {'id': '291c47e4-126d-4d3f-bd6a-5c90e6f75065', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'cd0f6275-2daa-4deb-a53b-f625cab5c0b3', 'ip_version': 4, 'cidr': '17.247.180.64/26', 'allocation_pools': [{'start': '17.247.180.66', 'end': '17.247.180.126'}], 'gateway_ip': '17.247.180.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '17.247.180.66', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:37,581 - INFO - Created VN ctest-dst_parent_port_vn-70884227 2025-07-31 03:04:37,596 - DEBUG - VN ctest-dst_parent_port_vn-70884227 UUID is cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:37,702 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:37,827 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:37,841 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:37,963 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:37,987 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:38,001 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1e4aec53-d601-4836-a4be-c6196f5f7b46 2025-07-31 03:04:38,012 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1e4aec53-d601-4836-a4be-c6196f5f7b46 2025-07-31 03:04:38,021 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/87c4955f-6db4-4a1c-9313-ab0af86149a5 2025-07-31 03:04:38,030 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:04:38,030 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:38,044 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1e4aec53-d601-4836-a4be-c6196f5f7b46 2025-07-31 03:04:38,063 - INFO - Verified VN network id 15 for VN cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:38,063 - INFO - Verifications in API Server for VN ctest-dst_parent_port_vn-70884227 passed 2025-07-31 03:04:38,063 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:38,076 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1e4aec53-d601-4836-a4be-c6196f5f7b46 2025-07-31 03:04:38,088 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1e4aec53-d601-4836-a4be-c6196f5f7b46 2025-07-31 03:04:38,097 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/87c4955f-6db4-4a1c-9313-ab0af86149a5 2025-07-31 03:04:38,117 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14776137157842718187', 'uuid-lslong': '11906380682059169971'}, 'enable': 'true', 'created': '2025-07-31T03:04:37', 'last-modified': '2025-07-31T03:04:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.615723'} 2025-07-31 03:04:38,124 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:04:38,131 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14776137157842718187', 'uuid-lslong': '11906380682059169971'}, 'enable': 'true', 'created': '2025-07-31T03:04:37', 'last-modified': '2025-07-31T03:04:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.630479'} 2025-07-31 03:04:38,138 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:04:38,144 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14776137157842718187', 'uuid-lslong': '11906380682059169971'}, 'enable': 'true', 'created': '2025-07-31T03:04:37', 'last-modified': '2025-07-31T03:04:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.655122'} 2025-07-31 03:04:38,151 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:04:38,151 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-dst_parent_port_vn-70884227 passed 2025-07-31 03:04:38,151 - DEBUG - ====Verifying policy data for ctest-dst_parent_port_vn-70884227 in API_Server ====== 2025-07-31 03:04:38,151 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:38,158 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:38,170 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:38,297 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/cd0f6275-2daa-4deb-a53b-f625cab5c0b3 2025-07-31 03:04:38,310 - DEBUG - =>VN ctest-dst_parent_port_vn-70884227 has no policy to be verified 2025-07-31 03:04:38,310 - DEBUG - Verifying the vn in opserver 2025-07-31 03:04:38,310 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:38,310 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:04:38,324 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227?flat'} 2025-07-31 03:04:38,324 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:38,324 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:04:38,338 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227?flat'} 2025-07-31 03:04:38,338 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:38,338 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:04:38,352 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227?flat'} 2025-07-31 03:04:38,352 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-70884227 is found in opserver 2025-07-31 03:04:38,382 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:04:38,401 - DEBUG - VRF ids for VN ctest-dst_parent_port_vn-70884227: {} 2025-07-31 03:04:38,401 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-58208912']} 2025-07-31 03:04:38,685 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-58208912', 'id': '064da926-4323-4e7d-8aa6-6a4aae98a6eb', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'cd0f6275-2daa-4deb-a53b-f625cab5c0b3', 'mac_address': '02:06:4d:a9:26:43', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '17.247.180.67', 'subnet_id': '291c47e4-126d-4d3f-bd6a-5c90e6f75065'}], 'security_groups': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:38,685 - DEBUG - Created port 064da926-4323-4e7d-8aa6-6a4aae98a6eb 2025-07-31 03:04:38,762 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-05841866']} 2025-07-31 03:04:39,241 - DEBUG - Created port 3b7f7f73-1e8b-4a1d-b8da-10d098852674 2025-07-31 03:04:39,707 - DEBUG - Response for create_network : {'network': {'id': 'ed77e027-a3fd-4808-b766-c6acf7dd6e74', 'name': 'ctest-analyzer_parent_port_vn-79216737', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-analyzer_parent_port_vn-79216737'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:04:39,997 - DEBUG - Response for create_subnet : {'subnet': {'id': '94756e6a-3d6f-4c36-a2ff-45dcb63b7ac6', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'ed77e027-a3fd-4808-b766-c6acf7dd6e74', 'ip_version': 4, 'cidr': '81.206.92.0/26', 'allocation_pools': [{'start': '81.206.92.2', 'end': '81.206.92.62'}], 'gateway_ip': '81.206.92.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '81.206.92.2', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:40,020 - INFO - Created VN ctest-analyzer_parent_port_vn-79216737 2025-07-31 03:04:40,034 - DEBUG - VN ctest-analyzer_parent_port_vn-79216737 UUID is ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,117 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:40,125 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:40,141 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:40,262 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,278 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,289 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e5c4ab5-c895-43e5-a456-a116b7f79c16 2025-07-31 03:04:40,297 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e5c4ab5-c895-43e5-a456-a116b7f79c16 2025-07-31 03:04:40,313 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ba1e9502-0d6f-44af-af5d-e0f92329b924 2025-07-31 03:04:40,322 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:04:40,322 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,332 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e5c4ab5-c895-43e5-a456-a116b7f79c16 2025-07-31 03:04:40,349 - INFO - Verified VN network id 16 for VN ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,349 - INFO - Verifications in API Server for VN ctest-analyzer_parent_port_vn-79216737 passed 2025-07-31 03:04:40,349 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,361 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e5c4ab5-c895-43e5-a456-a116b7f79c16 2025-07-31 03:04:40,373 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e5c4ab5-c895-43e5-a456-a116b7f79c16 2025-07-31 03:04:40,385 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/ba1e9502-0d6f-44af-af5d-e0f92329b924 2025-07-31 03:04:40,402 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17111391770077120520', 'uuid-lslong': '13215468602760457844'}, 'enable': 'true', 'created': '2025-07-31T03:04:39', 'last-modified': '2025-07-31T03:04:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.473353'} 2025-07-31 03:04:40,410 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:04:40,417 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17111391770077120520', 'uuid-lslong': '13215468602760457844'}, 'enable': 'true', 'created': '2025-07-31T03:04:39', 'last-modified': '2025-07-31T03:04:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.475450'} 2025-07-31 03:04:40,424 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:04:40,431 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17111391770077120520', 'uuid-lslong': '13215468602760457844'}, 'enable': 'true', 'created': '2025-07-31T03:04:39', 'last-modified': '2025-07-31T03:04:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501421'} 2025-07-31 03:04:40,439 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:04:40,439 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-analyzer_parent_port_vn-79216737 passed 2025-07-31 03:04:40,440 - DEBUG - ====Verifying policy data for ctest-analyzer_parent_port_vn-79216737 in API_Server ====== 2025-07-31 03:04:40,440 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:04:40,448 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:04:40,468 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:04:40,582 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/ed77e027-a3fd-4808-b766-c6acf7dd6e74 2025-07-31 03:04:40,592 - DEBUG - =>VN ctest-analyzer_parent_port_vn-79216737 has no policy to be verified 2025-07-31 03:04:40,592 - DEBUG - Verifying the vn in opserver 2025-07-31 03:04:40,592 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737 virtual network link through opserver 10.0.0.41 2025-07-31 03:04:40,592 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:04:40,608 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737?flat'} 2025-07-31 03:04:40,608 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737 virtual network link through opserver 10.0.0.38 2025-07-31 03:04:40,608 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:04:40,623 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737?flat'} 2025-07-31 03:04:40,623 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737 virtual network link through opserver 10.0.0.61 2025-07-31 03:04:40,623 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:04:40,640 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737?flat'} 2025-07-31 03:04:40,640 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-79216737 is found in opserver 2025-07-31 03:04:40,668 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:04:40,682 - DEBUG - VRF ids for VN ctest-analyzer_parent_port_vn-79216737: {} 2025-07-31 03:04:40,682 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-35849211']} 2025-07-31 03:04:40,963 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-35849211', 'id': 'd0402ee4-fb6e-44b3-94eb-9a953c731963', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'ed77e027-a3fd-4808-b766-c6acf7dd6e74', 'mac_address': '02:d0:40:2e:e4:fb', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '81.206.92.3', 'subnet_id': '94756e6a-3d6f-4c36-a2ff-45dcb63b7ac6'}], 'security_groups': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:04:40,964 - DEBUG - Created port d0402ee4-fb6e-44b3-94eb-9a953c731963 2025-07-31 03:04:41,037 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-58764515']} 2025-07-31 03:04:41,493 - DEBUG - Created port cfb3d11a-0264-4181-9d3f-1f9d667ce64a 2025-07-31 03:06:22,438 - DEBUG - Installing image ubuntu 2025-07-31 03:06:22,439 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 03:06:22,439 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:06:22,439 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:06:22,440 - DEBUG - Unzip image 2025-07-31 03:06:22,440 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:06:22,468 - DEBUG - Try to create image in user context 2025-07-31 03:06:22,715 - INFO - Deleted port cfb3d11a-0264-4181-9d3f-1f9d667ce64a 2025-07-31 03:06:22,875 - DEBUG - Response for delete_port : () 2025-07-31 03:06:22,875 - INFO - Deleted port d0402ee4-fb6e-44b3-94eb-9a953c731963 2025-07-31 03:06:22,876 - INFO - Deleting VN ctest-analyzer_parent_port_vn-79216737 2025-07-31 03:06:23,103 - DEBUG - Response for deleting network () 2025-07-31 03:06:23,103 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/0e5c4ab5-c895-43e5-a456-a116b7f79c16 2025-07-31 03:06:23,113 - DEBUG - Response Code: 404 2025-07-31 03:06:23,114 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:23,120 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:23,178 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:23,282 - INFO - Validated that VN ctest-analyzer_parent_port_vn-79216737 is not found in API Server 2025-07-31 03:06:23,296 - DEBUG - VN ctest-analyzer_parent_port_vn-79216737 is not present in Agent 10.0.0.27 2025-07-31 03:06:23,308 - DEBUG - VN ctest-analyzer_parent_port_vn-79216737 is not present in Agent 10.0.0.57 2025-07-31 03:06:23,308 - INFO - Validated that VN ctest-analyzer_parent_port_vn-79216737 is not in any agent 2025-07-31 03:06:23,349 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-analyzer_parent_port_vn-79216737 info 2025-07-31 03:06:23,479 - INFO - Deleted port 3b7f7f73-1e8b-4a1d-b8da-10d098852674 2025-07-31 03:06:23,626 - DEBUG - Response for delete_port : () 2025-07-31 03:06:23,626 - INFO - Deleted port 064da926-4323-4e7d-8aa6-6a4aae98a6eb 2025-07-31 03:06:23,626 - INFO - Deleting VN ctest-dst_parent_port_vn-70884227 2025-07-31 03:06:23,780 - DEBUG - Response for deleting network () 2025-07-31 03:06:23,780 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1e4aec53-d601-4836-a4be-c6196f5f7b46 2025-07-31 03:06:23,786 - DEBUG - Response Code: 404 2025-07-31 03:06:23,786 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:23,793 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:23,812 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:23,927 - INFO - Validated that VN ctest-dst_parent_port_vn-70884227 is not found in API Server 2025-07-31 03:06:23,939 - DEBUG - VN ctest-dst_parent_port_vn-70884227 is not present in Agent 10.0.0.27 2025-07-31 03:06:23,952 - DEBUG - VN ctest-dst_parent_port_vn-70884227 is not present in Agent 10.0.0.57 2025-07-31 03:06:23,952 - INFO - Validated that VN ctest-dst_parent_port_vn-70884227 is not in any agent 2025-07-31 03:06:23,994 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-dst_parent_port_vn-70884227 info 2025-07-31 03:06:24,133 - INFO - Deleted port 5e2d29d7-414e-4642-a6fc-a6e987785fc6 2025-07-31 03:06:24,310 - DEBUG - Response for delete_port : () 2025-07-31 03:06:24,311 - INFO - Deleted port 22b98854-5142-46fb-80d8-2d6b20c84685 2025-07-31 03:06:24,311 - INFO - Deleting VN ctest-src_parent_port_vn-28358154 2025-07-31 03:06:24,568 - DEBUG - Response for deleting network () 2025-07-31 03:06:24,568 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/90d31716-af2e-4155-86d2-6f31d69ab8c8 2025-07-31 03:06:24,575 - DEBUG - Response Code: 404 2025-07-31 03:06:24,575 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:24,582 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:24,596 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:24,714 - INFO - Validated that VN ctest-src_parent_port_vn-28358154 is not found in API Server 2025-07-31 03:06:24,730 - DEBUG - VN ctest-src_parent_port_vn-28358154 is not present in Agent 10.0.0.27 2025-07-31 03:06:24,749 - DEBUG - VN ctest-src_parent_port_vn-28358154 is not present in Agent 10.0.0.57 2025-07-31 03:06:24,749 - INFO - Validated that VN ctest-src_parent_port_vn-28358154 is not in any agent 2025-07-31 03:06:24,806 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-src_parent_port_vn-28358154 info 2025-07-31 03:06:24,806 - INFO - Dettaching policy ctest-vn2_vn3_pass-77024729 from vn ctest-vn3-48038929 2025-07-31 03:06:25,064 - INFO - Dettaching policy ctest-vn2_vn3_pass-77024729 from vn ctest-vn2-18920373 2025-07-31 03:06:25,344 - INFO - Dettaching policy ctest-vn1_vn3_pass-90854115 from vn ctest-vn3-48038929 2025-07-31 03:06:25,556 - INFO - Dettaching policy ctest-vn1_vn3_pass-90854115 from vn ctest-vn1-79219050 2025-07-31 03:06:25,829 - INFO - Dettaching policy ctest-vn1_vn2_pass-96831411 from vn ctest-vn2-18920373 2025-07-31 03:06:26,068 - INFO - Dettaching policy ctest-vn1_vn2_pass-96831411 from vn ctest-vn1-79219050 2025-07-31 03:06:26,317 - INFO - Deleted policy ctest-vn2_vn3_pass-77024729 2025-07-31 03:06:26,364 - INFO - Deleted policy ctest-vn1_vn3_pass-90854115 2025-07-31 03:06:26,408 - INFO - Deleted policy ctest-vn1_vn2_pass-96831411 2025-07-31 03:06:26,408 - INFO - Deleting VN ctest-vn3-48038929 2025-07-31 03:06:26,561 - DEBUG - Response for deleting network () 2025-07-31 03:06:26,561 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/eb5c3f97-c0f1-48f1-b519-5c90438cef66 2025-07-31 03:06:26,568 - DEBUG - Response Code: 404 2025-07-31 03:06:26,568 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:26,574 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:26,602 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:26,707 - INFO - Validated that VN ctest-vn3-48038929 is not found in API Server 2025-07-31 03:06:26,719 - DEBUG - VN ctest-vn3-48038929 is not present in Agent 10.0.0.27 2025-07-31 03:06:26,733 - DEBUG - VN ctest-vn3-48038929 is not present in Agent 10.0.0.57 2025-07-31 03:06:26,733 - INFO - Validated that VN ctest-vn3-48038929 is not in any agent 2025-07-31 03:06:26,770 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-48038929 info 2025-07-31 03:06:26,770 - INFO - Deleting VN ctest-vn2-18920373 2025-07-31 03:06:26,966 - DEBUG - Response for deleting network () 2025-07-31 03:06:26,966 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/01474142-9a89-4adc-985d-da0a85e77ed8 2025-07-31 03:06:26,973 - DEBUG - Response Code: 404 2025-07-31 03:06:26,973 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:26,985 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:27,044 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:27,149 - INFO - Validated that VN ctest-vn2-18920373 is not found in API Server 2025-07-31 03:06:27,167 - DEBUG - VN ctest-vn2-18920373 is not present in Agent 10.0.0.27 2025-07-31 03:06:27,182 - DEBUG - VN ctest-vn2-18920373 is not present in Agent 10.0.0.57 2025-07-31 03:06:27,182 - INFO - Validated that VN ctest-vn2-18920373 is not in any agent 2025-07-31 03:06:27,230 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-18920373 info 2025-07-31 03:06:27,231 - INFO - Deleting VN ctest-vn1-79219050 2025-07-31 03:06:27,430 - DEBUG - Response for deleting network () 2025-07-31 03:06:27,431 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/aa776f2d-49cb-403e-b79b-bbda50761384 2025-07-31 03:06:27,437 - DEBUG - Response Code: 404 2025-07-31 03:06:27,438 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:27,457 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:27,470 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:27,569 - INFO - Validated that VN ctest-vn1-79219050 is not found in API Server 2025-07-31 03:06:27,582 - DEBUG - VN ctest-vn1-79219050 is not present in Agent 10.0.0.27 2025-07-31 03:06:27,594 - DEBUG - VN ctest-vn1-79219050 is not present in Agent 10.0.0.57 2025-07-31 03:06:27,594 - INFO - Validated that VN ctest-vn1-79219050 is not in any agent 2025-07-31 03:06:27,630 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-79219050 info 2025-07-31 03:06:28,987 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 125, in test_intf_mirror_with_subintf_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3
    return self.verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3(sub_intf=True)
  File "/contrail-test/common/intf_mirroring/verify.py", line 85, in verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 03:06:29,011 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 03:06:29,011 - INFO - 2025-07-31 03:06:29,011 - INFO - END TEST : test_intf_mirror_with_subintf_src_cn1vn1_dst_cn2vn2_analyzer_cn3vn3 : FAILED[0:02:04] 2025-07-31 03:06:29,011 - INFO - -------------------------------------------------------------------------------- 2025-07-31 03:06:29,015 - INFO - ================================================================================ 2025-07-31 03:06:29,015 - INFO - STARTING TEST : test_intf_mirroring_disable_enable_scenarios 2025-07-31 03:06:29,015 - INFO - TEST DESCRIPTION : Validate the interface mirroring Validate enable/disable combinations on parent/sub interface 1) Check pkts get mirrored from both sub intf and parent intf when enabled on both 2) Disable on sub intf and check pkts from parent still get mirrored 3) Enable on sub intf and verify step 1 4) Disable on parent and check pkts from sub intf still get mirrored 5) Enable on parent and verify step 1 2025-07-31 03:06:30,382 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 03:06:30,382 - INFO - Initial checks done. Running the testcase now 2025-07-31 03:06:30,382 - INFO - 2025-07-31 03:06:30,383 - INFO - src compute an-jenkins-deploy-platform-ansible-os-3732-1 -> dst compute an-jenkins-deploy-platform-ansible-os-3732-2 => analyzer compute an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:06:30,670 - DEBUG - Response for create_network : {'network': {'id': '3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94', 'name': 'ctest-vn1-31824960', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn1-31824960'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:06:30,867 - DEBUG - Response for create_subnet : {'subnet': {'id': '4aa76340-5a39-4f90-88be-bb9abc05dbe3', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94', 'ip_version': 4, 'cidr': '65.25.65.128/26', 'allocation_pools': [{'start': '65.25.65.130', 'end': '65.25.65.190'}], 'gateway_ip': '65.25.65.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '65.25.65.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:30,890 - INFO - Created VN ctest-vn1-31824960 2025-07-31 03:06:30,901 - DEBUG - VN ctest-vn1-31824960 UUID is 3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:30,974 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:30,980 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:30,995 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:31,121 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:31,134 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:31,147 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4102332a-fe05-49d9-997c-569df7f103ac 2025-07-31 03:06:31,159 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4102332a-fe05-49d9-997c-569df7f103ac 2025-07-31 03:06:31,169 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e8af03ec-213f-4345-adf4-76c3be7263fe 2025-07-31 03:06:31,180 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:06:31,180 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:31,199 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4102332a-fe05-49d9-997c-569df7f103ac 2025-07-31 03:06:31,226 - INFO - Verified VN network id 11 for VN 3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:31,227 - INFO - Verifications in API Server for VN ctest-vn1-31824960 passed 2025-07-31 03:06:31,227 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:31,249 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4102332a-fe05-49d9-997c-569df7f103ac 2025-07-31 03:06:31,266 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4102332a-fe05-49d9-997c-569df7f103ac 2025-07-31 03:06:31,282 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/e8af03ec-213f-4345-adf4-76c3be7263fe 2025-07-31 03:06:31,311 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4502092154482741212', 'uuid-lslong': '9595419103783971732'}, 'enable': 'true', 'created': '2025-07-31T03:06:30', 'last-modified': '2025-07-31T03:06:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.498911'} 2025-07-31 03:06:31,326 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:06:31,335 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4502092154482741212', 'uuid-lslong': '9595419103783971732'}, 'enable': 'true', 'created': '2025-07-31T03:06:30', 'last-modified': '2025-07-31T03:06:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.523084'} 2025-07-31 03:06:31,344 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:06:31,354 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4502092154482741212', 'uuid-lslong': '9595419103783971732'}, 'enable': 'true', 'created': '2025-07-31T03:06:30', 'last-modified': '2025-07-31T03:06:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.541249'} 2025-07-31 03:06:31,364 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:06:31,365 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-31824960 passed 2025-07-31 03:06:31,365 - DEBUG - ====Verifying policy data for ctest-vn1-31824960 in API_Server ====== 2025-07-31 03:06:31,365 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:31,379 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:31,418 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:31,568 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/3e7aa4f6-1e04-4fdc-8529-c6d6100a6b94 2025-07-31 03:06:31,588 - DEBUG - =>VN ctest-vn1-31824960 has no policy to be verified 2025-07-31 03:06:31,588 - DEBUG - Verifying the vn in opserver 2025-07-31 03:06:31,588 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960 virtual network link through opserver 10.0.0.41 2025-07-31 03:06:31,588 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:06:31,607 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960?flat'} 2025-07-31 03:06:31,607 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960 virtual network link through opserver 10.0.0.38 2025-07-31 03:06:31,607 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:06:31,626 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960?flat'} 2025-07-31 03:06:31,626 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960 virtual network link through opserver 10.0.0.61 2025-07-31 03:06:31,626 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:06:31,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960?flat'} 2025-07-31 03:06:31,644 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960 is found in opserver 2025-07-31 03:06:31,683 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:06:31,710 - DEBUG - VRF ids for VN ctest-vn1-31824960: {} 2025-07-31 03:06:32,035 - DEBUG - Response for create_network : {'network': {'id': '1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385', 'name': 'ctest-vn2-05866454', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn2-05866454'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:06:32,256 - DEBUG - Response for create_subnet : {'subnet': {'id': '27b2e013-e3a5-4b96-874c-57bd0593a387', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385', 'ip_version': 4, 'cidr': '20.59.189.0/26', 'allocation_pools': [{'start': '20.59.189.2', 'end': '20.59.189.62'}], 'gateway_ip': '20.59.189.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '20.59.189.2', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:32,277 - INFO - Created VN ctest-vn2-05866454 2025-07-31 03:06:32,291 - DEBUG - VN ctest-vn2-05866454 UUID is 1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,365 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:32,376 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:32,391 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:32,498 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,517 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,532 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1ac8eced-8265-42ea-8058-345619881e3c 2025-07-31 03:06:32,544 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1ac8eced-8265-42ea-8058-345619881e3c 2025-07-31 03:06:32,558 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d941db44-ac72-420f-a4db-b97392ae14c4 2025-07-31 03:06:32,573 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:06:32,573 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,588 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1ac8eced-8265-42ea-8058-345619881e3c 2025-07-31 03:06:32,612 - INFO - Verified VN network id 12 for VN 1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,612 - INFO - Verifications in API Server for VN ctest-vn2-05866454 passed 2025-07-31 03:06:32,612 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,627 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1ac8eced-8265-42ea-8058-345619881e3c 2025-07-31 03:06:32,637 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1ac8eced-8265-42ea-8058-345619881e3c 2025-07-31 03:06:32,645 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d941db44-ac72-420f-a4db-b97392ae14c4 2025-07-31 03:06:32,666 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2293414140230650787', 'uuid-lslong': '10036826105652368261'}, 'enable': 'true', 'created': '2025-07-31T03:06:31', 'last-modified': '2025-07-31T03:06:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476328'} 2025-07-31 03:06:32,673 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:06:32,681 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2293414140230650787', 'uuid-lslong': '10036826105652368261'}, 'enable': 'true', 'created': '2025-07-31T03:06:31', 'last-modified': '2025-07-31T03:06:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487681'} 2025-07-31 03:06:32,692 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:06:32,699 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2293414140230650787', 'uuid-lslong': '10036826105652368261'}, 'enable': 'true', 'created': '2025-07-31T03:06:31', 'last-modified': '2025-07-31T03:06:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.507169'} 2025-07-31 03:06:32,708 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:06:32,708 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-05866454 passed 2025-07-31 03:06:32,708 - DEBUG - ====Verifying policy data for ctest-vn2-05866454 in API_Server ====== 2025-07-31 03:06:32,708 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:32,716 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:32,730 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:32,859 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/1fd3d802-6f4e-4ba3-8b49-f82a6bc6d385 2025-07-31 03:06:32,879 - DEBUG - =>VN ctest-vn2-05866454 has no policy to be verified 2025-07-31 03:06:32,879 - DEBUG - Verifying the vn in opserver 2025-07-31 03:06:32,879 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454 virtual network link through opserver 10.0.0.41 2025-07-31 03:06:32,879 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:06:32,896 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454?flat'} 2025-07-31 03:06:32,896 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454 virtual network link through opserver 10.0.0.38 2025-07-31 03:06:32,896 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:06:32,912 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454?flat'} 2025-07-31 03:06:32,912 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454 virtual network link through opserver 10.0.0.61 2025-07-31 03:06:32,912 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:06:32,935 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454?flat'} 2025-07-31 03:06:32,935 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454 is found in opserver 2025-07-31 03:06:32,977 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:06:32,999 - DEBUG - VRF ids for VN ctest-vn2-05866454: {} 2025-07-31 03:06:33,310 - DEBUG - Response for create_network : {'network': {'id': 'e2e8fc0b-5d23-4bc3-afd1-29800bfee95c', 'name': 'ctest-vn3-81591458', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn3-81591458'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:06:33,540 - DEBUG - Response for create_subnet : {'subnet': {'id': 'b345c2c5-fb3d-45b5-af3d-07b60bd7e092', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'e2e8fc0b-5d23-4bc3-afd1-29800bfee95c', 'ip_version': 4, 'cidr': '30.88.207.64/26', 'allocation_pools': [{'start': '30.88.207.66', 'end': '30.88.207.126'}], 'gateway_ip': '30.88.207.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.88.207.66', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:33,561 - INFO - Created VN ctest-vn3-81591458 2025-07-31 03:06:33,573 - DEBUG - VN ctest-vn3-81591458 UUID is e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:33,660 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:33,669 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:33,685 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:33,801 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:33,826 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:33,846 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d919bf85-1102-4add-9e84-493dabbd04d5 2025-07-31 03:06:33,863 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d919bf85-1102-4add-9e84-493dabbd04d5 2025-07-31 03:06:33,878 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4694950e-48f3-42ab-8bc1-37663855a391 2025-07-31 03:06:33,893 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:06:33,893 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:33,912 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d919bf85-1102-4add-9e84-493dabbd04d5 2025-07-31 03:06:33,939 - INFO - Verified VN network id 13 for VN e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:33,939 - INFO - Verifications in API Server for VN ctest-vn3-81591458 passed 2025-07-31 03:06:33,939 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:33,963 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d919bf85-1102-4add-9e84-493dabbd04d5 2025-07-31 03:06:33,985 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d919bf85-1102-4add-9e84-493dabbd04d5 2025-07-31 03:06:34,004 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/4694950e-48f3-42ab-8bc1-37663855a391 2025-07-31 03:06:34,041 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16350595572906019779', 'uuid-lslong': '12668952856703723868'}, 'enable': 'true', 'created': '2025-07-31T03:06:33', 'last-modified': '2025-07-31T03:06:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.550825'} 2025-07-31 03:06:34,060 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:06:34,072 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16350595572906019779', 'uuid-lslong': '12668952856703723868'}, 'enable': 'true', 'created': '2025-07-31T03:06:33', 'last-modified': '2025-07-31T03:06:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.585406'} 2025-07-31 03:06:34,084 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:06:34,095 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '16350595572906019779', 'uuid-lslong': '12668952856703723868'}, 'enable': 'true', 'created': '2025-07-31T03:06:33', 'last-modified': '2025-07-31T03:06:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.608565'} 2025-07-31 03:06:34,107 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:06:34,107 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-81591458 passed 2025-07-31 03:06:34,108 - DEBUG - ====Verifying policy data for ctest-vn3-81591458 in API_Server ====== 2025-07-31 03:06:34,108 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:34,121 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:34,146 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:34,300 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/e2e8fc0b-5d23-4bc3-afd1-29800bfee95c 2025-07-31 03:06:34,320 - DEBUG - =>VN ctest-vn3-81591458 has no policy to be verified 2025-07-31 03:06:34,320 - DEBUG - Verifying the vn in opserver 2025-07-31 03:06:34,320 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458 virtual network link through opserver 10.0.0.41 2025-07-31 03:06:34,320 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:06:34,342 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458?flat'} 2025-07-31 03:06:34,342 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458 virtual network link through opserver 10.0.0.38 2025-07-31 03:06:34,342 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:06:34,361 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458?flat'} 2025-07-31 03:06:34,361 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458 virtual network link through opserver 10.0.0.61 2025-07-31 03:06:34,362 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:06:34,378 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458?flat'} 2025-07-31 03:06:34,378 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458 is found in opserver 2025-07-31 03:06:34,410 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:06:34,426 - DEBUG - VRF ids for VN ctest-vn3-81591458: {} 2025-07-31 03:06:34,435 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:06:34,805 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-31824960, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:06:35,162 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-05866454, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:06:35,554 - INFO - Attaching policy ctest-vn1_vn2_pass-59717672 to vn ctest-vn1-31824960 2025-07-31 03:06:35,953 - INFO - Attaching policy ctest-vn1_vn2_pass-59717672 to vn ctest-vn2-05866454 2025-07-31 03:06:36,364 - INFO - Attaching policy ctest-vn1_vn3_pass-76474009 to vn ctest-vn1-31824960 2025-07-31 03:06:36,786 - INFO - Attaching policy ctest-vn1_vn3_pass-76474009 to vn ctest-vn3-81591458 2025-07-31 03:06:37,211 - INFO - Attaching policy ctest-vn2_vn3_pass-76247785 to vn ctest-vn2-05866454 2025-07-31 03:06:37,669 - INFO - Attaching policy ctest-vn2_vn3_pass-76247785 to vn ctest-vn3-81591458 2025-07-31 03:06:38,340 - DEBUG - Response for create_network : {'network': {'id': 'b2887c5e-5547-4e28-a1f0-f1d43bf3149c', 'name': 'ctest-src_parent_port_vn-71269764', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-src_parent_port_vn-71269764'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:06:38,575 - DEBUG - Response for create_subnet : {'subnet': {'id': '2bf8fa53-0935-42e1-ad4b-332bb7c69b0d', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'b2887c5e-5547-4e28-a1f0-f1d43bf3149c', 'ip_version': 4, 'cidr': '177.182.170.128/26', 'allocation_pools': [{'start': '177.182.170.130', 'end': '177.182.170.190'}], 'gateway_ip': '177.182.170.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '177.182.170.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:38,595 - INFO - Created VN ctest-src_parent_port_vn-71269764 2025-07-31 03:06:38,610 - DEBUG - VN ctest-src_parent_port_vn-71269764 UUID is b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:38,695 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:38,702 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:38,718 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:38,825 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:38,847 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:38,857 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3554166e-1d78-43e7-a1ca-f3510e80fbba 2025-07-31 03:06:38,866 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3554166e-1d78-43e7-a1ca-f3510e80fbba 2025-07-31 03:06:38,875 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5646675d-a6ed-4d10-91dd-dc54ccde7ba9 2025-07-31 03:06:38,883 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:06:38,883 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:38,895 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3554166e-1d78-43e7-a1ca-f3510e80fbba 2025-07-31 03:06:38,913 - INFO - Verified VN network id 14 for VN b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:38,913 - INFO - Verifications in API Server for VN ctest-src_parent_port_vn-71269764 passed 2025-07-31 03:06:38,913 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:38,926 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3554166e-1d78-43e7-a1ca-f3510e80fbba 2025-07-31 03:06:38,936 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3554166e-1d78-43e7-a1ca-f3510e80fbba 2025-07-31 03:06:38,949 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5646675d-a6ed-4d10-91dd-dc54ccde7ba9 2025-07-31 03:06:38,970 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12864669080183328296', 'uuid-lslong': '11669092528358102172'}, 'enable': 'true', 'created': '2025-07-31T03:06:38', 'last-modified': '2025-07-31T03:06:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.456971'} 2025-07-31 03:06:38,984 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:06:38,994 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12864669080183328296', 'uuid-lslong': '11669092528358102172'}, 'enable': 'true', 'created': '2025-07-31T03:06:38', 'last-modified': '2025-07-31T03:06:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467250'} 2025-07-31 03:06:39,005 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:06:39,015 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12864669080183328296', 'uuid-lslong': '11669092528358102172'}, 'enable': 'true', 'created': '2025-07-31T03:06:38', 'last-modified': '2025-07-31T03:06:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.501515'} 2025-07-31 03:06:39,026 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-31 03:06:39,026 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-src_parent_port_vn-71269764 passed 2025-07-31 03:06:39,026 - DEBUG - ====Verifying policy data for ctest-src_parent_port_vn-71269764 in API_Server ====== 2025-07-31 03:06:39,026 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:39,035 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:39,050 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:39,173 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b2887c5e-5547-4e28-a1f0-f1d43bf3149c 2025-07-31 03:06:39,193 - DEBUG - =>VN ctest-src_parent_port_vn-71269764 has no policy to be verified 2025-07-31 03:06:39,193 - DEBUG - Verifying the vn in opserver 2025-07-31 03:06:39,193 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764 virtual network link through opserver 10.0.0.41 2025-07-31 03:06:39,193 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:06:39,212 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764?flat'} 2025-07-31 03:06:39,212 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764 virtual network link through opserver 10.0.0.38 2025-07-31 03:06:39,212 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:06:39,235 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764?flat'} 2025-07-31 03:06:39,235 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764 virtual network link through opserver 10.0.0.61 2025-07-31 03:06:39,235 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:06:39,256 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764?flat'} 2025-07-31 03:06:39,256 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764 is found in opserver 2025-07-31 03:06:39,304 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:06:39,322 - DEBUG - VRF ids for VN ctest-src_parent_port_vn-71269764: {} 2025-07-31 03:06:39,323 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-85358803']} 2025-07-31 03:06:39,652 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-85358803', 'id': 'bfe1ffde-335a-46c8-9d43-56801ebe9cb2', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'b2887c5e-5547-4e28-a1f0-f1d43bf3149c', 'mac_address': '02:bf:e1:ff:de:33', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '177.182.170.131', 'subnet_id': '2bf8fa53-0935-42e1-ad4b-332bb7c69b0d'}], 'security_groups': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:39,652 - DEBUG - Created port bfe1ffde-335a-46c8-9d43-56801ebe9cb2 2025-07-31 03:06:39,733 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-35549330']} 2025-07-31 03:06:40,221 - DEBUG - Created port cca0da61-d309-4b38-a598-383c11b9e233 2025-07-31 03:06:40,776 - DEBUG - Response for create_network : {'network': {'id': 'd7f48996-1ada-4e82-8cf7-1080c6526b91', 'name': 'ctest-dst_parent_port_vn-95516242', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-dst_parent_port_vn-95516242'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:06:41,026 - DEBUG - Response for create_subnet : {'subnet': {'id': '6c74f394-8b79-45cd-b282-e7d274c72174', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'd7f48996-1ada-4e82-8cf7-1080c6526b91', 'ip_version': 4, 'cidr': '218.203.31.0/26', 'allocation_pools': [{'start': '218.203.31.2', 'end': '218.203.31.62'}], 'gateway_ip': '218.203.31.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '218.203.31.2', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:41,051 - INFO - Created VN ctest-dst_parent_port_vn-95516242 2025-07-31 03:06:41,063 - DEBUG - VN ctest-dst_parent_port_vn-95516242 UUID is d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,158 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:41,168 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:41,184 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:41,295 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,313 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,330 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/b1c86202-62dd-44c1-9c71-d968011aad00 2025-07-31 03:06:41,344 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/b1c86202-62dd-44c1-9c71-d968011aad00 2025-07-31 03:06:41,355 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/64a27218-8bc4-401b-8eee-70c28e951804 2025-07-31 03:06:41,364 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:06:41,364 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,375 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/b1c86202-62dd-44c1-9c71-d968011aad00 2025-07-31 03:06:41,393 - INFO - Verified VN network id 15 for VN d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,393 - INFO - Verifications in API Server for VN ctest-dst_parent_port_vn-95516242 passed 2025-07-31 03:06:41,393 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,411 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/b1c86202-62dd-44c1-9c71-d968011aad00 2025-07-31 03:06:41,424 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/b1c86202-62dd-44c1-9c71-d968011aad00 2025-07-31 03:06:41,438 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/64a27218-8bc4-401b-8eee-70c28e951804 2025-07-31 03:06:41,461 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15561213890260520578', 'uuid-lslong': '10157605629826591633'}, 'enable': 'true', 'created': '2025-07-31T03:06:40', 'last-modified': '2025-07-31T03:06:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492388'} 2025-07-31 03:06:41,474 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:06:41,482 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15561213890260520578', 'uuid-lslong': '10157605629826591633'}, 'enable': 'true', 'created': '2025-07-31T03:06:40', 'last-modified': '2025-07-31T03:06:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.514612'} 2025-07-31 03:06:41,492 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:06:41,500 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15561213890260520578', 'uuid-lslong': '10157605629826591633'}, 'enable': 'true', 'created': '2025-07-31T03:06:40', 'last-modified': '2025-07-31T03:06:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.528155'} 2025-07-31 03:06:41,509 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-31 03:06:41,509 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-dst_parent_port_vn-95516242 passed 2025-07-31 03:06:41,509 - DEBUG - ====Verifying policy data for ctest-dst_parent_port_vn-95516242 in API_Server ====== 2025-07-31 03:06:41,510 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:41,523 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:41,555 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:41,709 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/d7f48996-1ada-4e82-8cf7-1080c6526b91 2025-07-31 03:06:41,723 - DEBUG - =>VN ctest-dst_parent_port_vn-95516242 has no policy to be verified 2025-07-31 03:06:41,723 - DEBUG - Verifying the vn in opserver 2025-07-31 03:06:41,723 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242 virtual network link through opserver 10.0.0.41 2025-07-31 03:06:41,723 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:06:41,739 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242?flat'} 2025-07-31 03:06:41,739 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242 virtual network link through opserver 10.0.0.38 2025-07-31 03:06:41,740 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:06:41,755 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242?flat'} 2025-07-31 03:06:41,755 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242 virtual network link through opserver 10.0.0.61 2025-07-31 03:06:41,755 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:06:41,778 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242?flat'} 2025-07-31 03:06:41,778 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242 is found in opserver 2025-07-31 03:06:41,820 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:06:41,837 - DEBUG - VRF ids for VN ctest-dst_parent_port_vn-95516242: {} 2025-07-31 03:06:41,838 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-00717539']} 2025-07-31 03:06:42,218 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-00717539', 'id': '5e5de810-fb12-49bb-99e7-16844f940e35', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'd7f48996-1ada-4e82-8cf7-1080c6526b91', 'mac_address': '02:5e:5d:e8:10:fb', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '218.203.31.3', 'subnet_id': '6c74f394-8b79-45cd-b282-e7d274c72174'}], 'security_groups': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:42,218 - DEBUG - Created port 5e5de810-fb12-49bb-99e7-16844f940e35 2025-07-31 03:06:42,300 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-07580883']} 2025-07-31 03:06:42,797 - DEBUG - Created port f5f7398f-84f0-4064-a6ab-a3075f27674a 2025-07-31 03:06:43,265 - DEBUG - Response for create_network : {'network': {'id': '81a38197-3812-40e8-9828-5b78c5dfe041', 'name': 'ctest-analyzer_parent_port_vn-17397128', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-analyzer_parent_port_vn-17397128'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:06:43,561 - DEBUG - Response for create_subnet : {'subnet': {'id': '0ebaea9c-5895-47cd-86dc-136ea440ab60', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '81a38197-3812-40e8-9828-5b78c5dfe041', 'ip_version': 4, 'cidr': '70.136.221.0/26', 'allocation_pools': [{'start': '70.136.221.2', 'end': '70.136.221.62'}], 'gateway_ip': '70.136.221.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '70.136.221.2', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:43,583 - INFO - Created VN ctest-analyzer_parent_port_vn-17397128 2025-07-31 03:06:43,601 - DEBUG - VN ctest-analyzer_parent_port_vn-17397128 UUID is 81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:43,685 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:43,693 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:43,709 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:43,832 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:43,859 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:43,879 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2614b251-fef4-4a03-9cc9-07621dbd2c04 2025-07-31 03:06:43,897 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2614b251-fef4-4a03-9cc9-07621dbd2c04 2025-07-31 03:06:43,916 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/8fd719cf-1104-46cf-b318-a6826ad9556e 2025-07-31 03:06:43,937 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:06:43,937 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:43,969 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2614b251-fef4-4a03-9cc9-07621dbd2c04 2025-07-31 03:06:44,003 - INFO - Verified VN network id 16 for VN 81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:44,004 - INFO - Verifications in API Server for VN ctest-analyzer_parent_port_vn-17397128 passed 2025-07-31 03:06:44,004 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:44,033 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2614b251-fef4-4a03-9cc9-07621dbd2c04 2025-07-31 03:06:44,051 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2614b251-fef4-4a03-9cc9-07621dbd2c04 2025-07-31 03:06:44,071 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/8fd719cf-1104-46cf-b318-a6826ad9556e 2025-07-31 03:06:44,104 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9341452538577305832', 'uuid-lslong': '10964113867107459137'}, 'enable': 'true', 'created': '2025-07-31T03:06:43', 'last-modified': '2025-07-31T03:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.600973'} 2025-07-31 03:06:44,119 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:06:44,129 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9341452538577305832', 'uuid-lslong': '10964113867107459137'}, 'enable': 'true', 'created': '2025-07-31T03:06:43', 'last-modified': '2025-07-31T03:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.626262'} 2025-07-31 03:06:44,141 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:06:44,152 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9341452538577305832', 'uuid-lslong': '10964113867107459137'}, 'enable': 'true', 'created': '2025-07-31T03:06:43', 'last-modified': '2025-07-31T03:06:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.650317'} 2025-07-31 03:06:44,161 - DEBUG - Route Targets: ['target:64512:8000010'] 2025-07-31 03:06:44,162 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-analyzer_parent_port_vn-17397128 passed 2025-07-31 03:06:44,162 - DEBUG - ====Verifying policy data for ctest-analyzer_parent_port_vn-17397128 in API_Server ====== 2025-07-31 03:06:44,162 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:06:44,176 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:06:44,206 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:06:44,371 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/81a38197-3812-40e8-9828-5b78c5dfe041 2025-07-31 03:06:44,386 - DEBUG - =>VN ctest-analyzer_parent_port_vn-17397128 has no policy to be verified 2025-07-31 03:06:44,386 - DEBUG - Verifying the vn in opserver 2025-07-31 03:06:44,386 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128 virtual network link through opserver 10.0.0.41 2025-07-31 03:06:44,386 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:06:44,408 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128?flat'} 2025-07-31 03:06:44,408 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128 virtual network link through opserver 10.0.0.38 2025-07-31 03:06:44,408 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:06:44,424 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128?flat'} 2025-07-31 03:06:44,424 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128 virtual network link through opserver 10.0.0.61 2025-07-31 03:06:44,424 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:06:44,440 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128?flat'} 2025-07-31 03:06:44,440 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-analyzer_parent_port_vn-17397128 is found in opserver 2025-07-31 03:06:44,472 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:06:44,490 - DEBUG - VRF ids for VN ctest-analyzer_parent_port_vn-17397128: {} 2025-07-31 03:06:44,490 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-98102322']} 2025-07-31 03:06:44,795 - DEBUG - Response for create_port : {'port': {'name': 'ctest-vmi-98102322', 'id': 'f33617b7-7ff1-4382-be50-6113b69b2bbe', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '81a38197-3812-40e8-9828-5b78c5dfe041', 'mac_address': '02:f3:36:17:b7:7f', 'binding:vnic_type': 'normal', 'binding:vif_details': {'port_filter': True}, 'binding:vif_type': 'unbound', 'binding:host_id': None, 'allowed_address_pairs': [], 'fixed_ips': [{'ip_address': '70.136.221.3', 'subnet_id': '0ebaea9c-5895-47cd-86dc-136ea440ab60'}], 'security_groups': ['7d6b52e4-3681-487c-b991-16cff279063d'], 'admin_state_up': True, 'device_id': '', 'device_owner': '', 'status': 'DOWN', 'port_security_enabled': True, 'description': '', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:06:44,795 - DEBUG - Created port f33617b7-7ff1-4382-be50-6113b69b2bbe 2025-07-31 03:06:44,863 - DEBUG - Read virtual machine interface {'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vmi-82475331']} 2025-07-31 03:06:45,337 - DEBUG - Created port bbfaa4d6-3043-4bc6-9c64-2f79fb2299af 2025-07-31 03:06:45,502 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:06:45,813 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-81591458, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:06:46,109 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-src_parent_port_vn-71269764, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-dst_parent_port_vn-95516242, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:06:46,520 - INFO - Attaching policy ctest-src_parent_to_analyzer_pass-92704384 to vn ctest-vn3-81591458 2025-07-31 03:06:47,077 - INFO - Attaching policy ctest-src_parent_to_analyzer_pass-92704384 to vn ctest-src_parent_port_vn-71269764 2025-07-31 03:06:47,496 - INFO - Attaching policy ctest-dst_parent_to_analyzer_pass-53951678 to vn ctest-vn3-81591458 2025-07-31 03:06:48,107 - INFO - Attaching policy ctest-dst_parent_to_analyzer_pass-53951678 to vn ctest-dst_parent_port_vn-95516242 2025-07-31 03:06:48,561 - INFO - Attaching policy ctest-src_parent_to_dst_parent_pass-77309008 to vn ctest-src_parent_port_vn-71269764 2025-07-31 03:06:49,059 - INFO - Attaching policy ctest-src_parent_to_dst_parent_pass-77309008 to vn ctest-dst_parent_port_vn-95516242 2025-07-31 03:08:30,409 - DEBUG - Installing image ubuntu 2025-07-31 03:08:30,410 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 03:08:30,410 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:08:30,411 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:08:30,411 - DEBUG - Unzip image 2025-07-31 03:08:30,411 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:08:30,450 - DEBUG - Try to create image in user context 2025-07-31 03:08:30,593 - INFO - Dettaching policy ctest-src_parent_to_dst_parent_pass-77309008 from vn ctest-dst_parent_port_vn-95516242 2025-07-31 03:08:30,930 - INFO - Dettaching policy ctest-src_parent_to_dst_parent_pass-77309008 from vn ctest-src_parent_port_vn-71269764 2025-07-31 03:08:31,218 - INFO - Dettaching policy ctest-dst_parent_to_analyzer_pass-53951678 from vn ctest-dst_parent_port_vn-95516242 2025-07-31 03:08:31,653 - INFO - Dettaching policy ctest-dst_parent_to_analyzer_pass-53951678 from vn ctest-vn3-81591458 2025-07-31 03:08:32,040 - INFO - Dettaching policy ctest-src_parent_to_analyzer_pass-92704384 from vn ctest-src_parent_port_vn-71269764 2025-07-31 03:08:32,268 - INFO - Dettaching policy ctest-src_parent_to_analyzer_pass-92704384 from vn ctest-vn3-81591458 2025-07-31 03:08:32,678 - INFO - Deleted policy ctest-src_parent_to_dst_parent_pass-77309008 2025-07-31 03:08:32,742 - INFO - Deleted policy ctest-dst_parent_to_analyzer_pass-53951678 2025-07-31 03:08:32,811 - INFO - Deleted policy ctest-src_parent_to_analyzer_pass-92704384 2025-07-31 03:08:32,950 - INFO - Deleted port bbfaa4d6-3043-4bc6-9c64-2f79fb2299af 2025-07-31 03:08:33,121 - DEBUG - Response for delete_port : () 2025-07-31 03:08:33,122 - INFO - Deleted port f33617b7-7ff1-4382-be50-6113b69b2bbe 2025-07-31 03:08:33,122 - INFO - Deleting VN ctest-analyzer_parent_port_vn-17397128 2025-07-31 03:08:33,282 - DEBUG - Response for deleting network () 2025-07-31 03:08:33,283 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2614b251-fef4-4a03-9cc9-07621dbd2c04 2025-07-31 03:08:33,320 - DEBUG - Response Code: 404 2025-07-31 03:08:33,320 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:33,327 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:33,338 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:33,465 - INFO - Validated that VN ctest-analyzer_parent_port_vn-17397128 is not found in API Server 2025-07-31 03:08:33,480 - DEBUG - VN ctest-analyzer_parent_port_vn-17397128 is not present in Agent 10.0.0.27 2025-07-31 03:08:33,494 - DEBUG - VN ctest-analyzer_parent_port_vn-17397128 is not present in Agent 10.0.0.57 2025-07-31 03:08:33,494 - INFO - Validated that VN ctest-analyzer_parent_port_vn-17397128 is not in any agent 2025-07-31 03:08:33,540 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-analyzer_parent_port_vn-17397128 info 2025-07-31 03:08:33,656 - INFO - Deleted port f5f7398f-84f0-4064-a6ab-a3075f27674a 2025-07-31 03:08:33,816 - DEBUG - Response for delete_port : () 2025-07-31 03:08:33,816 - INFO - Deleted port 5e5de810-fb12-49bb-99e7-16844f940e35 2025-07-31 03:08:33,816 - INFO - Deleting VN ctest-dst_parent_port_vn-95516242 2025-07-31 03:08:33,991 - DEBUG - Response for deleting network () 2025-07-31 03:08:33,991 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/b1c86202-62dd-44c1-9c71-d968011aad00 2025-07-31 03:08:33,999 - DEBUG - Response Code: 404 2025-07-31 03:08:33,999 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:34,006 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:34,029 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:34,139 - INFO - Validated that VN ctest-dst_parent_port_vn-95516242 is not found in API Server 2025-07-31 03:08:34,154 - DEBUG - VN ctest-dst_parent_port_vn-95516242 is not present in Agent 10.0.0.27 2025-07-31 03:08:34,168 - DEBUG - VN ctest-dst_parent_port_vn-95516242 is not present in Agent 10.0.0.57 2025-07-31 03:08:34,168 - INFO - Validated that VN ctest-dst_parent_port_vn-95516242 is not in any agent 2025-07-31 03:08:34,209 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-dst_parent_port_vn-95516242 info 2025-07-31 03:08:34,326 - INFO - Deleted port cca0da61-d309-4b38-a598-383c11b9e233 2025-07-31 03:08:34,499 - DEBUG - Response for delete_port : () 2025-07-31 03:08:34,499 - INFO - Deleted port bfe1ffde-335a-46c8-9d43-56801ebe9cb2 2025-07-31 03:08:34,499 - INFO - Deleting VN ctest-src_parent_port_vn-71269764 2025-07-31 03:08:34,676 - DEBUG - Response for deleting network () 2025-07-31 03:08:34,676 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/3554166e-1d78-43e7-a1ca-f3510e80fbba 2025-07-31 03:08:34,684 - DEBUG - Response Code: 404 2025-07-31 03:08:34,685 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:34,692 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:34,707 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:34,814 - INFO - Validated that VN ctest-src_parent_port_vn-71269764 is not found in API Server 2025-07-31 03:08:34,828 - DEBUG - VN ctest-src_parent_port_vn-71269764 is not present in Agent 10.0.0.27 2025-07-31 03:08:34,844 - DEBUG - VN ctest-src_parent_port_vn-71269764 is not present in Agent 10.0.0.57 2025-07-31 03:08:34,844 - INFO - Validated that VN ctest-src_parent_port_vn-71269764 is not in any agent 2025-07-31 03:08:34,894 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-src_parent_port_vn-71269764 info 2025-07-31 03:08:34,895 - INFO - Dettaching policy ctest-vn2_vn3_pass-76247785 from vn ctest-vn3-81591458 2025-07-31 03:08:35,152 - INFO - Dettaching policy ctest-vn2_vn3_pass-76247785 from vn ctest-vn2-05866454 2025-07-31 03:08:35,406 - INFO - Dettaching policy ctest-vn1_vn3_pass-76474009 from vn ctest-vn3-81591458 2025-07-31 03:08:35,645 - INFO - Dettaching policy ctest-vn1_vn3_pass-76474009 from vn ctest-vn1-31824960 2025-07-31 03:08:35,889 - INFO - Dettaching policy ctest-vn1_vn2_pass-59717672 from vn ctest-vn2-05866454 2025-07-31 03:08:36,104 - INFO - Dettaching policy ctest-vn1_vn2_pass-59717672 from vn ctest-vn1-31824960 2025-07-31 03:08:36,353 - INFO - Deleted policy ctest-vn2_vn3_pass-76247785 2025-07-31 03:08:36,403 - INFO - Deleted policy ctest-vn1_vn3_pass-76474009 2025-07-31 03:08:36,452 - INFO - Deleted policy ctest-vn1_vn2_pass-59717672 2025-07-31 03:08:36,453 - INFO - Deleting VN ctest-vn3-81591458 2025-07-31 03:08:36,627 - DEBUG - Response for deleting network () 2025-07-31 03:08:36,627 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/d919bf85-1102-4add-9e84-493dabbd04d5 2025-07-31 03:08:36,635 - DEBUG - Response Code: 404 2025-07-31 03:08:36,635 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:36,642 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:36,659 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:36,754 - INFO - Validated that VN ctest-vn3-81591458 is not found in API Server 2025-07-31 03:08:36,768 - DEBUG - VN ctest-vn3-81591458 is not present in Agent 10.0.0.27 2025-07-31 03:08:36,781 - DEBUG - VN ctest-vn3-81591458 is not present in Agent 10.0.0.57 2025-07-31 03:08:36,781 - INFO - Validated that VN ctest-vn3-81591458 is not in any agent 2025-07-31 03:08:36,818 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-81591458 info 2025-07-31 03:08:36,819 - INFO - Deleting VN ctest-vn2-05866454 2025-07-31 03:08:37,013 - DEBUG - Response for deleting network () 2025-07-31 03:08:37,013 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1ac8eced-8265-42ea-8058-345619881e3c 2025-07-31 03:08:37,035 - DEBUG - Response Code: 404 2025-07-31 03:08:37,035 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:37,042 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:37,055 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:37,152 - INFO - Validated that VN ctest-vn2-05866454 is not found in API Server 2025-07-31 03:08:37,169 - DEBUG - VN ctest-vn2-05866454 is not present in Agent 10.0.0.27 2025-07-31 03:08:37,182 - DEBUG - VN ctest-vn2-05866454 is not present in Agent 10.0.0.57 2025-07-31 03:08:37,182 - INFO - Validated that VN ctest-vn2-05866454 is not in any agent 2025-07-31 03:08:37,230 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-05866454 info 2025-07-31 03:08:37,230 - INFO - Deleting VN ctest-vn1-31824960 2025-07-31 03:08:37,398 - DEBUG - Response for deleting network () 2025-07-31 03:08:37,398 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/4102332a-fe05-49d9-997c-569df7f103ac 2025-07-31 03:08:37,405 - DEBUG - Response Code: 404 2025-07-31 03:08:37,406 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:37,414 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:37,446 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:37,563 - INFO - Validated that VN ctest-vn1-31824960 is not found in API Server 2025-07-31 03:08:37,581 - DEBUG - VN ctest-vn1-31824960 is not present in Agent 10.0.0.27 2025-07-31 03:08:37,611 - DEBUG - VN ctest-vn1-31824960 is not present in Agent 10.0.0.57 2025-07-31 03:08:37,611 - INFO - Validated that VN ctest-vn1-31824960 is not in any agent 2025-07-31 03:08:37,674 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-31824960 info 2025-07-31 03:08:39,027 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 31, in test_intf_mirroring_disable_enable_scenarios
    return self.verify_intf_mirroring_disable_enable_scenarios()
  File "/contrail-test/common/intf_mirroring/verify.py", line 61, in verify_intf_mirroring_disable_enable_scenarios
    return self.verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3(sub_intf=True, parent_intf=True)
  File "/contrail-test/common/intf_mirroring/verify.py", line 85, in verify_intf_mirroring_src_on_cn1_vn1_dst_on_cn2_vn2_analyzer_on_cn3_vn3
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 03:08:39,065 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 03:08:39,065 - INFO - 2025-07-31 03:08:39,065 - INFO - END TEST : test_intf_mirroring_disable_enable_scenarios : FAILED[0:02:10] 2025-07-31 03:08:39,066 - INFO - -------------------------------------------------------------------------------- 2025-07-31 03:08:39,078 - INFO - ================================================================================ 2025-07-31 03:08:39,079 - INFO - STARTING TEST : test_juniper_header 2025-07-31 03:08:39,079 - INFO - TEST DESCRIPTION : Validate the presence of juniper header 1) Check pkts get mirrored from both sub intf and parent intf when enabled on both 2) Verify if the juniper header is correct 3) Verify if the inner header is correct 2025-07-31 03:08:40,453 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 03:08:40,453 - INFO - Initial checks done. Running the testcase now 2025-07-31 03:08:40,453 - INFO - 2025-07-31 03:08:40,453 - INFO - src compute an-jenkins-deploy-platform-ansible-os-3732-1 -> dst compute an-jenkins-deploy-platform-ansible-os-3732-2 => analyzer compute an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:08:40,834 - DEBUG - Response for create_network : {'network': {'id': '4338be1c-8da4-4c93-9742-5ca4b9f5c116', 'name': 'ctest-vn1-77078689', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn1-77078689'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:08:41,126 - DEBUG - Response for create_subnet : {'subnet': {'id': '7265adef-e8e8-4c03-ae90-770c4025b809', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '4338be1c-8da4-4c93-9742-5ca4b9f5c116', 'ip_version': 4, 'cidr': '23.20.92.64/26', 'allocation_pools': [{'start': '23.20.92.66', 'end': '23.20.92.126'}], 'gateway_ip': '23.20.92.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '23.20.92.66', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:08:41,157 - INFO - Created VN ctest-vn1-77078689 2025-07-31 03:08:41,169 - DEBUG - VN ctest-vn1-77078689 UUID is 4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,248 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:41,255 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:41,266 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:41,383 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,403 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,426 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1a66a17b-5ee9-4be1-8a98-116c459923ea 2025-07-31 03:08:41,440 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1a66a17b-5ee9-4be1-8a98-116c459923ea 2025-07-31 03:08:41,454 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5ac9c69e-e8c2-41c0-96c9-fead69be3197 2025-07-31 03:08:41,469 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:08:41,470 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,489 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1a66a17b-5ee9-4be1-8a98-116c459923ea 2025-07-31 03:08:41,527 - INFO - Verified VN network id 11 for VN 4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,527 - INFO - Verifications in API Server for VN ctest-vn1-77078689 passed 2025-07-31 03:08:41,528 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,553 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1a66a17b-5ee9-4be1-8a98-116c459923ea 2025-07-31 03:08:41,562 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1a66a17b-5ee9-4be1-8a98-116c459923ea 2025-07-31 03:08:41,570 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/5ac9c69e-e8c2-41c0-96c9-fead69be3197 2025-07-31 03:08:41,585 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4843830429081685139', 'uuid-lslong': '10899375910754304278'}, 'enable': 'true', 'created': '2025-07-31T03:08:40', 'last-modified': '2025-07-31T03:08:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510092'} 2025-07-31 03:08:41,592 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:08:41,599 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4843830429081685139', 'uuid-lslong': '10899375910754304278'}, 'enable': 'true', 'created': '2025-07-31T03:08:40', 'last-modified': '2025-07-31T03:08:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.531158'} 2025-07-31 03:08:41,607 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:08:41,613 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '4843830429081685139', 'uuid-lslong': '10899375910754304278'}, 'enable': 'true', 'created': '2025-07-31T03:08:40', 'last-modified': '2025-07-31T03:08:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.555406'} 2025-07-31 03:08:41,619 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:08:41,619 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-77078689 passed 2025-07-31 03:08:41,619 - DEBUG - ====Verifying policy data for ctest-vn1-77078689 in API_Server ====== 2025-07-31 03:08:41,620 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:41,627 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:41,641 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:41,767 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4338be1c-8da4-4c93-9742-5ca4b9f5c116 2025-07-31 03:08:41,783 - DEBUG - =>VN ctest-vn1-77078689 has no policy to be verified 2025-07-31 03:08:41,783 - DEBUG - Verifying the vn in opserver 2025-07-31 03:08:41,783 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689 virtual network link through opserver 10.0.0.41 2025-07-31 03:08:41,783 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:08:41,839 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689?flat'} 2025-07-31 03:08:41,839 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689 virtual network link through opserver 10.0.0.38 2025-07-31 03:08:41,839 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:08:41,895 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689?flat'} 2025-07-31 03:08:41,895 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689 virtual network link through opserver 10.0.0.61 2025-07-31 03:08:41,895 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:08:41,960 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689?flat'} 2025-07-31 03:08:41,960 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689 is found in opserver 2025-07-31 03:08:41,992 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:08:42,008 - DEBUG - VRF ids for VN ctest-vn1-77078689: {} 2025-07-31 03:08:42,309 - DEBUG - Response for create_network : {'network': {'id': '9cb8738c-4fb3-43b8-989b-fcea9fd4235b', 'name': 'ctest-vn2-34286160', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn2-34286160'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:08:42,557 - DEBUG - Response for create_subnet : {'subnet': {'id': 'aaa72f2e-7ff0-4dd8-998b-60116a279558', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '9cb8738c-4fb3-43b8-989b-fcea9fd4235b', 'ip_version': 4, 'cidr': '40.153.245.64/26', 'allocation_pools': [{'start': '40.153.245.66', 'end': '40.153.245.126'}], 'gateway_ip': '40.153.245.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '40.153.245.66', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:08:42,584 - INFO - Created VN ctest-vn2-34286160 2025-07-31 03:08:42,600 - DEBUG - VN ctest-vn2-34286160 UUID is 9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:42,678 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:42,685 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:42,700 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:42,805 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:42,818 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:42,828 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ff47841b-09d3-41b7-a3c0-b03f93fd60a8 2025-07-31 03:08:42,836 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ff47841b-09d3-41b7-a3c0-b03f93fd60a8 2025-07-31 03:08:42,846 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/cdda6628-94d6-4624-9cd2-531b7ad96155 2025-07-31 03:08:42,855 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:08:42,856 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:42,867 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ff47841b-09d3-41b7-a3c0-b03f93fd60a8 2025-07-31 03:08:42,885 - INFO - Verified VN network id 12 for VN 9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:42,885 - INFO - Verifications in API Server for VN ctest-vn2-34286160 passed 2025-07-31 03:08:42,887 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:42,899 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ff47841b-09d3-41b7-a3c0-b03f93fd60a8 2025-07-31 03:08:42,907 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ff47841b-09d3-41b7-a3c0-b03f93fd60a8 2025-07-31 03:08:42,915 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/cdda6628-94d6-4624-9cd2-531b7ad96155 2025-07-31 03:08:42,928 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11292903112101282744', 'uuid-lslong': '10996660999789224795'}, 'enable': 'true', 'created': '2025-07-31T03:08:42', 'last-modified': '2025-07-31T03:08:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455243'} 2025-07-31 03:08:42,937 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:08:42,944 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11292903112101282744', 'uuid-lslong': '10996660999789224795'}, 'enable': 'true', 'created': '2025-07-31T03:08:42', 'last-modified': '2025-07-31T03:08:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467524'} 2025-07-31 03:08:42,953 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:08:42,959 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11292903112101282744', 'uuid-lslong': '10996660999789224795'}, 'enable': 'true', 'created': '2025-07-31T03:08:42', 'last-modified': '2025-07-31T03:08:42', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492497'} 2025-07-31 03:08:42,966 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:08:42,966 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-34286160 passed 2025-07-31 03:08:42,966 - DEBUG - ====Verifying policy data for ctest-vn2-34286160 in API_Server ====== 2025-07-31 03:08:42,966 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:42,974 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:42,993 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:43,108 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9cb8738c-4fb3-43b8-989b-fcea9fd4235b 2025-07-31 03:08:43,126 - DEBUG - =>VN ctest-vn2-34286160 has no policy to be verified 2025-07-31 03:08:43,126 - DEBUG - Verifying the vn in opserver 2025-07-31 03:08:43,126 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160 virtual network link through opserver 10.0.0.41 2025-07-31 03:08:43,127 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:08:43,187 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160?flat'} 2025-07-31 03:08:43,187 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160 virtual network link through opserver 10.0.0.38 2025-07-31 03:08:43,187 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:08:43,252 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160?flat'} 2025-07-31 03:08:43,252 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160 virtual network link through opserver 10.0.0.61 2025-07-31 03:08:43,252 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:08:43,308 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160?flat'} 2025-07-31 03:08:43,308 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160 is found in opserver 2025-07-31 03:08:43,347 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:08:43,368 - DEBUG - VRF ids for VN ctest-vn2-34286160: {} 2025-07-31 03:08:43,686 - DEBUG - Response for create_network : {'network': {'id': 'b836905a-5273-42a1-81af-b0bc8f8140b4', 'name': 'ctest-vn3-87956031', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn3-87956031'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:08:43,953 - DEBUG - Response for create_subnet : {'subnet': {'id': '0f7730b8-24d4-4a5f-b689-c86668e2652f', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'b836905a-5273-42a1-81af-b0bc8f8140b4', 'ip_version': 4, 'cidr': '117.120.62.64/26', 'allocation_pools': [{'start': '117.120.62.66', 'end': '117.120.62.126'}], 'gateway_ip': '117.120.62.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '117.120.62.66', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:08:43,976 - INFO - Created VN ctest-vn3-87956031 2025-07-31 03:08:43,987 - DEBUG - VN ctest-vn3-87956031 UUID is b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,073 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:44,081 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:44,097 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:44,213 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,229 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,241 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/713aee16-0c25-48e4-b244-1012ea02f227 2025-07-31 03:08:44,252 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/713aee16-0c25-48e4-b244-1012ea02f227 2025-07-31 03:08:44,261 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d49d5a0b-79c4-463b-9200-1536ada6fc8b 2025-07-31 03:08:44,267 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:08:44,268 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,281 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/713aee16-0c25-48e4-b244-1012ea02f227 2025-07-31 03:08:44,306 - INFO - Verified VN network id 13 for VN b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,306 - INFO - Verifications in API Server for VN ctest-vn3-87956031 passed 2025-07-31 03:08:44,306 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,323 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/713aee16-0c25-48e4-b244-1012ea02f227 2025-07-31 03:08:44,333 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/713aee16-0c25-48e4-b244-1012ea02f227 2025-07-31 03:08:44,340 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/d49d5a0b-79c4-463b-9200-1536ada6fc8b 2025-07-31 03:08:44,357 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13273955669325857441', 'uuid-lslong': '9344882075725021364'}, 'enable': 'true', 'created': '2025-07-31T03:08:43', 'last-modified': '2025-07-31T03:08:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.464044'} 2025-07-31 03:08:44,366 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:08:44,374 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13273955669325857441', 'uuid-lslong': '9344882075725021364'}, 'enable': 'true', 'created': '2025-07-31T03:08:43', 'last-modified': '2025-07-31T03:08:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.483798'} 2025-07-31 03:08:44,382 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:08:44,388 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13273955669325857441', 'uuid-lslong': '9344882075725021364'}, 'enable': 'true', 'created': '2025-07-31T03:08:43', 'last-modified': '2025-07-31T03:08:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.499814'} 2025-07-31 03:08:44,394 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:08:44,395 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-87956031 passed 2025-07-31 03:08:44,395 - DEBUG - ====Verifying policy data for ctest-vn3-87956031 in API_Server ====== 2025-07-31 03:08:44,395 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:08:44,404 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:08:44,418 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:08:44,516 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/b836905a-5273-42a1-81af-b0bc8f8140b4 2025-07-31 03:08:44,529 - DEBUG - =>VN ctest-vn3-87956031 has no policy to be verified 2025-07-31 03:08:44,529 - DEBUG - Verifying the vn in opserver 2025-07-31 03:08:44,529 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031 virtual network link through opserver 10.0.0.41 2025-07-31 03:08:44,529 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:08:44,583 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031?flat'} 2025-07-31 03:08:44,583 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031 virtual network link through opserver 10.0.0.38 2025-07-31 03:08:44,584 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:08:44,636 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031?flat'} 2025-07-31 03:08:44,636 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031 virtual network link through opserver 10.0.0.61 2025-07-31 03:08:44,636 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:08:44,696 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031?flat'} 2025-07-31 03:08:44,696 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031 is found in opserver 2025-07-31 03:08:44,732 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:08:44,749 - DEBUG - VRF ids for VN ctest-vn3-87956031: {} 2025-07-31 03:08:44,758 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:08:45,053 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-77078689, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:08:45,369 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-34286160, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-87956031, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:08:45,721 - INFO - Attaching policy ctest-vn1_vn2_pass-70723347 to vn ctest-vn1-77078689 2025-07-31 03:08:46,110 - INFO - Attaching policy ctest-vn1_vn2_pass-70723347 to vn ctest-vn2-34286160 2025-07-31 03:08:46,538 - INFO - Attaching policy ctest-vn1_vn3_pass-06575582 to vn ctest-vn1-77078689 2025-07-31 03:08:47,040 - INFO - Attaching policy ctest-vn1_vn3_pass-06575582 to vn ctest-vn3-87956031 2025-07-31 03:08:47,512 - INFO - Attaching policy ctest-vn2_vn3_pass-26055207 to vn ctest-vn2-34286160 2025-07-31 03:08:47,993 - INFO - Attaching policy ctest-vn2_vn3_pass-26055207 to vn ctest-vn3-87956031 2025-07-31 03:10:29,250 - DEBUG - Installing image ubuntu 2025-07-31 03:10:29,250 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 03:10:29,251 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:10:29,251 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:10:29,251 - DEBUG - Unzip image 2025-07-31 03:10:29,251 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:10:29,263 - DEBUG - Try to create image in user context 2025-07-31 03:10:29,347 - INFO - Dettaching policy ctest-vn2_vn3_pass-26055207 from vn ctest-vn3-87956031 2025-07-31 03:10:29,569 - INFO - Dettaching policy ctest-vn2_vn3_pass-26055207 from vn ctest-vn2-34286160 2025-07-31 03:10:29,825 - INFO - Dettaching policy ctest-vn1_vn3_pass-06575582 from vn ctest-vn3-87956031 2025-07-31 03:10:30,014 - INFO - Dettaching policy ctest-vn1_vn3_pass-06575582 from vn ctest-vn1-77078689 2025-07-31 03:10:30,325 - INFO - Dettaching policy ctest-vn1_vn2_pass-70723347 from vn ctest-vn2-34286160 2025-07-31 03:10:30,553 - INFO - Dettaching policy ctest-vn1_vn2_pass-70723347 from vn ctest-vn1-77078689 2025-07-31 03:10:30,825 - INFO - Deleted policy ctest-vn2_vn3_pass-26055207 2025-07-31 03:10:30,887 - INFO - Deleted policy ctest-vn1_vn3_pass-06575582 2025-07-31 03:10:30,940 - INFO - Deleted policy ctest-vn1_vn2_pass-70723347 2025-07-31 03:10:30,940 - INFO - Deleting VN ctest-vn3-87956031 2025-07-31 03:10:31,155 - DEBUG - Response for deleting network () 2025-07-31 03:10:31,156 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/713aee16-0c25-48e4-b244-1012ea02f227 2025-07-31 03:10:31,162 - DEBUG - Response Code: 404 2025-07-31 03:10:31,163 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:31,173 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:31,184 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:31,288 - INFO - Validated that VN ctest-vn3-87956031 is not found in API Server 2025-07-31 03:10:31,302 - DEBUG - VN ctest-vn3-87956031 is not present in Agent 10.0.0.27 2025-07-31 03:10:31,317 - DEBUG - VN ctest-vn3-87956031 is not present in Agent 10.0.0.57 2025-07-31 03:10:31,317 - INFO - Validated that VN ctest-vn3-87956031 is not in any agent 2025-07-31 03:10:31,358 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-87956031 info 2025-07-31 03:10:31,358 - INFO - Deleting VN ctest-vn2-34286160 2025-07-31 03:10:31,504 - DEBUG - Response for deleting network () 2025-07-31 03:10:31,504 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/ff47841b-09d3-41b7-a3c0-b03f93fd60a8 2025-07-31 03:10:31,516 - DEBUG - Response Code: 404 2025-07-31 03:10:31,516 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:31,527 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:31,586 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:31,681 - INFO - Validated that VN ctest-vn2-34286160 is not found in API Server 2025-07-31 03:10:31,695 - DEBUG - VN ctest-vn2-34286160 is not present in Agent 10.0.0.27 2025-07-31 03:10:31,707 - DEBUG - VN ctest-vn2-34286160 is not present in Agent 10.0.0.57 2025-07-31 03:10:31,707 - INFO - Validated that VN ctest-vn2-34286160 is not in any agent 2025-07-31 03:10:31,746 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-34286160 info 2025-07-31 03:10:31,746 - INFO - Deleting VN ctest-vn1-77078689 2025-07-31 03:10:31,939 - DEBUG - Response for deleting network () 2025-07-31 03:10:31,939 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/1a66a17b-5ee9-4be1-8a98-116c459923ea 2025-07-31 03:10:31,947 - DEBUG - Response Code: 404 2025-07-31 03:10:31,947 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:31,953 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:31,967 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:32,071 - INFO - Validated that VN ctest-vn1-77078689 is not found in API Server 2025-07-31 03:10:32,085 - DEBUG - VN ctest-vn1-77078689 is not present in Agent 10.0.0.27 2025-07-31 03:10:32,097 - DEBUG - VN ctest-vn1-77078689 is not present in Agent 10.0.0.57 2025-07-31 03:10:32,098 - INFO - Validated that VN ctest-vn1-77078689 is not in any agent 2025-07-31 03:10:32,141 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-77078689 info 2025-07-31 03:10:33,528 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/tcutils/util.py", line 1041, in wrapper
    return f(self, *func_args, **func_kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 42, in test_juniper_header
    return self.verify_juniper_header_testcase(header = 2)
  File "/contrail-test/common/intf_mirroring/verify.py", line 77, in verify_juniper_header_testcase
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, header = header, nh_mode=nh_mode, direction = direction, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 03:10:33,566 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 03:10:33,566 - INFO - 2025-07-31 03:10:33,566 - INFO - END TEST : test_juniper_header : FAILED[0:01:54] 2025-07-31 03:10:33,567 - INFO - -------------------------------------------------------------------------------- 2025-07-31 03:10:33,588 - INFO - ================================================================================ 2025-07-31 03:10:33,588 - INFO - STARTING TEST : test_juniper_header_without_header_ingress 2025-07-31 03:10:33,589 - INFO - TEST DESCRIPTION : Validate the presence of no juniper header 1) Check pkts get mirrored from both sub intf and parent intf when enabled on both 2) Verify if the juniper header is absent 3) Verify if the inner header is correct 2025-07-31 03:10:34,949 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.20.0.193': '0', '10.20.0.18': '0'}, '10.0.0.57': {'10.20.0.18': '0', '10.20.0.193': '0'}} with 2025-07-31 03:10:34,949 - INFO - Initial checks done. Running the testcase now 2025-07-31 03:10:34,949 - INFO - 2025-07-31 03:10:34,949 - INFO - src compute an-jenkins-deploy-platform-ansible-os-3732-1 -> dst compute an-jenkins-deploy-platform-ansible-os-3732-2 => analyzer compute an-jenkins-deploy-platform-ansible-os-3732-2 2025-07-31 03:10:35,249 - DEBUG - Response for create_network : {'network': {'id': '9ee4da30-f7d0-46e8-af85-fbc3a420a2c8', 'name': 'ctest-vn1-97286513', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn1-97286513'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:10:35,468 - DEBUG - Response for create_subnet : {'subnet': {'id': '8ff5de85-1cbd-43ee-b61b-7996be45e8ea', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '9ee4da30-f7d0-46e8-af85-fbc3a420a2c8', 'ip_version': 4, 'cidr': '215.233.229.128/26', 'allocation_pools': [{'start': '215.233.229.130', 'end': '215.233.229.190'}], 'gateway_ip': '215.233.229.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '215.233.229.130', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:10:35,491 - INFO - Created VN ctest-vn1-97286513 2025-07-31 03:10:35,503 - DEBUG - VN ctest-vn1-97286513 UUID is 9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:35,610 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:35,619 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:35,639 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:35,793 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:35,820 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:35,838 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9b3e97a0-bb55-4921-af2c-9e9d0f6f1f82 2025-07-31 03:10:35,854 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9b3e97a0-bb55-4921-af2c-9e9d0f6f1f82 2025-07-31 03:10:35,866 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/f975339e-d0c3-476e-8a50-8379c53c9763 2025-07-31 03:10:35,878 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:10:35,878 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:35,896 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9b3e97a0-bb55-4921-af2c-9e9d0f6f1f82 2025-07-31 03:10:35,921 - INFO - Verified VN network id 11 for VN 9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:35,921 - INFO - Verifications in API Server for VN ctest-vn1-97286513 passed 2025-07-31 03:10:35,921 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:35,947 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9b3e97a0-bb55-4921-af2c-9e9d0f6f1f82 2025-07-31 03:10:35,965 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9b3e97a0-bb55-4921-af2c-9e9d0f6f1f82 2025-07-31 03:10:35,985 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/f975339e-d0c3-476e-8a50-8379c53c9763 2025-07-31 03:10:36,022 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11449516056533550824', 'uuid-lslong': '12647791946230702792'}, 'enable': 'true', 'created': '2025-07-31T03:10:35', 'last-modified': '2025-07-31T03:10:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.604517'} 2025-07-31 03:10:36,046 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:10:36,059 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11449516056533550824', 'uuid-lslong': '12647791946230702792'}, 'enable': 'true', 'created': '2025-07-31T03:10:35', 'last-modified': '2025-07-31T03:10:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.636184'} 2025-07-31 03:10:36,074 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:10:36,086 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11449516056533550824', 'uuid-lslong': '12647791946230702792'}, 'enable': 'true', 'created': '2025-07-31T03:10:35', 'last-modified': '2025-07-31T03:10:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.662535'} 2025-07-31 03:10:36,099 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-31 03:10:36,099 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-97286513 passed 2025-07-31 03:10:36,100 - DEBUG - ====Verifying policy data for ctest-vn1-97286513 in API_Server ====== 2025-07-31 03:10:36,100 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:36,115 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:36,159 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:36,335 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/9ee4da30-f7d0-46e8-af85-fbc3a420a2c8 2025-07-31 03:10:36,355 - DEBUG - =>VN ctest-vn1-97286513 has no policy to be verified 2025-07-31 03:10:36,355 - DEBUG - Verifying the vn in opserver 2025-07-31 03:10:36,356 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513 virtual network link through opserver 10.0.0.41 2025-07-31 03:10:36,356 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:10:36,375 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513?flat'} 2025-07-31 03:10:36,375 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513 virtual network link through opserver 10.0.0.38 2025-07-31 03:10:36,375 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:10:36,397 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513?flat'} 2025-07-31 03:10:36,397 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513 virtual network link through opserver 10.0.0.61 2025-07-31 03:10:36,397 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:10:36,421 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513?flat'} 2025-07-31 03:10:36,421 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513 is found in opserver 2025-07-31 03:10:36,455 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:10:36,468 - DEBUG - VRF ids for VN ctest-vn1-97286513: {} 2025-07-31 03:10:36,763 - DEBUG - Response for create_network : {'network': {'id': 'db4983ff-ff3e-4c41-b705-3563ac7e009c', 'name': 'ctest-vn2-30816017', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn2-30816017'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:10:37,022 - DEBUG - Response for create_subnet : {'subnet': {'id': '29cba484-ba05-410e-adcd-60cc277991be', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': 'db4983ff-ff3e-4c41-b705-3563ac7e009c', 'ip_version': 4, 'cidr': '73.95.110.0/26', 'allocation_pools': [{'start': '73.95.110.2', 'end': '73.95.110.62'}], 'gateway_ip': '73.95.110.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '73.95.110.2', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:10:37,044 - INFO - Created VN ctest-vn2-30816017 2025-07-31 03:10:37,061 - DEBUG - VN ctest-vn2-30816017 UUID is db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,136 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:37,144 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:37,162 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:37,271 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,289 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,301 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cf21f6ac-8770-4f0b-85b3-620887ef327c 2025-07-31 03:10:37,311 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cf21f6ac-8770-4f0b-85b3-620887ef327c 2025-07-31 03:10:37,319 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/24676e8b-d7d2-4efd-a0e0-b578945335ce 2025-07-31 03:10:37,329 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:10:37,329 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,340 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cf21f6ac-8770-4f0b-85b3-620887ef327c 2025-07-31 03:10:37,363 - INFO - Verified VN network id 12 for VN db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,363 - INFO - Verifications in API Server for VN ctest-vn2-30816017 passed 2025-07-31 03:10:37,363 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,388 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cf21f6ac-8770-4f0b-85b3-620887ef327c 2025-07-31 03:10:37,406 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cf21f6ac-8770-4f0b-85b3-620887ef327c 2025-07-31 03:10:37,420 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/24676e8b-d7d2-4efd-a0e0-b578945335ce 2025-07-31 03:10:37,445 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15801305903128267841', 'uuid-lslong': '13188005786036338844'}, 'enable': 'true', 'created': '2025-07-31T03:10:36', 'last-modified': '2025-07-31T03:10:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491677'} 2025-07-31 03:10:37,464 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:10:37,477 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15801305903128267841', 'uuid-lslong': '13188005786036338844'}, 'enable': 'true', 'created': '2025-07-31T03:10:36', 'last-modified': '2025-07-31T03:10:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.522334'} 2025-07-31 03:10:37,490 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:10:37,501 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15801305903128267841', 'uuid-lslong': '13188005786036338844'}, 'enable': 'true', 'created': '2025-07-31T03:10:36', 'last-modified': '2025-07-31T03:10:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.546385'} 2025-07-31 03:10:37,515 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-31 03:10:37,515 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-30816017 passed 2025-07-31 03:10:37,515 - DEBUG - ====Verifying policy data for ctest-vn2-30816017 in API_Server ====== 2025-07-31 03:10:37,516 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:37,525 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:37,548 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:37,663 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/db4983ff-ff3e-4c41-b705-3563ac7e009c 2025-07-31 03:10:37,680 - DEBUG - =>VN ctest-vn2-30816017 has no policy to be verified 2025-07-31 03:10:37,680 - DEBUG - Verifying the vn in opserver 2025-07-31 03:10:37,680 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017 virtual network link through opserver 10.0.0.41 2025-07-31 03:10:37,680 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:10:37,700 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017?flat'} 2025-07-31 03:10:37,700 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017 virtual network link through opserver 10.0.0.38 2025-07-31 03:10:37,700 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:10:37,722 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017?flat'} 2025-07-31 03:10:37,722 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017 virtual network link through opserver 10.0.0.61 2025-07-31 03:10:37,722 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:10:37,743 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017?flat'} 2025-07-31 03:10:37,743 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017 is found in opserver 2025-07-31 03:10:37,789 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:10:37,811 - DEBUG - VRF ids for VN ctest-vn2-30816017: {} 2025-07-31 03:10:38,204 - DEBUG - Response for create_network : {'network': {'id': '177af1bd-a6ff-4a93-bc70-bf1102dc7fae', 'name': 'ctest-vn3-34379600', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'project_id': '6b42921d30ba4d9ba14e460ba13c347f', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestIntfMirror-40773914', 'ctest-vn3-34379600'], 'port_security_enabled': True, 'description': ''}} 2025-07-31 03:10:38,427 - DEBUG - Response for create_subnet : {'subnet': {'id': '6210d8bb-e84f-4217-bd8e-4a4de5e3e323', 'name': '', 'tenant_id': '6b42921d30ba4d9ba14e460ba13c347f', 'network_id': '177af1bd-a6ff-4a93-bc70-bf1102dc7fae', 'ip_version': 4, 'cidr': '46.54.31.64/26', 'allocation_pools': [{'start': '46.54.31.66', 'end': '46.54.31.126'}], 'gateway_ip': '46.54.31.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '46.54.31.66', 'tags': [], 'project_id': '6b42921d30ba4d9ba14e460ba13c347f'}} 2025-07-31 03:10:38,449 - INFO - Created VN ctest-vn3-34379600 2025-07-31 03:10:38,462 - DEBUG - VN ctest-vn3-34379600 UUID is 177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:38,537 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:38,545 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:38,566 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:38,695 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:38,710 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:38,722 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2a50e621-b894-45f1-b105-59589e617c22 2025-07-31 03:10:38,731 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2a50e621-b894-45f1-b105-59589e617c22 2025-07-31 03:10:38,739 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/65bdeca1-b3f1-4aca-8c2e-297e0335439b 2025-07-31 03:10:38,746 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:10:38,746 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:38,757 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2a50e621-b894-45f1-b105-59589e617c22 2025-07-31 03:10:38,777 - INFO - Verified VN network id 13 for VN 177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:38,777 - INFO - Verifications in API Server for VN ctest-vn3-34379600 passed 2025-07-31 03:10:38,777 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:38,788 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2a50e621-b894-45f1-b105-59589e617c22 2025-07-31 03:10:38,796 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2a50e621-b894-45f1-b105-59589e617c22 2025-07-31 03:10:38,810 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/65bdeca1-b3f1-4aca-8c2e-297e0335439b 2025-07-31 03:10:38,828 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691930406883904147', 'uuid-lslong': '13578562956305399726'}, 'enable': 'true', 'created': '2025-07-31T03:10:38', 'last-modified': '2025-07-31T03:10:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460409'} 2025-07-31 03:10:38,836 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:10:38,842 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691930406883904147', 'uuid-lslong': '13578562956305399726'}, 'enable': 'true', 'created': '2025-07-31T03:10:38', 'last-modified': '2025-07-31T03:10:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.479412'} 2025-07-31 03:10:38,851 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:10:38,858 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestIntfMirror-40773914', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1691930406883904147', 'uuid-lslong': '13578562956305399726'}, 'enable': 'true', 'created': '2025-07-31T03:10:38', 'last-modified': '2025-07-31T03:10:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.497000'} 2025-07-31 03:10:38,867 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-31 03:10:38,868 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn3-34379600 passed 2025-07-31 03:10:38,868 - DEBUG - ====Verifying policy data for ctest-vn3-34379600 in API_Server ====== 2025-07-31 03:10:38,868 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:10:38,879 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:10:38,908 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:10:39,074 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/177af1bd-a6ff-4a93-bc70-bf1102dc7fae 2025-07-31 03:10:39,089 - DEBUG - =>VN ctest-vn3-34379600 has no policy to be verified 2025-07-31 03:10:39,090 - DEBUG - Verifying the vn in opserver 2025-07-31 03:10:39,090 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600 virtual network link through opserver 10.0.0.41 2025-07-31 03:10:39,090 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-31 03:10:39,112 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600?flat'} 2025-07-31 03:10:39,112 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600 virtual network link through opserver 10.0.0.38 2025-07-31 03:10:39,112 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-31 03:10:39,135 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600?flat'} 2025-07-31 03:10:39,135 - DEBUG - Verifying the default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600 virtual network link through opserver 10.0.0.61 2025-07-31 03:10:39,135 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-07-31 03:10:39,154 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600?flat'} 2025-07-31 03:10:39,154 - INFO - Validated that VN default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600 is found in opserver 2025-07-31 03:10:39,191 - DEBUG - Do not have enough data to verify VN in agent 2025-07-31 03:10:39,205 - DEBUG - VRF ids for VN ctest-vn3-34379600: {} 2025-07-31 03:10:39,212 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:10:39,569 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn1-97286513, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:10:39,877 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn2-30816017, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestIntfMirror-40773914:ctest-vn3-34379600, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-07-31 03:10:40,307 - INFO - Attaching policy ctest-vn1_vn2_pass-95804056 to vn ctest-vn1-97286513 2025-07-31 03:10:40,746 - INFO - Attaching policy ctest-vn1_vn2_pass-95804056 to vn ctest-vn2-30816017 2025-07-31 03:10:41,186 - INFO - Attaching policy ctest-vn1_vn3_pass-11995442 to vn ctest-vn1-97286513 2025-07-31 03:10:41,657 - INFO - Attaching policy ctest-vn1_vn3_pass-11995442 to vn ctest-vn3-34379600 2025-07-31 03:10:42,132 - INFO - Attaching policy ctest-vn2_vn3_pass-56474095 to vn ctest-vn2-30816017 2025-07-31 03:10:42,639 - INFO - Attaching policy ctest-vn2_vn3_pass-56474095 to vn ctest-vn3-34379600 2025-07-31 03:12:24,023 - DEBUG - Installing image ubuntu 2025-07-31 03:12:24,023 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-31 03:12:24,025 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:12:24,025 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:12:24,025 - DEBUG - Unzip image 2025-07-31 03:12:24,026 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-31 03:12:24,055 - DEBUG - Try to create image in user context 2025-07-31 03:12:24,162 - INFO - Dettaching policy ctest-vn2_vn3_pass-56474095 from vn ctest-vn3-34379600 2025-07-31 03:12:24,412 - INFO - Dettaching policy ctest-vn2_vn3_pass-56474095 from vn ctest-vn2-30816017 2025-07-31 03:12:24,741 - INFO - Dettaching policy ctest-vn1_vn3_pass-11995442 from vn ctest-vn3-34379600 2025-07-31 03:12:25,046 - INFO - Dettaching policy ctest-vn1_vn3_pass-11995442 from vn ctest-vn1-97286513 2025-07-31 03:12:25,405 - INFO - Dettaching policy ctest-vn1_vn2_pass-95804056 from vn ctest-vn2-30816017 2025-07-31 03:12:25,655 - INFO - Dettaching policy ctest-vn1_vn2_pass-95804056 from vn ctest-vn1-97286513 2025-07-31 03:12:25,947 - INFO - Deleted policy ctest-vn2_vn3_pass-56474095 2025-07-31 03:12:26,011 - INFO - Deleted policy ctest-vn1_vn3_pass-11995442 2025-07-31 03:12:26,067 - INFO - Deleted policy ctest-vn1_vn2_pass-95804056 2025-07-31 03:12:26,068 - INFO - Deleting VN ctest-vn3-34379600 2025-07-31 03:12:26,231 - DEBUG - Response for deleting network () 2025-07-31 03:12:26,231 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/2a50e621-b894-45f1-b105-59589e617c22 2025-07-31 03:12:26,243 - DEBUG - Response Code: 404 2025-07-31 03:12:26,243 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:12:26,252 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:12:26,290 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:12:26,419 - INFO - Validated that VN ctest-vn3-34379600 is not found in API Server 2025-07-31 03:12:26,432 - DEBUG - VN ctest-vn3-34379600 is not present in Agent 10.0.0.27 2025-07-31 03:12:26,445 - DEBUG - VN ctest-vn3-34379600 is not present in Agent 10.0.0.57 2025-07-31 03:12:26,445 - INFO - Validated that VN ctest-vn3-34379600 is not in any agent 2025-07-31 03:12:26,488 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn3-34379600 info 2025-07-31 03:12:26,488 - INFO - Deleting VN ctest-vn2-30816017 2025-07-31 03:12:26,748 - DEBUG - Response for deleting network () 2025-07-31 03:12:26,748 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/cf21f6ac-8770-4f0b-85b3-620887ef327c 2025-07-31 03:12:26,757 - DEBUG - Response Code: 404 2025-07-31 03:12:26,757 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:12:26,768 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:12:26,830 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:12:26,960 - INFO - Validated that VN ctest-vn2-30816017 is not found in API Server 2025-07-31 03:12:26,974 - DEBUG - VN ctest-vn2-30816017 is not present in Agent 10.0.0.27 2025-07-31 03:12:26,987 - DEBUG - VN ctest-vn2-30816017 is not present in Agent 10.0.0.57 2025-07-31 03:12:26,987 - INFO - Validated that VN ctest-vn2-30816017 is not in any agent 2025-07-31 03:12:27,046 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-30816017 info 2025-07-31 03:12:27,047 - INFO - Deleting VN ctest-vn1-97286513 2025-07-31 03:12:27,300 - DEBUG - Response for deleting network () 2025-07-31 03:12:27,300 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/9b3e97a0-bb55-4921-af2c-9e9d0f6f1f82 2025-07-31 03:12:27,312 - DEBUG - Response Code: 404 2025-07-31 03:12:27,312 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2025-07-31 03:12:27,325 - DEBUG - Requesting: http://10.0.0.41:8082/domain/34dad5b7-e30d-42c7-8ff4-7b0d7fa576d7 2025-07-31 03:12:27,347 - DEBUG - Requesting: http://10.0.0.41:8082/project/6b42921d-30ba-4d9b-a14e-460ba13c347f 2025-07-31 03:12:27,445 - INFO - Validated that VN ctest-vn1-97286513 is not found in API Server 2025-07-31 03:12:27,458 - DEBUG - VN ctest-vn1-97286513 is not present in Agent 10.0.0.27 2025-07-31 03:12:27,472 - DEBUG - VN ctest-vn1-97286513 is not present in Agent 10.0.0.57 2025-07-31 03:12:27,472 - INFO - Validated that VN ctest-vn1-97286513 is not in any agent 2025-07-31 03:12:27,511 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-97286513 info 2025-07-31 03:12:28,888 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/intf_mirror/test_intf_mirror.py", line 71, in test_juniper_header_without_header_ingress
    return self.verify_juniper_header_testcase(header = 3, direction = direction)
  File "/contrail-test/common/intf_mirroring/verify.py", line 77, in verify_juniper_header_testcase
    return self.verify_intf_mirroring(compute_nodes, [0, 1, 2], sub_intf, parent_intf, nic_mirror, header = header, nh_mode=nh_mode, direction = direction, ipv6=ipv6)
  File "/contrail-test/common/intf_mirroring/verify.py", line 549, in verify_intf_mirroring
    image_name=image_name, node_name=src_compute, port_ids=src_port_ids)
  File "/contrail-test/common/base.py", line 281, in create_vm
    **kwargs)
  File "/contrail-test/common/base.py", line 254, in create_only_vm
    vm_obj.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-31 03:12:28,918 - DEBUG - No XMPP flaps were noticed during the test 2025-07-31 03:12:28,918 - INFO - 2025-07-31 03:12:28,918 - INFO - END TEST : test_juniper_header_without_header_ingress : FAILED[0:01:55] 2025-07-31 03:12:28,918 - INFO - -------------------------------------------------------------------------------- 2025-07-31 03:12:29,814 - INFO - Deleted project: ctest-TestIntfMirror-40773914, ID : 6b42921d-30ba-4d9b-a14e-460ba13c347f