2025-07-22 16:48:47,760 - INFO - Domain Default found not creating 2025-07-22 16:48:47,942 - INFO - Project ctest-TestSVCV2Mirror-74670308 not found, creating it 2025-07-22 16:48:48,557 - INFO - Created Project:ctest-TestSVCV2Mirror-74670308, ID : 306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:50,010 - INFO - ================================================================================ 2025-07-22 16:48:50,010 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-07-22 16:48:50,010 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-07-22 16:48:51,314 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.20.0.14': '0', '10.20.0.17': '0'}, '10.0.0.27': {'10.20.0.14': '0', '10.20.0.254': '0'}} with 2025-07-22 16:48:51,314 - INFO - Initial checks done. Running the testcase now 2025-07-22 16:48:51,314 - INFO - 2025-07-22 16:48:52,041 - DEBUG - Response for create_network : {'network': {'id': '9e991ed5-e75d-4c50-bba7-ceae05089017', 'name': 'ctest-left-66600316', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'project_id': '306442adfe6b4952b329f422f9e548d2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-74670308', 'ctest-left-66600316'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 16:48:52,331 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f8d6fa5b-7a98-4154-a184-b04330af3839', 'name': '', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'network_id': '9e991ed5-e75d-4c50-bba7-ceae05089017', 'ip_version': 4, 'cidr': '109.237.93.0/26', 'allocation_pools': [{'start': '109.237.93.2', 'end': '109.237.93.62'}], 'gateway_ip': '109.237.93.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '109.237.93.2', 'tags': [], 'project_id': '306442adfe6b4952b329f422f9e548d2'}} 2025-07-22 16:48:52,358 - INFO - Created VN ctest-left-66600316 2025-07-22 16:48:52,373 - DEBUG - VN ctest-left-66600316 UUID is 9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:52,455 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:52,746 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:52,775 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:52,792 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:52,892 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:52,906 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:52,917 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1c33f778-0db4-450f-9506-b522a53add65 2025-07-22 16:48:52,926 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1c33f778-0db4-450f-9506-b522a53add65 2025-07-22 16:48:52,936 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/58ad3428-03f8-4d96-ac5f-56a491c9117c 2025-07-22 16:48:52,944 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 16:48:52,945 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:52,957 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1c33f778-0db4-450f-9506-b522a53add65 2025-07-22 16:48:52,975 - INFO - Verified VN network id 12 for VN 9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:52,975 - INFO - Verifications in API Server for VN ctest-left-66600316 passed 2025-07-22 16:48:52,975 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:52,988 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1c33f778-0db4-450f-9506-b522a53add65 2025-07-22 16:48:53,001 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1c33f778-0db4-450f-9506-b522a53add65 2025-07-22 16:48:53,013 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/58ad3428-03f8-4d96-ac5f-56a491c9117c 2025-07-22 16:48:53,029 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11428199433487862864', 'uuid-lslong': '13522003653007282199'}, 'enable': 'true', 'created': '2025-07-22T16:48:51', 'last-modified': '2025-07-22T16:48:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.782182'} 2025-07-22 16:48:53,035 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 16:48:53,042 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11428199433487862864', 'uuid-lslong': '13522003653007282199'}, 'enable': 'true', 'created': '2025-07-22T16:48:51', 'last-modified': '2025-07-22T16:48:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.788672'} 2025-07-22 16:48:53,049 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 16:48:53,056 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11428199433487862864', 'uuid-lslong': '13522003653007282199'}, 'enable': 'true', 'created': '2025-07-22T16:48:51', 'last-modified': '2025-07-22T16:48:52', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.809477'} 2025-07-22 16:48:53,064 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-22 16:48:53,064 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-66600316 passed 2025-07-22 16:48:53,064 - DEBUG - ====Verifying policy data for ctest-left-66600316 in API_Server ====== 2025-07-22 16:48:53,064 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:53,071 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:53,085 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:53,189 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/9e991ed5-e75d-4c50-bba7-ceae05089017 2025-07-22 16:48:53,200 - DEBUG - =>VN ctest-left-66600316 has no policy to be verified 2025-07-22 16:48:53,200 - DEBUG - Verifying the vn in opserver 2025-07-22 16:48:53,200 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316 virtual network link through opserver 10.0.0.254 2025-07-22 16:48:53,200 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-22 16:48:53,494 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-22 16:48:53,555 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316?flat'} 2025-07-22 16:48:53,555 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316 virtual network link through opserver 10.0.0.50 2025-07-22 16:48:53,555 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-07-22 16:48:53,850 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-07-22 16:48:53,915 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316?flat'} 2025-07-22 16:48:53,915 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316 virtual network link through opserver 10.0.0.23 2025-07-22 16:48:53,915 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-22 16:48:54,208 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-22 16:48:54,271 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316?flat'} 2025-07-22 16:48:54,271 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-74670308:ctest-left-66600316 is found in opserver 2025-07-22 16:48:54,304 - DEBUG - Do not have enough data to verify VN in agent 2025-07-22 16:48:54,318 - DEBUG - VRF ids for VN ctest-left-66600316: {} 2025-07-22 16:48:54,605 - DEBUG - Response for create_network : {'network': {'id': '6fe40c03-e22d-4663-bdd9-1908cce4ea3a', 'name': 'ctest-right-35545029', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'project_id': '306442adfe6b4952b329f422f9e548d2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-74670308', 'ctest-right-35545029'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 16:48:54,841 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a9711c25-c038-43cc-9dbf-2ab0ee307316', 'name': '', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'network_id': '6fe40c03-e22d-4663-bdd9-1908cce4ea3a', 'ip_version': 4, 'cidr': '41.240.209.0/26', 'allocation_pools': [{'start': '41.240.209.2', 'end': '41.240.209.62'}], 'gateway_ip': '41.240.209.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.240.209.2', 'tags': [], 'project_id': '306442adfe6b4952b329f422f9e548d2'}} 2025-07-22 16:48:54,865 - INFO - Created VN ctest-right-35545029 2025-07-22 16:48:54,879 - DEBUG - VN ctest-right-35545029 UUID is 6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:54,960 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:54,967 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:54,980 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:55,078 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:55,094 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:55,105 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7ae8544e-41b6-4a5d-80ab-96ae4ee80bea 2025-07-22 16:48:55,117 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7ae8544e-41b6-4a5d-80ab-96ae4ee80bea 2025-07-22 16:48:55,127 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/376cf359-3e8a-40ae-89fa-ea61204e845b 2025-07-22 16:48:55,136 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-22 16:48:55,136 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:55,147 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7ae8544e-41b6-4a5d-80ab-96ae4ee80bea 2025-07-22 16:48:55,166 - INFO - Verified VN network id 13 for VN 6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:55,166 - INFO - Verifications in API Server for VN ctest-right-35545029 passed 2025-07-22 16:48:55,166 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:55,178 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7ae8544e-41b6-4a5d-80ab-96ae4ee80bea 2025-07-22 16:48:55,187 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7ae8544e-41b6-4a5d-80ab-96ae4ee80bea 2025-07-22 16:48:55,198 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/376cf359-3e8a-40ae-89fa-ea61204e845b 2025-07-22 16:48:55,213 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8062582443719083619', 'uuid-lslong': '13679992868702579258'}, 'enable': 'true', 'created': '2025-07-22T16:48:54', 'last-modified': '2025-07-22T16:48:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.425572'} 2025-07-22 16:48:55,220 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-22 16:48:55,226 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8062582443719083619', 'uuid-lslong': '13679992868702579258'}, 'enable': 'true', 'created': '2025-07-22T16:48:54', 'last-modified': '2025-07-22T16:48:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.446992'} 2025-07-22 16:48:55,233 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-22 16:48:55,241 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8062582443719083619', 'uuid-lslong': '13679992868702579258'}, 'enable': 'true', 'created': '2025-07-22T16:48:54', 'last-modified': '2025-07-22T16:48:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459107'} 2025-07-22 16:48:55,249 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-22 16:48:55,249 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-35545029 passed 2025-07-22 16:48:55,249 - DEBUG - ====Verifying policy data for ctest-right-35545029 in API_Server ====== 2025-07-22 16:48:55,249 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:55,258 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:55,271 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:55,372 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/6fe40c03-e22d-4663-bdd9-1908cce4ea3a 2025-07-22 16:48:55,386 - DEBUG - =>VN ctest-right-35545029 has no policy to be verified 2025-07-22 16:48:55,386 - DEBUG - Verifying the vn in opserver 2025-07-22 16:48:55,386 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029 virtual network link through opserver 10.0.0.254 2025-07-22 16:48:55,386 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-22 16:48:55,452 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029?flat'} 2025-07-22 16:48:55,452 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029 virtual network link through opserver 10.0.0.50 2025-07-22 16:48:55,453 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-07-22 16:48:55,519 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029?flat'} 2025-07-22 16:48:55,519 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029 virtual network link through opserver 10.0.0.23 2025-07-22 16:48:55,519 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-22 16:48:55,578 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029?flat'} 2025-07-22 16:48:55,578 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-74670308:ctest-right-35545029 is found in opserver 2025-07-22 16:48:55,603 - DEBUG - Do not have enough data to verify VN in agent 2025-07-22 16:48:55,614 - DEBUG - VRF ids for VN ctest-right-35545029: {} 2025-07-22 16:48:55,919 - DEBUG - Response for create_network : {'network': {'id': '23c2cb8a-379e-4220-9816-4817271abbfa', 'name': 'ctest-mgmt_vn-51020571', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'project_id': '306442adfe6b4952b329f422f9e548d2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-74670308', 'ctest-mgmt_vn-51020571'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 16:48:56,220 - DEBUG - Response for create_subnet : {'subnet': {'id': '1ef555b0-c480-452c-9119-f4edcdc9a096', 'name': '', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'network_id': '23c2cb8a-379e-4220-9816-4817271abbfa', 'ip_version': 4, 'cidr': '173.214.230.64/26', 'allocation_pools': [{'start': '173.214.230.66', 'end': '173.214.230.126'}], 'gateway_ip': '173.214.230.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '173.214.230.66', 'tags': [], 'project_id': '306442adfe6b4952b329f422f9e548d2'}} 2025-07-22 16:48:56,246 - INFO - Created VN ctest-mgmt_vn-51020571 2025-07-22 16:48:56,262 - DEBUG - VN ctest-mgmt_vn-51020571 UUID is 23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,416 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:56,425 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:56,440 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:56,535 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,551 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,561 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b82959e2-acde-438b-a33e-98fac9ace6a2 2025-07-22 16:48:56,571 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b82959e2-acde-438b-a33e-98fac9ace6a2 2025-07-22 16:48:56,580 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/23971ee1-efe5-4cb5-9f47-f690ce2c0b3c 2025-07-22 16:48:56,590 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-22 16:48:56,590 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,602 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b82959e2-acde-438b-a33e-98fac9ace6a2 2025-07-22 16:48:56,620 - INFO - Verified VN network id 14 for VN 23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,621 - INFO - Verifications in API Server for VN ctest-mgmt_vn-51020571 passed 2025-07-22 16:48:56,621 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,632 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b82959e2-acde-438b-a33e-98fac9ace6a2 2025-07-22 16:48:56,641 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b82959e2-acde-438b-a33e-98fac9ace6a2 2025-07-22 16:48:56,650 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/23971ee1-efe5-4cb5-9f47-f690ce2c0b3c 2025-07-22 16:48:56,667 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2576845731308388896', 'uuid-lslong': '10959026007530191866'}, 'enable': 'true', 'created': '2025-07-22T16:48:55', 'last-modified': '2025-07-22T16:48:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.494098'} 2025-07-22 16:48:56,677 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-22 16:48:56,686 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2576845731308388896', 'uuid-lslong': '10959026007530191866'}, 'enable': 'true', 'created': '2025-07-22T16:48:55', 'last-modified': '2025-07-22T16:48:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.510412'} 2025-07-22 16:48:56,694 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-22 16:48:56,701 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2576845731308388896', 'uuid-lslong': '10959026007530191866'}, 'enable': 'true', 'created': '2025-07-22T16:48:55', 'last-modified': '2025-07-22T16:48:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.534198'} 2025-07-22 16:48:56,709 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-22 16:48:56,709 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-51020571 passed 2025-07-22 16:48:56,709 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-51020571 in API_Server ====== 2025-07-22 16:48:56,709 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:56,717 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:56,730 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:56,827 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/23c2cb8a-379e-4220-9816-4817271abbfa 2025-07-22 16:48:56,842 - DEBUG - =>VN ctest-mgmt_vn-51020571 has no policy to be verified 2025-07-22 16:48:56,842 - DEBUG - Verifying the vn in opserver 2025-07-22 16:48:56,842 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571 virtual network link through opserver 10.0.0.254 2025-07-22 16:48:56,842 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-22 16:48:56,901 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571?flat'} 2025-07-22 16:48:56,901 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571 virtual network link through opserver 10.0.0.50 2025-07-22 16:48:56,901 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-07-22 16:48:56,965 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571?flat'} 2025-07-22 16:48:56,966 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571 virtual network link through opserver 10.0.0.23 2025-07-22 16:48:56,966 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-22 16:48:57,026 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571?flat'} 2025-07-22 16:48:57,026 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-74670308:ctest-mgmt_vn-51020571 is found in opserver 2025-07-22 16:48:57,051 - DEBUG - Do not have enough data to verify VN in agent 2025-07-22 16:48:57,062 - DEBUG - VRF ids for VN ctest-mgmt_vn-51020571: {} 2025-07-22 16:48:57,367 - DEBUG - Response for create_network : {'network': {'id': 'b0ec8690-7343-4964-a2b5-35baab6a8ac6', 'name': 'ctest-trans_left_vn-72965155', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'project_id': '306442adfe6b4952b329f422f9e548d2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-74670308', 'ctest-trans_left_vn-72965155'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 16:48:57,667 - DEBUG - Response for create_subnet : {'subnet': {'id': '7f450eec-484c-423b-8191-41c7489946c3', 'name': '', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'network_id': 'b0ec8690-7343-4964-a2b5-35baab6a8ac6', 'ip_version': 4, 'cidr': '28.112.70.192/26', 'allocation_pools': [{'start': '28.112.70.194', 'end': '28.112.70.254'}], 'gateway_ip': '28.112.70.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '28.112.70.194', 'tags': [], 'project_id': '306442adfe6b4952b329f422f9e548d2'}} 2025-07-22 16:48:57,694 - INFO - Created VN ctest-trans_left_vn-72965155 2025-07-22 16:48:57,709 - DEBUG - VN ctest-trans_left_vn-72965155 UUID is b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:57,788 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:57,795 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:57,808 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:57,910 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:57,928 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:57,940 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8e161e9c-29b0-4ad7-8fe5-a832557204b5 2025-07-22 16:48:57,949 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8e161e9c-29b0-4ad7-8fe5-a832557204b5 2025-07-22 16:48:57,958 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/6f183eb5-4751-48c9-b411-7e524ce49082 2025-07-22 16:48:57,966 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-22 16:48:57,966 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:57,977 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8e161e9c-29b0-4ad7-8fe5-a832557204b5 2025-07-22 16:48:57,996 - INFO - Verified VN network id 15 for VN b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:57,996 - INFO - Verifications in API Server for VN ctest-trans_left_vn-72965155 passed 2025-07-22 16:48:57,997 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:58,008 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8e161e9c-29b0-4ad7-8fe5-a832557204b5 2025-07-22 16:48:58,017 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8e161e9c-29b0-4ad7-8fe5-a832557204b5 2025-07-22 16:48:58,026 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/6f183eb5-4751-48c9-b411-7e524ce49082 2025-07-22 16:48:58,040 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12748712600146233700', 'uuid-lslong': '11724336280785029830'}, 'enable': 'true', 'created': '2025-07-22T16:48:57', 'last-modified': '2025-07-22T16:48:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.441555'} 2025-07-22 16:48:58,046 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-22 16:48:58,053 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12748712600146233700', 'uuid-lslong': '11724336280785029830'}, 'enable': 'true', 'created': '2025-07-22T16:48:57', 'last-modified': '2025-07-22T16:48:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.459674'} 2025-07-22 16:48:58,061 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-22 16:48:58,068 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12748712600146233700', 'uuid-lslong': '11724336280785029830'}, 'enable': 'true', 'created': '2025-07-22T16:48:57', 'last-modified': '2025-07-22T16:48:57', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.474835'} 2025-07-22 16:48:58,076 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-22 16:48:58,076 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-72965155 passed 2025-07-22 16:48:58,077 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-72965155 in API_Server ====== 2025-07-22 16:48:58,077 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:58,084 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:58,101 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:58,209 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/b0ec8690-7343-4964-a2b5-35baab6a8ac6 2025-07-22 16:48:58,222 - DEBUG - =>VN ctest-trans_left_vn-72965155 has no policy to be verified 2025-07-22 16:48:58,222 - DEBUG - Verifying the vn in opserver 2025-07-22 16:48:58,222 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155 virtual network link through opserver 10.0.0.254 2025-07-22 16:48:58,222 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-22 16:48:58,237 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155?flat'} 2025-07-22 16:48:58,237 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155 virtual network link through opserver 10.0.0.50 2025-07-22 16:48:58,237 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-07-22 16:48:58,252 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155?flat'} 2025-07-22 16:48:58,252 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155 virtual network link through opserver 10.0.0.23 2025-07-22 16:48:58,252 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-22 16:48:58,267 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155?flat'} 2025-07-22 16:48:58,267 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_left_vn-72965155 is found in opserver 2025-07-22 16:48:58,296 - DEBUG - Do not have enough data to verify VN in agent 2025-07-22 16:48:58,310 - DEBUG - VRF ids for VN ctest-trans_left_vn-72965155: {} 2025-07-22 16:48:58,620 - DEBUG - Response for create_network : {'network': {'id': '4cfa5249-5c50-4446-b3d5-8ce11aabf032', 'name': 'ctest-trans_right_vn-44837452', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'project_id': '306442adfe6b4952b329f422f9e548d2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-74670308', 'ctest-trans_right_vn-44837452'], 'port_security_enabled': True, 'description': ''}} 2025-07-22 16:48:58,851 - DEBUG - Response for create_subnet : {'subnet': {'id': '75b82808-f661-40e9-9927-285bf95d08d5', 'name': '', 'tenant_id': '306442adfe6b4952b329f422f9e548d2', 'network_id': '4cfa5249-5c50-4446-b3d5-8ce11aabf032', 'ip_version': 4, 'cidr': '102.125.63.0/26', 'allocation_pools': [{'start': '102.125.63.2', 'end': '102.125.63.62'}], 'gateway_ip': '102.125.63.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '102.125.63.2', 'tags': [], 'project_id': '306442adfe6b4952b329f422f9e548d2'}} 2025-07-22 16:48:58,876 - INFO - Created VN ctest-trans_right_vn-44837452 2025-07-22 16:48:58,892 - DEBUG - VN ctest-trans_right_vn-44837452 UUID is 4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:58,981 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:58,989 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:59,004 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:59,108 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:59,122 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:59,135 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/91f2830d-2758-47e6-bb51-baa6dbce2e49 2025-07-22 16:48:59,147 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/91f2830d-2758-47e6-bb51-baa6dbce2e49 2025-07-22 16:48:59,157 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c417452c-ddbd-4aea-b4af-a0eda349ac61 2025-07-22 16:48:59,168 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-22 16:48:59,168 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:59,181 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/91f2830d-2758-47e6-bb51-baa6dbce2e49 2025-07-22 16:48:59,203 - INFO - Verified VN network id 16 for VN 4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:59,203 - INFO - Verifications in API Server for VN ctest-trans_right_vn-44837452 passed 2025-07-22 16:48:59,203 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:59,217 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/91f2830d-2758-47e6-bb51-baa6dbce2e49 2025-07-22 16:48:59,225 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/91f2830d-2758-47e6-bb51-baa6dbce2e49 2025-07-22 16:48:59,233 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/c417452c-ddbd-4aea-b4af-a0eda349ac61 2025-07-22 16:48:59,247 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5546836366095041606', 'uuid-lslong': '12958418401271476274'}, 'enable': 'true', 'created': '2025-07-22T16:48:58', 'last-modified': '2025-07-22T16:48:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.455488'} 2025-07-22 16:48:59,255 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-22 16:48:59,262 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5546836366095041606', 'uuid-lslong': '12958418401271476274'}, 'enable': 'true', 'created': '2025-07-22T16:48:58', 'last-modified': '2025-07-22T16:48:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.476942'} 2025-07-22 16:48:59,270 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-22 16:48:59,277 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-74670308', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5546836366095041606', 'uuid-lslong': '12958418401271476274'}, 'enable': 'true', 'created': '2025-07-22T16:48:58', 'last-modified': '2025-07-22T16:48:58', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.491878'} 2025-07-22 16:48:59,285 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-22 16:48:59,285 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-44837452 passed 2025-07-22 16:48:59,286 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-44837452 in API_Server ====== 2025-07-22 16:48:59,286 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:48:59,293 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:48:59,308 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:48:59,413 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/4cfa5249-5c50-4446-b3d5-8ce11aabf032 2025-07-22 16:48:59,427 - DEBUG - =>VN ctest-trans_right_vn-44837452 has no policy to be verified 2025-07-22 16:48:59,428 - DEBUG - Verifying the vn in opserver 2025-07-22 16:48:59,428 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452 virtual network link through opserver 10.0.0.254 2025-07-22 16:48:59,428 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks 2025-07-22 16:48:59,444 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452?flat'} 2025-07-22 16:48:59,444 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452 virtual network link through opserver 10.0.0.50 2025-07-22 16:48:59,444 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks 2025-07-22 16:48:59,459 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452?flat'} 2025-07-22 16:48:59,459 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452 virtual network link through opserver 10.0.0.23 2025-07-22 16:48:59,459 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-22 16:48:59,474 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452?flat'} 2025-07-22 16:48:59,474 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-74670308:ctest-trans_right_vn-44837452 is found in opserver 2025-07-22 16:48:59,501 - DEBUG - Do not have enough data to verify VN in agent 2025-07-22 16:48:59,515 - DEBUG - VRF ids for VN ctest-trans_right_vn-44837452: {} 2025-07-22 16:48:59,573 - DEBUG - Services list from nova: [, , , ] 2025-07-22 16:49:00,763 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-2) 2025-07-22 16:49:02,181 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3693-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3693-1) 2025-07-22 16:49:02,182 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-02341721'] 2025-07-22 16:49:02,504 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-02341721'] created succesfully 2025-07-22 16:50:43,125 - DEBUG - Installing image ubuntu 2025-07-22 16:50:43,125 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-07-22 16:50:43,125 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-22 16:50:43,125 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-22 16:50:43,125 - DEBUG - Unzip image 2025-07-22 16:50:43,125 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-22 16:50:43,143 - DEBUG - Try to create image in user context 2025-07-22 16:50:43,243 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-02341721'] 2025-07-22 16:50:43,340 - INFO - Service template: ['default-domain', 'ctest-service_template_1-02341721'] deleted successfully. 2025-07-22 16:50:43,340 - INFO - Skip interface_detach for VM ctest-right_vm-14775539 in state BUILD 2025-07-22 16:50:43,340 - INFO - Deleting VM ctest-right_vm-14775539 2025-07-22 16:50:43,377 - ERROR - VM ctest-right_vm-14775539 has failed to come up 2025-07-22 16:50:43,377 - ERROR - Nova failed to get host of the VM 2025-07-22 16:50:43,377 - ERROR - VM ctest-right_vm-14775539 has failed to come up 2025-07-22 16:50:43,377 - ERROR - Nova failed to get host of the VM 2025-07-22 16:50:43,451 - INFO - Skip interface_detach for VM ctest-left_vm-70039250 in state BUILD 2025-07-22 16:50:43,452 - INFO - Deleting VM ctest-left_vm-70039250 2025-07-22 16:50:43,452 - ERROR - VM ctest-left_vm-70039250 has failed to come up 2025-07-22 16:50:43,452 - ERROR - Nova failed to get host of the VM 2025-07-22 16:50:43,452 - ERROR - VM ctest-left_vm-70039250 has failed to come up 2025-07-22 16:50:43,452 - ERROR - Nova failed to get host of the VM 2025-07-22 16:50:43,524 - INFO - Deleting VN ctest-trans_right_vn-44837452 2025-07-22 16:50:43,702 - DEBUG - Response for deleting network () 2025-07-22 16:50:43,702 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/91f2830d-2758-47e6-bb51-baa6dbce2e49 2025-07-22 16:50:43,711 - DEBUG - Response Code: 404 2025-07-22 16:50:43,711 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:50:43,724 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:50:43,790 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:50:43,892 - INFO - Validated that VN ctest-trans_right_vn-44837452 is not found in API Server 2025-07-22 16:50:43,906 - DEBUG - VN ctest-trans_right_vn-44837452 is not present in Agent 10.0.0.19 2025-07-22 16:50:43,921 - DEBUG - VN ctest-trans_right_vn-44837452 is not present in Agent 10.0.0.27 2025-07-22 16:50:43,921 - INFO - Validated that VN ctest-trans_right_vn-44837452 is not in any agent 2025-07-22 16:50:43,968 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-44837452 info 2025-07-22 16:50:43,968 - INFO - Deleting VN ctest-trans_left_vn-72965155 2025-07-22 16:50:44,157 - DEBUG - Response for deleting network () 2025-07-22 16:50:44,157 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/8e161e9c-29b0-4ad7-8fe5-a832557204b5 2025-07-22 16:50:44,164 - DEBUG - Response Code: 404 2025-07-22 16:50:44,165 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:50:44,173 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:50:44,219 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:50:44,332 - INFO - Validated that VN ctest-trans_left_vn-72965155 is not found in API Server 2025-07-22 16:50:44,352 - DEBUG - VN ctest-trans_left_vn-72965155 is not present in Agent 10.0.0.19 2025-07-22 16:50:44,366 - DEBUG - VN ctest-trans_left_vn-72965155 is not present in Agent 10.0.0.27 2025-07-22 16:50:44,366 - INFO - Validated that VN ctest-trans_left_vn-72965155 is not in any agent 2025-07-22 16:50:44,435 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-72965155 info 2025-07-22 16:50:44,437 - INFO - Deleting VN ctest-mgmt_vn-51020571 2025-07-22 16:50:44,638 - DEBUG - Response for deleting network () 2025-07-22 16:50:44,638 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/b82959e2-acde-438b-a33e-98fac9ace6a2 2025-07-22 16:50:44,648 - DEBUG - Response Code: 404 2025-07-22 16:50:44,648 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:50:44,658 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:50:44,680 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:50:44,811 - INFO - Validated that VN ctest-mgmt_vn-51020571 is not found in API Server 2025-07-22 16:50:44,826 - DEBUG - VN ctest-mgmt_vn-51020571 is not present in Agent 10.0.0.19 2025-07-22 16:50:44,852 - DEBUG - VN ctest-mgmt_vn-51020571 is not present in Agent 10.0.0.27 2025-07-22 16:50:44,853 - INFO - Validated that VN ctest-mgmt_vn-51020571 is not in any agent 2025-07-22 16:50:44,903 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-51020571 info 2025-07-22 16:50:44,904 - INFO - Deleting VN ctest-right-35545029 2025-07-22 16:50:45,108 - DEBUG - Response for deleting network () 2025-07-22 16:50:45,108 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/7ae8544e-41b6-4a5d-80ab-96ae4ee80bea 2025-07-22 16:50:45,119 - DEBUG - Response Code: 404 2025-07-22 16:50:45,119 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:50:45,129 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:50:45,186 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:50:45,289 - INFO - Validated that VN ctest-right-35545029 is not found in API Server 2025-07-22 16:50:45,301 - DEBUG - VN ctest-right-35545029 is not present in Agent 10.0.0.19 2025-07-22 16:50:45,315 - DEBUG - VN ctest-right-35545029 is not present in Agent 10.0.0.27 2025-07-22 16:50:45,315 - INFO - Validated that VN ctest-right-35545029 is not in any agent 2025-07-22 16:50:45,355 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-35545029 info 2025-07-22 16:50:45,355 - INFO - Deleting VN ctest-left-66600316 2025-07-22 16:50:45,523 - DEBUG - Response for deleting network () 2025-07-22 16:50:45,523 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/1c33f778-0db4-450f-9506-b522a53add65 2025-07-22 16:50:45,532 - DEBUG - Response Code: 404 2025-07-22 16:50:45,532 - DEBUG - Requesting: http://10.0.0.254:8082/domains 2025-07-22 16:50:45,541 - DEBUG - Requesting: http://10.0.0.254:8082/domain/6830e6da-995f-41aa-841e-c47f32c16910 2025-07-22 16:50:45,583 - DEBUG - Requesting: http://10.0.0.254:8082/project/306442ad-fe6b-4952-b329-f422f9e548d2 2025-07-22 16:50:45,674 - INFO - Validated that VN ctest-left-66600316 is not found in API Server 2025-07-22 16:50:45,691 - DEBUG - VN ctest-left-66600316 is not present in Agent 10.0.0.19 2025-07-22 16:50:45,706 - DEBUG - VN ctest-left-66600316 is not present in Agent 10.0.0.27 2025-07-22 16:50:45,706 - INFO - Validated that VN ctest-left-66600316 is not in any agent 2025-07-22 16:50:45,746 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-66600316 info 2025-07-22 16:50:47,009 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_mirror/test_mirror.py", line 24, in test_svc_v2_mirroring
    return self.verify_svc_mirroring()
  File "/contrail-test/common/servicechain/mirror/verify.py", line 14, in verify_svc_mirroring
    ret_dict = self.config_svc_mirroring(*args, **kwargs)
  File "/contrail-test/common/servicechain/mirror/config.py", line 42, in config_svc_mirroring
    create_svms=create_svms, **kwargs)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-22 16:50:47,023 - DEBUG - No XMPP flaps were noticed during the test 2025-07-22 16:50:47,023 - INFO -
2025-07-22 16:50:47,023 - INFO - END TEST : test_svc_v2_mirroring : FAILED[0:01:57]
2025-07-22 16:50:47,023 - INFO - -------------------------------------------------------------------------------- 2025-07-22 16:50:47,790 - INFO - Deleted project: ctest-TestSVCV2Mirror-74670308, ID : 306442ad-fe6b-4952-b329-f422f9e548d2