2025-07-23 16:39:08,822 - INFO - Domain Default found not creating 2025-07-23 16:39:09,144 - INFO - Project ctest-TestSVCV2Mirror-06881283 not found, creating it 2025-07-23 16:39:09,701 - INFO - Created Project:ctest-TestSVCV2Mirror-06881283, ID : 2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:11,167 - INFO - ================================================================================ 2025-07-23 16:39:11,167 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-07-23 16:39:11,167 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-07-23 16:39:12,543 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.254': '0', '10.20.0.17': '0'}, '10.0.0.130': {'10.20.0.17': '0', '10.20.0.254': '0'}} with 2025-07-23 16:39:12,544 - INFO - Initial checks done. Running the testcase now 2025-07-23 16:39:12,544 - INFO - 2025-07-23 16:39:13,549 - DEBUG - Response for create_network : {'network': {'id': 'd1ce33d9-68fe-4fa2-8035-788cdfb64e5f', 'name': 'ctest-left-05854954', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06881283', 'ctest-left-05854954'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:39:13,879 - DEBUG - Response for create_subnet : {'subnet': {'id': '5225f201-445c-433e-a15b-4fdcfb51db51', 'name': '', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'network_id': 'd1ce33d9-68fe-4fa2-8035-788cdfb64e5f', 'ip_version': 4, 'cidr': '112.61.7.0/26', 'allocation_pools': [{'start': '112.61.7.2', 'end': '112.61.7.62'}], 'gateway_ip': '112.61.7.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '112.61.7.2', 'tags': [], 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4'}} 2025-07-23 16:39:13,909 - INFO - Created VN ctest-left-05854954 2025-07-23 16:39:13,930 - DEBUG - VN ctest-left-05854954 UUID is d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,017 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:14,317 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:14,344 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:14,362 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:14,478 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,491 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,506 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b38e24f4-1c2e-4ca6-bd01-ab61005ea3ff 2025-07-23 16:39:14,516 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b38e24f4-1c2e-4ca6-bd01-ab61005ea3ff 2025-07-23 16:39:14,527 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e17a4e96-384a-4744-b698-eea06d8c4932 2025-07-23 16:39:14,541 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:39:14,541 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,553 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b38e24f4-1c2e-4ca6-bd01-ab61005ea3ff 2025-07-23 16:39:14,583 - INFO - Verified VN network id 12 for VN d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,583 - INFO - Verifications in API Server for VN ctest-left-05854954 passed 2025-07-23 16:39:14,583 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,600 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b38e24f4-1c2e-4ca6-bd01-ab61005ea3ff 2025-07-23 16:39:14,611 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b38e24f4-1c2e-4ca6-bd01-ab61005ea3ff 2025-07-23 16:39:14,624 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/e17a4e96-384a-4744-b698-eea06d8c4932 2025-07-23 16:39:14,642 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15118078007991750562', 'uuid-lslong': '9238422757064461919'}, 'enable': 'true', 'created': '2025-07-23T16:39:13', 'last-modified': '2025-07-23T16:39:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.837090'} 2025-07-23 16:39:14,651 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:39:14,658 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15118078007991750562', 'uuid-lslong': '9238422757064461919'}, 'enable': 'true', 'created': '2025-07-23T16:39:13', 'last-modified': '2025-07-23T16:39:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.855813'} 2025-07-23 16:39:14,667 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:39:14,673 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15118078007991750562', 'uuid-lslong': '9238422757064461919'}, 'enable': 'true', 'created': '2025-07-23T16:39:13', 'last-modified': '2025-07-23T16:39:13', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.868236'} 2025-07-23 16:39:14,679 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-23 16:39:14,680 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-05854954 passed 2025-07-23 16:39:14,680 - DEBUG - ====Verifying policy data for ctest-left-05854954 in API_Server ====== 2025-07-23 16:39:14,680 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:14,687 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:14,702 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:14,789 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d1ce33d9-68fe-4fa2-8035-788cdfb64e5f 2025-07-23 16:39:14,805 - DEBUG - =>VN ctest-left-05854954 has no policy to be verified 2025-07-23 16:39:14,805 - DEBUG - Verifying the vn in opserver 2025-07-23 16:39:14,805 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954 virtual network link through opserver 10.0.0.23 2025-07-23 16:39:14,805 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:39:15,111 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:39:15,170 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954?flat'} 2025-07-23 16:39:15,170 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954 virtual network link through opserver 10.0.0.249 2025-07-23 16:39:15,170 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:39:15,464 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:39:15,534 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954?flat'} 2025-07-23 16:39:15,534 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954 virtual network link through opserver 10.0.0.73 2025-07-23 16:39:15,535 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:39:15,831 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:39:15,895 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954?flat'} 2025-07-23 16:39:15,895 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06881283:ctest-left-05854954 is found in opserver 2025-07-23 16:39:15,940 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:39:15,965 - DEBUG - VRF ids for VN ctest-left-05854954: {} 2025-07-23 16:39:16,257 - DEBUG - Response for create_network : {'network': {'id': 'c1e72a42-b850-4efe-8d95-9e4a838193cc', 'name': 'ctest-right-33000311', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06881283', 'ctest-right-33000311'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:39:16,531 - DEBUG - Response for create_subnet : {'subnet': {'id': '8b728775-48f9-4fbd-aa11-6aad08125237', 'name': '', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'network_id': 'c1e72a42-b850-4efe-8d95-9e4a838193cc', 'ip_version': 4, 'cidr': '30.9.183.64/26', 'allocation_pools': [{'start': '30.9.183.66', 'end': '30.9.183.126'}], 'gateway_ip': '30.9.183.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '30.9.183.66', 'tags': [], 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4'}} 2025-07-23 16:39:16,553 - INFO - Created VN ctest-right-33000311 2025-07-23 16:39:16,567 - DEBUG - VN ctest-right-33000311 UUID is c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:16,644 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:16,651 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:16,668 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:16,763 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:16,777 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:16,789 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e9573b13-72dd-456e-96fa-14eb6c0f9b0f 2025-07-23 16:39:16,798 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e9573b13-72dd-456e-96fa-14eb6c0f9b0f 2025-07-23 16:39:16,807 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/106e9a81-9edf-46ec-ace9-c66fdbaf55be 2025-07-23 16:39:16,816 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:39:16,816 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:16,829 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e9573b13-72dd-456e-96fa-14eb6c0f9b0f 2025-07-23 16:39:16,849 - INFO - Verified VN network id 13 for VN c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:16,849 - INFO - Verifications in API Server for VN ctest-right-33000311 passed 2025-07-23 16:39:16,849 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:16,860 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e9573b13-72dd-456e-96fa-14eb6c0f9b0f 2025-07-23 16:39:16,869 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e9573b13-72dd-456e-96fa-14eb6c0f9b0f 2025-07-23 16:39:16,878 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/106e9a81-9edf-46ec-ace9-c66fdbaf55be 2025-07-23 16:39:16,893 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13972182834988732158', 'uuid-lslong': '10202234573748802508'}, 'enable': 'true', 'created': '2025-07-23T16:39:16', 'last-modified': '2025-07-23T16:39:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.406691'} 2025-07-23 16:39:16,901 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:39:16,907 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13972182834988732158', 'uuid-lslong': '10202234573748802508'}, 'enable': 'true', 'created': '2025-07-23T16:39:16', 'last-modified': '2025-07-23T16:39:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431166'} 2025-07-23 16:39:16,915 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:39:16,923 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13972182834988732158', 'uuid-lslong': '10202234573748802508'}, 'enable': 'true', 'created': '2025-07-23T16:39:16', 'last-modified': '2025-07-23T16:39:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.444136'} 2025-07-23 16:39:16,931 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-23 16:39:16,931 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-33000311 passed 2025-07-23 16:39:16,931 - DEBUG - ====Verifying policy data for ctest-right-33000311 in API_Server ====== 2025-07-23 16:39:16,932 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:16,939 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:16,952 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:17,057 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/c1e72a42-b850-4efe-8d95-9e4a838193cc 2025-07-23 16:39:17,068 - DEBUG - =>VN ctest-right-33000311 has no policy to be verified 2025-07-23 16:39:17,068 - DEBUG - Verifying the vn in opserver 2025-07-23 16:39:17,068 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311 virtual network link through opserver 10.0.0.23 2025-07-23 16:39:17,068 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:39:17,134 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311?flat'} 2025-07-23 16:39:17,134 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311 virtual network link through opserver 10.0.0.249 2025-07-23 16:39:17,134 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:39:17,210 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311?flat'} 2025-07-23 16:39:17,210 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311 virtual network link through opserver 10.0.0.73 2025-07-23 16:39:17,211 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:39:17,265 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311?flat'} 2025-07-23 16:39:17,265 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06881283:ctest-right-33000311 is found in opserver 2025-07-23 16:39:17,324 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:39:17,352 - DEBUG - VRF ids for VN ctest-right-33000311: {} 2025-07-23 16:39:17,633 - DEBUG - Response for create_network : {'network': {'id': '48d6c1a8-f779-4231-9ca9-83d065959495', 'name': 'ctest-mgmt_vn-15448493', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06881283', 'ctest-mgmt_vn-15448493'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:39:17,866 - DEBUG - Response for create_subnet : {'subnet': {'id': 'a47512da-8af6-4098-8e4b-44a130f84488', 'name': '', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'network_id': '48d6c1a8-f779-4231-9ca9-83d065959495', 'ip_version': 4, 'cidr': '96.253.10.64/26', 'allocation_pools': [{'start': '96.253.10.66', 'end': '96.253.10.126'}], 'gateway_ip': '96.253.10.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '96.253.10.66', 'tags': [], 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4'}} 2025-07-23 16:39:17,887 - INFO - Created VN ctest-mgmt_vn-15448493 2025-07-23 16:39:17,901 - DEBUG - VN ctest-mgmt_vn-15448493 UUID is 48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:17,986 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:17,994 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:18,010 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:18,117 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:18,135 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:18,149 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3d49e405-abc9-4ce7-afda-315557b40cfa 2025-07-23 16:39:18,162 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3d49e405-abc9-4ce7-afda-315557b40cfa 2025-07-23 16:39:18,174 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0ce4e3c-5653-4564-ab51-f2ac0e62a53e 2025-07-23 16:39:18,182 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:39:18,182 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:18,195 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3d49e405-abc9-4ce7-afda-315557b40cfa 2025-07-23 16:39:18,215 - INFO - Verified VN network id 14 for VN 48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:18,215 - INFO - Verifications in API Server for VN ctest-mgmt_vn-15448493 passed 2025-07-23 16:39:18,215 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:18,227 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3d49e405-abc9-4ce7-afda-315557b40cfa 2025-07-23 16:39:18,238 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3d49e405-abc9-4ce7-afda-315557b40cfa 2025-07-23 16:39:18,248 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0ce4e3c-5653-4564-ab51-f2ac0e62a53e 2025-07-23 16:39:18,265 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5248595347197477425', 'uuid-lslong': '11288698872061596821'}, 'enable': 'true', 'created': '2025-07-23T16:39:17', 'last-modified': '2025-07-23T16:39:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.460971'} 2025-07-23 16:39:18,274 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:39:18,281 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5248595347197477425', 'uuid-lslong': '11288698872061596821'}, 'enable': 'true', 'created': '2025-07-23T16:39:17', 'last-modified': '2025-07-23T16:39:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486716'} 2025-07-23 16:39:18,288 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:39:18,295 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5248595347197477425', 'uuid-lslong': '11288698872061596821'}, 'enable': 'true', 'created': '2025-07-23T16:39:17', 'last-modified': '2025-07-23T16:39:17', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492572'} 2025-07-23 16:39:18,302 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-23 16:39:18,302 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-15448493 passed 2025-07-23 16:39:18,303 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-15448493 in API_Server ====== 2025-07-23 16:39:18,303 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:18,310 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:18,325 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:18,436 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/48d6c1a8-f779-4231-9ca9-83d065959495 2025-07-23 16:39:18,452 - DEBUG - =>VN ctest-mgmt_vn-15448493 has no policy to be verified 2025-07-23 16:39:18,452 - DEBUG - Verifying the vn in opserver 2025-07-23 16:39:18,452 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493 virtual network link through opserver 10.0.0.23 2025-07-23 16:39:18,452 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:39:18,525 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493?flat'} 2025-07-23 16:39:18,525 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493 virtual network link through opserver 10.0.0.249 2025-07-23 16:39:18,525 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:39:18,584 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493?flat'} 2025-07-23 16:39:18,584 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493 virtual network link through opserver 10.0.0.73 2025-07-23 16:39:18,585 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:39:18,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493?flat'} 2025-07-23 16:39:18,648 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06881283:ctest-mgmt_vn-15448493 is found in opserver 2025-07-23 16:39:18,676 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:39:18,698 - DEBUG - VRF ids for VN ctest-mgmt_vn-15448493: {} 2025-07-23 16:39:18,997 - DEBUG - Response for create_network : {'network': {'id': '9e5a3dfa-6712-464e-a756-a12737039db4', 'name': 'ctest-trans_left_vn-47519035', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06881283', 'ctest-trans_left_vn-47519035'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:39:19,241 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f878d6b8-f4cf-41f0-a4da-4c2a29f6cb2c', 'name': '', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'network_id': '9e5a3dfa-6712-464e-a756-a12737039db4', 'ip_version': 4, 'cidr': '176.11.76.128/26', 'allocation_pools': [{'start': '176.11.76.130', 'end': '176.11.76.190'}], 'gateway_ip': '176.11.76.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '176.11.76.130', 'tags': [], 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4'}} 2025-07-23 16:39:19,265 - INFO - Created VN ctest-trans_left_vn-47519035 2025-07-23 16:39:19,283 - DEBUG - VN ctest-trans_left_vn-47519035 UUID is 9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,355 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:19,362 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:19,375 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:19,471 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,489 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,501 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/93a414bc-266f-4d8e-9154-ca1bdc108917 2025-07-23 16:39:19,511 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/93a414bc-266f-4d8e-9154-ca1bdc108917 2025-07-23 16:39:19,519 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/86e1313e-5b6f-4380-b370-098233ac1d6c 2025-07-23 16:39:19,528 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:39:19,528 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,549 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/93a414bc-266f-4d8e-9154-ca1bdc108917 2025-07-23 16:39:19,569 - INFO - Verified VN network id 15 for VN 9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,569 - INFO - Verifications in API Server for VN ctest-trans_left_vn-47519035 passed 2025-07-23 16:39:19,569 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,579 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/93a414bc-266f-4d8e-9154-ca1bdc108917 2025-07-23 16:39:19,587 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/93a414bc-266f-4d8e-9154-ca1bdc108917 2025-07-23 16:39:19,596 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/86e1313e-5b6f-4380-b370-098233ac1d6c 2025-07-23 16:39:19,613 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11410500751576942158', 'uuid-lslong': '12058002242129862068'}, 'enable': 'true', 'created': '2025-07-23T16:39:18', 'last-modified': '2025-07-23T16:39:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.434356'} 2025-07-23 16:39:19,621 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:39:19,629 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11410500751576942158', 'uuid-lslong': '12058002242129862068'}, 'enable': 'true', 'created': '2025-07-23T16:39:18', 'last-modified': '2025-07-23T16:39:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.448599'} 2025-07-23 16:39:19,638 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:39:19,646 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11410500751576942158', 'uuid-lslong': '12058002242129862068'}, 'enable': 'true', 'created': '2025-07-23T16:39:18', 'last-modified': '2025-07-23T16:39:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.467662'} 2025-07-23 16:39:19,655 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-23 16:39:19,655 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-47519035 passed 2025-07-23 16:39:19,656 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-47519035 in API_Server ====== 2025-07-23 16:39:19,656 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:19,666 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:19,692 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:19,804 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/9e5a3dfa-6712-464e-a756-a12737039db4 2025-07-23 16:39:19,817 - DEBUG - =>VN ctest-trans_left_vn-47519035 has no policy to be verified 2025-07-23 16:39:19,817 - DEBUG - Verifying the vn in opserver 2025-07-23 16:39:19,817 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035 virtual network link through opserver 10.0.0.23 2025-07-23 16:39:19,817 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:39:19,833 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035?flat'} 2025-07-23 16:39:19,833 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035 virtual network link through opserver 10.0.0.249 2025-07-23 16:39:19,833 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:39:19,848 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035?flat'} 2025-07-23 16:39:19,848 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035 virtual network link through opserver 10.0.0.73 2025-07-23 16:39:19,849 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:39:19,867 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035?flat'} 2025-07-23 16:39:19,867 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_left_vn-47519035 is found in opserver 2025-07-23 16:39:19,894 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:39:19,906 - DEBUG - VRF ids for VN ctest-trans_left_vn-47519035: {} 2025-07-23 16:39:20,218 - DEBUG - Response for create_network : {'network': {'id': '2f73c37c-a50d-4821-8e0b-f8f0b6a7b663', 'name': 'ctest-trans_right_vn-31161544', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-06881283', 'ctest-trans_right_vn-31161544'], 'port_security_enabled': True, 'description': ''}} 2025-07-23 16:39:20,456 - DEBUG - Response for create_subnet : {'subnet': {'id': 'dbe223a8-e8fd-4fc6-afdc-b7fabda5e427', 'name': '', 'tenant_id': '2821197cacd243e9b7b6a14bdf38f2f4', 'network_id': '2f73c37c-a50d-4821-8e0b-f8f0b6a7b663', 'ip_version': 4, 'cidr': '140.94.142.0/26', 'allocation_pools': [{'start': '140.94.142.2', 'end': '140.94.142.62'}], 'gateway_ip': '140.94.142.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '140.94.142.2', 'tags': [], 'project_id': '2821197cacd243e9b7b6a14bdf38f2f4'}} 2025-07-23 16:39:20,483 - INFO - Created VN ctest-trans_right_vn-31161544 2025-07-23 16:39:20,495 - DEBUG - VN ctest-trans_right_vn-31161544 UUID is 2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:20,589 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:20,597 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:20,611 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:20,722 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:20,739 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:20,758 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1cd99c0b-884d-4de3-a9f9-d257853df409 2025-07-23 16:39:20,771 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1cd99c0b-884d-4de3-a9f9-d257853df409 2025-07-23 16:39:20,783 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/5f740d5b-2d60-443b-b677-72afd3ab4e66 2025-07-23 16:39:20,793 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:39:20,793 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:20,808 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1cd99c0b-884d-4de3-a9f9-d257853df409 2025-07-23 16:39:20,829 - INFO - Verified VN network id 16 for VN 2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:20,829 - INFO - Verifications in API Server for VN ctest-trans_right_vn-31161544 passed 2025-07-23 16:39:20,830 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:20,846 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1cd99c0b-884d-4de3-a9f9-d257853df409 2025-07-23 16:39:20,857 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1cd99c0b-884d-4de3-a9f9-d257853df409 2025-07-23 16:39:20,868 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/5f740d5b-2d60-443b-b677-72afd3ab4e66 2025-07-23 16:39:20,887 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3419291482216810529', 'uuid-lslong': '10235548290869868131'}, 'enable': 'true', 'created': '2025-07-23T16:39:20', 'last-modified': '2025-07-23T16:39:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.492059'} 2025-07-23 16:39:20,899 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:39:20,908 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3419291482216810529', 'uuid-lslong': '10235548290869868131'}, 'enable': 'true', 'created': '2025-07-23T16:39:20', 'last-modified': '2025-07-23T16:39:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516992'} 2025-07-23 16:39:20,915 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:39:20,923 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-06881283', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3419291482216810529', 'uuid-lslong': '10235548290869868131'}, 'enable': 'true', 'created': '2025-07-23T16:39:20', 'last-modified': '2025-07-23T16:39:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.525295'} 2025-07-23 16:39:20,933 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-23 16:39:20,933 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-31161544 passed 2025-07-23 16:39:20,933 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-31161544 in API_Server ====== 2025-07-23 16:39:20,934 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:39:20,944 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:39:20,966 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:39:21,076 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/2f73c37c-a50d-4821-8e0b-f8f0b6a7b663 2025-07-23 16:39:21,091 - DEBUG - =>VN ctest-trans_right_vn-31161544 has no policy to be verified 2025-07-23 16:39:21,091 - DEBUG - Verifying the vn in opserver 2025-07-23 16:39:21,091 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544 virtual network link through opserver 10.0.0.23 2025-07-23 16:39:21,091 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks 2025-07-23 16:39:21,106 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544?flat'} 2025-07-23 16:39:21,106 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544 virtual network link through opserver 10.0.0.249 2025-07-23 16:39:21,106 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-07-23 16:39:21,125 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544?flat'} 2025-07-23 16:39:21,125 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544 virtual network link through opserver 10.0.0.73 2025-07-23 16:39:21,126 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks 2025-07-23 16:39:21,143 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544?flat'} 2025-07-23 16:39:21,143 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-06881283:ctest-trans_right_vn-31161544 is found in opserver 2025-07-23 16:39:21,184 - DEBUG - Do not have enough data to verify VN in agent 2025-07-23 16:39:21,204 - DEBUG - VRF ids for VN ctest-trans_right_vn-31161544: {} 2025-07-23 16:39:21,260 - DEBUG - Services list from nova: [, , , ] 2025-07-23 16:39:22,469 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-2) 2025-07-23 16:39:23,802 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3704-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3704-1) 2025-07-23 16:39:23,802 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-83326398'] 2025-07-23 16:39:24,128 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-83326398'] created succesfully 2025-07-23 16:41:04,768 - DEBUG - Installing image ubuntu 2025-07-23 16:41:04,768 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-07-23 16:41:04,768 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-23 16:41:04,768 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-23 16:41:04,769 - DEBUG - Unzip image 2025-07-23 16:41:04,769 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-23 16:41:04,787 - DEBUG - Try to create image in user context 2025-07-23 16:41:04,876 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-83326398'] 2025-07-23 16:41:04,975 - INFO - Service template: ['default-domain', 'ctest-service_template_1-83326398'] deleted successfully. 2025-07-23 16:41:04,976 - INFO - Skip interface_detach for VM ctest-right_vm-34806734 in state BUILD 2025-07-23 16:41:04,976 - INFO - Deleting VM ctest-right_vm-34806734 2025-07-23 16:41:05,009 - ERROR - VM ctest-right_vm-34806734 has failed to come up 2025-07-23 16:41:05,010 - ERROR - Nova failed to get host of the VM 2025-07-23 16:41:05,010 - ERROR - VM ctest-right_vm-34806734 has failed to come up 2025-07-23 16:41:05,010 - ERROR - Nova failed to get host of the VM 2025-07-23 16:41:05,079 - INFO - Skip interface_detach for VM ctest-left_vm-04497852 in state BUILD 2025-07-23 16:41:05,079 - INFO - Deleting VM ctest-left_vm-04497852 2025-07-23 16:41:05,080 - ERROR - VM ctest-left_vm-04497852 has failed to come up 2025-07-23 16:41:05,080 - ERROR - Nova failed to get host of the VM 2025-07-23 16:41:05,080 - ERROR - VM ctest-left_vm-04497852 has failed to come up 2025-07-23 16:41:05,081 - ERROR - Nova failed to get host of the VM 2025-07-23 16:41:05,159 - INFO - Deleting VN ctest-trans_right_vn-31161544 2025-07-23 16:41:05,326 - DEBUG - Response for deleting network () 2025-07-23 16:41:05,326 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/1cd99c0b-884d-4de3-a9f9-d257853df409 2025-07-23 16:41:05,333 - DEBUG - Response Code: 404 2025-07-23 16:41:05,334 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:41:05,340 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:41:05,366 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:41:05,468 - INFO - Validated that VN ctest-trans_right_vn-31161544 is not found in API Server 2025-07-23 16:41:05,503 - DEBUG - VN ctest-trans_right_vn-31161544 is not present in Agent 10.0.0.50 2025-07-23 16:41:05,515 - DEBUG - VN ctest-trans_right_vn-31161544 is not present in Agent 10.0.0.130 2025-07-23 16:41:05,515 - INFO - Validated that VN ctest-trans_right_vn-31161544 is not in any agent 2025-07-23 16:41:05,584 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-31161544 info 2025-07-23 16:41:05,585 - INFO - Deleting VN ctest-trans_left_vn-47519035 2025-07-23 16:41:05,786 - DEBUG - Response for deleting network () 2025-07-23 16:41:05,786 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/93a414bc-266f-4d8e-9154-ca1bdc108917 2025-07-23 16:41:05,801 - DEBUG - Response Code: 404 2025-07-23 16:41:05,801 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:41:05,809 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:41:05,841 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:41:05,984 - INFO - Validated that VN ctest-trans_left_vn-47519035 is not found in API Server 2025-07-23 16:41:06,024 - DEBUG - VN ctest-trans_left_vn-47519035 is not present in Agent 10.0.0.50 2025-07-23 16:41:06,040 - DEBUG - VN ctest-trans_left_vn-47519035 is not present in Agent 10.0.0.130 2025-07-23 16:41:06,040 - INFO - Validated that VN ctest-trans_left_vn-47519035 is not in any agent 2025-07-23 16:41:06,123 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-47519035 info 2025-07-23 16:41:06,124 - INFO - Deleting VN ctest-mgmt_vn-15448493 2025-07-23 16:41:06,303 - DEBUG - Response for deleting network () 2025-07-23 16:41:06,303 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/3d49e405-abc9-4ce7-afda-315557b40cfa 2025-07-23 16:41:06,312 - DEBUG - Response Code: 404 2025-07-23 16:41:06,312 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:41:06,321 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:41:06,345 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:41:06,438 - INFO - Validated that VN ctest-mgmt_vn-15448493 is not found in API Server 2025-07-23 16:41:06,464 - DEBUG - VN ctest-mgmt_vn-15448493 is not present in Agent 10.0.0.50 2025-07-23 16:41:06,477 - DEBUG - VN ctest-mgmt_vn-15448493 is not present in Agent 10.0.0.130 2025-07-23 16:41:06,477 - INFO - Validated that VN ctest-mgmt_vn-15448493 is not in any agent 2025-07-23 16:41:06,527 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-15448493 info 2025-07-23 16:41:06,527 - INFO - Deleting VN ctest-right-33000311 2025-07-23 16:41:06,685 - DEBUG - Response for deleting network () 2025-07-23 16:41:06,685 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/e9573b13-72dd-456e-96fa-14eb6c0f9b0f 2025-07-23 16:41:06,692 - DEBUG - Response Code: 404 2025-07-23 16:41:06,693 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:41:06,700 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:41:06,721 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:41:06,813 - INFO - Validated that VN ctest-right-33000311 is not found in API Server 2025-07-23 16:41:06,843 - DEBUG - VN ctest-right-33000311 is not present in Agent 10.0.0.50 2025-07-23 16:41:06,859 - DEBUG - VN ctest-right-33000311 is not present in Agent 10.0.0.130 2025-07-23 16:41:06,860 - INFO - Validated that VN ctest-right-33000311 is not in any agent 2025-07-23 16:41:06,907 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-33000311 info 2025-07-23 16:41:06,907 - INFO - Deleting VN ctest-left-05854954 2025-07-23 16:41:07,083 - DEBUG - Response for deleting network () 2025-07-23 16:41:07,083 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b38e24f4-1c2e-4ca6-bd01-ab61005ea3ff 2025-07-23 16:41:07,091 - DEBUG - Response Code: 404 2025-07-23 16:41:07,091 - DEBUG - Requesting: http://10.0.0.23:8082/domains 2025-07-23 16:41:07,100 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692 2025-07-23 16:41:07,134 - DEBUG - Requesting: http://10.0.0.23:8082/project/2821197c-acd2-43e9-b7b6-a14bdf38f2f4 2025-07-23 16:41:07,228 - INFO - Validated that VN ctest-left-05854954 is not found in API Server 2025-07-23 16:41:07,258 - DEBUG - VN ctest-left-05854954 is not present in Agent 10.0.0.50 2025-07-23 16:41:07,270 - DEBUG - VN ctest-left-05854954 is not present in Agent 10.0.0.130 2025-07-23 16:41:07,270 - INFO - Validated that VN ctest-left-05854954 is not in any agent 2025-07-23 16:41:07,318 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-05854954 info 2025-07-23 16:41:08,616 - ERROR -
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_mirror/test_mirror.py", line 24, in test_svc_v2_mirroring
    return self.verify_svc_mirroring()
  File "/contrail-test/common/servicechain/mirror/verify.py", line 14, in verify_svc_mirroring
    ret_dict = self.config_svc_mirroring(*args, **kwargs)
  File "/contrail-test/common/servicechain/mirror/config.py", line 42, in config_svc_mirroring
    create_svms=create_svms, **kwargs)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 580, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 199, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 339, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 410, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-23 16:41:08,648 - DEBUG - No XMPP flaps were noticed during the test 2025-07-23 16:41:08,649 - INFO -
2025-07-23 16:41:08,649 - INFO - END TEST : test_svc_v2_mirroring : FAILED[0:01:57]
2025-07-23 16:41:08,649 - INFO - -------------------------------------------------------------------------------- 2025-07-23 16:41:09,393 - INFO - Deleted project: ctest-TestSVCV2Mirror-06881283, ID : 2821197c-acd2-43e9-b7b6-a14bdf38f2f4