2025-07-24 04:21:28,628 - INFO - Domain Default found not creating 2025-07-24 04:21:28,812 - INFO - Project ctest-TestSVCV2Mirror-61005150 not found, creating it 2025-07-24 04:21:29,452 - INFO - Created Project:ctest-TestSVCV2Mirror-61005150, ID : efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:30,981 - INFO - ================================================================================ 2025-07-24 04:21:30,981 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-07-24 04:21:30,981 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-07-24 04:21:32,266 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.20.0.17': '0', '10.20.0.129': '0'}, '10.0.0.23': {'10.20.0.129': '0', '10.20.0.17': '0'}} with 2025-07-24 04:21:32,267 - INFO - Initial checks done. Running the testcase now 2025-07-24 04:21:32,267 - INFO - 2025-07-24 04:21:33,098 - DEBUG - Response for create_network : {'network': {'id': '1d2c3651-80db-46ca-b0b9-4f72516d5047', 'name': 'ctest-left-54244296', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'project_id': 'efabaa7a316d4e9886b54db99cda15e2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61005150', 'ctest-left-54244296'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:21:33,413 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f33c8c96-3109-434a-8022-88765ad7af23', 'name': '', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'network_id': '1d2c3651-80db-46ca-b0b9-4f72516d5047', 'ip_version': 4, 'cidr': '103.160.162.128/26', 'allocation_pools': [{'start': '103.160.162.130', 'end': '103.160.162.190'}], 'gateway_ip': '103.160.162.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.160.162.130', 'tags': [], 'project_id': 'efabaa7a316d4e9886b54db99cda15e2'}} 2025-07-24 04:21:33,442 - INFO - Created VN ctest-left-54244296 2025-07-24 04:21:33,457 - DEBUG - VN ctest-left-54244296 UUID is 1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:33,550 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:33,856 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:33,887 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:33,908 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:34,008 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:34,027 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:34,041 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b159cc32-12b2-4cb3-8bb2-ae1b972c948c 2025-07-24 04:21:34,054 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b159cc32-12b2-4cb3-8bb2-ae1b972c948c 2025-07-24 04:21:34,064 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/5794bc76-6d21-4177-808e-605e4efdcc7a 2025-07-24 04:21:34,074 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:21:34,074 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:34,085 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b159cc32-12b2-4cb3-8bb2-ae1b972c948c 2025-07-24 04:21:34,104 - INFO - Verified VN network id 11 for VN 1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:34,104 - INFO - Verifications in API Server for VN ctest-left-54244296 passed 2025-07-24 04:21:34,105 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:34,119 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b159cc32-12b2-4cb3-8bb2-ae1b972c948c 2025-07-24 04:21:34,128 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b159cc32-12b2-4cb3-8bb2-ae1b972c948c 2025-07-24 04:21:34,136 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/5794bc76-6d21-4177-808e-605e4efdcc7a 2025-07-24 04:21:34,149 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2102114849757284042', 'uuid-lslong': '12734296773777772615'}, 'enable': 'true', 'created': '2025-07-24T04:21:33', 'last-modified': '2025-07-24T04:21:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.796645'} 2025-07-24 04:21:34,157 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:21:34,164 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2102114849757284042', 'uuid-lslong': '12734296773777772615'}, 'enable': 'true', 'created': '2025-07-24T04:21:33', 'last-modified': '2025-07-24T04:21:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.810766'} 2025-07-24 04:21:34,172 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:21:34,178 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2102114849757284042', 'uuid-lslong': '12734296773777772615'}, 'enable': 'true', 'created': '2025-07-24T04:21:33', 'last-modified': '2025-07-24T04:21:33', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.829125'} 2025-07-24 04:21:34,186 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-07-24 04:21:34,186 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-54244296 passed 2025-07-24 04:21:34,186 - DEBUG - ====Verifying policy data for ctest-left-54244296 in API_Server ====== 2025-07-24 04:21:34,186 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:34,194 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:34,208 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:34,317 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/1d2c3651-80db-46ca-b0b9-4f72516d5047 2025-07-24 04:21:34,329 - DEBUG - =>VN ctest-left-54244296 has no policy to be verified 2025-07-24 04:21:34,329 - DEBUG - Verifying the vn in opserver 2025-07-24 04:21:34,329 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296 virtual network link through opserver 10.0.0.19 2025-07-24 04:21:34,329 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:21:34,647 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:21:34,720 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296?flat'} 2025-07-24 04:21:34,720 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296 virtual network link through opserver 10.0.0.38 2025-07-24 04:21:34,720 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:21:35,029 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:21:35,103 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296?flat'} 2025-07-24 04:21:35,103 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296 virtual network link through opserver 10.0.0.41 2025-07-24 04:21:35,103 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:21:35,440 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:21:35,513 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296?flat'} 2025-07-24 04:21:35,514 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61005150:ctest-left-54244296 is found in opserver 2025-07-24 04:21:35,542 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:21:35,556 - DEBUG - VRF ids for VN ctest-left-54244296: {} 2025-07-24 04:21:35,857 - DEBUG - Response for create_network : {'network': {'id': '8420c35c-e23f-4ead-839c-874154c4aa3f', 'name': 'ctest-right-83245703', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'project_id': 'efabaa7a316d4e9886b54db99cda15e2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61005150', 'ctest-right-83245703'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:21:36,154 - DEBUG - Response for create_subnet : {'subnet': {'id': '809691e2-3b1b-499c-a86b-f7caa758a318', 'name': '', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'network_id': '8420c35c-e23f-4ead-839c-874154c4aa3f', 'ip_version': 4, 'cidr': '56.80.208.192/26', 'allocation_pools': [{'start': '56.80.208.194', 'end': '56.80.208.254'}], 'gateway_ip': '56.80.208.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.80.208.194', 'tags': [], 'project_id': 'efabaa7a316d4e9886b54db99cda15e2'}} 2025-07-24 04:21:36,179 - INFO - Created VN ctest-right-83245703 2025-07-24 04:21:36,195 - DEBUG - VN ctest-right-83245703 UUID is 8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,286 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:36,296 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:36,311 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:36,415 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,429 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,442 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b6251b97-54b8-48e9-aa04-0dd306d2800e 2025-07-24 04:21:36,456 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b6251b97-54b8-48e9-aa04-0dd306d2800e 2025-07-24 04:21:36,467 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/ace3e98c-257e-4a48-ab9b-81196e3a396b 2025-07-24 04:21:36,476 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:21:36,476 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,490 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b6251b97-54b8-48e9-aa04-0dd306d2800e 2025-07-24 04:21:36,513 - INFO - Verified VN network id 12 for VN 8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,513 - INFO - Verifications in API Server for VN ctest-right-83245703 passed 2025-07-24 04:21:36,513 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,531 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b6251b97-54b8-48e9-aa04-0dd306d2800e 2025-07-24 04:21:36,544 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b6251b97-54b8-48e9-aa04-0dd306d2800e 2025-07-24 04:21:36,554 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/ace3e98c-257e-4a48-ab9b-81196e3a396b 2025-07-24 04:21:36,569 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9520824415961435821', 'uuid-lslong': '9483603630000220735'}, 'enable': 'true', 'created': '2025-07-24T04:21:35', 'last-modified': '2025-07-24T04:21:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.487925'} 2025-07-24 04:21:36,578 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:21:36,586 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9520824415961435821', 'uuid-lslong': '9483603630000220735'}, 'enable': 'true', 'created': '2025-07-24T04:21:35', 'last-modified': '2025-07-24T04:21:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.504366'} 2025-07-24 04:21:36,595 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:21:36,605 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9520824415961435821', 'uuid-lslong': '9483603630000220735'}, 'enable': 'true', 'created': '2025-07-24T04:21:35', 'last-modified': '2025-07-24T04:21:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.519941'} 2025-07-24 04:21:36,614 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-07-24 04:21:36,614 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-83245703 passed 2025-07-24 04:21:36,614 - DEBUG - ====Verifying policy data for ctest-right-83245703 in API_Server ====== 2025-07-24 04:21:36,614 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:36,622 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:36,637 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:36,741 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/8420c35c-e23f-4ead-839c-874154c4aa3f 2025-07-24 04:21:36,757 - DEBUG - =>VN ctest-right-83245703 has no policy to be verified 2025-07-24 04:21:36,757 - DEBUG - Verifying the vn in opserver 2025-07-24 04:21:36,757 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703 virtual network link through opserver 10.0.0.19 2025-07-24 04:21:36,757 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:21:36,823 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703?flat'} 2025-07-24 04:21:36,823 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703 virtual network link through opserver 10.0.0.38 2025-07-24 04:21:36,823 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:21:36,889 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703?flat'} 2025-07-24 04:21:36,889 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703 virtual network link through opserver 10.0.0.41 2025-07-24 04:21:36,889 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:21:36,951 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703?flat'} 2025-07-24 04:21:36,951 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61005150:ctest-right-83245703 is found in opserver 2025-07-24 04:21:36,981 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:21:36,995 - DEBUG - VRF ids for VN ctest-right-83245703: {} 2025-07-24 04:21:37,327 - DEBUG - Response for create_network : {'network': {'id': 'cdc19114-7a9c-4e03-be4b-285577881ac5', 'name': 'ctest-mgmt_vn-10245514', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'project_id': 'efabaa7a316d4e9886b54db99cda15e2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61005150', 'ctest-mgmt_vn-10245514'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:21:37,605 - DEBUG - Response for create_subnet : {'subnet': {'id': 'e0b743e7-6b3a-4b86-a3f3-deadcd5b27a8', 'name': '', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'network_id': 'cdc19114-7a9c-4e03-be4b-285577881ac5', 'ip_version': 4, 'cidr': '219.139.131.192/26', 'allocation_pools': [{'start': '219.139.131.194', 'end': '219.139.131.254'}], 'gateway_ip': '219.139.131.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '219.139.131.194', 'tags': [], 'project_id': 'efabaa7a316d4e9886b54db99cda15e2'}} 2025-07-24 04:21:37,637 - INFO - Created VN ctest-mgmt_vn-10245514 2025-07-24 04:21:37,657 - DEBUG - VN ctest-mgmt_vn-10245514 UUID is cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:37,753 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:37,762 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:37,782 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:37,904 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:37,921 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:37,933 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/99bba742-1a46-43d5-bc85-57352d2cc617 2025-07-24 04:21:37,942 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/99bba742-1a46-43d5-bc85-57352d2cc617 2025-07-24 04:21:37,956 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/8f8980e7-3abd-4868-8205-87f99cfc17c6 2025-07-24 04:21:37,967 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:21:37,967 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:37,983 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/99bba742-1a46-43d5-bc85-57352d2cc617 2025-07-24 04:21:38,008 - INFO - Verified VN network id 13 for VN cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:38,008 - INFO - Verifications in API Server for VN ctest-mgmt_vn-10245514 passed 2025-07-24 04:21:38,009 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:38,026 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/99bba742-1a46-43d5-bc85-57352d2cc617 2025-07-24 04:21:38,041 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/99bba742-1a46-43d5-bc85-57352d2cc617 2025-07-24 04:21:38,052 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/8f8980e7-3abd-4868-8205-87f99cfc17c6 2025-07-24 04:21:38,072 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14826290965422820867', 'uuid-lslong': '13712097838002346693'}, 'enable': 'true', 'created': '2025-07-24T04:21:37', 'last-modified': '2025-07-24T04:21:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.542692'} 2025-07-24 04:21:38,079 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:21:38,087 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14826290965422820867', 'uuid-lslong': '13712097838002346693'}, 'enable': 'true', 'created': '2025-07-24T04:21:37', 'last-modified': '2025-07-24T04:21:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.555162'} 2025-07-24 04:21:38,095 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:21:38,102 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14826290965422820867', 'uuid-lslong': '13712097838002346693'}, 'enable': 'true', 'created': '2025-07-24T04:21:37', 'last-modified': '2025-07-24T04:21:37', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.574534'} 2025-07-24 04:21:38,110 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-07-24 04:21:38,110 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-10245514 passed 2025-07-24 04:21:38,110 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-10245514 in API_Server ====== 2025-07-24 04:21:38,110 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:38,118 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:38,141 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:38,277 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/cdc19114-7a9c-4e03-be4b-285577881ac5 2025-07-24 04:21:38,293 - DEBUG - =>VN ctest-mgmt_vn-10245514 has no policy to be verified 2025-07-24 04:21:38,293 - DEBUG - Verifying the vn in opserver 2025-07-24 04:21:38,293 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514 virtual network link through opserver 10.0.0.19 2025-07-24 04:21:38,293 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:21:38,373 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514?flat'} 2025-07-24 04:21:38,373 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514 virtual network link through opserver 10.0.0.38 2025-07-24 04:21:38,373 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:21:38,443 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514?flat'} 2025-07-24 04:21:38,443 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514 virtual network link through opserver 10.0.0.41 2025-07-24 04:21:38,443 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:21:38,519 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514?flat'} 2025-07-24 04:21:38,519 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61005150:ctest-mgmt_vn-10245514 is found in opserver 2025-07-24 04:21:38,550 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:21:38,568 - DEBUG - VRF ids for VN ctest-mgmt_vn-10245514: {} 2025-07-24 04:21:38,909 - DEBUG - Response for create_network : {'network': {'id': '9b9513e1-3f02-4380-a733-5923c59ff1dc', 'name': 'ctest-trans_left_vn-98325984', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'project_id': 'efabaa7a316d4e9886b54db99cda15e2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61005150', 'ctest-trans_left_vn-98325984'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:21:39,179 - DEBUG - Response for create_subnet : {'subnet': {'id': '6a11d728-639f-4d47-a67b-d355ac3c3f4f', 'name': '', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'network_id': '9b9513e1-3f02-4380-a733-5923c59ff1dc', 'ip_version': 4, 'cidr': '19.175.244.192/26', 'allocation_pools': [{'start': '19.175.244.194', 'end': '19.175.244.254'}], 'gateway_ip': '19.175.244.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '19.175.244.194', 'tags': [], 'project_id': 'efabaa7a316d4e9886b54db99cda15e2'}} 2025-07-24 04:21:39,209 - INFO - Created VN ctest-trans_left_vn-98325984 2025-07-24 04:21:39,224 - DEBUG - VN ctest-trans_left_vn-98325984 UUID is 9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,324 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:39,331 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:39,349 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:39,452 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,486 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,498 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6eb6ab99-9904-4616-90eb-3894bc3f340a 2025-07-24 04:21:39,510 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6eb6ab99-9904-4616-90eb-3894bc3f340a 2025-07-24 04:21:39,518 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a4db1036-2f68-49ba-82bb-75fdd86da11b 2025-07-24 04:21:39,527 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:21:39,527 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,539 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6eb6ab99-9904-4616-90eb-3894bc3f340a 2025-07-24 04:21:39,562 - INFO - Verified VN network id 14 for VN 9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,562 - INFO - Verifications in API Server for VN ctest-trans_left_vn-98325984 passed 2025-07-24 04:21:39,562 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,575 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6eb6ab99-9904-4616-90eb-3894bc3f340a 2025-07-24 04:21:39,586 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6eb6ab99-9904-4616-90eb-3894bc3f340a 2025-07-24 04:21:39,596 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/a4db1036-2f68-49ba-82bb-75fdd86da11b 2025-07-24 04:21:39,617 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11210888705554400128', 'uuid-lslong': '12048071438320529884'}, 'enable': 'true', 'created': '2025-07-24T04:21:38', 'last-modified': '2025-07-24T04:21:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.490720'} 2025-07-24 04:21:39,636 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:21:39,651 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11210888705554400128', 'uuid-lslong': '12048071438320529884'}, 'enable': 'true', 'created': '2025-07-24T04:21:38', 'last-modified': '2025-07-24T04:21:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.528151'} 2025-07-24 04:21:39,660 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:21:39,668 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11210888705554400128', 'uuid-lslong': '12048071438320529884'}, 'enable': 'true', 'created': '2025-07-24T04:21:38', 'last-modified': '2025-07-24T04:21:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.548105'} 2025-07-24 04:21:39,681 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-07-24 04:21:39,681 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-98325984 passed 2025-07-24 04:21:39,681 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-98325984 in API_Server ====== 2025-07-24 04:21:39,681 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:39,690 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:39,707 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:39,807 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/9b9513e1-3f02-4380-a733-5923c59ff1dc 2025-07-24 04:21:39,828 - DEBUG - =>VN ctest-trans_left_vn-98325984 has no policy to be verified 2025-07-24 04:21:39,828 - DEBUG - Verifying the vn in opserver 2025-07-24 04:21:39,828 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984 virtual network link through opserver 10.0.0.19 2025-07-24 04:21:39,828 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:21:39,873 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984?flat'} 2025-07-24 04:21:39,874 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984 virtual network link through opserver 10.0.0.38 2025-07-24 04:21:39,874 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:21:39,890 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984?flat'} 2025-07-24 04:21:39,891 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984 virtual network link through opserver 10.0.0.41 2025-07-24 04:21:39,891 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:21:39,910 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984?flat'} 2025-07-24 04:21:39,910 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_left_vn-98325984 is found in opserver 2025-07-24 04:21:39,968 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:21:39,996 - DEBUG - VRF ids for VN ctest-trans_left_vn-98325984: {} 2025-07-24 04:21:40,361 - DEBUG - Response for create_network : {'network': {'id': 'fd4d1245-7463-4787-a0ef-4d787e583d47', 'name': 'ctest-trans_right_vn-09118396', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'project_id': 'efabaa7a316d4e9886b54db99cda15e2', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61005150', 'ctest-trans_right_vn-09118396'], 'port_security_enabled': True, 'description': ''}} 2025-07-24 04:21:40,652 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd06e23c1-e5ab-41f8-9c85-1d9df2451255', 'name': '', 'tenant_id': 'efabaa7a316d4e9886b54db99cda15e2', 'network_id': 'fd4d1245-7463-4787-a0ef-4d787e583d47', 'ip_version': 4, 'cidr': '181.213.40.0/26', 'allocation_pools': [{'start': '181.213.40.2', 'end': '181.213.40.62'}], 'gateway_ip': '181.213.40.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '181.213.40.2', 'tags': [], 'project_id': 'efabaa7a316d4e9886b54db99cda15e2'}} 2025-07-24 04:21:40,678 - INFO - Created VN ctest-trans_right_vn-09118396 2025-07-24 04:21:40,694 - DEBUG - VN ctest-trans_right_vn-09118396 UUID is fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:40,779 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:40,787 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:40,804 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:40,916 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:40,931 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:40,942 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f9c23356-a1a0-47a1-a044-7fa590f82457 2025-07-24 04:21:40,953 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f9c23356-a1a0-47a1-a044-7fa590f82457 2025-07-24 04:21:40,963 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/5e03a2ff-02ed-4e7e-a927-528830fff1e3 2025-07-24 04:21:40,975 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:21:40,975 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:40,990 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f9c23356-a1a0-47a1-a044-7fa590f82457 2025-07-24 04:21:41,014 - INFO - Verified VN network id 15 for VN fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:41,015 - INFO - Verifications in API Server for VN ctest-trans_right_vn-09118396 passed 2025-07-24 04:21:41,015 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:41,029 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f9c23356-a1a0-47a1-a044-7fa590f82457 2025-07-24 04:21:41,040 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f9c23356-a1a0-47a1-a044-7fa590f82457 2025-07-24 04:21:41,051 - DEBUG - Requesting: http://10.0.0.19:8082/route-target/5e03a2ff-02ed-4e7e-a927-528830fff1e3 2025-07-24 04:21:41,072 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18252264954317195143', 'uuid-lslong': '11596572745413442887'}, 'enable': 'true', 'created': '2025-07-24T04:21:40', 'last-modified': '2025-07-24T04:21:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.511761'} 2025-07-24 04:21:41,084 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:21:41,091 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18252264954317195143', 'uuid-lslong': '11596572745413442887'}, 'enable': 'true', 'created': '2025-07-24T04:21:40', 'last-modified': '2025-07-24T04:21:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.535147'} 2025-07-24 04:21:41,100 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:21:41,110 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61005150', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '18252264954317195143', 'uuid-lslong': '11596572745413442887'}, 'enable': 'true', 'created': '2025-07-24T04:21:40', 'last-modified': '2025-07-24T04:21:40', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.533624'} 2025-07-24 04:21:41,119 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-07-24 04:21:41,120 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-09118396 passed 2025-07-24 04:21:41,120 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-09118396 in API_Server ====== 2025-07-24 04:21:41,120 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:21:41,129 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:21:41,149 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:21:41,247 - DEBUG - Requesting: http://10.0.0.19:8082/virtual-network/fd4d1245-7463-4787-a0ef-4d787e583d47 2025-07-24 04:21:41,265 - DEBUG - =>VN ctest-trans_right_vn-09118396 has no policy to be verified 2025-07-24 04:21:41,265 - DEBUG - Verifying the vn in opserver 2025-07-24 04:21:41,265 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396 virtual network link through opserver 10.0.0.19 2025-07-24 04:21:41,265 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-07-24 04:21:41,281 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396?flat'} 2025-07-24 04:21:41,281 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396 virtual network link through opserver 10.0.0.38 2025-07-24 04:21:41,281 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-07-24 04:21:41,297 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396?flat'} 2025-07-24 04:21:41,297 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396 virtual network link through opserver 10.0.0.41 2025-07-24 04:21:41,297 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-07-24 04:21:41,314 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396?flat'} 2025-07-24 04:21:41,314 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61005150:ctest-trans_right_vn-09118396 is found in opserver 2025-07-24 04:21:41,349 - DEBUG - Do not have enough data to verify VN in agent 2025-07-24 04:21:41,368 - DEBUG - VRF ids for VN ctest-trans_right_vn-09118396: {} 2025-07-24 04:21:41,460 - DEBUG - Services list from nova: [, , , ] 2025-07-24 04:21:42,722 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-1) 2025-07-24 04:21:44,245 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3712-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3712-2) 2025-07-24 04:21:44,246 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-22143496'] 2025-07-24 04:21:44,589 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-22143496'] created succesfully 2025-07-24 04:23:25,438 - DEBUG - Installing image ubuntu 2025-07-24 04:23:25,439 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd', 'vctmpl': 'ubuntu.vmtx', 'vcname': 'ubuntu-disk1.vmdk'} 2025-07-24 04:23:25,439 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-24 04:23:25,439 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-07-24 04:23:25,440 - DEBUG - Unzip image 2025-07-24 04:23:25,440 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-07-24 04:23:25,466 - DEBUG - Try to create image in user context 2025-07-24 04:23:25,549 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-22143496'] 2025-07-24 04:23:25,655 - INFO - Service template: ['default-domain', 'ctest-service_template_1-22143496'] deleted successfully. 2025-07-24 04:23:25,656 - INFO - Skip interface_detach for VM ctest-right_vm-98193886 in state BUILD 2025-07-24 04:23:25,656 - INFO - Deleting VM ctest-right_vm-98193886 2025-07-24 04:23:25,703 - ERROR - VM ctest-right_vm-98193886 has failed to come up 2025-07-24 04:23:25,705 - ERROR - Nova failed to get host of the VM 2025-07-24 04:23:25,705 - ERROR - VM ctest-right_vm-98193886 has failed to come up 2025-07-24 04:23:25,705 - ERROR - Nova failed to get host of the VM 2025-07-24 04:23:25,790 - INFO - Skip interface_detach for VM ctest-left_vm-53231745 in state BUILD 2025-07-24 04:23:25,790 - INFO - Deleting VM ctest-left_vm-53231745 2025-07-24 04:23:25,790 - ERROR - VM ctest-left_vm-53231745 has failed to come up 2025-07-24 04:23:25,790 - ERROR - Nova failed to get host of the VM 2025-07-24 04:23:25,790 - ERROR - VM ctest-left_vm-53231745 has failed to come up 2025-07-24 04:23:25,790 - ERROR - Nova failed to get host of the VM 2025-07-24 04:23:25,875 - INFO - Deleting VN ctest-trans_right_vn-09118396 2025-07-24 04:23:26,059 - DEBUG - Response for deleting network () 2025-07-24 04:23:26,059 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/f9c23356-a1a0-47a1-a044-7fa590f82457 2025-07-24 04:23:26,071 - DEBUG - Response Code: 404 2025-07-24 04:23:26,072 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:23:26,080 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:23:26,109 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:23:26,230 - INFO - Validated that VN ctest-trans_right_vn-09118396 is not found in API Server 2025-07-24 04:23:26,247 - DEBUG - VN ctest-trans_right_vn-09118396 is not present in Agent 10.0.0.57 2025-07-24 04:23:26,266 - DEBUG - VN ctest-trans_right_vn-09118396 is not present in Agent 10.0.0.23 2025-07-24 04:23:26,266 - INFO - Validated that VN ctest-trans_right_vn-09118396 is not in any agent 2025-07-24 04:23:26,311 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-09118396 info 2025-07-24 04:23:26,311 - INFO - Deleting VN ctest-trans_left_vn-98325984 2025-07-24 04:23:26,515 - DEBUG - Response for deleting network () 2025-07-24 04:23:26,515 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/6eb6ab99-9904-4616-90eb-3894bc3f340a 2025-07-24 04:23:26,525 - DEBUG - Response Code: 404 2025-07-24 04:23:26,525 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:23:26,536 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:23:26,576 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:23:26,764 - INFO - Validated that VN ctest-trans_left_vn-98325984 is not found in API Server 2025-07-24 04:23:26,780 - DEBUG - VN ctest-trans_left_vn-98325984 is not present in Agent 10.0.0.57 2025-07-24 04:23:26,800 - DEBUG - VN ctest-trans_left_vn-98325984 is not present in Agent 10.0.0.23 2025-07-24 04:23:26,800 - INFO - Validated that VN ctest-trans_left_vn-98325984 is not in any agent 2025-07-24 04:23:26,886 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-98325984 info 2025-07-24 04:23:26,886 - INFO - Deleting VN ctest-mgmt_vn-10245514 2025-07-24 04:23:27,129 - DEBUG - Response for deleting network () 2025-07-24 04:23:27,129 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/99bba742-1a46-43d5-bc85-57352d2cc617 2025-07-24 04:23:27,137 - DEBUG - Response Code: 404 2025-07-24 04:23:27,137 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:23:27,156 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:23:27,205 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:23:27,341 - INFO - Validated that VN ctest-mgmt_vn-10245514 is not found in API Server 2025-07-24 04:23:27,362 - DEBUG - VN ctest-mgmt_vn-10245514 is not present in Agent 10.0.0.57 2025-07-24 04:23:27,384 - DEBUG - VN ctest-mgmt_vn-10245514 is not present in Agent 10.0.0.23 2025-07-24 04:23:27,385 - INFO - Validated that VN ctest-mgmt_vn-10245514 is not in any agent 2025-07-24 04:23:27,438 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-10245514 info 2025-07-24 04:23:27,438 - INFO - Deleting VN ctest-right-83245703 2025-07-24 04:23:27,618 - DEBUG - Response for deleting network () 2025-07-24 04:23:27,618 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b6251b97-54b8-48e9-aa04-0dd306d2800e 2025-07-24 04:23:27,626 - DEBUG - Response Code: 404 2025-07-24 04:23:27,626 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:23:27,656 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:23:27,672 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:23:27,785 - INFO - Validated that VN ctest-right-83245703 is not found in API Server 2025-07-24 04:23:27,801 - DEBUG - VN ctest-right-83245703 is not present in Agent 10.0.0.57 2025-07-24 04:23:27,814 - DEBUG - VN ctest-right-83245703 is not present in Agent 10.0.0.23 2025-07-24 04:23:27,814 - INFO - Validated that VN ctest-right-83245703 is not in any agent 2025-07-24 04:23:27,853 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-83245703 info 2025-07-24 04:23:27,853 - INFO - Deleting VN ctest-left-54244296 2025-07-24 04:23:28,055 - DEBUG - Response for deleting network () 2025-07-24 04:23:28,055 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/b159cc32-12b2-4cb3-8bb2-ae1b972c948c 2025-07-24 04:23:28,068 - DEBUG - Response Code: 404 2025-07-24 04:23:28,069 - DEBUG - Requesting: http://10.0.0.19:8082/domains 2025-07-24 04:23:28,078 - DEBUG - Requesting: http://10.0.0.19:8082/domain/ef05d1d9-2fbc-48d4-8924-0cbd930e68f2 2025-07-24 04:23:28,094 - DEBUG - Requesting: http://10.0.0.19:8082/project/efabaa7a-316d-4e98-86b5-4db99cda15e2 2025-07-24 04:23:28,206 - INFO - Validated that VN ctest-left-54244296 is not found in API Server 2025-07-24 04:23:28,221 - DEBUG - VN ctest-left-54244296 is not present in Agent 10.0.0.57 2025-07-24 04:23:28,234 - DEBUG - VN ctest-left-54244296 is not present in Agent 10.0.0.23 2025-07-24 04:23:28,235 - INFO - Validated that VN ctest-left-54244296 is not in any agent 2025-07-24 04:23:28,282 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-54244296 info 2025-07-24 04:23:29,554 - ERROR - 
Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/svc_mirror/test_mirror.py", line 24, in test_svc_v2_mirroring
    return self.verify_svc_mirroring()
  File "/contrail-test/common/servicechain/mirror/verify.py", line 14, in verify_svc_mirroring
    ret_dict = self.config_svc_mirroring(*args, **kwargs)
  File "/contrail-test/common/servicechain/mirror/config.py", line 42, in config_svc_mirroring
    create_svms=create_svms, **kwargs)
  File "/contrail-test/common/servicechain/verify.py", line 320, in verify_svc_chain
    ret_dict = svc_chain_info or self.config_svc_chain(*args, **kwargs)
  File "/contrail-test/common/servicechain/config.py", line 533, in config_svc_chain
    max_inst=max_inst)
  File "/contrail-test/common/servicechain/config.py", line 335, in create_service_vms
    zone=random.choice(valid_zones))
  File "/contrail-test/common/servicechain/config.py", line 161, in config_vm_only
    flavor=flavor, zone=zone, node_name=node_name,**kwargs)
  File "/contrail-test/common/servicechain/config.py", line 203, in config_vm
    flavor=flavor, vn_objs=vns, count=count, zone=zone,**kwargs))
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 756, in useFixture
    reraise(*exc_info)
  File "/usr/local/lib/python3.6/site-packages/testtools/_compat3x.py", line 16, in reraise
    raise exc_obj.with_traceback(exc_tb)
  File "/usr/local/lib/python3.6/site-packages/testtools/testcase.py", line 731, in useFixture
    fixture.setUp()
  File "/contrail-test/fixtures/vm_test.py", line 188, in setUp
    self.create()
  File "/contrail-test/fixtures/vm_test.py", line 240, in create
    fixed_ips=self.fixed_ips)
  File "/contrail-test/fixtures/openstack.py", line 118, in create_vm
    return self.nova_h.create_vm(vm_name=vm_name, image_name=image_name, vn_ids=vn_ids, **kwargs)
  File "/contrail-test/fixtures/nova_test.py", line 577, in create_vm
    image = self.get_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 198, in get_image
    self._install_image(image_name=image_name)
  File "/contrail-test/fixtures/nova_test.py", line 338, in _install_image
    return self.copy_and_glance(build_path, image_name, params)
  File "/contrail-test/fixtures/nova_test.py", line 407, in copy_and_glance
    image_id = self.glance_h.create_image(generic_image_name, image_path_real, **params)
  File "/contrail-test/fixtures/glance_test.py", line 50, in create_image
    self.upload_image(obj['id'], filename)
  File "/contrail-test/fixtures/glance_test.py", line 54, in upload_image
    self.obj.images.upload(uuid, open(filename, 'rb'))
FileNotFoundError: [Errno 2] No such file or directory: '/contrail-test/images/ubuntu.vmdk'
2025-07-24 04:23:29,572 - DEBUG - No XMPP flaps were noticed during the test 2025-07-24 04:23:29,572 - INFO -
2025-07-24 04:23:29,572 - INFO - END TEST : test_svc_v2_mirroring : FAILED[0:01:59]
2025-07-24 04:23:29,572 - INFO - -------------------------------------------------------------------------------- 2025-07-24 04:23:30,408 - INFO - Deleted project: ctest-TestSVCV2Mirror-61005150, ID : efabaa7a-316d-4e98-86b5-4db99cda15e2