2026-10-21 16:40:07,602 - INFO - Domain Default found not creating 2026-10-21 16:40:07,960 - INFO - Project ctest-TestCRUD-41053282 not found, creating it 2026-10-21 16:40:08,465 - INFO - Created Project:ctest-TestCRUD-41053282, ID : bbfac0d2-0501-4874-b5ca-7f155dcffef7 2026-10-21 16:40:10,378 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg1-22347170'] 2026-10-21 16:40:11,409 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg2-30719344'] 2026-10-21 16:40:12,790 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg1-83136097'] 2026-10-21 16:40:13,575 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg2-05810458'] 2026-10-21 16:40:14,458 - INFO - ================================================================================ 2026-10-21 16:40:14,458 - INFO - STARTING TEST : test_network_tags_crud 2026-10-21 16:40:14,459 - INFO - TEST DESCRIPTION : Tag CRUD on a network: set/list/append/show/delete/delete-all/ filter. Regression guard for OpenSDN-io/community#124. 2026-10-21 16:40:14,735 - DEBUG - Nothing to compare xmpp stats {'10.0.0.190': {'10.20.0.25': '0'}} with 2026-10-21 16:40:14,735 - INFO - Initial checks done. Running the testcase now 2026-10-21 16:40:14,735 - INFO - 2026-10-21 16:40:15,252 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg2-05810458'] 2026-10-21 16:40:15,326 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg1-83136097'] 2026-10-21 16:40:15,406 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg2-30719344'] 2026-10-21 16:40:15,484 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg1-22347170'] 2026-10-21 16:40:15,827 - ERROR - InternalServerError Python 3.9.25: /usr/bin/python3 Wed Oct 21 16:40:15 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/neutron/test_crud.py in test_network_tags_crud(self=) 605 606 # append: single PUT must add, not wipe the set 607 c.add_tag('networks', net_id, 'c') 608 assert tags() == {'a', 'b', 'c'}, 'add_tag replaced the set' 609 c = c.add_tag = > net_id = '6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62' /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in add_tag(self=, resource_type='networks', resource_id='6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62', tag='c', **_params={}) 2092 def add_tag(self, resource_type, resource_id, tag, **_params): 2093 """Add a tag on the resource.""" 2094 return self.put(self.tag_path % (resource_type, resource_id, tag)) 2095 2096 def replace_tag(self, resource_type, resource_id, body, **_params): self = self.put = > self.tag_path = '/%s/%s/tags/%s' resource_type = 'networks' resource_id = '6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62' tag = 'c' /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in put(self=, action='/networks/6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62/tags/c', body=None, headers=None, params=None) 360 361 def put(self, action, body=None, headers=None, params=None): 362 return self.retry_request("PUT", action, body=body, 363 headers=headers, params=params) 364 self = self.retry_request = > action = '/networks/6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62/tags/c' body = None headers = None params = None /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in retry_request(self=, method='PUT', action='/networks/6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62/tags/c', body=None, headers=None, params=None) 328 for i in range(max_attempts): 329 try: 330 return self.do_request(method, action, body=body, 331 headers=headers, params=params) 332 except (exceptions.ConnectionFailed, ksa_exc.ConnectionError): self = self.do_request = > method = 'PUT' action = '/networks/6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62/tags/c' body = None headers = None params = None /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in do_request(self=, method='PUT', action='/v2.0/networks/6e04f5f3-3ff4-4244-b77e-4fa92a7dcd62/tags/c', body=None, headers=None, params=None) 292 if not replybody: 293 replybody = resp.reason 294 self._handle_fault_response(status_code, replybody, resp) 295 296 def get_auth_info(self): self = self._handle_fault_response = > status_code = 500 replybody = '{"NeutronError": {"type": "HTTPInternalServerErr...r while processing your request.", "detail": ""}}' resp = /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in _handle_fault_response(self=, status_code=500, response_body='{"NeutronError": {"type": "HTTPInternalServerErr...r while processing your request.", "detail": ""}}', resp=) 267 error_body = self._convert_into_with_meta(des_error_body, resp) 268 # Raise the appropriate exception 269 exception_handler_v20(status_code, error_body) 270 271 def do_request(self, method, action, body=None, headers=None, params=None): global exception_handler_v20 = status_code = 500 error_body = {'NeutronError': {'type': 'HTTPInternalServerErr...r while processing your request.', 'detail': ''}} /usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py in exception_handler_v20(status_code=500, error_content={'NeutronError': {'type': 'HTTPInternalServerErr...r while processing your request.', 'detail': ''}}) 89 client_exc = exceptions.NeutronClientException 90 91 raise client_exc(message=error_message, 92 status_code=status_code, 93 request_ids=request_ids) client_exc = message undefined error_message = 'Request Failed: internal server error while processing your request.' status_code = 500 request_ids = ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40'] InternalServerError: Request Failed: internal server error while processing your request. Neutron server returns request_ids: ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40'] __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'_error_string': "Request Failed: internal server error while proc...ids: ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40']", 'message': "Request Failed: internal server error while proc...ids: ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40']", 'request_ids': ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40'], 'status_code': 500} __dir__ = __doc__ = None __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'neutronclient.common.exceptions' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None _error_string = "Request Failed: internal server error while proc...ids: ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40']" args = () message = "Request Failed: internal server error while proc...ids: ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40']" req_ids_msg = 'Neutron server returns request_ids: %s' request_ids = ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40'] status_code = 500 with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/neutron/test_crud.py", line 607, in test_network_tags_crud c.add_tag('networks', net_id, 'c') File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 2094, in add_tag return self.put(self.tag_path % (resource_type, resource_id, tag)) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 362, in put return self.retry_request("PUT", action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 330, in retry_request return self.do_request(method, action, body=body, File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 294, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/local/lib/python3.9/site-packages/neutronclient/v2_0/client.py", line 91, in exception_handler_v20 raise client_exc(message=error_message, neutronclient.common.exceptions.InternalServerError: Request Failed: internal server error while processing your request. Neutron server returns request_ids: ['req-bd729a25-5df9-4619-9f9c-e6621f2f5d40'] 2026-10-21 16:40:15,838 - DEBUG - No XMPP flaps were noticed during the test 2026-10-21 16:40:15,838 - INFO - 2026-10-21 16:40:15,839 - INFO - END TEST : test_network_tags_crud : FAILED[0:00:01] 2026-10-21 16:40:15,839 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:15,855 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg1-08962872'] 2026-10-21 16:40:16,738 - INFO - Creating Security group: ['default-domain', 'admin', 'ctest-admin-sg2-88846849'] 2026-10-21 16:40:17,566 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg1-87701494'] 2026-10-21 16:40:18,428 - INFO - Creating Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg2-49052956'] 2026-10-21 16:40:19,237 - INFO - ================================================================================ 2026-10-21 16:40:19,237 - INFO - STARTING TEST : test_router_crud 2026-10-21 16:40:19,506 - DEBUG - Nothing to compare xmpp stats {'10.0.0.190': {'10.20.0.25': '0'}} with 2026-10-21 16:40:19,506 - INFO - Initial checks done. Running the testcase now 2026-10-21 16:40:19,506 - INFO - 2026-10-21 16:40:19,507 - INFO - Router create Request {'router': {'name': 'name-96683698'}} 2026-10-21 16:40:19,580 - INFO - Router create Response : {'router': {'id': 'c477a071-a697-49c5-bf1d-8a42fd424771', 'name': 'name-96683698', 'tenant_id': '5b6d0ebf96bd48549ae7884ed49bfe70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-96683698'], 'description': '', 'project_id': '5b6d0ebf96bd48549ae7884ed49bfe70'}} 2026-10-21 16:40:19,580 - INFO - Router create PASSED ,Body : {'router': {'name': 'name-96683698'}} 2026-10-21 16:40:19,594 - INFO - Attribute id is created 2026-10-21 16:40:19,594 - INFO - Attribute name is created 2026-10-21 16:40:19,594 - INFO - Attribute admin_state_up is created 2026-10-21 16:40:19,594 - INFO - Attribute status is created 2026-10-21 16:40:19,594 - INFO - Attribute tenant_id is created 2026-10-21 16:40:20,043 - INFO - Router show with fields ['name', 'admin_state_up', 'status', 'tenant_id'] passed 2026-10-21 16:40:20,043 - INFO - Router Update request {'router': {'name': 'name-98118701'}} 2026-10-21 16:40:20,092 - INFO - Router Update request PASSED,Body : {'router': {'name': 'name-98118701'}} 2026-10-21 16:40:20,092 - INFO - Response : {'router': {'id': 'c477a071-a697-49c5-bf1d-8a42fd424771', 'name': 'name-98118701', 'tenant_id': '5b6d0ebf96bd48549ae7884ed49bfe70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-96683698'], 'description': '', 'project_id': '5b6d0ebf96bd48549ae7884ed49bfe70'}} 2026-10-21 16:40:20,092 - INFO - Updation of Router c477a071-a697-49c5-bf1d-8a42fd424771 with body {'router': {'name': 'name-98118701'}} passed 2026-10-21 16:40:20,092 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:20,092 - INFO - Router Update request {'router': {'admin_state_up': 'False'}} 2026-10-21 16:40:20,138 - INFO - Router Update request PASSED,Body : {'router': {'admin_state_up': 'False'}} 2026-10-21 16:40:20,138 - INFO - Response : {'router': {'id': 'c477a071-a697-49c5-bf1d-8a42fd424771', 'name': 'name-98118701', 'tenant_id': '5b6d0ebf96bd48549ae7884ed49bfe70', 'admin_state_up': False, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-96683698'], 'description': '', 'project_id': '5b6d0ebf96bd48549ae7884ed49bfe70'}} 2026-10-21 16:40:20,138 - INFO - Updation of Router c477a071-a697-49c5-bf1d-8a42fd424771 with body {'router': {'admin_state_up': 'False'}} passed 2026-10-21 16:40:20,138 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:20,138 - INFO - Deleting router c477a071-a697-49c5-bf1d-8a42fd424771 2026-10-21 16:40:20,209 - ERROR - Result of delete router c477a071-a697-49c5-bf1d-8a42fd424771: () 2026-10-21 16:40:20,209 - INFO - ================================================================================ 2026-10-21 16:40:20,209 - INFO - Router create Request {'router': {'admin_state_up': 'True', 'name': 'name-19907574'}} 2026-10-21 16:40:20,283 - INFO - Router create Response : {'router': {'id': '229e651b-e5d1-4a9e-aca0-594e30c98d2a', 'name': 'name-19907574', 'tenant_id': '5b6d0ebf96bd48549ae7884ed49bfe70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-19907574'], 'description': '', 'project_id': '5b6d0ebf96bd48549ae7884ed49bfe70'}} 2026-10-21 16:40:20,283 - INFO - Router create PASSED ,Body : {'router': {'admin_state_up': 'True', 'name': 'name-19907574'}} 2026-10-21 16:40:20,299 - INFO - Attribute id is created 2026-10-21 16:40:20,299 - INFO - Attribute name is created 2026-10-21 16:40:20,299 - INFO - Attribute admin_state_up is created 2026-10-21 16:40:20,299 - INFO - Attribute status is created 2026-10-21 16:40:20,299 - INFO - Attribute tenant_id is created 2026-10-21 16:40:20,749 - INFO - Router show with fields ['name', 'admin_state_up', 'status', 'tenant_id'] passed 2026-10-21 16:40:20,749 - INFO - Router Update request {'router': {'name': 'name-14026424'}} 2026-10-21 16:40:20,791 - INFO - Router Update request PASSED,Body : {'router': {'name': 'name-14026424'}} 2026-10-21 16:40:20,791 - INFO - Response : {'router': {'id': '229e651b-e5d1-4a9e-aca0-594e30c98d2a', 'name': 'name-14026424', 'tenant_id': '5b6d0ebf96bd48549ae7884ed49bfe70', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-19907574'], 'description': '', 'project_id': '5b6d0ebf96bd48549ae7884ed49bfe70'}} 2026-10-21 16:40:20,791 - INFO - Updation of Router 229e651b-e5d1-4a9e-aca0-594e30c98d2a with body {'router': {'name': 'name-14026424'}} passed 2026-10-21 16:40:20,791 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:20,791 - INFO - Router Update request {'router': {'admin_state_up': 'False'}} 2026-10-21 16:40:20,834 - INFO - Router Update request PASSED,Body : {'router': {'admin_state_up': 'False'}} 2026-10-21 16:40:20,835 - INFO - Response : {'router': {'id': '229e651b-e5d1-4a9e-aca0-594e30c98d2a', 'name': 'name-14026424', 'tenant_id': '5b6d0ebf96bd48549ae7884ed49bfe70', 'admin_state_up': False, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'admin', 'name-19907574'], 'description': '', 'project_id': '5b6d0ebf96bd48549ae7884ed49bfe70'}} 2026-10-21 16:40:20,835 - INFO - Updation of Router 229e651b-e5d1-4a9e-aca0-594e30c98d2a with body {'router': {'admin_state_up': 'False'}} passed 2026-10-21 16:40:20,835 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:20,835 - INFO - Deleting router 229e651b-e5d1-4a9e-aca0-594e30c98d2a 2026-10-21 16:40:20,912 - ERROR - Result of delete router 229e651b-e5d1-4a9e-aca0-594e30c98d2a: () 2026-10-21 16:40:20,912 - INFO - ================================================================================ 2026-10-21 16:40:20,913 - INFO - Router create Request {'router': {'tenant_id': 'bbfac0d2-0501-4874-b5ca-7f155dcffef7', 'name': 'name-30997292'}} 2026-10-21 16:40:20,993 - INFO - Router create Response : {'router': {'id': '859479fe-e2f2-4f86-b790-106a91d0ba78', 'name': 'name-30997292', 'tenant_id': 'bbfac0d205014874b5ca7f155dcffef7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'ctest-TestCRUD-41053282', 'name-30997292'], 'description': '', 'project_id': 'bbfac0d205014874b5ca7f155dcffef7'}} 2026-10-21 16:40:20,994 - INFO - Router create PASSED ,Body : {'router': {'tenant_id': 'bbfac0d2-0501-4874-b5ca-7f155dcffef7', 'name': 'name-30997292'}} 2026-10-21 16:40:21,011 - INFO - Attribute id is created 2026-10-21 16:40:21,011 - INFO - Attribute name is created 2026-10-21 16:40:21,011 - INFO - Attribute admin_state_up is created 2026-10-21 16:40:21,012 - INFO - Attribute status is created 2026-10-21 16:40:21,012 - INFO - Attribute tenant_id is created 2026-10-21 16:40:21,474 - INFO - Router show with fields ['name', 'admin_state_up', 'status', 'tenant_id'] passed 2026-10-21 16:40:21,474 - INFO - Router Update request {'router': {'name': 'name-56436701'}} 2026-10-21 16:40:21,519 - INFO - Router Update request PASSED,Body : {'router': {'name': 'name-56436701'}} 2026-10-21 16:40:21,519 - INFO - Response : {'router': {'id': '859479fe-e2f2-4f86-b790-106a91d0ba78', 'name': 'name-56436701', 'tenant_id': 'bbfac0d205014874b5ca7f155dcffef7', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'ctest-TestCRUD-41053282', 'name-30997292'], 'description': '', 'project_id': 'bbfac0d205014874b5ca7f155dcffef7'}} 2026-10-21 16:40:21,519 - INFO - Updation of Router 859479fe-e2f2-4f86-b790-106a91d0ba78 with body {'router': {'name': 'name-56436701'}} passed 2026-10-21 16:40:21,519 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:21,519 - INFO - Router Update request {'router': {'admin_state_up': 'False'}} 2026-10-21 16:40:21,562 - INFO - Router Update request PASSED,Body : {'router': {'admin_state_up': 'False'}} 2026-10-21 16:40:21,563 - INFO - Response : {'router': {'id': '859479fe-e2f2-4f86-b790-106a91d0ba78', 'name': 'name-56436701', 'tenant_id': 'bbfac0d205014874b5ca7f155dcffef7', 'admin_state_up': False, 'status': 'ACTIVE', 'external_gateway_info': None, 'tags': [], 'fq_name': ['default-domain', 'ctest-TestCRUD-41053282', 'name-30997292'], 'description': '', 'project_id': 'bbfac0d205014874b5ca7f155dcffef7'}} 2026-10-21 16:40:21,563 - INFO - Updation of Router 859479fe-e2f2-4f86-b790-106a91d0ba78 with body {'router': {'admin_state_up': 'False'}} passed 2026-10-21 16:40:21,563 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:21,563 - INFO - Deleting router 859479fe-e2f2-4f86-b790-106a91d0ba78 2026-10-21 16:40:21,642 - ERROR - Result of delete router 859479fe-e2f2-4f86-b790-106a91d0ba78: () 2026-10-21 16:40:21,642 - INFO - ================================================================================ 2026-10-21 16:40:21,642 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg2-49052956'] 2026-10-21 16:40:21,715 - INFO - Deleting Security group: ['default-domain', 'ctest-TestCRUD-41053282', 'ctest-proj-sg1-87701494'] 2026-10-21 16:40:21,792 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg2-88846849'] 2026-10-21 16:40:21,873 - INFO - Deleting Security group: ['default-domain', 'admin', 'ctest-admin-sg1-08962872'] 2026-10-21 16:40:22,215 - DEBUG - No XMPP flaps were noticed during the test 2026-10-21 16:40:22,215 - INFO - END TEST : test_router_crud : PASSED[0:00:03] 2026-10-21 16:40:22,215 - INFO - -------------------------------------------------------------------------------- 2026-10-21 16:40:23,011 - INFO - Deleted project: ctest-TestCRUD-41053282, ID : bbfac0d2-0501-4874-b5ca-7f155dcffef7