04/09/2025 18:19:07.535 7f371d25c390 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 04/09/2025 18:19:07.535 7f371d25c390 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 04/09/2025 18:19:07.536 7f371d25c390 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 04/09/2025 18:19:07.540 7f371d25c390 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@localhost:5672/'] 04/09/2025 18:19:07.541 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 04/09/2025 18:19:07.541 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <cfgm_common.tests.test_utils.FakeKombu.Connection object at 0x7f371d264898> 04/09/2025 18:19:07.541 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 04/09/2025 18:19:07.541 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <cfgm_common.tests.test_utils.FakeKombu.Connection object at 0x7f371d2646a0> 04/09/2025 18:19:07.542 7f371d25c390 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 04/09/2025 18:19:08.554 7f371d25c390 [contrail-device-manager] [WARNING]: Process 12069 prepared to run in Full mode... 04/09/2025 18:19:08.555 7f371d25c390 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 04/09/2025 18:19:08.555 7f371d25c390 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:45853 04/09/2025 18:19:08.578 7f371d270e10 [contrail-device-manager] [ERROR]: Cannot write http_port 45853 to /tmp/contrail-device-manager.12060.http_port 04/09/2025 18:19:08.578 7f371d270e10 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 45853 04/09/2025 18:19:08.592 7f371d25c390 [contrail-device-manager] [ERROR]: predef payloads file does not exist: /opt/contrail/fabric_ansible_playbooks/conf/predef_payloads.json 04/09/2025 18:19:08.592 7f371d25c390 [contrail-device-manager] [ERROR]: Unable to load init data 04/09/2025 18:19:08.593 7f371d25c390 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 04/09/2025 18:19:08.601 7f371d25c390 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@localhost:5672/'] 04/09/2025 18:19:08.602 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 04/09/2025 18:19:08.602 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <cfgm_common.tests.test_utils.FakeKombu.Connection object at 0x7f371d1b6ba8> 04/09/2025 18:19:08.602 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 04/09/2025 18:19:08.602 7f371d25c390 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <cfgm_common.tests.test_utils.FakeKombu.Connection object at 0x7f371d264da0> 04/09/2025 18:19:08.603 7f371d485198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 04/09/2025 18:19:08.603 7f371d485198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <cfgm_common.tests.test_utils.FakeKombu.Connection object at 0x7f371d264da0> 04/09/2025 18:19:12.512 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_dci(2e6f5704-aa67-4b2c-a1e2-b84f32089e7e), feature=l3-gateway 04/09/2025 18:19:12.512 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_dci(2e6f5704-aa67-4b2c-a1e2-b84f32089e7e), feature=vn-interconnect 04/09/2025 18:19:12.513 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=2e6f5704-aa67-4b2c-a1e2-b84f32089e7e, role/vendor/product=spine:juniper:qfx10008 04/09/2025 18:19:12.697 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_dci(99cf3d5d-2fd6-44c9-9842-9c05daca55e9), feature=l3-gateway 04/09/2025 18:19:12.697 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_dci(99cf3d5d-2fd6-44c9-9842-9c05daca55e9), feature=vn-interconnect 04/09/2025 18:19:12.697 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=99cf3d5d-2fd6-44c9-9842-9c05daca55e9, role/vendor/product=pnf:juniper:qfx10008 04/09/2025 18:19:16.420 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'cd5a477e-70b1-4613-946f-c70555372a82'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:16.420 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid cd5a477e-70b1-4613-946f-c70555372a82 update caused NoIdError 04/09/2025 18:19:16.449 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'8c3ffe72-3c8e-487d-830f-536359ba7223'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:16.449 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid 8c3ffe72-3c8e-487d-830f-536359ba7223 update caused NoIdError 04/09/2025 18:19:16.478 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_dci', 'xe-0/0/0'], 'obj_dict': {'display_name': 'xe-0/0/0', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_dci', 'xe-0/0/0'], 'id_perms': {'created': '2025-04-10T01:19:12.739542', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:12.739542', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12145653537386945737, 'uuid_mslong': 1491554902700937060}}, 'parent_type': 'physical-router', 'parent_uuid': '2e6f5704-aa67-4b2c-a1e2-b84f32089e7e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '14b31148-0a7b-4f64-a88e-078ab4ea5cc9'}, 'oper': 'DELETE', 'request-id': 'req-23713ee4-42ea-4c3e-818d-a1a58f5880fa', 'type': 'physical_interface', 'uuid': '14b31148-0a7b-4f64-a88e-078ab4ea5cc9'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:16.487 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:16 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_dci', 'xe-0/0/1'], 'obj_dict': {'display_name': 'xe-0/0/1', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_dci', 'xe-0/0/1'], 'id_perms': {'created': '2025-04-10T01:19:12.786937', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:12.786937', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10294823771840506210, 'uuid_mslong': 17586423154886527932}}, 'parent_type': 'physical-router', 'parent_uuid': '2e6f5704-aa67-4b2c-a1e2-b84f32089e7e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f40f86ae-b8b7-4bbc-8ede-8fad19cce962'}, 'oper': 'DELETE', 'request-id': 'req-10d635e6-b831-404b-811c-cf4a27febfcf', 'type': 'physical_interface', 'uuid': 'f40f86ae-b8b7-4bbc-8ede-8fad19cce962'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:18.680 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_logical_router(786a7024-1c72-42c2-ad73-9d89a4d0c084), feature=l3-gateway 04/09/2025 18:19:18.680 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_logical_router(786a7024-1c72-42c2-ad73-9d89a4d0c084), feature=vn-interconnect 04/09/2025 18:19:18.680 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=786a7024-1c72-42c2-ad73-9d89a4d0c084, role/vendor/product=spine:juniper:qfx10008 04/09/2025 18:19:18.863 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_logical_router(2938776c-83bb-4ab5-9a96-0e3d05932b15), feature=l3-gateway 04/09/2025 18:19:18.863 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_logical_router(2938776c-83bb-4ab5-9a96-0e3d05932b15), feature=vn-interconnect 04/09/2025 18:19:18.863 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=2938776c-83bb-4ab5-9a96-0e3d05932b15, role/vendor/product=pnf:juniper:qfx10008 04/09/2025 18:19:19.522 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:19 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-domain', 'default-project', '__contrail_lr_internal_vn_f92da091-b247-42b0-8a91-f8bdd91827a9__', '__contrail_lr_internal_vn_f92da091-b247-42b0-8a91-f8bdd91827a9__'], 'obj_dict': {'display_name': '__contrail_lr_internal_vn_f92da091-b247-42b0-8a91-f8bdd91827a9__', 'fq_name': ['default-domain', 'default-project', '__contrail_lr_internal_vn_f92da091-b247-42b0-8a91-f8bdd91827a9__', '__contrail_lr_internal_vn_f92da091-b247-42b0-8a91-f8bdd91827a9__'], 'id_perms': {'created': '2025-04-10T01:19:19.499878', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:19.499878', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12890509075991351998, 'uuid_mslong': 16044329505253834833}}, 'parent_type': 'virtual-network', 'parent_uuid': 'a6002b66-c424-4433-8eca-d6c69f21f24a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': 'dea8e8ad-b3f9-4051-b2e4-49b53069d2be'}, 'oper': 'CREATE', 'request-id': 'req-b46b5316-66b2-4720-bbec-a305e10db556', 'type': 'routing_instance', 'uuid': 'dea8e8ad-b3f9-4051-b2e4-49b53069d2be'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:19.525 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:19 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-domain', 'default-project', 'lr-test.test_dm_transactions.TestTransactionsDM.test_create_logical_router'], 'oper': 'UPDATE', 'request-id': 'req-b46b5316-66b2-4720-bbec-a305e10db556', 'type': 'logical_router', 'uuid': 'f92da091-b247-42b0-8a91-f8bdd91827a9'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:21.569 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'f92da091-b247-42b0-8a91-f8bdd91827a9'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:21.569 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid f92da091-b247-42b0-8a91-f8bdd91827a9 update caused NoIdError 04/09/2025 18:19:22.583 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'bfc1562c-d72b-40b7-8662-378407f0f4c0'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:22.584 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid bfc1562c-d72b-40b7-8662-378407f0f4c0 update caused NoIdError 04/09/2025 18:19:22.614 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'f789c7c7-425a-4c78-8129-f3e805edf0a9'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:22.614 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid f789c7c7-425a-4c78-8129-f3e805edf0a9 update caused NoIdError 04/09/2025 18:19:22.643 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:22 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_logical_router', 'xe-0/0/0'], 'obj_dict': {'display_name': 'xe-0/0/0', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_logical_router', 'xe-0/0/0'], 'id_perms': {'created': '2025-04-10T01:19:18.903007', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:18.903007', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12500075062845843420, 'uuid_mslong': 11553121902297236900}}, 'parent_type': 'physical-router', 'parent_uuid': '786a7024-1c72-42c2-ad73-9d89a4d0c084', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a054ef28-b936-45a4-ad79-300a9aa527dc'}, 'oper': 'DELETE', 'request-id': 'req-6a05589c-7847-467b-82de-7fdc6d465472', 'type': 'physical_interface', 'uuid': 'a054ef28-b936-45a4-ad79-300a9aa527dc'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:22.655 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:22 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_logical_router', 'xe-0/0/1'], 'obj_dict': {'display_name': 'xe-0/0/1', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_logical_router', 'xe-0/0/1'], 'id_perms': {'created': '2025-04-10T01:19:18.949428', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:18.949428', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10620186317915076583, 'uuid_mslong': 8877303712045944253}}, 'parent_type': 'physical-router', 'parent_uuid': '786a7024-1c72-42c2-ad73-9d89a4d0c084', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7b3284b1-2fc1-4dbd-9362-7b301fcab7e7'}, 'oper': 'DELETE', 'request-id': 'req-83647896-0aeb-4819-ae31-b7a6f0f6867d', 'type': 'physical_interface', 'uuid': '7b3284b1-2fc1-4dbd-9362-7b301fcab7e7'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:24.852 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance(c26b26f6-2d86-40d1-8fd6-c15cfee60879), feature=vn-interconnect 04/09/2025 18:19:24.852 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance(c26b26f6-2d86-40d1-8fd6-c15cfee60879), feature=l3-gateway 04/09/2025 18:19:24.852 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=c26b26f6-2d86-40d1-8fd6-c15cfee60879, role/vendor/product=spine:juniper:qfx10008 04/09/2025 18:19:25.037 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_service_instance(75dab928-f032-46ff-990f-3b090e60c4c9), feature=vn-interconnect 04/09/2025 18:19:25.037 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_service_instance(75dab928-f032-46ff-990f-3b090e60c4c9), feature=l3-gateway 04/09/2025 18:19:25.037 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=75dab928-f032-46ff-990f-3b090e60c4c9, role/vendor/product=pnf:juniper:qfx10008 04/09/2025 18:19:25.744 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:25 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance', 'xe-0/0/1'], 'oper': 'UPDATE', 'request-id': 'req-0d119e46-e760-41f0-bd84-766e16931411', 'type': 'physical_interface', 'uuid': 'd81d5fb2-1437-4f21-b964-bcb97ce5155b'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:31.858 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'a2a53539-0f10-43a3-99e3-67d0af65313f'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:31.858 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid a2a53539-0f10-43a3-99e3-67d0af65313f update caused NoIdError 04/09/2025 18:19:31.889 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'8d0b92e2-85e7-447e-91e4-a7a847bc5476'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:31.889 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid 8d0b92e2-85e7-447e-91e4-a7a847bc5476 update caused NoIdError 04/09/2025 18:19:31.922 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance', 'xe-0/0/0'], 'obj_dict': {'display_name': 'xe-0/0/0', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance', 'xe-0/0/0'], 'id_perms': {'created': '2025-04-10T01:19:25.075143', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:30.833039', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9558633292690540723, 'uuid_mslong': 1530226234800099209}}, 'parent_type': 'physical-router', 'parent_uuid': 'c26b26f6-2d86-40d1-8fd6-c15cfee60879', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '153c74a7-2f3e-4f89-84a7-1655fd0ac8b3'}, 'oper': 'DELETE', 'request-id': 'req-4f6a10e5-c566-4eba-866f-84b17e7fa4a9', 'type': 'physical_interface', 'uuid': '153c74a7-2f3e-4f89-84a7-1655fd0ac8b3'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:31.935 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:31 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance', 'xe-0/0/1'], 'obj_dict': {'display_name': 'xe-0/0/1', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_service_instance', 'xe-0/0/1'], 'id_perms': {'created': '2025-04-10T01:19:25.123621', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:30.837208', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13359009899538093403, 'uuid_mslong': 15572708304965029665}}, 'parent_type': 'physical-router', 'parent_uuid': 'c26b26f6-2d86-40d1-8fd6-c15cfee60879', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd81d5fb2-1437-4f21-b964-bcb97ce5155b'}, 'oper': 'DELETE', 'request-id': 'req-1ec918e6-3f6f-4543-9533-e720590a1fc6', 'type': 'physical_interface', 'uuid': 'd81d5fb2-1437-4f21-b964-bcb97ce5155b'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:34.121 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg(7f2ef70c-61ae-4c96-84d3-54e1a5a3770a), feature=l3-gateway 04/09/2025 18:19:34.122 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg(7f2ef70c-61ae-4c96-84d3-54e1a5a3770a), feature=vn-interconnect 04/09/2025 18:19:34.122 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=7f2ef70c-61ae-4c96-84d3-54e1a5a3770a, role/vendor/product=spine:juniper:qfx10008 04/09/2025 18:19:34.305 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_vpg(e12ab30d-43be-4728-a833-d33f8cb4b25d), feature=l3-gateway 04/09/2025 18:19:34.305 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_create_vpg(e12ab30d-43be-4728-a833-d33f8cb4b25d), feature=vn-interconnect 04/09/2025 18:19:34.305 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=e12ab30d-43be-4728-a833-d33f8cb4b25d, role/vendor/product=pnf:juniper:qfx10008 04/09/2025 18:19:35.151 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:35 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-domain', 'default-project', 'vpg-test.test_dm_transactions.TestTransactionsDM.test_create_vpg-tagged-10'], 'obj_dict': {'display_name': 'vpg-test.test_dm_transactions.TestTransactionsDM.test_create_vpg-tagged-10', 'fq_name': ['default-domain', 'default-project', 'vpg-test.test_dm_transactions.TestTransactionsDM.test_create_vpg-tagged-10'], 'id_perms': {'created': '2025-04-10T01:19:35.128984', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:35.128984', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10770727174770500207, 'uuid_mslong': 14658622129975346824}}, 'parent_type': 'project', 'parent_uuid': '8102c433-862c-42ab-a861-728745ccc4c8', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_virtual_port_group_id': 'b9948e8d-4977-4107-8a61-3db72c9d0c25', 'uuid': 'cb6de329-99dc-4688-9579-4f4cb8d7a26f', 'virtual_machine_interface_bindings': {'key_value_pair': [{'key': 'vnic_type', 'value': 'baremetal'}, {'key': 'vif_type', 'value': 'vrouter'}, {'key': 'vpg', 'value': 'vpg-test.test_dm_transactions.TestTransactionsDM.test_create_vpg'}, {'key': 'profile', 'value': '{"local_link_information":[{"switch_id":"xe-0/0/...ansactions.TestTransactionsDM.test_create_vpg"}]}'}]}, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:cb:6d:e3:29:99']}, ...}, 'oper': 'CREATE', 'request-id': 'req-e9c40a1a-7c0f-4a21-94a1-6a61f27b1266', 'type': 'virtual_machine_interface', 'uuid': 'cb6de329-99dc-4688-9579-4f4cb8d7a26f'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:35.155 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:35 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'fabric-1test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'vpg-test.test_dm_transactions.TestTransactionsDM.test_create_vpg'], 'oper': 'UPDATE', 'request-id': 'req-e9c40a1a-7c0f-4a21-94a1-6a61f27b1266', 'type': 'virtual_port_group', 'uuid': 'b9948e8d-4977-4107-8a61-3db72c9d0c25'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:35.161 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:35 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-domain', 'default-project', 'vpg-test.test_dm_transactions.TestTransactionsDM.test_create_vpg-tagged-10'], 'oper': 'UPDATE', 'request-id': 'req-e9c40a1a-7c0f-4a21-94a1-6a61f27b1266', 'type': 'virtual_machine_interface', 'uuid': 'cb6de329-99dc-4688-9579-4f4cb8d7a26f'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:39.336 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'06e50b9f-d654-4c1f-9cfb-00d827ea656c'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:39.336 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid 06e50b9f-d654-4c1f-9cfb-00d827ea656c update caused NoIdError 04/09/2025 18:19:39.342 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:39 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-domain', 'default-project', '__contrail_lr_internal_vn_06e50b9f-d654-4c1f-9cfb-00d827ea656c__'], 'obj_dict': {'display_name': 'LR::lr1-test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', '__contrail_lr_internal_vn_06e50b9f-d654-4c1f-9cfb-00d827ea656c__'], 'id_perms': {'created': '2025-04-10T01:19:34.729702', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:34.729702', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12131603851909152313, 'uuid_mslong': 14470491340151144553}}, 'igmp_enable': False, 'is_provider_network': False, 'is_shared': False, 'layer2_control_word': False, 'mac_aging_time': 300, ...}, 'oper': 'DELETE', 'request-id': 'req-ca67635b-aeca-4eca-8983-7afed16d49d3', 'type': 'virtual_network', 'uuid': 'c8d18334-b713-4069-a85c-1d6d64ce3e39'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:39.360 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:39 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-domain', 'default-project', 'lr1-test.test_dm_transactions.TestTransactionsDM.test_create_vpg'], 'obj_dict': {'display_name': 'lr1-test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'fq_name': ['default-domain', 'default-project', 'lr1-test.test_dm_transactions.TestTransactionsDM.test_create_vpg'], 'id_perms': {'created': '2025-04-10T01:19:34.726263', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:34.884675', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11311635817453741420, 'uuid_mslong': 496816115017862175}}, 'logical_router_type': 'vxlan-routing', 'parent_type': 'project', 'parent_uuid': '8102c433-862c-42ab-a861-728745ccc4c8', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'physical_router_refs': [{'attr': None, 'to': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg'], 'uuid': '7f2ef70c-61ae-4c96-84d3-54e1a5a3770a'}], 'route_target_refs': [{'attr': None, 'to': ['target:64512:8000005'], 'uuid': 'f2662e05-e868-462a-bdb2-a18238c3bca7'}], 'uuid': '06e50b9f-d654-4c1f-9cfb-00d827ea656c', ...}, 'oper': 'DELETE', 'request-id': 'req-ca67635b-aeca-4eca-8983-7afed16d49d3', 'type': 'logical_router', 'uuid': '06e50b9f-d654-4c1f-9cfb-00d827ea656c'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:39.366 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'82fbc187-4825-4156-8da5-a16aed23903b'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:39.366 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid 82fbc187-4825-4156-8da5-a16aed23903b update caused NoIdError 04/09/2025 18:19:39.393 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:39 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'xe-0/0/0'], 'obj_dict': {'display_name': 'xe-0/0/0', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'xe-0/0/0'], 'id_perms': {'created': '2025-04-10T01:19:34.346618', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:39.292412', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10955183378748163463, 'uuid_mslong': 12581442959000424221}}, 'parent_type': 'physical-router', 'parent_uuid': '7f2ef70c-61ae-4c96-84d3-54e1a5a3770a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ae9a43b6-3d0f-4f1d-9808-a13d6b8c4587'}, 'oper': 'DELETE', 'request-id': 'req-9b3c876b-3ea1-4318-9ffd-5f153a9fbc43', 'type': 'physical_interface', 'uuid': 'ae9a43b6-3d0f-4f1d-9808-a13d6b8c4587'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:39.399 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:39 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'xe-0/0/1'], 'obj_dict': {'display_name': 'xe-0/0/1', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_create_vpg', 'xe-0/0/1'], 'id_perms': {'created': '2025-04-10T01:19:34.393314', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:34.393314', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10556682286449659571, 'uuid_mslong': 17900985462411248708}}, 'parent_type': 'physical-router', 'parent_uuid': '7f2ef70c-61ae-4c96-84d3-54e1a5a3770a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f86d136f-4074-4444-9280-de9b9a7d8eb3'}, 'oper': 'DELETE', 'request-id': 'req-cc8a0b93-76a4-4fc1-865c-752df020c8ec', 'type': 'physical_interface', 'uuid': 'f86d136f-4074-4444-9280-de9b9a7d8eb3'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:41.584 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router(40a66332-4e08-4d00-a52c-5a9c97292bdf), feature=l3-gateway 04/09/2025 18:19:41.584 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router1test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router(40a66332-4e08-4d00-a52c-5a9c97292bdf), feature=vn-interconnect 04/09/2025 18:19:41.584 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=40a66332-4e08-4d00-a52c-5a9c97292bdf, role/vendor/product=spine:juniper:qfx10008 04/09/2025 18:19:41.771 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router(385b320a-dcfc-4c8f-9fc9-305793fe5bca), feature=l3-gateway 04/09/2025 18:19:41.771 7f371d16a978 [contrail-device-manager] [INFO]: Found feature plugin for pr=router2test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router(385b320a-dcfc-4c8f-9fc9-305793fe5bca), feature=vn-interconnect 04/09/2025 18:19:41.772 7f371d16a978 [contrail-device-manager] [INFO]: Found ansible plugin pr=385b320a-dcfc-4c8f-9fc9-305793fe5bca, role/vendor/product=pnf:juniper:qfx10008 04/09/2025 18:19:43.463 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'13274578-5abf-4ca4-a96f-9db7b7134f25'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:43.464 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid 13274578-5abf-4ca4-a96f-9db7b7134f25 update caused NoIdError 04/09/2025 18:19:43.490 7f371d16a978 [contrail-device-manager] [WARNING]: Inconsistency discovered. wanted=1, received=0, missing={'a29b5214-a2a8-4726-968a-0770fad1bdc7'}. This may indicate that the cluster needs a 'nodetool repair'. 04/09/2025 18:19:43.490 7f371d16a978 [contrail-device-manager] [WARNING]: logical_router uuid a29b5214-a2a8-4726-968a-0770fad1bdc7 update caused NoIdError 04/09/2025 18:19:43.517 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:43 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router', 'xe-0/0/0'], 'obj_dict': {'display_name': 'xe-0/0/0', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router', 'xe-0/0/0'], 'id_perms': {'created': '2025-04-10T01:19:41.809904', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:41.809904', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11026371880392977467, 'uuid_mslong': 11397415649686604576}}, 'parent_type': 'physical-router', 'parent_uuid': '40a66332-4e08-4d00-a52c-5a9c97292bdf', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9e2bc125-b50c-4b20-9905-8ace142dec3b'}, 'oper': 'DELETE', 'request-id': 'req-d5c9876c-a8ce-4dc1-9de7-1d20aacb06b8', 'type': 'physical_interface', 'uuid': '9e2bc125-b50c-4b20-9905-8ace142dec3b'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' 04/09/2025 18:19:43.529 7f371d16a978 [contrail-device-manager] [ERROR]: AttributeError Python 3.6.8: /root/work/build/debug/config/device-manager/.tox/py36/bin/python Wed Apr 9 18:19:43 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in _vnc_subscribe_callback(self=<device_manager.dm_amqp.DMAmqpHandle object>, oper_info={'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router', 'xe-0/0/1'], 'obj_dict': {'display_name': 'xe-0/0/1', 'fq_name': ['default-global-system-config', 'router1test.test_dm_transactions.TestTransactionsDM.test_update_bgp_router', 'xe-0/0/1'], 'id_perms': {'created': '2025-04-10T01:19:41.857632', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-04-10T01:19:41.857632', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11641596536167078484, 'uuid_mslong': 16830048828153023846}}, 'parent_type': 'physical-router', 'parent_uuid': '40a66332-4e08-4d00-a52c-5a9c97292bdf', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e990583d-628a-4d66-a18f-425eaca81a54'}, 'oper': 'DELETE', 'request-id': 'req-39020576-8581-4ed9-8ede-56dcf0586fe8', 'type': 'physical_interface', 'uuid': 'e990583d-628a-4d66-a18f-425eaca81a54'}) 82 try: 83 self.oper_info = oper_info 84 self.vnc_subscribe_actions() 85 86 except ConnectionError: self = <device_manager.dm_amqp.DMAmqpHandle object> self.vnc_subscribe_actions = <bound method VncAmqpHandle.vnc_subscribe_actions of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py in vnc_subscribe_actions(self=<device_manager.dm_amqp.DMAmqpHandle object>) 146 (self. obj_type, obj_id, oper)) 147 return 148 self.evaluate_dependency() 149 150 def _get_key_from_oper_info(self): self = <device_manager.dm_amqp.DMAmqpHandle object> self.evaluate_dependency = <bound method DMAmqpHandle.evaluate_dependency of <device_manager.dm_amqp.DMAmqpHandle object>> /root/work/build/debug/config/device-manager/device_manager/dm_amqp.py in evaluate_dependency(self=<device_manager.dm_amqp.DMAmqpHandle object>) 49 []): 50 pr = PhysicalRouterDM.get(pr_id) 51 if pr is not None: 52 pr.set_config_state() 53 pr.uve_send() pr = <device_manager.db.PhysicalRouterDM object> pr.set_config_state = <bound method PhysicalRouterDM.set_config_state of <device_manager.db.PhysicalRouterDM object>> /root/work/build/debug/config/device-manager/device_manager/db.py in set_config_state(self=<device_manager.db.PhysicalRouterDM object>, reset_retry_count=True) 1044 self.nc_q.put_nowait(1) 1045 except queue.Full: 1046 self._logger.warn(f"queue is full") 1047 1048 # end self = <device_manager.db.PhysicalRouterDM object> self._logger = <device_manager.logger.DeviceManagerLogger object> self._logger.warn undefined AttributeError: 'DeviceManagerLogger' object has no attribute 'warn' __cause__ = None __class__ = <class 'AttributeError'> __context__ = Full() __delattr__ = <method-wrapper '__delattr__' of AttributeError object> __dict__ = {} __dir__ = <built-in method __dir__ of AttributeError object> __doc__ = 'Attribute not found.' __eq__ = <method-wrapper '__eq__' of AttributeError object> __format__ = <built-in method __format__ of AttributeError object> __ge__ = <method-wrapper '__ge__' of AttributeError object> __getattribute__ = <method-wrapper '__getattribute__' of AttributeError object> __gt__ = <method-wrapper '__gt__' of AttributeError object> __hash__ = <method-wrapper '__hash__' of AttributeError object> __init__ = <method-wrapper '__init__' of AttributeError object> __init_subclass__ = <built-in method __init_subclass__ of type object> __le__ = <method-wrapper '__le__' of AttributeError object> __lt__ = <method-wrapper '__lt__' of AttributeError object> __ne__ = <method-wrapper '__ne__' of AttributeError object> __new__ = <built-in method __new__ of type object> __reduce__ = <built-in method __reduce__ of AttributeError object> __reduce_ex__ = <built-in method __reduce_ex__ of AttributeError object> __repr__ = <method-wrapper '__repr__' of AttributeError object> __setattr__ = <method-wrapper '__setattr__' of AttributeError object> __setstate__ = <built-in method __setstate__ of AttributeError object> __sizeof__ = <built-in method __sizeof__ of AttributeError object> __str__ = <method-wrapper '__str__' of AttributeError object> __subclasshook__ = <built-in method __subclasshook__ of type object> __suppress_context__ = False __traceback__ = <traceback object> args = ("'DeviceManagerLogger' object has no attribute 'warn'",) with_traceback = <built-in method with_traceback of AttributeError object> The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1044, in set_config_state self.nc_q.put_nowait(1) File "src/gevent/queue.py", line 290, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 296, in gevent._gevent_cqueue.Queue.put_nowait File "src/gevent/queue.py", line 288, in gevent._gevent_cqueue.Queue.put queue.Full During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 84, in _vnc_subscribe_callback self.vnc_subscribe_actions() File "/root/work/build/debug/config/device-manager/.tox/py36/lib/python3.6/site-packages/cfgm_common/vnc_amqp.py", line 148, in vnc_subscribe_actions self.evaluate_dependency() File "/root/work/build/debug/config/device-manager/device_manager/dm_amqp.py", line 52, in evaluate_dependency pr.set_config_state() File "/root/work/build/debug/config/device-manager/device_manager/db.py", line 1046, in set_config_state self._logger.warn(f"queue is full") AttributeError: 'DeviceManagerLogger' object has no attribute 'warn'