09/14/2026 02:27:46.948 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/14/2026 02:27:46.948 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/14/2026 02:27:46.948 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/14/2026 02:27:46.959 7f398b2c0900 [contrail-config-database-nodemgr] [ERROR]: Cannot write http_port 8112 to /tmp/contrail-config-database-nodemgr.0.http_port 09/14/2026 02:27:46.959 7f398b2c0900 [contrail-config-database-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8112 09/14/2026 02:27:46.960 7f398b2c0cc0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/14/2026 02:27:46.961 7f398b2c0cc0 [contrail-config-database-nodemgr] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:NodeStatusUVE] map 09/14/2026 02:27:46.962 7f398b2c0cc0 [contrail-config-database-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/14/2026 02:27:46.963 7f398b2c0cc0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/14/2026 02:27:46.966 7f398b2c0cc0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:46.966 7f398b2c0cc0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:27:46.966 7f398b2c0cc0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:46.966 7f398b2c0cc0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:46.967 7f398b2c0cc0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/14/2026 02:27:46.967 7f398b2c0cc0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.022 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'cassandra', 'group': 'cassandra', 'pid': 66090977207638118033536316893214146019837070811060563852862335079905792767640, 'start': '1789352864000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'zookeeper', 'group': 'zookeeper', 'pid': 90094044266336325995021094549930680449769748543066290414736255154359660237098, 'start': '1789352864000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-config-database-nodemgr', 'group': 'contrail-config-database-nodemgr', 'pid': 71671618245880647393751444768676654893711571496485504457395029121942517959063, 'start': '1789352864000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/14/2026 02:27:47.079 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.080 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> >> 09/14/2026 02:27:47.080 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.080 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-database-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-2.', _node_type='ConfigDatabase', _instance_id='0', _timestamp=1789352867080468, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo'), _seqnum=0) 09/14/2026 02:27:47.080 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-database-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-2.', _node_type='ConfigDatabase', _instance_id='0', _timestamp=1789352867080779, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='zookeeper', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo'), _seqnum=0) 09/14/2026 02:27:47.082 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.083 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:27:47.083 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.083 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.083 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. deleted = False process_info = [ << process_name = cassandra process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789352864000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = zookeeper process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789352864000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-database-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789352864000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} >> 09/14/2026 02:27:47.083 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.348 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:27:47.493 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:DatabaseUsage] map 09/14/2026 02:27:47.494 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:47.495 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. database_usage = [ << disk_space_used_1k = 4360336 disk_space_available_1k = 76730148 config_db_size_1k = 4 >>, ] >> 09/14/2026 02:27:47.495 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:48.054 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to connect to database by CQL and socket: Result: 1 09/14/2026 02:27:48.055 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-database-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-2.', _node_type='ConfigDatabase', _instance_id='0', _timestamp=1789352868055163, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo'), _seqnum=0) 09/14/2026 02:27:48.056 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:48.057 7f398aa48ea0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Cassandra state detected DOWN. Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:27:48.057 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:50.476 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:27:50.961 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:27:50.963 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:27:50.963 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:27:50.963 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:27:50.963 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:27:50.964 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:27:50.964 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:27:50.964 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:27:50.964 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:50.964 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:27:50.964 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:50.965 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:50.965 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:27:50.965 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:52.663 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7201 repair -pr config_db_uuid'. Error is: Result: 1 09/14/2026 02:27:53.828 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7201 repair -pr to_bgp_keyspace'. Error is: Result: 1 09/14/2026 02:27:54.796 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7201 repair -pr svc_monitor_keyspace'. Error is: Result: 1 09/14/2026 02:27:54.964 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:27:54.965 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:27:54.966 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:27:54.966 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:27:54.966 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:27:54.967 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:27:54.967 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:27:54.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:56.286 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7201 repair -pr DISCOVERY_SERVER'. Error is: Result: 1 09/14/2026 02:27:57.346 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7201 repair -pr useragent'. Error is: Result: 1 09/14/2026 02:27:58.280 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to run cmd: 'nodetool -p 7201 repair -pr dm_keyspace'. Error is: Result: 1 09/14/2026 02:27:58.966 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:27:58.968 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:27:58.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:27:58.968 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:27:58.969 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:58.970 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:27:58.970 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:27:58.970 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:02.970 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:02.971 7f398a9f85e0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:02.971 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:02.971 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:02.972 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:02.973 7f398a9f85e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:02.973 7f398a9f85e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:03.316 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-database-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-2.', _node_type='ConfigDatabase', _instance_id='0', _timestamp=1789352883316609, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='zookeeper', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo'), _seqnum=0) 09/14/2026 02:28:03.317 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=4730576, partition_space_available_1k=76359908, percentage_partition_space_used=6, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1304904, cpu_share=0.0, mem_res=1294288, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1616, cpu_share=0.0, mem_res=992, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56392, cpu_share=0.0, mem_res=46388, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=2178328, free=10167944, buffers=122048, cached=4088996, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.9, five_min_avg=0.57, fifteen_min_avg=0.2, cpu_share=0, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:28:03.317 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:03.317 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. deleted = False process_info = [ << process_name = cassandra process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789352864000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = zookeeper process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789352864000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-config-database-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789352864000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} >> 09/14/2026 02:28:03.317 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:03.317 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:03.317 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 4730576 partition_space_available_1k = 76359908 percentage_partition_space_used = 6 >> } all_core_file_list = [ ] process_mem_cpu_usage = { cassandra : << mem_virt = 1304904 cpu_share = 0.0 mem_res = 1294288 >>zookeeper : << mem_virt = 1616 cpu_share = 0.0 mem_res = 992 >>contrail-config-database-nodemgr : << mem_virt = 56392 cpu_share = 0.0 mem_res = 46388 >> } system_mem_usage = << total = 16175636 used = 2178328 free = 10167944 buffers = 122048 cached = 4088996 node_type = config-database-node >> system_cpu_usage = << one_min_avg = 1.9 five_min_avg = 0.57 fifteen_min_avg = 0.2 cpu_share = 0 node_type = config-database-node >> >> 09/14/2026 02:28:03.317 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:06.975 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:06.976 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:06.976 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:06.977 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:06.977 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:06.977 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:06.977 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:06.977 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:06.977 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:06.978 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:06.978 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:06.978 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:06.978 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:06.978 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:10.978 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:10.980 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:10.980 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:10.980 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:10.980 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:10.980 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:10.980 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:10.981 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:14.982 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:14.984 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:14.984 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:14.984 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:14.984 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:14.984 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:14.985 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:14.986 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:18.986 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:18.988 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:18.988 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:18.988 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:18.988 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:18.988 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:18.988 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:18.989 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:22.991 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:22.995 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:22.995 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:22.995 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:22.995 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:22.995 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:22.995 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:22.996 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:22.996 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:22.996 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:22.997 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:22.997 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:22.997 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:22.998 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:26.997 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:26.998 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:26.998 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:26.999 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:27.000 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:27.000 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:27.000 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:31.002 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:31.004 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:31.004 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:31.004 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:31.005 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:31.005 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:31.005 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:31.005 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:31.005 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:31.006 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:31.006 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:31.006 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:31.006 7f398aa48d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:31.006 7f398aa48d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:35.006 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:35.008 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:35.008 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:35.008 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:35.008 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:35.008 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:35.008 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:35.009 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:39.009 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:39.011 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:39.011 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:39.011 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:39.011 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:39.011 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:39.011 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:39.012 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:43.014 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:43.015 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:43.016 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:43.017 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:43.017 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:43.017 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:43.017 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.018 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Cassandra state detected DOWN. Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:47.020 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:47.021 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.021 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Cassandra state detected DOWN. Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:47.021 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.021 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.021 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:47.021 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.238 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:28:47.413 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.413 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. database_usage = [ << disk_space_used_1k = 5458932 disk_space_available_1k = 75631552 config_db_size_1k = 772 >>, ] >> 09/14/2026 02:28:47.413 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.961 7f398da598c0 [contrail-config-database-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-config-database-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-2.', _node_type='ConfigDatabase', _instance_id='0', _timestamp=1789352927961504, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-config-database-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=['10.0.0.38:8086'], status='Down', description='Connect to Idle on EvTcpConnectFail')]), flag_infos=None, description='Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo'), _seqnum=0) 09/14/2026 02:28:47.962 7f398aa48b80 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:47.963 7f398aa48b80 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:47.963 7f398aa48b80 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:49.059 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:28:51.021 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:51.023 7f398a9f8400 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:51.023 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:51.024 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:51.024 7f398a9f8400 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:51.024 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:51.024 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:51.025 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:51.025 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:51.025 7f398a9f8400 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:51.025 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:51.025 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:51.026 7f398a9f8400 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:51.026 7f398a9f8400 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:54.102 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=5459264, partition_space_available_1k=75631220, percentage_partition_space_used=7, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1309700, cpu_share=0.11, mem_res=1297668, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1620, cpu_share=0.0, mem_res=992, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56496, cpu_share=0.01, mem_res=46388, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=2655692, free=8992976, buffers=160644, cached=4755464, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.93, five_min_avg=1.09, fifteen_min_avg=0.4, cpu_share=9.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:28:54.103 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:54.103 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 5459264 partition_space_available_1k = 75631220 percentage_partition_space_used = 7 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1309700 cpu_share = 0.11 mem_res = 1297668 >>zookeeper : << mem_virt = 1620 cpu_share = 0.0 mem_res = 992 >>contrail-config-database-nodemgr : << mem_virt = 56496 cpu_share = 0.01 mem_res = 46388 >> } system_mem_usage = << total = 16175636 used = 2655692 free = 8992976 buffers = 160644 cached = 4755464 node_type = config-database-node >> system_cpu_usage = << one_min_avg = 2.93 five_min_avg = 1.09 fifteen_min_avg = 0.4 cpu_share = 9.5 node_type = config-database-node >> >> 09/14/2026 02:28:54.103 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:55.025 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:55.026 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:55.026 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:55.026 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:55.026 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:55.026 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:55.027 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:55.028 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:59.030 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:28:59.031 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:28:59.032 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:28:59.032 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:59.032 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:28:59.032 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:28:59.032 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:28:59.032 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:28:59.033 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:59.033 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:28:59.033 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:59.033 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:28:59.033 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:28:59.033 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:03.033 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:03.034 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:03.034 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:03.034 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:03.035 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:03.035 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:03.035 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:03.035 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:03.036 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:03.036 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:03.036 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:03.036 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:03.036 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:03.036 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:07.039 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:07.040 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:07.040 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:07.040 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:07.040 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:07.040 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:07.040 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:07.041 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:11.042 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:11.044 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:11.045 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:11.045 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:11.045 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:11.045 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:11.045 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:11.045 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:15.046 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:15.048 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:15.048 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:15.048 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:15.048 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:15.048 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:15.048 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:15.049 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:19.050 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:19.051 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:19.052 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:19.052 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:19.052 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:19.052 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:19.053 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:19.053 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:19.053 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:19.053 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:19.053 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:19.054 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:19.054 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:19.054 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:23.054 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:23.056 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:23.056 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:23.056 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:23.056 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:23.056 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:23.056 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:23.057 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:27.058 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:27.060 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:27.060 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:27.060 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:27.060 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:27.060 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:27.060 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:27.061 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:27.061 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:27.061 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:27.061 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:27.061 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:27.061 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:27.062 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:31.063 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:31.064 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:31.064 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:31.065 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:31.065 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:31.065 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:31.065 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:31.066 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:31.066 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:31.066 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:31.066 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:31.067 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:31.067 7f398a9f8f40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:31.067 7f398a9f8f40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:35.067 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:35.068 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:35.068 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:35.068 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:35.069 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:35.069 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:35.069 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:35.069 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:35.069 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:35.069 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:35.070 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:35.070 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:35.070 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:35.070 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:39.072 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:39.074 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:39.074 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:39.074 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:39.074 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:39.074 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:39.075 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:39.076 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:43.079 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:43.080 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:43.081 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:43.082 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:43.082 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:43.082 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:43.082 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:47.083 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:47.085 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:47.086 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:47.086 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:47.086 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:47.086 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:47.086 7f398a9f8360 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:47.086 7f398a9f8360 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:47.400 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:29:47.946 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:47.947 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. database_usage = [ << disk_space_used_1k = 5707092 disk_space_available_1k = 75383392 config_db_size_1k = 772 >>, ] >> 09/14/2026 02:29:47.947 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:51.086 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:51.088 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:51.089 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:51.089 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:51.089 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:51.089 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:51.089 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:51.191 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:29:55.089 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:55.091 7f398a9f8540 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:55.091 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:55.091 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:55.092 7f398a9f8540 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:55.092 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:55.092 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:55.092 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:55.092 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:55.092 7f398a9f8540 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:55.093 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:55.093 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:55.093 7f398a9f8540 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:55.093 7f398a9f8540 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:56.255 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=5740308, partition_space_available_1k=75350176, percentage_partition_space_used=7, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1302828, cpu_share=0.1, mem_res=1290760, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1620, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56628, cpu_share=0.01, mem_res=46388, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=4326952, free=6809060, buffers=176940, cached=5173920, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.98, five_min_avg=1.65, fifteen_min_avg=0.64, cpu_share=13.0, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:29:56.255 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:56.256 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 5740308 partition_space_available_1k = 75350176 percentage_partition_space_used = 7 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1302828 cpu_share = 0.1 mem_res = 1290760 >>zookeeper : << mem_virt = 1620 cpu_share = -0.0 mem_res = 988 >>contrail-config-database-nodemgr : << mem_virt = 56628 cpu_share = 0.01 mem_res = 46388 >> } system_mem_usage = << total = 16175636 used = 4326952 free = 6809060 buffers = 176940 cached = 5173920 node_type = config-database-node >> system_cpu_usage = << one_min_avg = 3.98 five_min_avg = 1.65 fifteen_min_avg = 0.64 cpu_share = 13.0 node_type = config-database-node >> >> 09/14/2026 02:29:56.256 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:59.094 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:29:59.095 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:29:59.096 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:29:59.096 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:59.096 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:29:59.096 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:29:59.096 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:29:59.097 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:29:59.097 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:59.098 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:29:59.098 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:59.099 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:29:59.099 7f398aa48680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:29:59.099 7f398aa48680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:03.096 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:03.098 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:30:03.098 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:03.098 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:03.098 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:03.098 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:03.098 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:30:03.099 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:07.102 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:07.103 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:30:07.104 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:07.104 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:07.104 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:07.104 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:07.104 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:30:07.105 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:11.106 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:11.108 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:30:11.108 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:11.108 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:11.108 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:11.108 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:11.108 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:30:11.109 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:15.110 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:15.112 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connect Fail 09/14/2026 02:30:15.112 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:15.112 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:15.112 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:15.112 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:15.112 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 09/14/2026 02:30:15.113 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:19.112 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:30:19.114 7f398a9f8c20 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:30:19.115 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:30:19.115 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:19.115 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:47.304 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:30:47.556 7f398a9f8a40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:48.882 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:30:49.114 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:30:49.115 7f398aa48ea0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:30:49.115 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:30:49.115 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:30:49.115 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:30:49.115 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:49.116 7f398aa48ea0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:30:49.116 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:49.116 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:49.116 7f398aa48ea0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 09/14/2026 02:30:49.116 7f398aa48ea0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:53.116 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:53.117 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:30:53.117 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:53.117 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:53.118 7f398a70d900 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:53.118 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:53.118 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:30:53.118 7f398a70d900 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:30:53.118 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:30:53.119 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:53.119 7f398a70d900 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:53.977 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6681332, partition_space_available_1k=74409152, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1308720, cpu_share=0.11, mem_res=1296536, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1600, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56700, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5036444, free=5182144, buffers=197980, cached=6071260, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.63, five_min_avg=2.17, fifteen_min_avg=0.87, cpu_share=14.25, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:30:53.977 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:23.121 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:23.122 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:23.123 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:31:23.123 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:27.123 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:27.124 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:27.124 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:27.124 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:27.125 7f398a9f8040 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:47.404 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:31:47.683 7f398b32ea40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:48.993 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:31:54.036 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6703336, partition_space_available_1k=74387148, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1309864, cpu_share=0.08, mem_res=1297676, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1608, cpu_share=0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56612, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5283588, free=4910648, buffers=200016, cached=6093528, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.12, five_min_avg=2.51, fifteen_min_avg=1.07, cpu_share=13.75, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:31:54.037 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:57.124 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:31:57.124 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:57.125 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:57.126 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:31:57.126 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:01.127 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:01.129 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:01.129 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:01.129 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:01.129 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:32:01.129 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:01.130 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:01.130 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:32:01.130 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:01.130 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:01.130 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:31.138 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:31.139 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:31.140 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:31.140 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:31.140 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:31.141 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:31.141 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:32:31.141 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:31.142 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:31.142 7f398a9f8c20 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:32:31.142 7f398a9f8c20 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:35.141 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:35.143 7f398a9f8680 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:32:35.144 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:35.144 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:35.144 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:47.351 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:32:47.728 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:48.960 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:32:54.009 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6710100, partition_space_available_1k=74380384, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1317148, cpu_share=0.09, mem_res=1304936, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2348, cpu_share=-0.0, mem_res=1348, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56660, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=4905556, free=5283460, buffers=201564, cached=6097176, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.52, five_min_avg=2.7, fifteen_min_avg=1.24, cpu_share=12.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:32:54.009 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:05.143 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:05.144 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:05.145 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:05.145 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:05.145 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:05.145 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:05.145 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:33:05.145 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:05.146 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:05.146 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:33:05.146 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:09.147 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:09.149 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:09.149 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:09.149 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:09.149 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:33:09.149 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:09.149 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:09.150 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:33:09.150 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:09.150 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:09.150 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:39.151 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:39.152 7f398a70d7c0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:39.152 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:39.152 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:39.152 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:39.152 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:39.152 7f398a70d7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:33:39.153 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:39.153 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:39.153 7f398a70d7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 6 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:33:39.153 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:43.155 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:43.156 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:43.156 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:43.157 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:43.159 7f398a70d7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:33:43.159 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:43.159 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:43.160 7f398a70d7c0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:33:43.160 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:43.160 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:43.161 7f398a70d7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:47.343 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:33:47.591 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:48.923 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:33:53.977 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6718160, partition_space_available_1k=74372324, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1314676, cpu_share=0.09, mem_res=1301104, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1616, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56676, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5096388, free=5079956, buffers=202672, cached=6108752, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.64, five_min_avg=2.83, fifteen_min_avg=1.37, cpu_share=13.0, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:33:53.978 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:13.162 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:13.163 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:13.164 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 7 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:34:13.165 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:17.168 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:34:17.170 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:34:17.170 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:34:17.170 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:17.170 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:34:17.170 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:17.170 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:34:17.171 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:34:17.171 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:34:17.171 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:17.171 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:47.169 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:47.170 7f398a70d860 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:47.170 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:47.171 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:47.171 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:47.171 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:47.171 7f398a70d860 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:34:47.171 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:47.171 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:47.172 7f398a70d860 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 8 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:34:47.172 7f398a70d860 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:47.457 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:34:48.006 7f398b32ea40 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:48.011 7f398b32ea40 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. database_usage = [ << disk_space_used_1k = 6725468 disk_space_available_1k = 74365016 config_db_size_1k = 772 >>, ] >> 09/14/2026 02:34:48.011 7f398b32ea40 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:49.603 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:34:51.171 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:34:51.173 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:34:51.173 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:34:51.173 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:51.174 7f398a9f8ea0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:34:51.174 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:51.174 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:34:51.174 7f398a9f8ea0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:34:51.175 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:34:51.175 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:51.175 7f398a9f8ea0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:54.639 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6725944, partition_space_available_1k=74364540, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1336168, cpu_share=0.08, mem_res=1322624, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1608, cpu_share=0.0, mem_res=984, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56720, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5264176, free=4900688, buffers=204044, cached=6117824, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.19, five_min_avg=2.84, fifteen_min_avg=1.47, cpu_share=13.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:34:54.639 7f398a9f8220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:21.174 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:35:21.174 7f398a70d2c0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:35:21.175 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:35:21.175 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:35:21.175 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:35:21.175 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:21.175 7f398a70d2c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:35:21.175 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:21.176 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:21.176 7f398a70d2c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 9 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:35:21.176 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:25.179 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:25.180 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:25.181 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:25.181 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:25.181 7f398a70d2c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:35:25.181 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:25.181 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:25.181 7f398a70d2c0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:35:25.182 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:25.182 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:25.182 7f398a70d2c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:47.339 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:35:47.588 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:49.041 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:35:54.077 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6733148, partition_space_available_1k=74357336, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1311784, cpu_share=0.08, mem_res=1298252, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1604, cpu_share=-0.0, mem_res=984, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56712, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5151520, free=5004784, buffers=205096, cached=6125376, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.32, five_min_avg=2.65, fifteen_min_avg=1.49, cpu_share=13.25, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:35:54.078 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:55.181 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:35:55.182 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:35:55.183 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:35:55.183 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:35:55.183 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:35:55.183 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:55.184 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:35:55.184 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:55.185 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:55.185 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 10 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:35:55.186 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:59.186 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:59.189 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:59.189 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:59.189 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:59.190 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:35:59.190 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:59.190 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:59.190 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:35:59.191 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:59.191 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:59.191 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:29.195 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:29.196 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:29.196 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:29.196 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:29.196 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:29.196 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:29.196 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:36:29.197 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:29.197 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:29.197 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 11 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:36:29.197 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:33.197 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:33.198 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:33.199 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:33.199 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:33.199 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:36:33.199 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:33.199 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:33.199 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:36:33.200 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:33.200 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:33.200 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:47.319 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:36:47.539 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:49.381 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:36:54.425 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6740964, partition_space_available_1k=74349520, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1305704, cpu_share=0.07, mem_res=1292148, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1608, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56728, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5182348, free=4965724, buffers=206352, cached=6131388, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.22, five_min_avg=2.89, fifteen_min_avg=1.64, cpu_share=13.75, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:36:54.426 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:03.206 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:03.207 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:03.207 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:03.207 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:03.207 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:03.207 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:03.207 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:37:03.208 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:03.208 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:03.208 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 12 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:37:03.208 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:07.209 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:07.211 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:07.211 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:07.211 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:07.212 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:37:07.212 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:07.212 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:07.212 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:37:07.213 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:07.213 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:07.213 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:37.212 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:37.213 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:37.213 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:37.213 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 13 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:37:37.214 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:41.217 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:41.218 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:41.219 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:41.219 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:41.219 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:37:41.219 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:41.219 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:41.219 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:37:41.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:41.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:41.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:47.374 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:37:47.627 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:49.013 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:37:54.067 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6748032, partition_space_available_1k=74342452, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1340624, cpu_share=0.15, mem_res=1327036, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1632, cpu_share=0.0, mem_res=996, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56752, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5283644, free=4850988, buffers=207300, cached=6143880, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.45, five_min_avg=3.08, fifteen_min_avg=1.8, cpu_share=13.75, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:37:54.068 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:11.219 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:11.220 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:11.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:11.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:11.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:11.220 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:11.221 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:38:11.221 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:11.221 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:11.221 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 14 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:38:11.221 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:15.225 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:15.226 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:15.226 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:15.227 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:15.227 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:38:15.227 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:15.227 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:15.227 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:38:15.227 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:15.228 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:15.228 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:45.235 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:45.235 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:45.236 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 15 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:38:45.237 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:47.423 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:38:47.739 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:47.740 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] DatabaseUsage: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. database_usage = [ << disk_space_used_1k = 6763880 disk_space_available_1k = 74326604 config_db_size_1k = 772 >>, ] >> 09/14/2026 02:38:47.740 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:49.237 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:49.239 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:49.239 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:49.239 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:49.239 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:38:49.240 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:49.240 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:49.240 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:38:49.240 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:49.241 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:49.241 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:49.755 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:38:54.793 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6764116, partition_space_available_1k=74326368, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1311840, cpu_share=0.08, mem_res=1298116, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1612, cpu_share=-0.0, mem_res=984, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56768, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5111660, free=5016860, buffers=208268, cached=6149028, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.31, five_min_avg=3.07, fifteen_min_avg=1.88, cpu_share=14.0, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:38:54.794 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:19.252 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:39:19.252 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 16 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:39:19.253 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:23.255 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:39:23.256 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:39:23.257 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:39:23.257 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:23.257 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:39:23.257 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:23.257 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:39:23.258 7f398b2c0220 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:39:23.258 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:39:23.258 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:23.258 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:47.361 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:39:47.584 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:49.203 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:39:53.257 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:39:53.258 7f398a70d400 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:39:53.259 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:39:53.259 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:39:53.259 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:39:53.259 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:53.259 7f398a70d400 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:39:53.259 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:53.260 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:53.260 7f398a70d400 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 17 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:39:53.260 7f398a70d400 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:54.261 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6771636, partition_space_available_1k=74318848, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1308084, cpu_share=0.07, mem_res=1294300, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1616, cpu_share=-0.0, mem_res=996, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56776, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5267140, free=4852168, buffers=209348, cached=6157156, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.2, five_min_avg=3.09, fifteen_min_avg=1.95, cpu_share=14.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:39:54.261 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:54.262 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6771636 partition_space_available_1k = 74318848 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1308084 cpu_share = 0.07 mem_res = 1294300 >>zookeeper : << mem_virt = 1616 cpu_share = -0.0 mem_res = 996 >>contrail-config-database-nodemgr : << mem_virt = 56776 cpu_share = 0.01 mem_res = 46384 >> } system_mem_usage = << total = 16175636 used = 5267140 free = 4852168 buffers = 209348 cached = 6157156 node_type = config-database-node >> system_cpu_usage = << one_min_avg = 3.2 five_min_avg = 3.09 fifteen_min_avg = 1.95 cpu_share = 14.5 node_type = config-database-node >> >> 09/14/2026 02:39:54.262 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:57.262 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:39:57.264 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:39:57.264 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:39:57.264 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:57.264 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:39:57.265 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:57.265 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:39:57.265 7f398a8ec7c0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:39:57.265 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:39:57.265 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:57.266 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:27.266 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:27.267 7f398a9f8680 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:27.267 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:27.267 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:27.267 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:27.268 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:27.268 7f398a9f8680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:40:27.268 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:27.268 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:27.268 7f398a9f8680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 18 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:40:27.268 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:31.271 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:31.272 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:31.272 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:31.272 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:31.272 7f398a9f8680 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:40:31.272 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:31.272 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:31.273 7f398a9f8680 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:40:31.273 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:31.273 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:31.273 7f398a9f8680 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:47.388 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:40:47.640 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:50.401 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:40:55.655 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6779524, partition_space_available_1k=74310960, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1305148, cpu_share=0.06, mem_res=1291436, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1600, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56800, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5253812, free=4855748, buffers=210220, cached=6166048, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.99, five_min_avg=3.66, fifteen_min_avg=2.23, cpu_share=14.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:40:55.656 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:01.274 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:01.275 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:01.276 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 19 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:41:01.276 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:05.278 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:05.280 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:05.280 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:05.282 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:05.282 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:41:05.283 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:05.283 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:05.283 7f398b2c0220 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:41:05.283 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:05.284 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:05.284 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:35.290 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:41:35.291 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:35.292 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:35.292 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 20 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:41:35.292 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:39.292 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:39.294 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:39.294 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:39.294 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:39.294 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:41:39.295 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:39.295 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:39.295 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:41:39.295 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:39.295 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:39.295 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:47.379 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:41:47.596 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:49.119 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:41:54.159 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6786208, partition_space_available_1k=74304276, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1302092, cpu_share=0.07, mem_res=1288300, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1616, cpu_share=0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56820, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5260404, free=4838200, buffers=210968, cached=6176236, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.09, five_min_avg=3.65, fifteen_min_avg=2.31, cpu_share=13.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:41:54.159 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:09.295 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:09.295 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:09.296 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:09.297 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 21 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:42:09.297 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:13.299 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:13.301 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:13.301 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:13.301 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:13.301 7f398b2c0220 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:42:13.301 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:13.301 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:13.302 7f398b2c0220 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:42:13.302 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:13.302 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:13.302 7f398b2c0220 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:43.303 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:43.304 7f398a70d9a0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:43.304 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:43.304 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:43.304 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:43.304 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:43.305 7f398a70d9a0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:42:43.305 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:43.305 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:43.305 7f398a70d9a0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 22 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:42:43.305 7f398a70d9a0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:47.364 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:42:47.366 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:47.367 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:47.367 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:47.367 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:47.368 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:47.598 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:49.511 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:42:54.564 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6794268, partition_space_available_1k=74296216, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1311536, cpu_share=0.07, mem_res=1297740, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1608, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56844, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5232908, free=4858968, buffers=211728, cached=6182208, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.22, five_min_avg=3.53, fifteen_min_avg=2.35, cpu_share=14.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:42:54.564 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:17.375 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:43:17.376 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:17.377 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:17.377 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 23 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:43:17.377 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:21.378 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:43:21.380 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:43:21.381 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:43:21.381 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:21.381 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:47.700 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:43:48.235 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:50.082 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:43:51.380 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:43:51.381 7f398a9f8e00 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:51.382 7f398a9f8e00 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 24 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:43:51.383 7f398a9f8e00 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:55.192 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6801672, partition_space_available_1k=74288812, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1300584, cpu_share=0.07, mem_res=1286596, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=680, cpu_share=-0.0, mem_res=324, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56856, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5377764, free=4702392, buffers=212404, cached=6192308, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.04, five_min_avg=3.42, fifteen_min_avg=2.4, cpu_share=14.75, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:43:55.192 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:55.192 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6801672 partition_space_available_1k = 74288812 percentage_partition_space_used = 8 >> } process_mem_cpu_usage = { cassandra : << mem_virt = 1300584 cpu_share = 0.07 mem_res = 1286596 >>zookeeper : << mem_virt = 680 cpu_share = -0.0 mem_res = 324 >>contrail-config-database-nodemgr : << mem_virt = 56856 cpu_share = 0.01 mem_res = 46384 >> } system_mem_usage = << total = 16175636 used = 5377764 free = 4702392 buffers = 212404 cached = 6192308 node_type = config-database-node >> system_cpu_usage = << one_min_avg = 3.04 five_min_avg = 3.42 fifteen_min_avg = 2.4 cpu_share = 14.75 node_type = config-database-node >> >> 09/14/2026 02:43:55.192 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:55.382 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:43:55.383 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:43:55.383 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:43:55.384 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:55.384 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:43:55.384 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:55.384 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:43:55.384 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:43:55.385 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:43:55.385 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:55.385 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:25.384 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:25.385 7f398a9f87c0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:25.385 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:25.385 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:25.385 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:25.385 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:25.386 7f398a9f87c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:44:25.386 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:25.386 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:25.386 7f398a9f87c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 25 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:44:25.386 7f398a9f87c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:29.389 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:29.391 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:29.391 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:29.391 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:29.392 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:47.451 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:44:47.757 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:49.299 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:44:54.348 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6808936, partition_space_available_1k=74281548, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1302576, cpu_share=0.07, mem_res=1288640, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1612, cpu_share=0.0, mem_res=912, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56876, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5134360, free=4938420, buffers=213104, cached=6198936, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.42, five_min_avg=3.22, fifteen_min_avg=2.39, cpu_share=13.5, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:44:54.349 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:59.394 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:59.395 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:59.395 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 26 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:44:59.396 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:03.398 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:03.400 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:03.400 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:03.400 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:03.400 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:45:03.401 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:03.401 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:03.401 7f398a8ec7c0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:45:03.401 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:03.401 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:03.401 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:33.407 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:33.408 7f398a9f80e0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:33.409 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:33.409 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:33.409 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:33.410 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:33.410 7f398a9f80e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:45:33.410 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:33.411 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:33.411 7f398a9f80e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 27 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:45:33.412 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:37.413 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:37.415 7f398a9f80e0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:45:37.416 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:37.416 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:37.416 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:47.405 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:45:47.688 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:49.426 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:45:54.467 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6816664, partition_space_available_1k=74273820, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1313936, cpu_share=0.07, mem_res=1299948, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1608, cpu_share=-0.0, mem_res=988, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56900, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5525036, free=4538772, buffers=213752, cached=6207256, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.5, five_min_avg=3.1, fifteen_min_avg=2.4, cpu_share=14.0, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:45:54.468 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:07.426 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:07.427 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:07.427 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:07.427 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:07.427 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:07.428 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:07.428 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:46:07.428 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:07.428 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:07.428 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 28 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:46:07.428 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:10.740 7f398aa487c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_process_state:zookeeper,group:zookeeper,state:PROCESS_STATE_BACKOFF 09/14/2026 02:46:11.428 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:11.430 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:11.430 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:11.430 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:11.430 7f398a9f80e0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:46:11.431 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:11.431 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:11.431 7f398a9f80e0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:46:11.431 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:11.431 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:11.431 7f398a9f80e0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:25.894 7f398aa487c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_process_state:zookeeper,group:zookeeper,state:PROCESS_STATE_RUNNING 09/14/2026 02:46:25.894 7f398aa487c0 [contrail-config-database-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-config-database-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-2.', _node_type='ConfigDatabase', _instance_id='0', _timestamp=1789353985894705, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='cassandra', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='zookeeper', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1789353985894623', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-config-database-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789352864000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo'), _seqnum=0) 09/14/2026 02:46:25.896 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:41.430 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:41.430 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 29 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:46:41.431 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:45.434 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:45.436 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:45.436 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:45.437 7f398a8ec7c0 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:47.424 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: dir for config is /var/lib/cassandra/data 09/14/2026 02:46:47.662 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:49.475 7f398da598c0 [contrail-config-database-nodemgr] [ERROR]: Failed to get nodetool compactionstats: Result: 1 09/14/2026 02:46:54.526 7f398da598c0 [contrail-config-database-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6824388, partition_space_available_1k=74266096, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'cassandra': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1312780, cpu_share=0.06, mem_res=1298824, _EventManager__key='cassandra'), 'zookeeper': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=0, cpu_share=0.0, mem_res=0, _EventManager__key='zookeeper'), 'contrail-config-database-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56920, cpu_share=0.01, mem_res=46384, _EventManager__key='contrail-config-database-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175636, used=5245840, free=4809132, buffers=214484, cached=6215360, node_type='config-database-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.63, five_min_avg=3.03, fifteen_min_avg=2.42, cpu_share=13.75, node_type='config-database-node'), running_package_version=None, installed_package_version=None, _table='ObjectConfigDatabaseInfo') 09/14/2026 02:46:54.526 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:15.440 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:15.440 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:15.441 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:15.441 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:15.441 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:15.441 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:15.441 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:47:15.442 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:15.442 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:15.442 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2.:ConfigDatabase:contrail-config-database-nodemgr:0 client_info = << status = Idle successful_connections = 30 pid = 1 http_port = 8112 start_time = 1789352866962814 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.189:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:47:15.442 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:19.442 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-2. process_status = [ << module_id = contrail-config-database-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:47:19.444 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:47:19.445 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:47:19.445 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:19.445 7f398b2c0d60 [contrail-config-database-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:27.733 7f398b2c0d60 [contrail-config-database-nodemgr] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:NodeStatusUVE] map