09/14/2026 02:30:36.169 7f1732d89600 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/14/2026 02:30:36.169 7f1732d89600 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/14/2026 02:30:36.169 7f1732d89600 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/14/2026 02:30:36.180 7f172fd0b900 [contrail-analytics-alarm-nodemgr] [ERROR]: Cannot write http_port 8113 to /tmp/contrail-analytics-alarm-nodemgr.0.http_port 09/14/2026 02:30:36.180 7f172fd0b900 [contrail-analytics-alarm-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8113 09/14/2026 02:30:36.181 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvStart] in state[none] 09/14/2026 02:30:36.181 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 09/14/2026 02:30:36.182 7f172fd0bcc0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.371 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-alarm-gen', 'group': 'contrail-alarm-gen', 'pid': 75905708625772942578327044421393757558557877008539430784250926381068976505836, 'start': '1789353033000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'kafka', 'group': 'kafka', 'pid': 96145510643476409515666745454125231756352883741337040055377047642215778040215, 'start': '1789353033000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-alarm-nodemgr', 'group': 'contrail-analytics-alarm-nodemgr', 'pid': 6784588787726930826902827442994486091284252004849539006611329348698801042150, 'start': '1789353033000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 09/14/2026 02:30:36.421 7f1732d89600 [contrail-analytics-alarm-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-3.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1789353036421142, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-alarm-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 09/14/2026 02:30:36.421 7f1732d89600 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-3.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1789353036421664, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 09/14/2026 02:30:36.424 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> >> 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:36.425 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789353033000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789353033000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789353033000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} >> 09/14/2026 02:30:36.426 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:30:40.182 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:30:40.184 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:30:40.184 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:30:40.184 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:40.184 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:30:40.184 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:30:40.184 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:30:40.185 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:30:40.185 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:30:40.185 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:40.185 7f172f9e3a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:41.484 7f1732d89600 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-3.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1789353041484287, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 09/14/2026 02:30:41.484 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6570540, partition_space_available_1k=74519944, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2204, cpu_share=0.0, mem_res=1256, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=241388, cpu_share=0.0, mem_res=95052, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55916, cpu_share=0.0, mem_res=46416, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4897096, free=5333880, buffers=191004, cached=6063076, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.72, five_min_avg=1.73, fifteen_min_avg=0.69, cpu_share=0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:30:41.484 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:30:41.485 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:10.187 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:31:10.187 7f1730538f40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:31:10.188 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:14.192 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:14.193 7f1730538f40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:31:14.194 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:14.194 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:14.194 7f1730538f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:41.474 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6843128, partition_space_available_1k=74247356, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170064, cpu_share=0.05, mem_res=167192, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98364, cpu_share=-0.01, mem_res=96448, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55904, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4700240, free=5371080, buffers=199912, cached=6214104, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.95, five_min_avg=2.26, fifteen_min_avg=0.94, cpu_share=14.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:31:41.475 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:44.195 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:31:44.196 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:31:44.196 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:31:44.196 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:31:44.196 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:31:44.196 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:44.196 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:31:44.197 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:44.197 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:44.197 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 2 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:31:44.197 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:31:48.199 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:31:48.201 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:31:48.202 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:18.211 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:18.211 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:18.212 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:32:18.213 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:22.216 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:22.217 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:22.217 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:22.217 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:22.218 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:37.479 7f1730538360 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_process_state:contrail-alarm-gen,group:contrail-alarm-gen,state:PROCESS_STATE_BACKOFF 09/14/2026 02:32:41.516 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6849816, partition_space_available_1k=74240668, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=3312, cpu_share=-0.06, mem_res=1844, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98248, cpu_share=-0.0, mem_res=96340, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55912, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5028692, free=5033884, buffers=201204, cached=6221544, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.2, five_min_avg=2.69, fifteen_min_avg=1.18, cpu_share=14.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:32:41.517 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:52.227 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:32:52.227 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:32:52.228 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:52.583 7f1730538360 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_process_state:contrail-alarm-gen,group:contrail-alarm-gen,state:PROCESS_STATE_RUNNING 09/14/2026 02:32:52.583 7f1730538360 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-3.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1789353172583289, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1789353172583204', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 09/14/2026 02:32:52.585 7f1730538680 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:52.585 7f1730538680 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 2 stop_count = 0 exit_count = 0 last_start_time = 1789353172583204 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789353033000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789353033000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} >> 09/14/2026 02:32:52.585 7f1730538680 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:32:56.231 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:32:56.232 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:32:56.232 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:32:56.233 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:26.235 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:26.236 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 5 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:33:26.237 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:33:30.241 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:33:30.243 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:33:30.243 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:33:30.243 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:30.243 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:33:30.243 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:33:30.243 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:33:30.244 7f17306b7400 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:33:30.244 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:33:30.244 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:30.244 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:33:41.509 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6856456, partition_space_available_1k=74234028, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170096, cpu_share=0.07, mem_res=167200, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97368, cpu_share=0.0, mem_res=95468, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55924, cpu_share=0.01, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4715372, free=5340944, buffers=202396, cached=6226620, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.81, five_min_avg=2.86, fifteen_min_avg=1.34, cpu_share=13.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:33:41.510 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:00.247 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:00.247 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:00.248 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:00.249 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 6 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:34:00.249 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:04.252 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:34:04.253 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:34:04.253 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:34:04.253 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:04.254 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:34.263 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:34:34.263 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 7 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:34:34.264 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:34:38.266 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:34:38.269 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:34:38.270 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:34:38.270 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:38.270 7f1730538d60 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:34:38.270 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:34:38.270 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:34:38.270 7f1730538d60 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:34:38.271 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:34:38.271 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:38.271 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:41.491 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6864212, partition_space_available_1k=74226272, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170088, cpu_share=0.0, mem_res=167208, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96888, cpu_share=-0.0, mem_res=95012, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55964, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5259052, free=4780024, buffers=203440, cached=6240120, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.44, five_min_avg=2.92, fifteen_min_avg=1.45, cpu_share=14.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:34:41.491 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:34:53.544 7f1730538360 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_process_state:kafka,group:kafka,state:PROCESS_STATE_BACKOFF 09/14/2026 02:35:08.282 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:35:08.283 7f1730538d60 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:35:08.283 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:35:08.283 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:35:08.283 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:35:08.283 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:08.284 7f1730538d60 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:35:08.284 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:08.284 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:08.284 7f1730538d60 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 8 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:35:08.284 7f1730538d60 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:08.810 7f1730538360 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_process_state:kafka,group:kafka,state:PROCESS_STATE_RUNNING 09/14/2026 02:35:08.810 7f1730538360 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-6277-3.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1789353308810862, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1789353172583204', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=2, stop_count=0, exit_count=0, last_start_time='1789353308810804', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1789353033000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 09/14/2026 02:35:08.812 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:08.812 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 2 stop_count = 0 exit_count = 0 last_start_time = 1789353172583204 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 2 stop_count = 0 exit_count = 0 last_start_time = 1789353308810804 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1789353033000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info": [{"build-version": "v0+nightly", "build-time": "2026-09-14 00:57:02.446689", "build-user": "root", "build-hostname": "jenkins-build-prepare-sandbox-15999-1.novalocal", "build-id": "v0+nightly", "build-number": "202609140010"}]} >> 09/14/2026 02:35:08.812 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:12.287 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:12.289 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:12.289 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:12.289 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:12.290 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:35:12.290 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:12.290 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:12.290 7f1730538720 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:35:12.290 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:12.290 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:12.291 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:41.512 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6871816, partition_space_available_1k=74218668, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=168560, cpu_share=-0.02, mem_res=166352, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96824, cpu_share=-0.0, mem_res=94976, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55964, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4951484, free=5080768, buffers=204768, cached=6244672, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.73, five_min_avg=3.17, fifteen_min_avg=1.64, cpu_share=14.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:35:41.513 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:42.290 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:35:42.290 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 9 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:35:42.291 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:35:46.294 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:35:46.295 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:35:46.296 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:35:46.296 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:46.296 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:35:46.296 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:35:46.296 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:35:46.296 7f17306b7400 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:35:46.297 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:35:46.297 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:35:46.297 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:16.301 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:16.302 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:16.303 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 10 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:36:16.303 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:20.303 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:20.304 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:20.304 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:20.305 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:20.306 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:41.521 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6879580, partition_space_available_1k=74210904, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=169816, cpu_share=0.01, mem_res=166936, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98300, cpu_share=0.01, mem_res=96464, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55968, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5389364, free=4629736, buffers=205716, cached=6256876, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.55, five_min_avg=3.52, fifteen_min_avg=1.85, cpu_share=14.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:36:41.522 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:50.313 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:36:50.313 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:50.314 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 11 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:36:50.315 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:36:54.315 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:36:54.317 7f17306b7400 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:36:54.318 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:36:54.318 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:36:54.318 7f17306b7400 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:24.331 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:24.331 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 12 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:37:24.332 7f172f9e3220 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:28.335 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:37:28.337 7f1730538180 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:37:28.338 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:37:28.338 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:28.338 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:41.532 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6886440, partition_space_available_1k=74204044, percentage_partition_space_used=8, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=33852, cpu_share=-0.04, mem_res=32056, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98976, cpu_share=-0.0, mem_res=97068, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55984, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4907728, free=5105356, buffers=206848, cached=6261764, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.16, five_min_avg=3.6, fifteen_min_avg=1.99, cpu_share=13.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:37:41.532 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:37:58.336 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:37:58.337 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:37:58.337 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:37:58.337 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:37:58.337 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:37:58.337 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:58.338 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:37:58.338 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:58.338 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:37:58.338 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 13 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:37:58.338 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:02.339 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:02.340 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:38:02.341 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:02.342 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:02.342 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:32.347 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:38:32.347 7f1730538860 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 14 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:38:32.348 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:38:36.351 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:38:36.352 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:38:36.352 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:38:36.352 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:36.352 7f1730538860 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:38:36.352 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:38:36.353 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:38:36.353 7f1730538860 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:38:36.353 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:38:36.353 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:36.353 7f1730538860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:38:41.523 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6894548, partition_space_available_1k=74195936, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170108, cpu_share=0.04, mem_res=167236, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97808, cpu_share=-0.01, mem_res=95924, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=55996, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5373692, free=4629244, buffers=207756, cached=6271000, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.06, five_min_avg=3.77, fifteen_min_avg=2.15, cpu_share=14.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:38:41.523 7f172f9e3680 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:06.363 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:39:06.363 7f1730538900 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 15 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:39:06.364 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:10.367 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:39:10.369 7f1730538900 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:39:10.370 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:39:10.370 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:10.370 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:40.369 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:39:40.370 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:39:40.370 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:39:40.370 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:39:40.370 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:39:40.370 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:40.371 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:39:40.371 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:40.371 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:40.371 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 16 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:39:40.371 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:41.534 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6910212, partition_space_available_1k=74180272, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2108, cpu_share=-0.06, mem_res=1260, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97416, cpu_share=-0.0, mem_res=95548, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56000, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4972896, free=5021684, buffers=208736, cached=6278380, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.14, five_min_avg=3.58, fifteen_min_avg=2.19, cpu_share=13.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:39:41.534 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:41.534 7f1730538040 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6910212 partition_space_available_1k = 74180272 percentage_partition_space_used = 9 >> } process_mem_cpu_usage = { contrail-alarm-gen : << mem_virt = 2108 cpu_share = -0.06 mem_res = 1260 >>kafka : << mem_virt = 97416 cpu_share = -0.0 mem_res = 95548 >>contrail-analytics-alarm-nodemgr : << mem_virt = 56000 cpu_share = 0.0 mem_res = 46412 >> } system_mem_usage = << total = 16175632 used = 4972896 free = 5021684 buffers = 208736 cached = 6278380 node_type = analytics-alarm-node >> system_cpu_usage = << one_min_avg = 3.14 five_min_avg = 3.58 fifteen_min_avg = 2.19 cpu_share = 13.25 node_type = analytics-alarm-node >> >> 09/14/2026 02:39:41.534 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:39:44.371 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:39:44.372 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:39:44.373 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:39:44.374 7f1730538040 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:14.375 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:14.375 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 17 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:40:14.376 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:18.380 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:18.381 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:18.381 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:18.381 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:18.381 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:40:18.381 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:18.382 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:18.382 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:40:18.382 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:18.382 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:18.382 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:41.551 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6917940, partition_space_available_1k=74172544, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170308, cpu_share=0.06, mem_res=167448, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=90316, cpu_share=-0.0, mem_res=88552, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56016, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5220704, free=4765292, buffers=209532, cached=6286172, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.74, five_min_avg=3.38, fifteen_min_avg=2.21, cpu_share=13.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:40:41.551 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:48.387 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:40:48.388 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 18 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:40:48.389 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:40:52.392 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:40:52.393 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:40:52.393 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:40:52.393 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:52.393 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:40:52.393 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:40:52.394 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:40:52.394 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:40:52.394 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:40:52.394 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:40:52.394 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:22.403 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:22.403 7f17305389a0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 19 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:41:22.404 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:26.405 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:41:26.406 7f1730538900 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:41:26.407 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:41:26.407 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:26.407 7f1730538900 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:41.560 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6925208, partition_space_available_1k=74165276, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2088, cpu_share=-0.06, mem_res=1252, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97432, cpu_share=0.0, mem_res=95520, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56020, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4815632, free=5160552, buffers=210376, cached=6295056, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.37, five_min_avg=3.19, fifteen_min_avg=2.22, cpu_share=13.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:41:41.560 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:41:56.418 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:41:56.418 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:41:56.419 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 20 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:41:56.420 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:00.421 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:00.423 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:00.423 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:00.423 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:00.423 7f17305384a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:42:00.423 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:00.424 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:00.424 7f17305384a0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:42:00.424 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:00.424 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:00.424 7f17305384a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:30.423 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:42:30.423 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:42:30.423 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:42:30.423 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:42:30.423 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:42:30.423 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:30.424 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:42:30.424 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:30.424 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:30.424 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 21 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:42:30.424 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:42:34.427 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:42:34.429 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:42:34.429 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:42:34.429 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:34.429 7f17305385e0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:42:34.429 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:42:34.429 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:42:34.430 7f17305385e0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:42:34.430 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:42:34.430 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:34.430 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:42:41.552 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6933336, partition_space_available_1k=74157148, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170096, cpu_share=0.06, mem_res=167208, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97324, cpu_share=-0.0, mem_res=95420, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56032, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5486792, free=4478404, buffers=211180, cached=6305316, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.0, five_min_avg=3.28, fifteen_min_avg=2.31, cpu_share=14.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:42:41.553 7f17305385e0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:04.435 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:43:04.435 7f1730538a40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 22 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:43:04.436 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:08.440 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:43:08.441 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:43:08.441 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:43:08.441 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:08.442 7f1730538a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:38.442 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:43:38.442 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 23 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:43:38.443 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:41.572 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6940640, partition_space_available_1k=74149844, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170064, cpu_share=-0.0, mem_res=167192, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96964, cpu_share=0.0, mem_res=95060, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56032, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4893076, free=5066380, buffers=212016, cached=6309172, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.74, five_min_avg=3.71, fifteen_min_avg=2.52, cpu_share=13.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:43:41.572 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:41.573 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. disk_usage_info = { /dev/vda1 : << partition_type = ext4 partition_space_used_1k = 6940640 partition_space_available_1k = 74149844 percentage_partition_space_used = 9 >> } process_mem_cpu_usage = { contrail-alarm-gen : << mem_virt = 170064 cpu_share = -0.0 mem_res = 167192 >>kafka : << mem_virt = 96964 cpu_share = 0.0 mem_res = 95060 >>contrail-analytics-alarm-nodemgr : << mem_virt = 56032 cpu_share = 0.0 mem_res = 46412 >> } system_mem_usage = << total = 16175632 used = 4893076 free = 5066380 buffers = 212016 cached = 6309172 node_type = analytics-alarm-node >> system_cpu_usage = << one_min_avg = 4.74 five_min_avg = 3.71 fifteen_min_avg = 2.52 cpu_share = 13.75 node_type = analytics-alarm-node >> >> 09/14/2026 02:43:41.573 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:43:42.444 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:43:42.446 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:43:42.446 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:43:42.446 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:42.446 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:43:42.446 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:43:42.446 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:43:42.447 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:43:42.448 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:43:42.448 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:43:42.448 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:12.459 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 24 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:44:12.460 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:16.463 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:16.464 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:16.465 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:16.466 7f1730538ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:41.571 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6948108, partition_space_available_1k=74142376, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=169824, cpu_share=0.0, mem_res=166940, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=96912, cpu_share=-0.0, mem_res=95028, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56052, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5478508, free=4468236, buffers=212720, cached=6321100, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.48, five_min_avg=3.53, fifteen_min_avg=2.53, cpu_share=14.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:44:41.571 7f172f9e3c20 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:46.467 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:44:46.467 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:46.468 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 25 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:44:46.469 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:44:50.471 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:44:50.473 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:44:50.474 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:44:50.474 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:44:50.474 7f172f9e3d60 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:20.477 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:20.478 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:20.478 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:20.478 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:20.478 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:20.478 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:20.479 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:45:20.479 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:20.479 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:20.479 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 26 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:45:20.479 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:24.480 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:24.482 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:24.483 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:24.483 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:24.483 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:45:24.483 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:24.483 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:24.483 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:45:24.484 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:24.484 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:24.484 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:41.593 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6955976, partition_space_available_1k=74134508, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170064, cpu_share=0.0, mem_res=167188, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97180, cpu_share=-0.0, mem_res=95320, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56060, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5309208, free=4628420, buffers=213372, cached=6329644, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.0, five_min_avg=3.45, fifteen_min_avg=2.57, cpu_share=13.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:45:41.594 7f172f9e3ea0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:54.485 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:45:54.485 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 27 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:45:54.486 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:45:58.488 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:45:58.490 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:45:58.490 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:45:58.490 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:58.490 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:45:58.490 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:45:58.490 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:45:58.491 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:45:58.491 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:45:58.491 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:45:58.491 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:28.503 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:46:28.503 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 28 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:46:28.504 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:46:32.507 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:46:32.508 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:46:32.509 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:32.510 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:46:41.579 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6963568, partition_space_available_1k=74126916, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2132, cpu_share=-0.06, mem_res=1260, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=60968, cpu_share=-0.01, mem_res=59164, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56068, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5318052, free=4612052, buffers=214076, cached=6336468, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.13, five_min_avg=3.42, fifteen_min_avg=2.62, cpu_share=14.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:46:41.579 7f172f9e3f40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:02.512 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:02.512 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 29 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:47:02.513 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:06.515 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:47:06.517 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:47:06.518 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:47:06.518 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:06.518 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:36.523 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:47:36.523 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 30 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:47:36.524 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:47:40.524 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:47:40.526 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:47:40.526 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:47:40.527 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:40.527 7f1730538220 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:47:40.527 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:47:40.527 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:47:40.527 7f1730538220 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:47:40.527 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:47:40.528 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:40.528 7f1730538220 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:47:41.583 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6970896, partition_space_available_1k=74119588, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=169556, cpu_share=0.06, mem_res=166684, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98144, cpu_share=0.01, mem_res=96216, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56100, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5446564, free=4475488, buffers=214696, cached=6343796, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.74, five_min_avg=3.28, fifteen_min_avg=2.62, cpu_share=13.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:47:41.583 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:10.528 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:48:10.529 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:48:10.529 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:48:10.529 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:48:10.529 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:48:10.529 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:10.530 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:48:10.530 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:10.530 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:10.530 7f1730538720 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 31 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:48:10.530 7f1730538720 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:14.529 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:48:14.531 7f17305389a0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:48:14.532 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:48:14.532 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:14.532 7f17305389a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:41.590 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6978376, partition_space_available_1k=74112108, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=2092, cpu_share=-0.06, mem_res=1252, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97756, cpu_share=-0.0, mem_res=95856, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56088, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5041188, free=4871316, buffers=215160, cached=6352796, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.5, five_min_avg=3.14, fifteen_min_avg=2.62, cpu_share=13.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:48:41.590 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:44.532 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:48:44.532 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 32 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:48:44.533 7f172f9e3e00 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:48:48.535 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:48:48.537 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:48:48.537 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:48:48.537 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:48.537 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:48:48.537 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:48:48.538 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:48:48.538 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:48:48.538 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:48:48.538 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:48:48.538 7f172f9e3ae0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:18.536 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:49:18.537 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:18.538 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:18.538 7f1730538180 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 33 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:49:18.538 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:22.539 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:49:22.540 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:49:22.540 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:22.541 7f1730538180 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:41.594 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=6986200, partition_space_available_1k=74104284, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=170104, cpu_share=0.06, mem_res=167212, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97024, cpu_share=0.0, mem_res=95120, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56092, cpu_share=0.0, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5358264, free=4545012, buffers=215764, cached=6361468, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.24, five_min_avg=3.21, fifteen_min_avg=2.67, cpu_share=14.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:49:41.595 7f17306b7a40 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:52.548 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:49:52.548 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.189:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 34 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.189:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:49:52.549 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:49:56.551 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:49:56.552 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:49:56.552 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:49:56.552 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:49:56.553 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:26.563 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:50:26.563 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 35 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:50:26.564 7f172f9e39a0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:50:30.564 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/14/2026 02:50:30.566 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 09/14/2026 02:50:30.567 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/14/2026 02:50:30.567 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:30.567 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:50:40.936 7f1730538180 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 09/14/2026 02:50:41.610 7f1732d89600 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-6277-3.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7063228, partition_space_available_1k=74027256, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=169552, cpu_share=0.0, mem_res=166672, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=98288, cpu_share=0.0, mem_res=96404, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=56104, cpu_share=0.01, mem_res=46412, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5068660, free=4678104, buffers=219268, cached=6514580, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=4.19, five_min_avg=3.42, fifteen_min_avg=2.77, cpu_share=13.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 09/14/2026 02:50:41.610 7f172f9e3860 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/14/2026 02:51:00.580 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvConnectTimerExpired] in state[ClientInit] 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvConnectTimerExpired] => State[ClientInit] -> State[Idle] 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Idle] 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Ignore event [EvTcpClose] received for old session 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = ClientInit to Idle on EvConnectTimerExpired >>, ] description = Collector:Collector[ClientInit to Idle on EvConnectTimerExpired] connection down >>, ] >> 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:51:00.581 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/14/2026 02:51:00.582 7f172fc10540 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-6277-3.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 36 pid = 1 http_port = 8113 start_time = 1789353036182106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.189:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 3 >> 09/14/2026 02:51:00.582 7f172fc10540 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]