01/20/2025 00:52:26.655 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 00:52:26.655 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 00:52:26.655 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 00:52:26.662 7f1e05df3648 [contrail-analytics-alarm-nodemgr] [ERROR]: Cannot write http_port 8113 to /tmp/contrail-analytics-alarm-nodemgr.0.http_port 01/20/2025 00:52:26.662 7f1e05df3648 [contrail-analytics-alarm-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8113 01/20/2025 00:52:26.663 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 00:52:26.663 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 00:52:26.664 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:52:26.664 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 00:52:26.664 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.664 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:52:26.664 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.664 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.665 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8113 start_time = 1737334346664362 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.49:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 00:52:26.665 7f1e05df3e48 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.754 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-alarm-gen', 'group': 'contrail-alarm-gen', 'pid': 81069379158176206926277120644156798699959627032792174497446327517960045093320, 'start': '1737334345000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'kafka', 'group': 'kafka', 'pid': 46605743437641389559992417444645381201969237083361655962296006901814393557881, 'start': '1737334344000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-alarm-nodemgr', 'group': 'contrail-analytics-alarm-nodemgr', 'pid': 43219656383870858979819522609039436366075500707458998094976111980937595039058, 'start': '1737334345000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 00:52:26.874 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737334346873946, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-alarm-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 00:52:26.874 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737334346874543, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334345000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334344000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334345000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 00:52:26.877 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.877 7f1e05085348 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 01/20/2025 00:52:26.877 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.877 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.878 7f1e05085348 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 00:52:26.878 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.878 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:26.878 7f1e05085348 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334345000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334344000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737334345000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 00:52:26.878 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 00:52:30.664 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 00:52:30.665 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 00:52:30.665 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 00:52:30.665 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:30.665 7f1e05085348 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 00:52:30.665 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 00:52:30.665 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 00:52:30.666 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 00:52:30.666 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 00:52:30.666 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:30.666 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 00:52:30.673 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 00:52:30.673 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 00:52:30.674 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 00:52:30.674 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 00:52:30.674 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 00:52:30.674 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 00:52:30.674 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 00:52:30.674 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 00:52:30.675 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 00:52:32.441 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737334352441759, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334345000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334344000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737334345000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 00:52:32.442 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7147328, partition_space_available_1k=73943156, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1728, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=539724, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51092, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5267192, free=3948552, buffers=253844, cached=6706044, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=0.82, five_min_avg=0.95, fifteen_min_avg=0.53, cpu_share=0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:53:32.542 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7221796, partition_space_available_1k=73868688, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100880, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=719716, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51328, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5696500, free=3411612, buffers=262256, cached=6805264, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.04, five_min_avg=1.28, fifteen_min_avg=0.67, cpu_share=9.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:54:32.507 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7280904, partition_space_available_1k=73809580, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126464, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=746420, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51348, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5739128, free=3311380, buffers=263620, cached=6861504, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.7, five_min_avg=1.32, fifteen_min_avg=0.72, cpu_share=8.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:55:32.562 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7295972, partition_space_available_1k=73794512, percentage_partition_space_used=9, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128452, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=761564, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51364, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5812856, free=3213576, buffers=266004, cached=6883196, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.08, five_min_avg=1.55, fifteen_min_avg=0.85, cpu_share=10.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:55:55.523 7f1e05085048 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 00:56:32.727 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7749508, partition_space_available_1k=73340976, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=129568, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=771532, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51440, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5882764, free=2663876, buffers=272808, cached=7356184, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.36, five_min_avg=2.03, fifteen_min_avg=1.05, cpu_share=10.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:56:44.980 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 00:57:32.550 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7764552, partition_space_available_1k=73325932, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=131436, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=785744, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51480, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5950460, free=2603800, buffers=274068, cached=7347304, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.74, five_min_avg=2.16, fifteen_min_avg=1.17, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:58:32.799 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7765164, partition_space_available_1k=73325320, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=119976, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=797460, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51484, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5967676, free=2569808, buffers=275008, cached=7363140, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.38, five_min_avg=2.13, fifteen_min_avg=1.22, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 00:59:32.724 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7770836, partition_space_available_1k=73319648, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122588, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=802016, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51492, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6016480, free=2503976, buffers=275772, cached=7379404, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.07, five_min_avg=2.1, fifteen_min_avg=1.27, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:00:32.872 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7782284, partition_space_available_1k=73308200, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124944, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=807952, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51512, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6029944, free=2482520, buffers=276332, cached=7386836, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.17, five_min_avg=2.13, fifteen_min_avg=1.33, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:01:32.853 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7793428, partition_space_available_1k=73297056, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122400, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=817868, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51524, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6054760, free=2446280, buffers=276688, cached=7397904, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.89, five_min_avg=2.06, fifteen_min_avg=1.36, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:02:32.622 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7800792, partition_space_available_1k=73289692, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124516, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=809688, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51528, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6090016, free=2397976, buffers=276976, cached=7410664, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.82, five_min_avg=2.23, fifteen_min_avg=1.46, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:03:32.664 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7812348, partition_space_available_1k=73278136, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127136, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=813828, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51544, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6106188, free=2378556, buffers=277216, cached=7413672, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.98, five_min_avg=2.08, fifteen_min_avg=1.46, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:04:32.699 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7824636, partition_space_available_1k=73265848, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125204, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=816396, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51560, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6165568, free=2306160, buffers=277376, cached=7426528, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.84, five_min_avg=2.02, fifteen_min_avg=1.47, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:05:32.738 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7827708, partition_space_available_1k=73262776, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122884, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=827288, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51560, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6217460, free=2240456, buffers=277480, cached=7440236, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.7, five_min_avg=1.97, fifteen_min_avg=1.49, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:06:32.750 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7840760, partition_space_available_1k=73249724, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126640, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=823200, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51560, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6242536, free=2207160, buffers=277560, cached=7448376, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.81, five_min_avg=1.94, fifteen_min_avg=1.51, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:07:32.702 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7852892, partition_space_available_1k=73237592, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123368, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=824440, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51564, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6253132, free=2183464, buffers=277616, cached=7461420, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.68, five_min_avg=1.89, fifteen_min_avg=1.52, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:08:32.758 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7863964, partition_space_available_1k=73226520, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126520, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=825304, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51576, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6267616, free=2162592, buffers=277656, cached=7467768, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.29, five_min_avg=2.02, fifteen_min_avg=1.59, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:09:32.701 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7870452, partition_space_available_1k=73220032, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125344, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=825816, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51580, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6273168, free=2150068, buffers=277668, cached=7474728, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.11, five_min_avg=2.02, fifteen_min_avg=1.62, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:10:32.732 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7852884, partition_space_available_1k=73237600, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124124, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=830920, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51580, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6262176, free=2174388, buffers=277676, cached=7461392, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.5, five_min_avg=2.14, fifteen_min_avg=1.68, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:11:32.918 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7864072, partition_space_available_1k=73226412, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122888, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=831336, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51596, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6283528, free=2141396, buffers=277692, cached=7473016, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.0, five_min_avg=2.06, fifteen_min_avg=1.69, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:12:32.955 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7870940, partition_space_available_1k=73219544, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126068, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=834940, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51608, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6289748, free=2127896, buffers=277708, cached=7480280, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.06, five_min_avg=2.06, fifteen_min_avg=1.71, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:13:32.753 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7881412, partition_space_available_1k=73209072, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124288, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=836704, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51612, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6294484, free=2117336, buffers=277716, cached=7486096, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.93, five_min_avg=2.02, fifteen_min_avg=1.72, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:14:32.904 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7886808, partition_space_available_1k=73203676, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122552, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=837560, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51612, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6314620, free=2087012, buffers=277728, cached=7496272, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.24, five_min_avg=2.06, fifteen_min_avg=1.76, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:15:32.943 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7892596, partition_space_available_1k=73197888, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125768, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=837496, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51620, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6318496, free=2077020, buffers=277740, cached=7502376, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.15, five_min_avg=2.04, fifteen_min_avg=1.77, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:16:32.733 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7898864, partition_space_available_1k=73191620, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124564, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=837872, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51624, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6326004, free=2058244, buffers=277748, cached=7513636, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.76, five_min_avg=2.23, fifteen_min_avg=1.85, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:17:32.799 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7910952, partition_space_available_1k=73179532, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128480, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838316, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51624, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6320940, free=2056308, buffers=277748, cached=7520636, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.41, five_min_avg=2.25, fifteen_min_avg=1.88, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:18:32.795 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7916272, partition_space_available_1k=73174212, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122756, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838412, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51624, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6344920, free=2026536, buffers=277748, cached=7526428, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.31, five_min_avg=2.22, fifteen_min_avg=1.9, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:19:32.783 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7921064, partition_space_available_1k=73169420, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=121728, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838484, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51628, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6351364, free=2014984, buffers=277756, cached=7531528, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.15, five_min_avg=2.17, fifteen_min_avg=1.9, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:20:32.900 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7926668, partition_space_available_1k=73163816, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126052, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838600, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51628, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6350528, free=2009152, buffers=277772, cached=7538180, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.86, five_min_avg=2.08, fifteen_min_avg=1.89, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:21:32.796 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7934120, partition_space_available_1k=73156364, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126024, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838884, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51632, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6354900, free=1997872, buffers=277776, cached=7545084, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.66, five_min_avg=2.01, fifteen_min_avg=1.88, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:22:32.810 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7941160, partition_space_available_1k=73149324, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125440, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838820, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51636, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6351796, free=1994064, buffers=277780, cached=7551992, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.77, five_min_avg=1.95, fifteen_min_avg=1.86, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:23:32.915 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7946468, partition_space_available_1k=73144016, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124880, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=838936, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51636, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6361472, free=1973408, buffers=277792, cached=7562960, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.77, five_min_avg=1.92, fifteen_min_avg=1.86, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:24:32.972 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7956888, partition_space_available_1k=73133596, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123732, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839088, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51636, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6366624, free=1962840, buffers=277796, cached=7568372, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.72, five_min_avg=1.89, fifteen_min_avg=1.85, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:25:32.990 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7963124, partition_space_available_1k=73127360, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127976, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839148, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51664, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6369128, free=1958552, buffers=277796, cached=7570156, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.86, five_min_avg=1.89, fifteen_min_avg=1.85, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:26:32.839 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7964196, partition_space_available_1k=73126288, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122304, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839244, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51668, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6374668, free=1942128, buffers=277796, cached=7581040, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.06, five_min_avg=1.93, fifteen_min_avg=1.87, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:27:32.914 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7975228, partition_space_available_1k=73115256, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125996, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839420, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51672, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6380104, free=1930476, buffers=277800, cached=7587252, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.85, five_min_avg=1.89, fifteen_min_avg=1.86, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:28:32.861 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7981396, partition_space_available_1k=73109088, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125256, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839568, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51668, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6388452, free=1910916, buffers=277800, cached=7598464, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.85, five_min_avg=1.87, fifteen_min_avg=1.85, cpu_share=8.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:29:32.900 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7991556, partition_space_available_1k=73098928, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=129092, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839624, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51680, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6390080, free=1908612, buffers=277800, cached=7599140, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.95, five_min_avg=1.89, fifteen_min_avg=1.86, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:30:32.873 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7991688, partition_space_available_1k=73098796, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122368, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839804, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51680, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6349188, free=1926356, buffers=277800, cached=7622288, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.99, five_min_avg=1.9, fifteen_min_avg=1.86, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:31:32.885 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8013856, partition_space_available_1k=73076628, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125748, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839872, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51680, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6352856, free=1918312, buffers=277800, cached=7626664, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.56, five_min_avg=1.79, fifteen_min_avg=1.83, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:32:32.919 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8020320, partition_space_available_1k=73070164, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124724, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839936, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51716, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6352776, free=1906668, buffers=277804, cached=7638384, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.69, five_min_avg=1.77, fifteen_min_avg=1.82, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:33:32.861 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8030532, partition_space_available_1k=73059952, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=128924, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=840744, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51716, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6352132, free=1906316, buffers=277812, cached=7639372, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.89, five_min_avg=1.8, fifteen_min_avg=1.83, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:34:32.962 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8032952, partition_space_available_1k=73057532, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123500, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=840812, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51716, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6352748, free=1893176, buffers=277820, cached=7651888, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.74, five_min_avg=1.77, fifteen_min_avg=1.81, cpu_share=8.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:35:32.924 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8044972, partition_space_available_1k=73045512, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123320, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=840896, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51720, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6370492, free=1873004, buffers=277820, cached=7654316, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.08, five_min_avg=1.86, fifteen_min_avg=1.84, cpu_share=8.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:36:32.959 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8051256, partition_space_available_1k=73039228, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127808, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=840968, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6368528, free=1873340, buffers=277820, cached=7655944, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.61, five_min_avg=2.03, fifteen_min_avg=1.9, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:37:32.934 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8057700, partition_space_available_1k=73032784, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=121712, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841040, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6373436, free=1856976, buffers=277824, cached=7667396, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.26, five_min_avg=2.0, fifteen_min_avg=1.9, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:38:32.859 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8064184, partition_space_available_1k=73026300, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126564, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841104, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51716, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6373244, free=1850780, buffers=277824, cached=7673784, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.82, five_min_avg=1.91, fifteen_min_avg=1.87, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:39:32.887 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8069244, partition_space_available_1k=73021240, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125168, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841176, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6371256, free=1842960, buffers=277824, cached=7683592, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.71, five_min_avg=1.87, fifteen_min_avg=1.86, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:40:32.936 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8079656, partition_space_available_1k=73010828, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124684, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841260, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51728, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6371164, free=1842008, buffers=277824, cached=7684636, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.54, five_min_avg=1.79, fifteen_min_avg=1.83, cpu_share=8.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:41:32.967 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8080316, partition_space_available_1k=73010168, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124040, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841536, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51728, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6374828, free=1832476, buffers=277824, cached=7690504, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.63, five_min_avg=2.01, fifteen_min_avg=1.9, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:42:32.949 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8087456, partition_space_available_1k=73003028, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123088, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841640, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6387020, free=1808276, buffers=277824, cached=7702512, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.25, five_min_avg=2.01, fifteen_min_avg=1.91, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:43:33.035 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8098156, partition_space_available_1k=72992328, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127452, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841708, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6393060, free=1795988, buffers=277824, cached=7708760, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.97, five_min_avg=1.99, fifteen_min_avg=1.91, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:44:32.963 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8103452, partition_space_available_1k=72987032, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126500, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841784, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51724, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6391988, free=1791536, buffers=277824, cached=7714284, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.06, five_min_avg=2.0, fifteen_min_avg=1.92, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:45:32.945 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8110352, partition_space_available_1k=72980132, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=121200, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841880, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51732, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6399368, free=1777496, buffers=277824, cached=7720944, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.81, five_min_avg=1.94, fifteen_min_avg=1.9, cpu_share=8.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:46:33.009 7f1e0b77fdf0 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=8108628, partition_space_available_1k=72981856, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=123200, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841948, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=51732, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6396432, free=1771380, buffers=277824, cached=7729996, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.8, five_min_avg=1.91, fifteen_min_avg=1.9, cpu_share=8.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:47:03.724 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:03.725 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:47:03.727 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:03.728 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:03.771 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:47:03.772 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:47:03.772 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:47:03.773 7f1e05085048 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:47:03.773 7f1e05085048 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:47:03.773 7f1e05085048 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:03.773 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:47:03.773 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:03.774 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:04.091 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:04.091 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:04.093 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:47:04.094 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:04.094 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:04.094 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:04.170 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:47:04.170 7f1e05f3b348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:47:04.171 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:47:04.171 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:47:04.171 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:47:04.171 7f1e05085348 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:04.171 7f1e05085348 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:47:04.176 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:04.177 7f1e05085048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:47:21.549 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:47:21.549 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:47:21.549 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:47:21.553 7f3a01228748 [contrail-analytics-alarm-nodemgr] [ERROR]: Cannot write http_port 8113 to /tmp/contrail-analytics-alarm-nodemgr.0.http_port 01/20/2025 01:47:21.553 7f3a01228748 [contrail-analytics-alarm-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8113 01/20/2025 01:47:21.576 7f3a00053048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:47:21.577 7f3a00053048 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:47:21.578 7f3a00053048 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:21.578 7f3a00053048 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:47:21.578 7f3a00053048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:21.578 7f3a00053048 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:21.578 7f3a00053048 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:21.578 7f3a00053048 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:21.579 7f3a00053048 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:47:21.579 7f3a00053048 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.272 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-alarm-gen', 'group': 'contrail-alarm-gen', 'pid': 81069379158176206926277120644156798699959627032792174497446327517960045093320, 'start': '1737337637000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'kafka', 'group': 'kafka', 'pid': 46605743437641389559992417444645381201969237083361655962296006901814393557881, 'start': '1737337636000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-alarm-nodemgr', 'group': 'contrail-analytics-alarm-nodemgr', 'pid': 43219656383870858979819522609039436366075500707458998094976111980937595039058, 'start': '1737337637000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 01:47:22.698 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337642698133, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-alarm-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:47:22.698 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337642698661, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:47:22.721 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.721 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 installed_package_version = nightly.r24.1.centos-nightly_r24.1_centos.el7 >> 01/20/2025 01:47:22.721 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.721 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.722 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:47:22.722 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.722 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:22.722 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337636000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 01:47:22.722 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:25.579 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:25.580 7f3a00053448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:47:25.581 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:25.581 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:25.581 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:27.991 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337647991831, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:47:27.992 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=7989844, partition_space_available_1k=73100640, percentage_partition_space_used=10, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=[], build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1620, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=126864, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43788, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=4497228, free=3813748, buffers=277912, cached=7586744, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=7.02, five_min_avg=3.05, fifteen_min_avg=2.27, cpu_share=0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:47:27.992 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:27.992 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:34.902 7f3a00011448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:47:34.902 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:47:34.902 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:47:34.902 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:34.902 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 01/20/2025 01:47:34.903 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:34.903 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:34.903 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 1 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/20/2025 01:47:34.903 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:47:38.906 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:47:38.908 7f3a00053448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:47:38.909 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:47:38.909 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:38.910 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:47:38.963 7f3a00011448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:47:38.964 7f3a00011448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:47:38.964 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:47:38.964 7f3a00053448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:47:38.964 7f3a00053448 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:47:38.965 7f3a00053448 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:47:38.965 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:47:38.965 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:47:38.966 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:48:27.925 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=9070216, partition_space_available_1k=72020268, percentage_partition_space_used=11, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=85004, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=533904, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43968, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5561128, free=1440224, buffers=337844, cached=8836436, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=12.77, five_min_avg=5.52, fifteen_min_avg=3.17, cpu_share=23.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:49:27.942 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10073688, partition_space_available_1k=71016796, percentage_partition_space_used=12, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125760, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=535848, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=43996, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5858604, free=195864, buffers=381000, cached=9740164, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=9.35, five_min_avg=5.83, fifteen_min_avg=3.43, cpu_share=16.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:50:15.017 7f3a00011448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:50:15.018 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:50:15.020 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:50:15.020 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:50:15.020 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.020 7f3a00053148 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:50:15.020 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.020 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:50:15.021 7f3a00053148 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:50:15.021 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:50:15.021 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:15.021 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:15.075 7f3a00011448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:50:15.076 7f3a00011448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:50:15.076 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:50:15.077 7f3a00053148 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:50:15.077 7f3a00053148 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:50:15.077 7f3a00053148 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:50:15.077 7f3a00053148 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:50:15.077 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:50:15.078 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:50:15.232 7f3a00011448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:50:15.232 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[Established] 01/20/2025 01:50:15.233 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:15.233 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 01/20/2025 01:50:15.233 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, ] description = Collector:Collector[Established to Connect on EvTcpClose] connection down >>, ] >> 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:15.234 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:15.235 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:15.235 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 3 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:15.235 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:19.235 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:50:19.237 7f3a00053448 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:50:19.238 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:50:19.238 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:19.238 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:27.909 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337827909644, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:50:27.910 7f3a06e09f20 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10442008, partition_space_available_1k=70648476, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=['/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-2.1737337815'], build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127560, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=537816, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=44008, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5111400, free=1042400, buffers=383744, cached=9638088, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=5.51, five_min_avg=5.44, fifteen_min_avg=3.45, cpu_share=12.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:50:27.910 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:27.910 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:50:27.997 7f3a00011448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connection Closed 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:27.998 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:31.999 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:32.001 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:32.001 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:32.001 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:32.001 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:32.001 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:32.001 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:32.002 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:32.002 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:32.002 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:32.002 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:32.002 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:32.002 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:32.006 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.004 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:36.006 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:36.006 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:36.007 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.008 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:36.008 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:36.008 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.008 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:50:40.009 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: Session Event: TCP Connect Fail 01/20/2025 01:50:40.009 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:50:40.009 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:40.010 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:50:40.010 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:50:40.010 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/20/2025 01:50:40.010 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/20/2025 01:50:40.010 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.010 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/20/2025 01:50:40.011 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.011 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.011 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 4 pid = 1 http_port = 8113 start_time = 1737337641577989 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.42:8086, 10.0.0.22:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 01/20/2025 01:50:40.011 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.530 7f3a00011248 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_process_state:contrail-alarm-gen,group:contrail-alarm-gen,state:PROCESS_STATE_EXITED 01/20/2025 01:50:40.530 7f3a00011248 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337840530767, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1737337637000000', last_stop_time='', last_exit_time='1737337840530722', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337636000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:50:40.531 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.532 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_EXITED start_count = 1 stop_count = 0 exit_count = 1 last_start_time = 1737337637000000 last_stop_time = last_exit_time = 1737337840530722 core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337636000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 01:50:40.532 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.534 7f3a00011248 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_process_state:kafka,group:kafka,state:PROCESS_STATE_EXITED 01/20/2025 01:50:40.534 7f3a00011248 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337840534665, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1737337637000000', last_stop_time='', last_exit_time='1737337840530722', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_EXITED', start_count=1, stop_count=0, exit_count=1, last_start_time='1737337636000000', last_stop_time='', last_exit_time='1737337840534629', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337637000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:50:40.535 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:50:40.536 7f3a00053448 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_EXITED start_count = 1 stop_count = 0 exit_count = 1 last_start_time = 1737337637000000 last_stop_time = last_exit_time = 1737337840530722 core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_EXITED start_count = 1 stop_count = 0 exit_count = 1 last_start_time = 1737337636000000 last_stop_time = last_exit_time = 1737337840534629 core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337637000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-16 01:14:15.868302", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7545-1.novalocal", "build-id" : "nightly.r24.1.centos", "build-number" : "nightly_r24.1_centos.el7"}]} >> 01/20/2025 01:50:40.536 7f3a00053448 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:31.825 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/20/2025 01:52:31.825 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/20/2025 01:52:31.825 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/20/2025 01:52:31.833 7f32d569e438 [contrail-analytics-alarm-nodemgr] [ERROR]: Cannot write http_port 8113 to /tmp/contrail-analytics-alarm-nodemgr.0.http_port 01/20/2025 01:52:31.834 7f32d569e438 [contrail-analytics-alarm-nodemgr] [ERROR]: Starting Introspect on HTTP Port 8113 01/20/2025 01:52:31.834 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvStart] in state[none] 01/20/2025 01:52:31.835 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:52:31.835 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:52:31.835 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/20/2025 01:52:31.835 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:31.835 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:52:31.836 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:31.836 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:31.836 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2.:AnalyticsAlarm:contrail-analytics-alarm-nodemgr:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8113 start_time = 1737337951835504 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.42:8086, 10.0.0.49:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/20/2025 01:52:31.836 7f32d56a1d68 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:31.926 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: get_current_processes: '[{'name': 'contrail-alarm-gen', 'group': 'contrail-alarm-gen', 'pid': 82511762898269797250747583428169125232809774892672855560464186356230922928237, 'start': '1737337949000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'kafka', 'group': 'kafka', 'pid': 83362183609888535214891420322543651656086876665334694285607850973783361121274, 'start': '1737337949000000', 'statename': 'PROCESS_STATE_RUNNING'}, {'name': 'contrail-analytics-alarm-nodemgr', 'group': 'contrail-analytics-alarm-nodemgr', 'pid': 68617056119857591759382935392551457096336332067719658060614749132345769826498, 'start': '1737337950000000', 'statename': 'PROCESS_STATE_RUNNING'}]' 01/20/2025 01:52:32.061 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [INFO]: send_nodemgr_process_status: Sending UVE:NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337952061250, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=[ProcessStatus(module_id='contrail-analytics-alarm-nodemgr', instance_id='0', state='Non-Functional', connection_infos=dict_values([ConnectionInfo(type='Collector', name='Collector', server_addrs=[''], status='Down', description='none to Idle on EvStart')]), flag_infos=None, description='Collector:Collector[none to Idle on EvStart] connection down')], process_info=None, disk_usage_info=None, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:52:32.061 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337952061764, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337949000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337949000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337950000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:52:32.064 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:32.065 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} system_cpu_info = << num_socket = 1 num_cpu = 4 num_core_per_socket = 4 num_thread_per_core = 1 >> running_package_version = nightly-nightly.el7 installed_package_version = nightly-nightly.el7 >> 01/20/2025 01:52:32.065 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:32.065 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:32.065 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/20/2025 01:52:32.065 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:32.065 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:32.066 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. deleted = False process_info = [ << process_name = contrail-alarm-gen process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337949000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = kafka process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337949000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, << process_name = contrail-analytics-alarm-nodemgr process_state = PROCESS_STATE_RUNNING start_count = 1 stop_count = 0 exit_count = 0 last_start_time = 1737337950000000 last_stop_time = last_exit_time = core_file_list = [ ] >>, ] build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]} >> 01/20/2025 01:52:32.066 7f32dcf4e780 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/20/2025 01:52:35.836 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/20/2025 01:52:35.837 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Session Event: TCP Connected 01/20/2025 01:52:35.837 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/20/2025 01:52:35.837 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2650-2. process_status = [ << module_id = contrail-analytics-alarm-nodemgr instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Send sandesh control message. uve type count # 6 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:35.838 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/20/2025 01:52:35.845 7f32d4e23ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001017 01/20/2025 01:52:35.845 7f32d4e23ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:52:35.846 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/20/2025 01:52:35.846 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 0 01/20/2025 01:52:35.846 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:52:35.846 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:52:35.846 7f32d4e23cc0 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/20/2025 01:52:35.847 7f32d9230f60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/20/2025 01:52:35.848 7f32d9230f60 [contrail-analytics-alarm-nodemgr] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/20/2025 01:52:36.966 7f32d4e23ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: Extracted sandesh length: 0000001294 01/20/2025 01:52:36.967 7f32d4e23ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/20/2025 01:52:36.967 7f32d5636ac8 [contrail-analytics-alarm-nodemgr] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/20/2025 01:52:36.967 7f32d5636ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: Number of uve types in sandesh control message is 2 01/20/2025 01:52:36.968 7f32d5636ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 01:52:36.968 7f32d5636ac8 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/20/2025 01:52:37.990 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [INFO]: send_process_state_db: Sending UVE: NodeStatusUVE(_context='', _scope='', _module='contrail-analytics-alarm-nodemgr', _source='cn-jenkins-deploy-platform-ansible-os-2650-2.', _node_type='AnalyticsAlarm', _instance_id='0', _timestamp=1737337957990318, _versionsig=3672106175, _type=6, _hints=1, _client_context='', _client=None, _role=0, _logger=None, _level=2147483647, _category='', _send_queue_enabled=True, _http_server=None, _connect_to_collector=True, _disable_sending_object_logs=False, _disable_sending_all_messages=False, _more=False, data=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=False, status=None, process_status=None, process_info=[ProcessInfo(process_name='contrail-alarm-gen', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337949000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='kafka', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337949000000', last_stop_time='', last_exit_time='', core_file_list=[]), ProcessInfo(process_name='contrail-analytics-alarm-nodemgr', process_state='PROCESS_STATE_RUNNING', start_count=1, stop_count=0, exit_count=0, last_start_time='1737337950000000', last_stop_time='', last_exit_time='', core_file_list=[])], disk_usage_info=None, description=None, all_core_file_list=None, build_info='{"build-info" : [{"build-version" : "nightly", "build-time" : "2025-01-20 00:44:39.080355", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7550-1.novalocal", "build-id" : "nightly", "build-number" : "nightly.el7"}]}', process_mem_cpu_usage=None, system_cpu_info=None, system_mem_usage=None, system_cpu_usage=None, running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo'), _seqnum=0) 01/20/2025 01:52:37.990 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10473508, partition_space_available_1k=70616976, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=['/var/crashes/core.contrail-collec.1.cn-jenkins-deploy-platform-ansible-os-2650-2.1737337815'], build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=1720, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=562080, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50816, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5941312, free=328824, buffers=394520, cached=9510976, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.5, five_min_avg=4.56, fifteen_min_avg=3.38, cpu_share=0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:53:37.948 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10503504, partition_space_available_1k=70586980, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=97636, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=652832, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50656, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6041520, free=202436, buffers=403504, cached=9528172, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.12, five_min_avg=3.95, fifteen_min_avg=3.24, cpu_share=8.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:54:37.819 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10937648, partition_space_available_1k=70152836, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=99012, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=651792, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50568, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6038336, free=311932, buffers=407604, cached=9417760, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.59, five_min_avg=3.67, fifteen_min_avg=3.18, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:55:37.832 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10937628, partition_space_available_1k=70152856, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=100088, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=649540, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50568, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6043884, free=303364, buffers=407632, cached=9420752, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.89, five_min_avg=3.47, fifteen_min_avg=3.14, cpu_share=6.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:56:37.945 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=10942444, partition_space_available_1k=70148040, percentage_partition_space_used=13, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101068, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=649332, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50556, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6063948, free=322632, buffers=406816, cached=9382236, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.67, five_min_avg=3.01, fifteen_min_avg=3.0, cpu_share=6.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:57:37.231 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=11725412, partition_space_available_1k=69365072, percentage_partition_space_used=14, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=101660, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=680688, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50276, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=3868100, free=2555468, buffers=417676, cached=9334388, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.2, five_min_avg=2.92, fifteen_min_avg=2.97, cpu_share=9.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:58:37.881 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12143436, partition_space_available_1k=68947048, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=103184, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=782388, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50232, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5519712, free=547192, buffers=432108, cached=9676620, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.08, five_min_avg=3.17, fifteen_min_avg=3.06, cpu_share=15.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 01:59:37.899 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12145524, partition_space_available_1k=68944960, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=105260, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=798312, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50228, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5580204, free=482980, buffers=432128, cached=9680320, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.64, five_min_avg=2.74, fifteen_min_avg=2.92, cpu_share=7.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:00:37.909 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12152004, partition_space_available_1k=68938480, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=106212, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=813092, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50172, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=5966440, free=296216, buffers=431536, cached=9481440, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.97, five_min_avg=2.62, fifteen_min_avg=2.86, cpu_share=7.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:01:37.929 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12155088, partition_space_available_1k=68935396, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=107220, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=820672, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50168, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6004992, free=279376, buffers=431512, cached=9459752, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.94, five_min_avg=2.47, fifteen_min_avg=2.79, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:02:37.949 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12159216, partition_space_available_1k=68931268, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=108104, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=828416, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50156, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6031120, free=265248, buffers=431592, cached=9447672, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.49, five_min_avg=2.24, fifteen_min_avg=2.69, cpu_share=5.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:03:37.933 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12165728, partition_space_available_1k=68924756, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=109156, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=835468, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50164, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6011804, free=298956, buffers=431272, cached=9433600, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.92, five_min_avg=2.2, fifteen_min_avg=2.65, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:04:37.952 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12166104, partition_space_available_1k=68924380, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=110184, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=839944, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50168, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6030624, free=296472, buffers=431068, cached=9417468, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.49, five_min_avg=2.01, fifteen_min_avg=2.55, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:05:37.951 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12169728, partition_space_available_1k=68920756, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=111252, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=841304, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50164, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6036644, free=303064, buffers=430636, cached=9405288, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.39, five_min_avg=1.89, fifteen_min_avg=2.48, cpu_share=6.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:06:37.964 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12173836, partition_space_available_1k=68916648, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=112228, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=842344, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50164, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6033908, free=310616, buffers=430936, cached=9400172, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.17, five_min_avg=1.74, fifteen_min_avg=2.39, cpu_share=5.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:07:37.977 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12177556, partition_space_available_1k=68912928, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=113240, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=842832, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50156, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6060444, free=307492, buffers=430952, cached=9376744, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.27, five_min_avg=1.66, fifteen_min_avg=2.32, cpu_share=6.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:08:37.976 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12181416, partition_space_available_1k=68909068, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=114416, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=844644, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50160, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6060540, free=302660, buffers=430952, cached=9381480, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.09, five_min_avg=1.54, fifteen_min_avg=2.23, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:09:37.981 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12186844, partition_space_available_1k=68903640, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=115720, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=848096, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50156, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6057120, free=316064, buffers=430948, cached=9371500, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.33, five_min_avg=1.52, fifteen_min_avg=2.18, cpu_share=6.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:10:37.993 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12185840, partition_space_available_1k=68904644, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=116772, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=850128, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50156, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6081700, free=311096, buffers=430936, cached=9351900, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.31, five_min_avg=1.47, fifteen_min_avg=2.12, cpu_share=6.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:11:37.996 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12189536, partition_space_available_1k=68900948, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=118048, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=851328, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50156, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6097984, free=283308, buffers=431188, cached=9363152, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.25, five_min_avg=1.43, fifteen_min_avg=2.06, cpu_share=6.75, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:12:38.018 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12193360, partition_space_available_1k=68897124, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=119208, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=851560, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50152, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6084712, free=317552, buffers=430936, cached=9342432, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.09, five_min_avg=1.35, fifteen_min_avg=1.99, cpu_share=6.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:13:38.010 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12196748, partition_space_available_1k=68893736, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=120424, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=850892, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50148, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6107200, free=309312, buffers=430928, cached=9328192, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.07, five_min_avg=1.3, fifteen_min_avg=1.93, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:13:50.406 7f32d4e236d8 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 02:14:24.373 7f32d7a70438 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 02:14:38.012 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12556148, partition_space_available_1k=68534336, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=120188, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=849416, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50056, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6100288, free=360540, buffers=435492, cached=9279312, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.11, five_min_avg=1.26, fifteen_min_avg=1.88, cpu_share=7.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:14:43.161 7f32d56b5048 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 02:15:18.562 7f32d7b706d8 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 02:15:38.007 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12560520, partition_space_available_1k=68529964, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=121588, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=849712, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50056, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6100556, free=355264, buffers=435736, cached=9284076, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.17, five_min_avg=1.23, fifteen_min_avg=1.83, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:15:44.133 7f32d9238eb8 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 02:16:00.909 7f32d569ea20 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map 01/20/2025 02:16:38.016 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12562240, partition_space_available_1k=68528244, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=122712, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=849972, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50044, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6111856, free=388008, buffers=435440, cached=9240328, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.46, five_min_avg=1.31, fifteen_min_avg=1.82, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:17:38.034 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12566152, partition_space_available_1k=68524332, percentage_partition_space_used=15, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=124032, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=850468, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50056, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6143188, free=347080, buffers=435544, cached=9249820, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.25, five_min_avg=1.29, fifteen_min_avg=1.78, cpu_share=6.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:18:38.040 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12575840, partition_space_available_1k=68514644, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=125596, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=852776, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50056, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6172540, free=328136, buffers=435212, cached=9239744, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.61, five_min_avg=1.76, fifteen_min_avg=1.92, cpu_share=8.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:19:38.033 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12587356, partition_space_available_1k=68503128, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=127732, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=858884, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50056, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6215760, free=288244, buffers=434872, cached=9236756, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.69, five_min_avg=2.26, fifteen_min_avg=2.08, cpu_share=9.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:20:38.038 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12603804, partition_space_available_1k=68486680, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=129860, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=861752, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50052, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6218028, free=325012, buffers=434624, cached=9197968, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.52, five_min_avg=2.2, fifteen_min_avg=2.07, cpu_share=9.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:21:38.034 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12608140, partition_space_available_1k=68482344, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=131692, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=865420, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50060, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6220856, free=333744, buffers=434616, cached=9186416, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.87, five_min_avg=2.37, fifteen_min_avg=2.14, cpu_share=8.0, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:22:38.048 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12621060, partition_space_available_1k=68469424, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=133776, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=867572, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50048, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6244612, free=327304, buffers=434608, cached=9169108, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.65, five_min_avg=2.38, fifteen_min_avg=2.15, cpu_share=8.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:23:38.044 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12652720, partition_space_available_1k=68437764, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=135176, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=867164, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50000, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6329384, free=340304, buffers=434592, cached=9071352, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=3.5, five_min_avg=2.63, fifteen_min_avg=2.25, cpu_share=9.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:24:38.053 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12664316, partition_space_available_1k=68426168, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=137020, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=868020, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50000, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6330124, free=329700, buffers=434596, cached=9081212, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.13, five_min_avg=2.38, fifteen_min_avg=2.18, cpu_share=7.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:25:38.053 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12670756, partition_space_available_1k=68419728, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=138652, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=868284, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50000, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6334664, free=348936, buffers=434752, cached=9057280, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=2.58, five_min_avg=2.39, fifteen_min_avg=2.19, cpu_share=6.5, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:26:38.052 7f32d7d55a88 [contrail-analytics-alarm-nodemgr] [DEBUG]: DBG: event_tick_60: node_status=NodeStatus(name='cn-jenkins-deploy-platform-ansible-os-2650-2.', deleted=None, status=None, process_status=None, process_info=None, disk_usage_info={'/dev/vda1': DiskPartitionUsageStats(partition_type='ext4', partition_name=None, partition_space_used_1k=12677608, partition_space_available_1k=68412876, percentage_partition_space_used=16, _LinuxSysData__key='/dev/vda1')}, description=None, all_core_file_list=None, build_info=None, process_mem_cpu_usage={'contrail-alarm-gen': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=139672, cpu_share=0, mem_res=0, _EventManager__key='contrail-alarm-gen'), 'kafka': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=868272, cpu_share=0, mem_res=0, _EventManager__key='kafka'), 'contrail-analytics-alarm-nodemgr': ProcessCpuInfo(module_id=None, inst_id=None, mem_virt=50012, cpu_share=0, mem_res=0, _EventManager__key='contrail-analytics-alarm-nodemgr')}, system_cpu_info=None, system_mem_usage=SysMemInfo(total=16175632, used=6329540, free=337588, buffers=434788, cached=9073716, node_type='analytics-alarm-node'), system_cpu_usage=SysCpuInfo(one_min_avg=1.8, five_min_avg=2.18, fifteen_min_avg=2.13, cpu_share=7.25, node_type='analytics-alarm-node'), running_package_version=None, installed_package_version=None, _table='ObjectAnalyticsAlarmInfo') 01/20/2025 02:26:52.207 7f32d4e36048 [contrail-analytics-alarm-nodemgr] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:NodeStatusUVE] map